Center for Human Modeling and Simulation

Discrimintive Image Warping with Attribute Flow

Jianbo Shi, University of Pennsylvania
Weiyu Zhang, University of Pennsylvania
Praveen Srinivasan, University of Pennsylvania

Document Type Conference Paper

Zhang, W., Srinivasan, P., Shi, J. IEEE Conference on Computer Vision and Pattern Recognition. 2011.


We address the problem of finding deformation between two images for the purpose of recognizing objects. The challenge is that discriminative features are often transformation-variant (e.g. histogram of oriented gradients, texture), while transformation-invariant features (e.g. intensity, color) are often not discriminative. We introduce the concept of attribute flow which explicitly models how image attributes vary with its deformation. We develop a non-parametric method to approximate this using histogram matching, which can be solved efficiently using linear programming. Our method produces dense correspondence between images, and utilizes discriminative, transformation-variant features for simultaneous detection and alignment. Experiments on ETHZ shape categories dataset show that we can accurately recognize highly deformable objects with few training examples.


Date Posted: 11 July 2012