Technical Reports (CIS)

A Learnable Spectral Memory Graph for Recognition and Segmentation

Timothée Cour, University of Pennsylvania
Jianbo Shi, University of Pennsylvania

Document Type Technical Report

University of Pennsylvania Department of Computer and Information Science Technical Report No. MS-CIS-04-12.


Image segmentation is often treated as an unsupervised task. Segmentation by human, in contrast, relies heavily on memory to produce an object-like clustering, through a mechanism of controlled hallucination. This paper presents a learning algorithm for memory-driven object segmentation and recognition. We propose a general spectral graph learning algorithm based on gradient descent in the space of graph weight matrix using derivatives of eigenvectors. The gradients are efficiently computed using the theory of implicit functions. This algorithm effectively learns a graph network capable of memorizing and retrieving multiple patterns given noisy inputs. We demonstrate the validity of this approach on segmentation and recognition tasks, including geometric shape extraction, and hand-written digit recognition.


Date Posted: 27 October 2006