PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Gradient Field Descriptor for Sketch based Retrieval and Localization
Rui Hu, Mark Barnard and John Collomosse
In: ICIP 2010, Hong Kong(2010).


We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
User Modelling for Computer Human Interaction
Information Retrieval & Textual Information Access
ID Code:8345
Deposited By:John Collomosse
Deposited On:30 October 2011