PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

A Bag of Regions based approach to Sketch based Image Retrieval
Rui Hu, Tinghuai Wang and John Collomosse
In: ICIP 2011(2011).


This paper presents a system for retrieving photographs using free-hand sketched queries. Regions are extracted from each image by gathering nodes of a hierarchical image segmentation in to a bag-of-regions (BoR) representation. The BoR represents object shape at multiple scales, encoding shape even in the presence of adjacent clutter. We extract a shape representation from each region, using the Gradient Field HoG (GF-HOG) descriptor which enables direct comparison with the sketched query. The retrieval pipeline yields significant performance improvements over the previous GF-HOG results reliant on single-scale Canny edge maps, and over leading descriptors (SIFT, SSIM) for visual search. In addition, our system enables localization of the sketched object within matching images.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Conference or Workshop Item (Paper)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
User Modelling for Computer Human Interaction
Information Retrieval & Textual Information Access
ID Code:8347
Deposited By:John Collomosse
Deposited On:30 October 2011