Attribute-based Vehicle Search in Crowded Surveillance Videos
F Rogerio, S Behjat, Z Yun, James Petterson, B Lisa and P Sharath
In: ACM International Conference on Multimedia Retrieval (ICMR), 1-8 April 2011, Trento, Italy.
We present a novel application for searching for vehicles in surveillance videos based on semantic attributes. At the interface, the user speci fies a set of vehicle characteristics (such as color, direction of travel, speed, length, height, etc.) and the system automatically retrieves video events that match the provided description. A key di fferentiating aspect of our system is the ability to handle challenging urban conditions such as high volumes of activity and environmental factors. This is achieved through a novel multiview vehicle detection approach which relies on what we call motionlet classifi ers, i.e. classifi ers that are learned with vehicle samples clustered in the motion con guration space. We employ massively parallel feature selection to learn compact and accurate motionlet detectors. Moreover, in order to deal with diff erent vehicle types (buses, trucks, SUVs, cars), we learn the motionlet detectors in a shape-free appearance space, where all training samples are resized to the same aspect ratio, and then during test time the aspect ratio of the sliding window is changed to allow the detection of di erent vehicle types. Once a vehicle is detected and tracked over the video, fine-grained attributes are extracted and ingested into a database to allow future search queries such as "Show me all blue trucks larger than 7ft length traveling at high speed northbound last Saturday, from 2pm to 5pm".
|EPrint Type:||Conference or Workshop Item (Paper)|
|Project Keyword:||Project Keyword UNSPECIFIED|
|Deposited By:||Wray Buntine|
|Deposited On:||21 February 2012|