PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Analysis of semantic information available in an image collection augmented with auxiliary data
Mats Sjöberg, Ville Viitaniemi, Jorma Laaksonen and Timo Honkela
In: 3rd IFIP Conference an Artificial Intelligenge Applications and Innovations, Athens, Greece(2006).


An art installation was on display in the Centre Pompidou National Museum of Modern Art in Paris, where visitors could contribute with their own personal objects, adding keyword descriptions and quantified semantic features such as age or hardness. The data was projected in real-time onto a Self-Organizing Map (SOM) which was shown in the gallery. In this paper we analyze the same data by extracting visual features from the images and organize the image collection with multiple SOMs. We show how this mapping facilitates the emergence of semantic associations between visual, textual and metadata modalities by studying the distributions of the different feature vectors on the SOMs.

EPrint Type:Conference or Workshop Item (Oral)
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
Learning/Statistics & Optimisation
Multimodal Integration
ID Code:2558
Deposited By:Ville Viitaniemi
Deposited On:22 November 2006