PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Learning dynamic tactile sensing with robust vision-based training
Oliver Kroemer, Christoph Lampert and Jan Peters
IEEE Transactions on Robotics 2010.


Dynamic tactile sensing is a fundamental ability for recognizing materials and objects. However, while humans are born with partially developed dynamic tactile sensing and master this skill quickly, today's robots remain in their infancy. The development of such a sense requires not only better sensors, but also the right algorithms to deal with these sensors' data. For example, when classifying a material based on touch, the data is noisy, high-dimensional and contains irrelevant signals as well as essential ones. Few classification methods from machine learning can deal with such problems. In this paper, we propose an efficient approach to inferring suitable lower-dimensional representations of the tactile data. In order to classify materials based on only the sense of touch, these representations are autonomously discovered using visual information of the surfaces during training. However, accurately pairing vision and tactile samples in real robot applications is a difficult problem. The proposed approach therefore works with weak pairings between the modalities. Experiments show that the resulting approach is very robust and yields a significantly higher classification performance based on only dynamic tactile sensing. The resulting methods are straightforward to generalize from materials to objects and may potentially be applied in future artificial robot skin.

PDF - PASCAL Members only - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Article
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Machine Vision
ID Code:8040
Deposited By:Oliver Kroemer
Deposited On:17 March 2011