PASCAL - Pattern Analysis, Statistical Modelling and Computational Learning

Automatic 3D Face Reconstruction from Single Images or Video
P. Breuer, K.I. Kim, W. Kienzle, B. Schölkopf and V. Blanz
In: Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2008) (2008) IEEE Computer Society , Los Alamitos, CA, USA .


This paper presents a fully automated algorithm for reconstructing a textured 3D model of a face from a single photograph or a raw video stream. The algorithm is based on a combination of Support Vector Machines (SVMs) and a Morphable Model of 3D faces. After SVM face detection, individual facial features are detected using a novel regression- and classification-based approach, and probabilistically plausible configurations of features are selected to produce a list of candidates for several facial feature positions. In the next step, the configurations of feature points are evaluated using a novel criterion that is based on a Morphable Model and a combination of linear projections. To make the algorithm robust with respect to head orientation, this process is iterated while the estimate of pose is refined. Finally, the feature points initialize a model-fitting procedure of the Morphable Model. The result is a highresolution 3D surface model.

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
EPrint Type:Book Section
Project Keyword:Project Keyword UNSPECIFIED
Subjects:Computational, Information-Theoretic Learning with Statistics
Learning/Statistics & Optimisation
Brain Computer Interfaces
Theory & Algorithms
ID Code:4333
Deposited By:Bernhard Schölkopf
Deposited On:13 March 2009