Facial Expression Invariant Head Pose Normalization using Gaussian Process Regression


Rudovic, Ognjen and Patras, Ioannis and Pantic, Maja (2010) Facial Expression Invariant Head Pose Normalization using Gaussian Process Regression. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR '10), Workshop CVPR for Human Communicative Behaviour Analysis (CVPR4HB), 13-18 June 2010, San Francisco, CA, USA (pp. pp. 28-33).

[img] PDF - Published Version
Restricted to UT campus only
: Request a copy
Abstract:We present a regression-based scheme for facialexpression-invariant head pose normalization. We address the problem by mapping the locations of 2D facial points (e.g. mouth corners) from non-frontal poses to the frontal pose. This is done in two steps. First, we propose a head pose estimator that maps the input 2D facial point locations into a head-pose space defined by a low dimensional manifold attained by means of multi-class LDA. Then, to learn the mappings between a discrete set of non-frontal head poses and the frontal pose, we propose using a Gaussian Process Regression (GPR) model for each pair of target poses (i.e. a non-frontal and the frontal pose). During testing, the head pose estimator is used to activate the most relevant GPR model which is later applied to project the locations of 2D facial landmarks from an arbitrary pose (that does not have to be one of the training poses) to the frontal pose. In our experiments we show that the proposed scheme (i) performs accurately for continuous head pose in the range from 0° to 45° pan rotation and from 0° to 30° tilt rotation despite the fact that the training was conducted only on a set of discrete poses, (ii) handles successfully both expressive and expressionless faces (even in cases when some of the expression categories were missing in certain poses during the training), and (iii) outperforms both 3D Point Distribution Model (3D-PDM) and Linear Regression (LR) model that are used as baseline methods for pose normalization. The proposed method is experimentally evaluated on data from the BU
Item Type:Conference or Workshop Item
Copyright:© 2010 IEEE
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/75976
Official URL:http://dx.doi.org/10.1109/CVPRW.2010.5543269
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 276363