Robust 3D Face Recognition in the Presence of Realistic Occlusions


Alyuz, Nese and Gökberk, Berk and Spreeuwers, Luuk and Veldhuis, Raymond and Akarun, Lale (2012) Robust 3D Face Recognition in the Presence of Realistic Occlusions. In: 5th IAPR International Conference on Biometrics, ICB 2012, 29 March - 1 April 2012, New Delhi, India (pp. pp. 111-118).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:Facial occlusions pose significant problems for automatic face recognition systems. In this work, we propose a novel occlusion-resistant three-dimensional (3D) facial identification system. We show that, under extreme occlusions due to hair, hands, and eyeglasses, typical 3D face recognition systems exhibit poor performance. In order to deal with occlusions, our proposed system employs occlusion-resistant registration, occlusion detection, and regional classifiers. A two-step registration module first detects the nose region on the curvedness-weighted convex shape index map, and then performs fine alignment using nose-based Iterative Closest Point (ICP) algorithm. Occluded areas are determined automatically via a generic face model. After non-facial parts introduced by occlusions are removed, a variant of Gappy Principal Component Analysis (Gappy PCA) is used to restore the full face from occlusion-free facial surfaces. Experimental results obtained on realistically occluded facial images from the Bosphorus 3D face database shows that, with the use of score-level fusion of regional Linear Discriminant Analysis (LDA) classifiers, the proposed method improves rank-1 identification accuracy significantly: from 76.12% to 94.23%.
Item Type:Conference or Workshop Item
Copyright:© 2012 IEEE
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page