Designing Frameworks for Automatic Affect Prediction and Classiﬁcation in Dimensional Space

Nicolaou, Mihalis A. and Gunes, Hatice and Pantic, Maja (2011) Designing Frameworks for Automatic Affect Prediction and Classiﬁcation in Dimensional Space. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011, 20-25 June 2011, Colorado Springs, USA.

PDF
Restricted to UT campus only: Request a copy
1134Kb

Abstract:	This paper focuses on designing frameworks for automatic affect prediction and classification in dimensional space. Similarly to many pattern recognition problems, dimensional affect prediction requires predicting multidimensional output vectors (e.g., valence and arousal) given a specific set of input features (e.g., facial expression cues). To date, affect recognition in valence and arousal space has been done separately along each dimension, assuming that they are independent. However, various psychological findings suggest that these dimensions are correlated. In light of this, we focus on modeling inter-dimensional correlations, and propose (i) an Output-Associative Relevance Vector Machine (OA-RVM) regression framework that augments the traditional RVM regression by being able to learn non-linear input and output dependencies among affect dimensions, and (ii) a multi-layer hybrid framework composed of a temporal regression layer for predicting affect dimensions, a graphical model layer for modeling valence-arousal correlations, and a final classification and fusion layer exploiting informative statistics extracted from the lower layers. We demonstrate the effectiveness and the robustness of the proposed frameworks by subject-independent experimental validation(s) performed on a naturalistic data set of facial expressions.
Item Type:	Conference or Workshop Item
Copyright:	© 2011 IEEE
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Human Media Interaction (HMI)
Link to this item:	http://purl.utwente.nl/publications/79501
Official URL:	http://dx.doi.org/10.1109/CVPRW.2011.5981719
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page