Come and have an emotional workout with sensitive artificial listeners!


Schröder, Marc and Pammi, Sathish and Gunes, Hatice and Pantic, Maja and Valstar, Michel F. and Cowie, Roddy and McKeown, Gary and Heylen, Dirk and Maat, Mark ter and Eyben, Florian and Schuller, Björn and Wölmmer, Martin and Bevacqua, Elisabetta and Pelachaud, Catherine and Sevin, Etienne de (2011) Come and have an emotional workout with sensitive artificial listeners! In: IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, FG 2011, 21-25 March 2011, Santa Barbara, CA (pp. p. 646).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.
Item Type:Conference or Workshop Item
Copyright:© 2011 IEEE
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page