Multimodal End-of-Turn Prediction in Multi-Party Meetings

Kok de, Iwan and Heylen, Dirk (2009) Multimodal End-of-Turn Prediction in Multi-Party Meetings. In: International Conference on Multimodal Interfaces, ICMI-MLMI 2009, 2-6 November 2009, Cambridge, MA, USA.

PDF
Restricted to UT campus only: Request a copy
177Kb

Abstract:	One of many skills required to engage properly in a conversation is to know the appropiate use of the rules of engagement. In order to engage properly in a conversation, a virtual human or robot should, for instance, be able to know when it is being addressed or when the speaker is about to hand over the turn. The paper presents a multimodal approach to end-of-speaker-turn prediction using sequential probabilistic models (Conditional Random Fields) to learn a model from observations of real-life multi-party meetings. Although the results are not as good as expected, we provide insight into which modalities are important when taking a multimodal approach to the problem based on literature and our own results.
Item Type:	Conference or Workshop Item
Copyright:	© 2009 ACM
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Human Media Interaction (HMI)
Link to this item:	http://purl.utwente.nl/publications/73121
Official URL:	http://doi.acm.org/10.1145/1647314.1647332
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page