Multimodal End-of-Turn Prediction in Multi-Party Meetings


Kok, Iwan de and Heylen, Dirk (2009) Multimodal End-of-Turn Prediction in Multi-Party Meetings. In: International Conference on Multimodal Interfaces, ICMI-MLMI 2009, 2-6 November 2009, Cambridge, MA, USA (pp. pp. 91-98).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:One of many skills required to engage properly in a conversation is to know the appropiate use of the rules of engagement. In order to engage properly in a conversation, a virtual human or robot should, for instance, be able to know when it is being addressed or when the speaker is about to hand over the turn. The paper presents a multimodal approach to end-of-speaker-turn prediction using sequential probabilistic models (Conditional Random Fields) to learn a model from observations of real-life multi-party meetings. Although the results are not as good as expected, we provide insight into which modalities are important when taking a multimodal approach to the problem based on literature and our own results.
Item Type:Conference or Workshop Item
Copyright:© 2009 ACM
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page