Natural interaction with a virtual guide in a virtual environment: A multimodal dialogue system

Hofs, Dennis and Theune, Mariët and Akker op den, Rieks (2010) Natural interaction with a virtual guide in a virtual environment: A multimodal dialogue system. Journal on Multimodal User Interfaces, 3 (1-2). pp. 141-153. ISSN 1783-7677

Preview

PDF
577Kb

Abstract:	This paper describes the Virtual Guide, a multimodal dialogue system represented by an embodied conversational agent that can help users to find their way in a virtual environment, while adapting its affective linguistic style to that of the user. We discuss the modular architecture of the system, and describe the entire loop from multimodal input analysis to multimodal output generation. We also describe how the Virtual Guide detects the level of politeness of the user’s utterances in real-time during the dialogue and aligns its own language to that of the user, using different politeness strategies. Finally we report on our first user tests, and discuss some potential extensions to improve the system.
Item Type:	Article
Copyright:	© 2010 The Author(s)
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Human Media Interaction (HMI)
Link to this item:	http://purl.utwente.nl/publications/70362
Official URL:	http://dx.doi.org/10.1007/s12193-009-0024-6
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page