Development of Multimodal Interfaces: Active Listening and Synchrony


Esposito, Anna and Campbell, Nick and Vogel, Carl and Hussain, Amir and Nijholt, Anton , eds. (2010) Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science, 5967 . Springer Verlag, Heidelberg. ISBN 9783642123962

[img] PDF
Restricted to UT campus only

Abstract:This volume brings together, through a peer-revision process, the advanced research results obtained by the European COST Action 2102: Cross-Modal Analysis of Verbal and Nonverbal Communication, primarily discussed for the first time at the Second COST 2102 International Training School on “Development of Multimodal Interfaces: Active Listening and Synchrony” held in Dublin, Ireland, March 23–27 2009.
The school was sponsored by COST (European Cooperation in the Field of Scientific and Technical Research, ) in the domain of Information and Communication Technologies (ICT) for disseminating the advances of the research activities developed within the COST Action 2102: “Cross-Modal Analysis of Verbal and Nonverbal Communication” ( COST Action 2102 in its third year of life brought together about 60 European and 6 overseas scientific laboratories whose aim is to develop interactive dialogue systems and intelligent virtual avatars graphically embodied in a 2D and/or 3D interactive virtual world, capable of interacting intelligently with the environment, other avatars, and particularly with human users.
The main focus of the school was the development of multimodal interfaces. Traditional approaches to multimodal interface design tend to assume a “ping-pong” or “push-to-talk” approach to speech interaction wherein either the system or the human interlocutor is active at any one time. This is contrary to many recent findings in conversation and discourse analysis, where the definition of a “turn” or even an “utterance” is found to be very complex. People don’t “take turns” to talk in a typical conversational interaction, but they each contribute actively to the joint emergence of a “common understanding.” The sub-theme of the school was “Synchrony and Active Listening” selected with the idea to identify contributions that actively give support to the ongoing research into the dynamics of human spoken interaction, to the production of multimodal conversation data and to the subsequent analysis and modelling of interaction dynamics, with the dual goal of appropriately designing multimodal interfaces, as well as providing new approaches and developmental paradigms.
Item Type:Book
Copyright:© 2010 Springer
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page