Towards Cognitive-Aware Multimodal Presentation: The Modality Effects in High-Load HCI

Cao, Yujia and Theune, Mariët and Nijholt, Anton (2009) Towards Cognitive-Aware Multimodal Presentation: The Modality Effects in High-Load HCI. In: 8th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE, 19-24 July 2009, San Diego, USA.

PDF
Restricted to UT campus only: Request a copy
325Kb

Abstract:	In this study, we argue that multimodal presentations should be created in a cognitive-aware manner, especially in a high-load HCI situation where the user task challenges the full capacity of the human cognition. An experiment was conducted to investigate the cognitive effects of modalities, using a high-load task. The performance measurements and subjective reports consistently confirm a significant modality impact on cognitive workload, stress and performance. A relation between modality usage and physiological states was not found, due to the insufficient sensitivity and individual differences of the physiological measurements. The findings of this experiment can be well explained by several modality-related cognitive theories. We further integrate these theories into a suitability prediction model, which can systematically predict how suitable a certain modality usage is for this presentation task. The model demonstrates a possible approach towards cognitive-aware modality planning and can be modified for other applications.
Item Type:	Conference or Workshop Item
Copyright:	© 2009 Springer
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Human Media Interaction (HMI)
Link to this item:	http://purl.utwente.nl/publications/67820
Official URL:	http://dx.doi.org/10.1007/978-3-642-02728-4_1
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page