Towards Cognitive-Aware Multimodal Presentation: The Modality Effects in High-Load HCI


Cao, Yujia and Theune, Mariët and Nijholt, Anton (2009) Towards Cognitive-Aware Multimodal Presentation: The Modality Effects in High-Load HCI. In: 8th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE, 19-24 July 2009, San Diego, USA (pp. pp. 3-12).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:In this study, we argue that multimodal presentations should be created in a cognitive-aware manner, especially in a high-load HCI situation where the user task challenges the full capacity of the human cognition. An experiment was conducted to investigate the cognitive effects of modalities, using a high-load task. The performance measurements and subjective reports consistently confirm a significant modality impact on cognitive workload, stress and performance. A relation between modality usage and physiological states was not found, due to the insufficient sensitivity and individual differences of the physiological measurements. The findings of this experiment can be well explained by several modality-related cognitive theories. We further integrate these theories into a suitability prediction model, which can systematically predict how suitable a certain modality usage is for this presentation task. The model demonstrates a possible approach towards cognitive-aware modality planning and can be modified for other applications.
Item Type:Conference or Workshop Item
Copyright:© 2009 Springer
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page