Modality switching and performance in a thought and speech controlled computer game


Share/Save/Bookmark

Gürkök, Hayrettin and Hakvoort, Gido and Poel, Mannes (2011) Modality switching and performance in a thought and speech controlled computer game. In: 13th International Conference on Multimodal Interfaces, ICMI 2011, 14-18 November 2011, Alicante, Spain.

[img]PDF
Restricted to UT campus only
: Request a copy
1225Kb
Abstract:Providing multiple modalities to users is known to improve the overall performance of an interface. Weakness of one modality can be overcome by the strength of another one. Moreover, with respect to their abilities, users can choose between the modalities to use the one that is the best for them. In this paper we explored whether this holds for direct control of a computer game which can be played using a brain-computer interface (BCI) and an automatic speech recogniser (ASR). Participants played the games in unimodal mode (i.e. ASR-only and BCI-only) and multimodal mode where they could switch between the two modalities. The majority of the participants switched modality during the multimodal game but for the most of the time they stayed in ASR control. Therefore multimodality did not provide a significant performance improvement over unimodal control in our particular setup. We also investigated the factors which influence modality switching. We found that performance and peformance-related factors were prominently effective in modality switching.
Item Type:Conference or Workshop Item
Copyright:© 2011 ACM
Faculty:
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/78612
Official URL:http://dx.doi.org/10.1145/2070481.2070491
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page