A multimodal human-computer interaction framework for research into crisis management


Fitrianie, S. and Poppe, R. and Bui, T.H. and Chitu, A.G. and Datcu, D. and Dor, R. and Hofs, D.H.W. and Wiggers, P. and Willems, D.J.M. and Poel, M. and Rothkrantz, L.J.M. and Vuurpijl, L.G. and Zwiers, J. (2007) A multimodal human-computer interaction framework for research into crisis management. In: Fourth International Conference on Information Systems for Crisis Management, ISCRAM, 13-17 May 2007, Delft, The Netherlands (pp. pp. 149-158).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:Unreliable communication networks, chaotic environments and stressful conditions can make communication during crisis events difficult. The current practice in crisis management can be improved by introducing ICT systems in the process. However, much experimentation is needed to determine where and how ICT can aid. Therefore, we propose a framework in which predefined modules can be connected in an ad hoc fashion. Such a framework allows for rapid development and evaluation of such ICT systems. The framework offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. It provides mechanisms to fuse these modalities into a context dependent interpretation of the current situation and generate appropriate the multimodal information responses. The proposed toolbox can be used as part of a disaster and rescue simulation. We propose evaluation methods, and focus on the technological aspects of our framework.
Item Type:Conference or Workshop Item
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/64045
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 241640