Evaluating municipal websites: a methodological comparison of three think-aloud variants


Haak, Maaike J. van den and Jong, Menno D.T. de and Schellens, Peter Jan (2009) Evaluating municipal websites: a methodological comparison of three think-aloud variants. Government information quarterly, 26 (1). pp. 193-202. ISSN 0740-624X

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:Usability methods have received relatively little methodological attention within the field of E-Government. This paper aims to address this gap by reporting on a usability test of the municipal website of Deventer (the Netherlands), carried out by means of three variants of the think-aloud method (concurrent/retrospective think-aloud protocols and constructive interaction). These three methods had proved successful in a previous evaluation of a different municipal website, yet we decided to replicate our study in order to investigate whether the three methods would reveal different results when applied to another municipal website with a different information architecture. The results of our study showed that, as in the previous municipal website evaluation, the three evaluation methods were largely comparable in terms of output. Nevertheless, we did find a number of differences between the present and previous municipal website evaluation regarding the workings of the three methods—differences that could be explained by the different information architectures of the municipal websites tested. This suggests that the three evaluation methods might indeed work differently depending on the nature of the website that is being evaluated, and calls for more research into the effect of task type on the validity of evaluation methods.
Item Type:Article
Copyright:© 2009 Elsevier
Faculty of Behavioural, Management and Social sciences (BMS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/78430
Official URL:https://doi.org/10.1016/j.giq.2007.11.003
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 262501