Monitoring User-System Performance in Interactive Retrieval Tasks

Share/Save/Bookmark

Boldareva, L. and de Vries, A.P. and Hiemstra, D. (2004) Monitoring User-System Performance in Interactive Retrieval Tasks. In: Recherche d'Informations Assistee par Ordinateur (RIAO 2004), 26-28 Apr 2004, Avignon, France.

[img]PDF
Restricted to UT campus only
: Request a copy
112Kb
Abstract:Monitoring user-system performance in interactive search is a challenging task. Traditional measures
of retrieval evaluation, based on recall and precision, are not of any use in real time, for they require
a priori knowledge of relevant documents. This paper shows how a Shannon entropy-based measure
of user-system performance naturally falls in the framework of (interactive) probabilistic information
retrieval. The value of entropy of the distribution of probability of relevance associated with the
documents in the collection can be used to monitor search progress in live testing, to allow for example
the system to select an optimal combination of search strategies. User profiling and tuning parameters
of retrieval systems are other important applications.
Item Type:Conference or Workshop Item
Faculty:
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/63495
Official URL:http://www.riao.org/sites/RIAO-2004/Proceedings-2004
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page