Monitoring User-System Performance in Interactive Retrieval Tasks


Boldareva, L. and Vries, A.P. de and Hiemstra, D. (2004) Monitoring User-System Performance in Interactive Retrieval Tasks. In: Recherche d'Informations Assistee par Ordinateur (RIAO 2004), 26-28 Apr 2004, Avignon, France (pp. pp. 474-483).

[img] PDF
Restricted to UT campus only
: Request a copy
Abstract:Monitoring user-system performance in interactive search is a challenging task. Traditional measures
of retrieval evaluation, based on recall and precision, are not of any use in real time, for they require
a priori knowledge of relevant documents. This paper shows how a Shannon entropy-based measure
of user-system performance naturally falls in the framework of (interactive) probabilistic information
retrieval. The value of entropy of the distribution of probability of relevance associated with the
documents in the collection can be used to monitor search progress in live testing, to allow for example
the system to select an optimal combination of search strategies. User profiling and tuning parameters
of retrieval systems are other important applications.
Item Type:Conference or Workshop Item
Additional information:Imported from EWI/DB PMS [db-utwente:inpr:0000003578]
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 221593