Query quality: user ratings and system predictions

Hauff, Claudia and Jong de, Franciska and Kelly, Diane and Azzopardi, Leif (2010) Query quality: user ratings and system predictions. In: 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, July 19-23, 2010, Geneva, Switzerland.

PDF
Restricted to UT campus only: Request a copy
438Kb

Abstract:	Numerous studies have examined the ability of query performance prediction methods to estimate a query's quality for system effectiveness measures (such as average precision). However, little work has explored the relationship between these methods and user ratings of query quality. In this poster, we report the findings from an empirical study conducted on the TREC ClueWeb09 corpus, where we compared and contrasted user ratings of query quality against a range of query performance prediction methods. Given a set of queries, it is shown that user ratings of query quality correlate to both system effectiveness measures and a number of pre-retrieval predictors.
Item Type:	Conference or Workshop Item
Copyright:	© 2010 ACM
Faculty:	Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:	Human Media Interaction (HMI)
Link to this item:	http://purl.utwente.nl/publications/72486
Official URL:	http://dx.doi.org/10.1145/1835449.1835594
Export this item as:	BibTeX EndNote HTML Citation Reference Manager

Show download statistics for this publication

Repository Staff Only: item control page