Towards a Better Understanding of the Relationship Between Probabilistic Models in IR


Share/Save/Bookmark

Aly, Robin and Demeester, Thomas (2011) Towards a Better Understanding of the Relationship Between Probabilistic Models in IR. In: 3rd International Conference on Theory of Information Retrieval, ICTIR 2011, September 12-14, 2011, Bertinoro, Italy.

[img]PDF
Restricted to UT campus only
: Request a copy
224Kb
Abstract:Probability of relevance (PR) models are generally assumed to implement the Probability Ranking Principle (PRP) of IR, and recent publications claim that PR models and language models are similar. However, a careful analysis reveals two gaps in the chain of reasoning behind this statement. First, the PRP considers the relevance of particular documents, whereas PR models consider the relevance of any query-document pair. Second, unlike PR models, language models consider draws of terms and documents. We bridge the first gap by showing how the probability measure of PR models can be used to define the probabilistic model of the PRP. Furthermore, we argue that given the differences between PR models and language models, the second gap cannot be bridged at the probabilistic model level. We instead define a new PR model based on logistic regression, which has a similar score function to the one of the query likelihood model. The performance of both models is strongly correlated, hence providing a bridge for the second gap at the functional and ranking level. Understanding language models in relation with logistic regression models opens ample new research directions which we propose as future work.
Item Type:Conference or Workshop Item
Copyright:© 2011 Springer
Faculty:
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/78116
Official URL:http://dx.doi.org/10.1007/978-3-642-23318-0_16
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page