The uncertain representation ranking framework for concept-based video retrieval


Aly, Robin and Doherty, Aiden and Hiemstra, Djoerd and Jong, Franciska de and Smeaton, Alan F. (2012) The uncertain representation ranking framework for concept-based video retrieval. Information retrieval, 16 (5). pp. 557-583. ISSN 1386-4564

open access
Abstract:Concept based video retrieval often relies on imperfect and uncertain concept detectors. We propose a general ranking framework to define effective and robust ranking functions, through explicitly addressing detector uncertainty. It can cope with multiple concept-based representations per video segment and it allows the re-use of effective text retrieval functions which are defined on similar representations. The final ranking status value is a weighted combination of two components: the expected score of the possible scores, which represents the risk-neutral choice, and the scores’ standard deviation, which represents the risk or opportunity that the score for the actual representation is higher. The framework consistently improves the search performance in the shot retrieval task and the segment retrieval task over several baselines in five TRECVid collections and two collections which use simulated detectors of varying performance.
Item Type:Article
Copyright:© 2012 The Author(s)
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:
Official URL:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 287734