A Probabilistic Multimedia Retrieval Model and its Evaluation


Westerveld, T.H.W. and Vries, A.P. de and Ballegooij, A. van and Jong, F.M.G. de and Hiemstra, D. (2003) A Probabilistic Multimedia Retrieval Model and its Evaluation. Eurasip Journal on Applied Signal Processing, 2003 (2). pp. 186-198. ISSN 1110-8657

open access
[img] PDF
Abstract:We present a probabilistic model for the retrieval of multimodal documents. The model is based on Bayesian decision theory and combines models for text-based search with models for visual search. The textual model is based on the language modelling approach to text retrieval, and the visual information is modelled as a mixture of Gaussian densities. Both models have proved successful on various standard retrieval tasks. We evaluate the multimodal model on the search task of TREC′s video track. We found that the disclosure of video material based on visual information only is still too difficult. Even with purely visual information needs, text-based retrieval still outperforms visual approaches. The probabilistic model is useful for text, visual, and multimedia retrieval. Unfortunately, simplifying assumptions that reduce its computational complexity degrade retrieval effectiveness. Regarding the question whether the model can effectively combine information from different modalities, we conclude that whenever both modalities yield reasonable scores, a combined run outperforms the individual runs.
Item Type:Article
Additional information:Imported from EWI/DB PMS [db-utwente:arti:0000000017]
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Research Group:
Link to this item:http://purl.utwente.nl/publications/66373
Official URL:https://doi.org/10.1155/S111086570321101X
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page

Metis ID: 216472