Experiences with IR Top N Optimization in a Main Memory DBMS: Applying 'The Database Approach' in New Domains
Blok, H.E. and de Vries, A.P. and Blanken, H.M. and Apers, P.M.G. (2001) Experiences with IR Top N Optimization in a Main Memory DBMS: Applying 'The Database Approach' in New Domains. In: Advances in Databases : Proceedings of the 18th British National Conference on Databases (BNCOD 2001), 9-11 Jul 2001, Chilton, UK.
Restricted to UT campus only: Request a copy
|Abstract:||Data abstraction and query processing techniques are usually studied in the domain of administrative applications. We present a case-study in the non-standard domain of (multimedia) information retrieval, mainly intended as a feasibility study in favor of the `database approach' to data management.|
Top-N queries form a natural query class when dealing with content retrieval. In the IR field, a lot of research has been done on processing top-N queries efficiently. Unfortunately, these results cannot directly be ported to the database environment, because their tuple-oriented nature would seriously limit the freedom of the query optimizer to select appropriate query plans.
By horizontally fragmenting our database containing document statistics, we are able to combine some of the best of the IR and database optimization principles, providing good retrieval quality as well as database `goodies' like flexibility, scalability, efficiency, and generality. Key issues we address in this paper concern the effects of our fragmentation approach on speed and quality of the answers, opportunities for scalability, supported by experimental results.
|Item Type:||Conference or Workshop Item|
Electrical Engineering, Mathematics and Computer Science (EEMCS)
|Link to this item:||http://purl.utwente.nl/publications/63489|
|Export this item as:||BibTeX|
Daily downloads in the past month
Monthly downloads in the past 12 months
Repository Staff Only: item control page