Duplicate Detection in Probabilistic Data


Panse, Fabian and Keulen, Maurice van and Keijzer, Ander de and Ritter, Norbert (2009) Duplicate Detection in Probabilistic Data. [Report] (In Press)

open access
Abstract:Collected data often contains uncertainties. Probabilistic databases have been proposed to manage uncertain data. To combine data from multiple autonomous probabilistic databases, an integration of probabilistic data has to be performed. Until now, however, data integration approaches have focused on the integration of certain source data (relational or XML). There is no work on the integration of uncertain (esp. probabilistic) source data so far. In this paper, we present a first step towards a concise consolidation of probabilistic data. We focus on duplicate detection as a representative and essential step in an integration process. We present techniques for identifying multiple probabilistic representations of the same real-world entities. Furthermore, for increasing the efficiency of the duplicate detection process we introduce search space reduction methods adapted to probabilistic data.
Item Type:Report
Additional information:Extended version of NTII2010 workshop paper.
Copyright:© 2009 University of Twente, Centre for Telematics and Information Technology
Electrical Engineering, Mathematics and Computer Science (EEMCS)
Science and Technology (TNW)
Research Group:
Link to this item:http://purl.utwente.nl/publications/69305
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page