Corpus-based schema matching

• Published in: 21st International Conference on Data Engineering (ICDE'05) pp. 57 - 68
• Main Authors: Madhavan, J., Bernstein, P.A., Doan, A., Halevy, A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2005
• Subjects: Buildings; Data models; Documentation; Humans; Message passing; Ontologies; Pattern matching; Statistics; Web services
• ISBN: 0769522858; 9780769522852
• ISSN: 1063-6382; 2375-026X
• DOI: 10.1109/ICDE.2005.39

Schema matching is the problem of identifying corresponding elements in different schemas. Discovering these correspondences or matches is inherently difficult to automate. Past solutions have proposed a principled combination of multiple algorithms. However, these solutions sometimes perform rather poorly due to the lack of sufficient evidence in the schemas being matched. In this paper we show how a corpus of schemas and mappings can be used to augment the evidence about the schemas being matched, so they can be matched better. Such a corpus typically contains multiple schemas that model similar concepts and hence enables us to learn variations in the elements and their properties. We exploit such a corpus in two ways. First, we increase the evidence about each element being matched by including evidence from similar elements in the corpus. Second, we learn statistics about elements and their relationships and use them to infer constraints that we use to prune candidate mappings. We also describe how to use known mappings to learn the importance of domain and generic constraints. We present experimental results that demonstrate corpus-based matching outperforms direct matching (without the benefit of a corpus) in multiple domains.