Integrating Data Warehouses with Web Data: A Survey

• Published in: IEEE transactions on knowledge and data engineering Vol. 20; no. 7; pp. 940 - 955
• Main Authors: Perez, J.M., Berlanga, R., Aramburu, M.J., Pedersen, T.B.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.07.2008; IEEE Computer Society; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Content based retrieval; Data models; Data processing. List processing. Character string processing; Data warehouse and repository; Data warehouses; Data warehousing; Design engineering; Exact sciences and technology; Extensible Markup Language; Information retrieval; Information systems. Data bases; Mathematical analysis; Memory organisation. Data processing; Multidimensional systems; On-line systems; Paper technology; Resource description framework; Software; Stores; XML; XML/XSL/RDF; Data warehouse and repository; XML/XSL/RDF; Multidimensional database; Database query; XML/XSURDF; Semistructured data; World wide web; XML language; Information retrieval; Text; Internet; Data warehouse repository; Information technology; Data warehouse
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2007.190746

This paper surveys the most relevant research on combining Data Warehouse (DW) and Web data. It studies the XML technologies that are currently being used to integrate, store, query and retrieve web data, and their application to DWs. The paper reviews different DW distributed architectures and the use of XML languages as an integration tool in these systems. It also introduces the problem of dealing with semi-structured data in a DW. It studies Web data repositories, the design of multidimensional databases for XML data sources and the XML extensions of On-Line Analytical Processing techniques. The paper addresses the application of information retrieval technology in a DW to exploit text-rich documents collections. The authors hope that the paper will help to discover the main limitations and opportunities that offer the combination of the DW and the Web fields, as well as, to identify open research lines.