CommonCube-based conceptual modeling of ETL processes

ETL tools are responsible for the extraction of data from sources, their cleansing and loading into a target data warehouse. However, nowadays, the design and development of ETL processes are performed in an in-house fashion, and need uniformed methodological foundations. In this paper, we propose a...

Full description

Saved in:
Bibliographic Details
Published in2005 International Conference on Control and Automation Vol. 1; pp. 131 - 136 Vol. 1
Main Authors Zehai Li, Jigui Sun, Haihong Yu, Jian Zhang
Format Conference Proceeding
LanguageEnglish
Published IEEE 2005
Subjects
Cleaning
Computer science
Computer science education
Costs
Data mining
Data warehouses
Educational technology
Knowledge engineering
Laboratories
Process design
Online AccessGet full text

Cover

More Information
Summary:ETL tools are responsible for the extraction of data from sources, their cleansing and loading into a target data warehouse. However, nowadays, the design and development of ETL processes are performed in an in-house fashion, and need uniformed methodological foundations. In this paper, we propose a novel conceptual model for the modeling of ETL processes. We employ CommonCubes to represent the cubes in a target data warehouse. CommonCubes release the design of ETL processes from overdependence on the physical schema of the target data warehouse, and enable the designers to pay more efforts to data transforming than data loading when designing ETL processes. Based on the constraint functions on source attributes and the transforming operations on target attributes, we define ETL mappings 1:0 capture the semantics of various relationship cardinalities between source attributes and target attributes, which provide a good basis for the design of ETL processes.
ISBN:0780391373
9780780391376
ISSN:1948-3449
1948-3457
DOI:10.1109/ICCA.2005.1528104