Optimizing ETL Processes in Data Warehouses

Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. Usually, these processes must be completed in a certain time window; thus, it is necessary to optimize their execution time. In this paper, we delve into the logical optimization of ETL processes, modeling it as a state-space search problem. We consider each ETL workflow as a state and fabricate the state space through a set of correct state transitions. Moreover, we provide algorithms towards the minimization of the execution cost of an ETL workflow.

• Type: Conference
• Year: 2005
• Where: ICDE
• Authors: Alkis Simitsis, Panos Vassiliadis, Timos K. Sellis
• Keywords: Certain Time Window, Correct State Transitions, Database, ETL Workflow, ICDE 2005