Research and Implementation of a Universal ETL Management Platform Based on Telecom Industry

Abstract

ETL is an important process in building data warehouse. For processing large volume of data and accessing to heterogeneous multi-data sources, how to efficiently shorten the execution time and possess the ability of general accessing data sources is a big challenge. Aiming at the special requirements of telecommunication decision support system, this paper proposes a solution of a general ETL management platform, realizing such functions as accessing several heterogeneous data sources and monitoring ETL process. Considering the characteristic of massive data in telecom system, by means of thread pool technologies, this ETL management platform improves the multithreading technology to raise the ETL efficiency and resource utilization. At last, the system results prove this solution is efficient and valid.