Research on three-layered metadata model for oil-gas data integration

Abstract

As cloud computing going, data integration and data center have reemerged as an active research topic recently, due to the increased requirements for exchange of data in various formats in our increasingly interconnected but inevitably heterogeneous world. Three-layered metadata model, including data source metadata, business metadata and topic metadata, is proposed to realize heterogeneous data integration, and components and functions for each layer are introduced. Then RDF-based metadata representation is introduced for data interchange. The architecture of a typical heterogeneous data integration system based on metadata has been put forward, the applications can directly use HTTP protocol to access the broker by uniform data access interfaces based on RESTful Web Services, and the data broker provides all applications with integrated access to multiple, heterogeneous data sources, giving each client the illusion of a single, homogeneous database designed for his specific need. Metadata make it easy to query and locate data resources, and eliminate heterogeneity of multiple data sources. Meanwhile, it provides users with transparent and quick access to resources services.