An adaptive method for multi-document data loading

Abstract

In the field of engineering, there are a large amount of data which is automatically generated by the measuring instruments, this data are in different formats, how to quickly organize and manage data reasonably have become a hot topic. In this paper, an adaptive method of data loading has been designed to load multi-format text data into a database. We address the heterogeneous problem between the organization of data in a database and that of the original data file with our cutting technology, and make use of the Bridge pattern to design the configuration framework between the loading system and the file cutting system. With the template library, file cutters can be automatically generated, and the configuration file can be used to implement the correct loading of data files. Therefore, the scalability and configurability of the program are both improved.