Analysis of methods to prepare and transform information entering data repositories for effective management of the mining system

Abstract

The article assesses the existing methods of data collection and processing in the industry and proposes an alternative option of data processing to manage mining engineering systems at various stages of their operation. It is demonstrated that the formed volume of information that comes with different frequency rates and requires dedicated processing, structuring and analysis methods forms a system of big data and serves to enhance the efficiency of implementing geotechnical processes. A possible unified structure of data acquisition from digital sources of mining engineering system is presented. An analysis is provided of possible methods to process data for analytical purposes and for searching implicit dependencies and solving problems of predictive analytics. Tools for data collection and storage are proposed to create a unified system of big data analysis for management of mining engineering systems. It is stated that in order to create a unified analytical system for collection of digital data from a mining system, it is necessary to use standard industrial protocols for data collection and storage, for instance MQTT, used as an industry standard in the Industrial Internet of Things (IIoT) systems in accordance with requirements of ISO/ IEC 20922:2016. Storage requires the use of a conventional queue broker architecture, as well as a tool for working with the time series which is required to apply machine learning and big data methods. The approach to data classification in terms of the data acquisition speed proposed in the article makes it possible to standardize the data handling principles. Since the volume of transmitted data does not depend on the frequency of acquiring information from a digital source, it is proposed to transmit all the generated data from a digital source for subsequent search of implicit dependencies between the data. It is noted that application of specific methods and algorithms to analyze data of a mining system depends primarily on the task set which is often formed as a hypothesis to be tested by identifying implicit dependencies between different data sources. In order to improve the efficiency of managing a mining system at all the stages of field development, it is proposed to apply the ELT approach, which can be an important advantage in terms of controlling the technological processes of the mining system in the future.