Big Data technologies to process spatial and attribute data when designing and operating mine-engineering systems

Y. Stepanov, A. Stepanov
{"title":"Big Data technologies to process spatial and attribute data when designing and operating mine-engineering systems","authors":"Y. Stepanov, A. Stepanov","doi":"10.1080/19479832.2019.1625448","DOIUrl":null,"url":null,"abstract":"ABSTRACT A myriad of spatial and attribute data are in use when designing and operating mine-engineering systems. These data are hosted on various servers of a company and are diverse in structure of data and units of measurement and have different subject areas related to each other in a complex way. There is no conformity between conventional systems for managing and storing data and tools for analysing incoming data. Big Data paradigm that implies methods for processing distributed data is utilised in ‘big data’ processing. A MapReduce method involves two procedures: map procedure that applies a proper function to each element of the list and reduce procedure, integrating the map procedure results. Such conventional database management system methods as integration and indexation, graph search and other methods are used to cluster big data. These methods should be used within MapReduce. Employing standard equipment and means to control a distributed Hadoop and Apache Hadoop Distributed File System (HDFS) file system, data storages in petabytes can be implemented. To make a more in-depth analysis, Data Mining methods are utilised along with network analysis, predictive analytics, etc. The articlecovers various methods applied to collect and analyse ‘big data’ to do a feasibility study and design mine and engineering systems.","PeriodicalId":46012,"journal":{"name":"International Journal of Image and Data Fusion","volume":"10 1","pages":"217 - 231"},"PeriodicalIF":1.8000,"publicationDate":"2019-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19479832.2019.1625448","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Image and Data Fusion","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/19479832.2019.1625448","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0

Abstract

ABSTRACT A myriad of spatial and attribute data are in use when designing and operating mine-engineering systems. These data are hosted on various servers of a company and are diverse in structure of data and units of measurement and have different subject areas related to each other in a complex way. There is no conformity between conventional systems for managing and storing data and tools for analysing incoming data. Big Data paradigm that implies methods for processing distributed data is utilised in ‘big data’ processing. A MapReduce method involves two procedures: map procedure that applies a proper function to each element of the list and reduce procedure, integrating the map procedure results. Such conventional database management system methods as integration and indexation, graph search and other methods are used to cluster big data. These methods should be used within MapReduce. Employing standard equipment and means to control a distributed Hadoop and Apache Hadoop Distributed File System (HDFS) file system, data storages in petabytes can be implemented. To make a more in-depth analysis, Data Mining methods are utilised along with network analysis, predictive analytics, etc. The articlecovers various methods applied to collect and analyse ‘big data’ to do a feasibility study and design mine and engineering systems.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
在设计和操作矿山工程系统时处理空间和属性数据的大数据技术
摘要:在设计和操作矿山工程系统时,会使用大量的空间和属性数据。这些数据托管在一家公司的各种服务器上,数据结构和测量单位各不相同,并且具有以复杂方式相互关联的不同主题领域。用于管理和存储数据的传统系统与用于分析传入数据的工具之间不一致。大数据范式意味着处理分布式数据的方法被用于“大数据”处理。MapReduce方法包括两个过程:对列表的每个元素应用适当函数的映射过程和集成映射过程结果的reduce过程。采用集成索引、图形搜索等传统数据库管理系统方法对大数据进行聚类。这些方法应该在MapReduce中使用。采用标准设备和方法来控制分布式Hadoop和Apache Hadoop分布式文件系统(HDFS)文件系统,可以实现以PB为单位的数据存储。为了进行更深入的分析,数据挖掘方法与网络分析、预测分析等一起使用。本文介绍了用于收集和分析“大数据”的各种方法,以进行可行性研究并设计矿山和工程系统。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
5.00
自引率
0.00%
发文量
10
期刊介绍: International Journal of Image and Data Fusion provides a single source of information for all aspects of image and data fusion methodologies, developments, techniques and applications. Image and data fusion techniques are important for combining the many sources of satellite, airborne and ground based imaging systems, and integrating these with other related data sets for enhanced information extraction and decision making. Image and data fusion aims at the integration of multi-sensor, multi-temporal, multi-resolution and multi-platform image data, together with geospatial data, GIS, in-situ, and other statistical data sets for improved information extraction, as well as to increase the reliability of the information. This leads to more accurate information that provides for robust operational performance, i.e. increased confidence, reduced ambiguity and improved classification enabling evidence based management. The journal welcomes original research papers, review papers, shorter letters, technical articles, book reviews and conference reports in all areas of image and data fusion including, but not limited to, the following aspects and topics: • Automatic registration/geometric aspects of fusing images with different spatial, spectral, temporal resolutions; phase information; or acquired in different modes • Pixel, feature and decision level fusion algorithms and methodologies • Data Assimilation: fusing data with models • Multi-source classification and information extraction • Integration of satellite, airborne and terrestrial sensor systems • Fusing temporal data sets for change detection studies (e.g. for Land Cover/Land Use Change studies) • Image and data mining from multi-platform, multi-source, multi-scale, multi-temporal data sets (e.g. geometric information, topological information, statistical information, etc.).
期刊最新文献
CNN-based plant disease recognition using colour space models Building classification extraction from remote sensing images combining hyperpixel and maximum interclass variance PolSAR image classification based on TCN deep learning: a case study of greater Cairo Spatial enhancement of Landsat-9 land surface temperature imagery by Fourier transformation-based panchromatic fusion Underwater image contrast enhancement through an intensity-randomised approach incorporating a swarm intelligence technique with unsupervised dual-step fusion
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1