HDFS支持遥感数据的存储和管理

2016 2nd IEEE International Conference on Computer and Communications (ICCC) Pub Date : 2016-10-01 DOI:10.1109/COMPCOMM.2016.7924669

W. Kou, Xuejing Yang, Changxian Liang, Changbo Xie, Shu Gan

{"title":"HDFS支持遥感数据的存储和管理","authors":"W. Kou, Xuejing Yang, Changxian Liang, Changbo Xie, Shu Gan","doi":"10.1109/COMPCOMM.2016.7924669","DOIUrl":null,"url":null,"abstract":"The continuously growing volume of massive remote sensing data raised huge challenges on storage space and querying efficiency. In this paper, a new management model of remote sensing data has been proposed to address these issues of system architecture, data storage strategies, and functionalities based on Hadoop Distributed File System (HDFS). The model is capable of relieving the overloading problems of the single NameNode server in HDFS by taking a dual storage mechanism and a simulating operations method. On one hand, Relational Database Management System (RDBMS) and HDFS are separately taken to store and manage image files and related metadata of remote sensing data; on the other hand, operations of file systems are simulated by RDBMS. The study results show the model could improve management and storage efficiency of remote sensing data.","PeriodicalId":210833,"journal":{"name":"2016 2nd IEEE International Conference on Computer and Communications (ICCC)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"HDFS enabled storage and management of remote sensing data\",\"authors\":\"W. Kou, Xuejing Yang, Changxian Liang, Changbo Xie, Shu Gan\",\"doi\":\"10.1109/COMPCOMM.2016.7924669\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The continuously growing volume of massive remote sensing data raised huge challenges on storage space and querying efficiency. In this paper, a new management model of remote sensing data has been proposed to address these issues of system architecture, data storage strategies, and functionalities based on Hadoop Distributed File System (HDFS). The model is capable of relieving the overloading problems of the single NameNode server in HDFS by taking a dual storage mechanism and a simulating operations method. On one hand, Relational Database Management System (RDBMS) and HDFS are separately taken to store and manage image files and related metadata of remote sensing data; on the other hand, operations of file systems are simulated by RDBMS. The study results show the model could improve management and storage efficiency of remote sensing data.\",\"PeriodicalId\":210833,\"journal\":{\"name\":\"2016 2nd IEEE International Conference on Computer and Communications (ICCC)\",\"volume\":\"49 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 2nd IEEE International Conference on Computer and Communications (ICCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/COMPCOMM.2016.7924669\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 2nd IEEE International Conference on Computer and Communications (ICCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/COMPCOMM.2016.7924669","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 8

摘要

海量遥感数据的不断增长对存储空间和查询效率提出了巨大的挑战。本文提出了一种新的基于Hadoop分布式文件系统(HDFS)的遥感数据管理模型，以解决系统架构、数据存储策略和功能等问题。该模型采用双存储机制和模拟操作方法，能够缓解HDFS单NameNode服务器的过载问题。一方面，采用关系数据库管理系统(RDBMS)和HDFS分别存储和管理遥感数据的图像文件和相关元数据;另一方面，文件系统的操作由RDBMS模拟。研究结果表明，该模型可以提高遥感数据的管理和存储效率。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

HDFS enabled storage and management of remote sensing data

The continuously growing volume of massive remote sensing data raised huge challenges on storage space and querying efficiency. In this paper, a new management model of remote sensing data has been proposed to address these issues of system architecture, data storage strategies, and functionalities based on Hadoop Distributed File System (HDFS). The model is capable of relieving the overloading problems of the single NameNode server in HDFS by taking a dual storage mechanism and a simulating operations method. On one hand, Relational Database Management System (RDBMS) and HDFS are separately taken to store and manage image files and related metadata of remote sensing data; on the other hand, operations of file systems are simulated by RDBMS. The study results show the model could improve management and storage efficiency of remote sensing data.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2016 2nd IEEE International Conference on Computer and Communications (ICCC)

自引率

0.00%

发文量