{"title":"基于HBase的气象网格数据分布式存储","authors":"Honghao Yu, Hong Jia","doi":"10.1109/ISCEIC53685.2021.00041","DOIUrl":null,"url":null,"abstract":"In order to improve the storage and management ability of relational database for massive meteorological grid data, an index method based on spatial subdivision grid is proposed, and a distributed storage model of meteorological grid data based on HBase is designed and implemented. In this paper, the spatial grid is established on the NetCDF format meteorological grid data, and the spatial index coding based on spatial octree is designed; The distributed storage scheme based on HBase is adopted and the structure of rowkey and table is optimized . The experimental results show that HBase database is superior to relational database in storage and query for massive meteorological grid data.","PeriodicalId":342968,"journal":{"name":"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Distributed Storage of Meteorological Grid Data based on HBase\",\"authors\":\"Honghao Yu, Hong Jia\",\"doi\":\"10.1109/ISCEIC53685.2021.00041\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to improve the storage and management ability of relational database for massive meteorological grid data, an index method based on spatial subdivision grid is proposed, and a distributed storage model of meteorological grid data based on HBase is designed and implemented. In this paper, the spatial grid is established on the NetCDF format meteorological grid data, and the spatial index coding based on spatial octree is designed; The distributed storage scheme based on HBase is adopted and the structure of rowkey and table is optimized . The experimental results show that HBase database is superior to relational database in storage and query for massive meteorological grid data.\",\"PeriodicalId\":342968,\"journal\":{\"name\":\"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)\",\"volume\":\"67 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISCEIC53685.2021.00041\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISCEIC53685.2021.00041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Distributed Storage of Meteorological Grid Data based on HBase
In order to improve the storage and management ability of relational database for massive meteorological grid data, an index method based on spatial subdivision grid is proposed, and a distributed storage model of meteorological grid data based on HBase is designed and implemented. In this paper, the spatial grid is established on the NetCDF format meteorological grid data, and the spatial index coding based on spatial octree is designed; The distributed storage scheme based on HBase is adopted and the structure of rowkey and table is optimized . The experimental results show that HBase database is superior to relational database in storage and query for massive meteorological grid data.