Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin
{"title":"直方图立方体:面向地球观测大数据的轻量级交互时空聚合","authors":"Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin","doi":"10.1080/17538947.2023.2278684","DOIUrl":null,"url":null,"abstract":"In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.","PeriodicalId":54962,"journal":{"name":"International Journal of Digital Earth","volume":"46 5","pages":"0"},"PeriodicalIF":3.7000,"publicationDate":"2023-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data\",\"authors\":\"Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin\",\"doi\":\"10.1080/17538947.2023.2278684\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.\",\"PeriodicalId\":54962,\"journal\":{\"name\":\"International Journal of Digital Earth\",\"volume\":\"46 5\",\"pages\":\"0\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2023-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Digital Earth\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/17538947.2023.2278684\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Digital Earth","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/17538947.2023.2278684","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data
In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.
期刊介绍:
The International Journal of Digital Earth is a response to this initiative. This peer-reviewed academic journal (SCI-E) focuses on the theories, technologies, applications, and societal implications of Digital Earth and those visionary concepts that will enable a modeled virtual world. The journal encourages papers that:
Progress visions for Digital Earth frameworks, policies, and standards;
Explore geographically referenced 3D, 4D, or 5D models to represent the real planet, and geo-data-intensive science and discovery;
Develop methods that turn all forms of geo-referenced data, from scientific to social, into useful information that can be analyzed, visualized, and shared;
Present innovative, operational applications and pilots of Digital Earth technologies at a local, national, regional, and global level;
Expand the role of Digital Earth in the fields of Earth science, including climate change, adaptation and health related issues,natural disasters, new energy sources, agricultural and food security, and urban planning;
Foster the use of web-based public-domain platforms, social networks, and location-based services for the sharing of digital data, models, and information about the virtual Earth; and
Explore the role of social media and citizen-provided data in generating geo-referenced information in the spatial sciences and technologies.