Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data

IF 3.7 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL International Journal of Digital Earth Pub Date : 2023-11-12 DOI:10.1080/17538947.2023.2278684
Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin
{"title":"Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data","authors":"Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin","doi":"10.1080/17538947.2023.2278684","DOIUrl":null,"url":null,"abstract":"In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.","PeriodicalId":54962,"journal":{"name":"International Journal of Digital Earth","volume":"46 5","pages":"0"},"PeriodicalIF":3.7000,"publicationDate":"2023-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Digital Earth","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/17538947.2023.2278684","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

Abstract

In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
直方图立方体:面向地球观测大数据的轻量级交互时空聚合
在对地观测大数据时代,交互式时空聚合分析是探索地理格局的重要工具。然而,现有的方法既低效又复杂。它们的交互性能在很大程度上依赖于大规模的计算资源,特别是数据立方体基础设施。本研究从绿色计算的角度出发,提出了一种基于预聚合概念的轻量级数据立方体模型,其中EO数据的频率直方图作为具体测度。通过Google S2网格系统将立方体空间划分为晶格金字塔,并将EO数据的直方图统计信息注入到内存长方体中。因此,对EO数据集的探索性聚合分析可以快速转化为多维视图查询过程。我们在本地PC上实现了原型系统,并进行了全球植被指数聚合的案例研究。实验表明,该模型比ArcGIS Pro和XCube更小、更快、能耗更低,有利于实现涉及立方体基础设施的绿色计算策略。由于独立模式,更大的数据集将导致更长的多维数据集构建时间和索引延迟。该方法的效率是以精度为代价的,本文对其固有的不确定性进行了检验。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
6.50
自引率
3.90%
发文量
88
审稿时长
3 months
期刊介绍: The International Journal of Digital Earth is a response to this initiative. This peer-reviewed academic journal (SCI-E) focuses on the theories, technologies, applications, and societal implications of Digital Earth and those visionary concepts that will enable a modeled virtual world. The journal encourages papers that: Progress visions for Digital Earth frameworks, policies, and standards; Explore geographically referenced 3D, 4D, or 5D models to represent the real planet, and geo-data-intensive science and discovery; Develop methods that turn all forms of geo-referenced data, from scientific to social, into useful information that can be analyzed, visualized, and shared; Present innovative, operational applications and pilots of Digital Earth technologies at a local, national, regional, and global level; Expand the role of Digital Earth in the fields of Earth science, including climate change, adaptation and health related issues,natural disasters, new energy sources, agricultural and food security, and urban planning; Foster the use of web-based public-domain platforms, social networks, and location-based services for the sharing of digital data, models, and information about the virtual Earth; and Explore the role of social media and citizen-provided data in generating geo-referenced information in the spatial sciences and technologies.
期刊最新文献
MAL-YOLO: a lightweight algorithm for target detection in side-scan sonar images based on multi-scale feature fusion and attention mechanism PM2.5 estimation and its relationship with NO2 and SO2 in China from 2016 to 2020 Advances on the global human settlement layer by joint assessment of earth observation and population survey data Integrating trajectory data and demographic characteristics: a trajectory semantic model for predicting travel flow and conducting interaction analysis A detection method for multi-type earth's surface anomalies based on multi-dimensional feature space
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1