基于分布式矩阵的遥感计算强度求解方法

IF 6.2 2区 计算机科学 Q1 COMPUTER SCIENCE, THEORY & METHODS Future Generation Computer Systems-The International Journal of Escience Pub Date : 2024-12-03 DOI:10.1016/j.future.2024.107644
Weitao Zou , Wei Li , Zeyu Wang , Jiaming Pei , Tongtong Lou , Guangsheng Chen , Weipeng Jing , Albert Y. Zomaya
{"title":"基于分布式矩阵的遥感计算强度求解方法","authors":"Weitao Zou ,&nbsp;Wei Li ,&nbsp;Zeyu Wang ,&nbsp;Jiaming Pei ,&nbsp;Tongtong Lou ,&nbsp;Guangsheng Chen ,&nbsp;Weipeng Jing ,&nbsp;Albert Y. Zomaya","doi":"10.1016/j.future.2024.107644","DOIUrl":null,"url":null,"abstract":"<div><div>Remote sensing analysis is a dominant yet time-consuming part of geospatial applications. The performance can be optimized based on distributed computing, but current systems still face significant challenges. Firstly, the spatial characteristics of remote sensing data lead to an uneven distribution of computational intensity (CIT), which characterizes computing loads, including computation and IO, in different spatial domains. Secondly, it is hard to achieve load-balancing without introducing new computational costs, thus increasing the CIT and reducing the overall performance. Therefore, resolving CIT by decreasing and balancing it is an important research issue for distributed remote sensing computing. This paper proposes LBM-RS, an efficient distributed framework based on load-balancing matrix computing for remote sensing. It implements remote sensing applications based on the distributed matrix, representing the algorithms with a matrix computation and constructing multi-dimensional spatial domains to model computational costs for matrix operation tasks. It resolves the CIT with the minimum computation load and dynamic spatial domain decomposition strategy to support global load balancing. We also exploit the IO efficiency from the task staging strategy and the cache-aware memory structure for remote sensing data. In this way, it can reduce the bandwidth burden and memory access frequency, thus decreasing the overall CIT. Finally, we evaluate the proposed approach on both real and synthetic datasets, and the results demonstrate significant advantages in computation and communication efficiency compared to the benchmarks.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":"166 ","pages":"Article 107644"},"PeriodicalIF":6.2000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Efficient distributed matrix for resolving computational intensity in remote sensing\",\"authors\":\"Weitao Zou ,&nbsp;Wei Li ,&nbsp;Zeyu Wang ,&nbsp;Jiaming Pei ,&nbsp;Tongtong Lou ,&nbsp;Guangsheng Chen ,&nbsp;Weipeng Jing ,&nbsp;Albert Y. Zomaya\",\"doi\":\"10.1016/j.future.2024.107644\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Remote sensing analysis is a dominant yet time-consuming part of geospatial applications. The performance can be optimized based on distributed computing, but current systems still face significant challenges. Firstly, the spatial characteristics of remote sensing data lead to an uneven distribution of computational intensity (CIT), which characterizes computing loads, including computation and IO, in different spatial domains. Secondly, it is hard to achieve load-balancing without introducing new computational costs, thus increasing the CIT and reducing the overall performance. Therefore, resolving CIT by decreasing and balancing it is an important research issue for distributed remote sensing computing. This paper proposes LBM-RS, an efficient distributed framework based on load-balancing matrix computing for remote sensing. It implements remote sensing applications based on the distributed matrix, representing the algorithms with a matrix computation and constructing multi-dimensional spatial domains to model computational costs for matrix operation tasks. It resolves the CIT with the minimum computation load and dynamic spatial domain decomposition strategy to support global load balancing. We also exploit the IO efficiency from the task staging strategy and the cache-aware memory structure for remote sensing data. In this way, it can reduce the bandwidth burden and memory access frequency, thus decreasing the overall CIT. Finally, we evaluate the proposed approach on both real and synthetic datasets, and the results demonstrate significant advantages in computation and communication efficiency compared to the benchmarks.</div></div>\",\"PeriodicalId\":55132,\"journal\":{\"name\":\"Future Generation Computer Systems-The International Journal of Escience\",\"volume\":\"166 \",\"pages\":\"Article 107644\"},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2024-12-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Future Generation Computer Systems-The International Journal of Escience\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167739X24006083\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, THEORY & METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X24006083","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

摘要

遥感分析是地理空间应用中一个主要但耗时的部分。在分布式计算的基础上,性能可以得到优化,但目前的系统仍然面临着很大的挑战。首先,遥感数据的空间特征导致计算强度(CIT)分布不均匀,CIT是计算负荷(包括计算和IO)在不同空间域中的特征。其次,如果不引入新的计算成本,很难实现负载均衡,从而增加了CIT,降低了整体性能。因此,通过减小和平衡来解决CIT问题是分布式遥感计算的重要研究课题。提出了一种基于负载均衡矩阵计算的高效分布式遥感框架LBM-RS。它基于分布式矩阵实现遥感应用,用矩阵计算表示算法,构建多维空间域来模拟矩阵运算任务的计算成本。以最小的计算量求解CIT,采用动态空间域分解策略,支持全局负载均衡。我们还从任务分级策略和缓存感知内存结构中挖掘了遥感数据的IO效率。最后,我们在真实数据集和合成数据集上对该方法进行了评估,结果表明,与基准测试相比,该方法在计算和通信效率方面具有显著优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Efficient distributed matrix for resolving computational intensity in remote sensing
Remote sensing analysis is a dominant yet time-consuming part of geospatial applications. The performance can be optimized based on distributed computing, but current systems still face significant challenges. Firstly, the spatial characteristics of remote sensing data lead to an uneven distribution of computational intensity (CIT), which characterizes computing loads, including computation and IO, in different spatial domains. Secondly, it is hard to achieve load-balancing without introducing new computational costs, thus increasing the CIT and reducing the overall performance. Therefore, resolving CIT by decreasing and balancing it is an important research issue for distributed remote sensing computing. This paper proposes LBM-RS, an efficient distributed framework based on load-balancing matrix computing for remote sensing. It implements remote sensing applications based on the distributed matrix, representing the algorithms with a matrix computation and constructing multi-dimensional spatial domains to model computational costs for matrix operation tasks. It resolves the CIT with the minimum computation load and dynamic spatial domain decomposition strategy to support global load balancing. We also exploit the IO efficiency from the task staging strategy and the cache-aware memory structure for remote sensing data. In this way, it can reduce the bandwidth burden and memory access frequency, thus decreasing the overall CIT. Finally, we evaluate the proposed approach on both real and synthetic datasets, and the results demonstrate significant advantages in computation and communication efficiency compared to the benchmarks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
19.90
自引率
2.70%
发文量
376
审稿时长
10.6 months
期刊介绍: Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications. Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration. Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.
期刊最新文献
Self-sovereign identity framework with user-friendly private key generation and rule table Accelerating complex graph queries by summary-based hybrid partitioning for discovering vulnerabilities of distribution equipment DNA: Dual-radio Dual-constraint Node Activation scheduling for energy-efficient data dissemination in IoT Blending lossy and lossless data compression methods to support health data streaming in smart cities Energy–time modelling of distributed multi-population genetic algorithms with dynamic workload in HPC clusters
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1