ELunarDTMNet: Efficient Reconstruction of High-Resolution Lunar DTM From Single-View Orbiter Images

IF 8.6 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-11-18 DOI:10.1109/TGRS.2024.3501153
Hao Chen;Philipp Gläser;Xuanyu Hu;Konrad Willner;Yongjie Zheng;Friedrich Damme;Lorenzo Bruzzone;Jürgen Oberst
{"title":"ELunarDTMNet: Efficient Reconstruction of High-Resolution Lunar DTM From Single-View Orbiter Images","authors":"Hao Chen;Philipp Gläser;Xuanyu Hu;Konrad Willner;Yongjie Zheng;Friedrich Damme;Lorenzo Bruzzone;Jürgen Oberst","doi":"10.1109/TGRS.2024.3501153","DOIUrl":null,"url":null,"abstract":"High-resolution digital terrain models (DTMs) are critical for supporting planetary exploration missions and advancing scientific research. Recently, deep learning (DL) techniques have been applied to reconstruct high-resolution DTMs from single-view orbiter optical images, particularly for the Moon. However, DL-based methods face challenges in retrieving high-quality multiscale topographic features, especially in regions with irregular terrains or significant relief. Additionally, their generalization capability across diverse datasets is rarely evaluated. In this article, we propose an efficient DL-based single-view method with a coarse-resolution DTM as a constraint for high-quality lunar DTM reconstruction, named ELunarDTMNet. This approach introduces a hierarchical transformer-based backbone with a residual-connected mechanism, specifically designed to capture and integrate multiscale features from single-view lunar images, thereby enhancing prediction accuracy. Meanwhile, given the diverse and complex surface relief, new elevation normalization strategies are proposed to preserve terrain feature contrast while accommodating different elevation distributions. Our method performs well on diverse lunar landscapes with various topographic features and elevation changes. It outperforms the existing DL-based methods in accuracy and detail, effectively addressing their encountered challenges. Moreover, the proposed method achieves effective resolutions similar to those of the shape-from-shading (SFS) technique for subtle-scale terrain retrieval, but with enhanced elevation accuracy, illumination robustness, and approximately \n<inline-formula> <tex-math>$850\\times $ </tex-math></inline-formula>\n faster processing speed. Trained with the lunar reconnaissance orbiter (LRO) narrow angle camera (NAC) images, our model shows superior performance on other high-resolution lunar orbiter images, such as Chang’E-2 imagery.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-20"},"PeriodicalIF":8.6000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10755220","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10755220/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

High-resolution digital terrain models (DTMs) are critical for supporting planetary exploration missions and advancing scientific research. Recently, deep learning (DL) techniques have been applied to reconstruct high-resolution DTMs from single-view orbiter optical images, particularly for the Moon. However, DL-based methods face challenges in retrieving high-quality multiscale topographic features, especially in regions with irregular terrains or significant relief. Additionally, their generalization capability across diverse datasets is rarely evaluated. In this article, we propose an efficient DL-based single-view method with a coarse-resolution DTM as a constraint for high-quality lunar DTM reconstruction, named ELunarDTMNet. This approach introduces a hierarchical transformer-based backbone with a residual-connected mechanism, specifically designed to capture and integrate multiscale features from single-view lunar images, thereby enhancing prediction accuracy. Meanwhile, given the diverse and complex surface relief, new elevation normalization strategies are proposed to preserve terrain feature contrast while accommodating different elevation distributions. Our method performs well on diverse lunar landscapes with various topographic features and elevation changes. It outperforms the existing DL-based methods in accuracy and detail, effectively addressing their encountered challenges. Moreover, the proposed method achieves effective resolutions similar to those of the shape-from-shading (SFS) technique for subtle-scale terrain retrieval, but with enhanced elevation accuracy, illumination robustness, and approximately $850\times $ faster processing speed. Trained with the lunar reconnaissance orbiter (LRO) narrow angle camera (NAC) images, our model shows superior performance on other high-resolution lunar orbiter images, such as Chang’E-2 imagery.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
ELunarDTMNet:从单视角轨道器图像高效重建高分辨率月球 DTM
高分辨率数字地形模型(dtm)对于支持行星探测任务和推进科学研究至关重要。最近,深度学习(DL)技术已被应用于从单视图轨道器光学图像重建高分辨率dtm,特别是月球。然而,基于dl的方法在检索高质量的多尺度地形特征方面面临挑战,特别是在地形不规则或起伏较大的地区。此外,它们在不同数据集上的泛化能力很少被评估。在本文中,我们提出了一种高效的基于dl的单视图方法,以粗分辨率DTM作为约束,用于高质量的月球DTM重建,命名为ELunarDTMNet。该方法引入了基于分层变压器的骨干网和残差连接机制,专门用于捕获和整合单视图月球图像的多尺度特征,从而提高预测精度。同时,针对地形起伏的多样性和复杂性,提出了新的高程归一化策略,在保持地形特征对比的同时适应不同的高程分布。我们的方法在具有不同地形特征和高程变化的不同月球景观上表现良好。它在准确性和细节上优于现有的基于dl的方法,有效地解决了他们遇到的挑战。此外,该方法在小尺度地形检索中获得了与形状-阴影(SFS)技术相似的有效分辨率,但具有更高的高程精度、光照鲁棒性和大约850倍的处理速度。在月球侦察轨道器(LRO)窄角相机(NAC)图像的训练下,我们的模型在其他高分辨率月球轨道器图像(如嫦娥2号图像)上显示出优越的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Mamba-MPSE: Multi-Pattern State Evolution Based on the Mamba Model for Intra-Class Heterogeneous Wetland Classification with UAV Hyperspectral Imagery Physics-Constrained Adapter-Tuning of Meteorological Foundation Models for Global SST Forecasting ReflectGAN: Modeling Vegetation Effects for Soil Carbon Estimation from Satellite Imagery Synergizing Smoke and Hotspot: A Visible-Infrared Co-Learning Framework with Dataset for Large-Scale Wildfire Detection Probabilistic Fusion Framework Based on Fully Convolutional Networks and Graphical Models for Burnt Area Detection from Multiresolution Satellite and UAV Imagery
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1