ELunarDTMNet:从单视角轨道器图像高效重建高分辨率月球 DTM

IF 8.6 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-11-18 DOI:10.1109/TGRS.2024.3501153
Hao Chen;Philipp Gläser;Xuanyu Hu;Konrad Willner;Yongjie Zheng;Friedrich Damme;Lorenzo Bruzzone;Jürgen Oberst
{"title":"ELunarDTMNet:从单视角轨道器图像高效重建高分辨率月球 DTM","authors":"Hao Chen;Philipp Gläser;Xuanyu Hu;Konrad Willner;Yongjie Zheng;Friedrich Damme;Lorenzo Bruzzone;Jürgen Oberst","doi":"10.1109/TGRS.2024.3501153","DOIUrl":null,"url":null,"abstract":"High-resolution digital terrain models (DTMs) are critical for supporting planetary exploration missions and advancing scientific research. Recently, deep learning (DL) techniques have been applied to reconstruct high-resolution DTMs from single-view orbiter optical images, particularly for the Moon. However, DL-based methods face challenges in retrieving high-quality multiscale topographic features, especially in regions with irregular terrains or significant relief. Additionally, their generalization capability across diverse datasets is rarely evaluated. In this article, we propose an efficient DL-based single-view method with a coarse-resolution DTM as a constraint for high-quality lunar DTM reconstruction, named ELunarDTMNet. This approach introduces a hierarchical transformer-based backbone with a residual-connected mechanism, specifically designed to capture and integrate multiscale features from single-view lunar images, thereby enhancing prediction accuracy. Meanwhile, given the diverse and complex surface relief, new elevation normalization strategies are proposed to preserve terrain feature contrast while accommodating different elevation distributions. Our method performs well on diverse lunar landscapes with various topographic features and elevation changes. It outperforms the existing DL-based methods in accuracy and detail, effectively addressing their encountered challenges. Moreover, the proposed method achieves effective resolutions similar to those of the shape-from-shading (SFS) technique for subtle-scale terrain retrieval, but with enhanced elevation accuracy, illumination robustness, and approximately \n<inline-formula> <tex-math>$850\\times $ </tex-math></inline-formula>\n faster processing speed. Trained with the lunar reconnaissance orbiter (LRO) narrow angle camera (NAC) images, our model shows superior performance on other high-resolution lunar orbiter images, such as Chang’E-2 imagery.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-20"},"PeriodicalIF":8.6000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10755220","citationCount":"0","resultStr":"{\"title\":\"ELunarDTMNet: Efficient Reconstruction of High-Resolution Lunar DTM From Single-View Orbiter Images\",\"authors\":\"Hao Chen;Philipp Gläser;Xuanyu Hu;Konrad Willner;Yongjie Zheng;Friedrich Damme;Lorenzo Bruzzone;Jürgen Oberst\",\"doi\":\"10.1109/TGRS.2024.3501153\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-resolution digital terrain models (DTMs) are critical for supporting planetary exploration missions and advancing scientific research. Recently, deep learning (DL) techniques have been applied to reconstruct high-resolution DTMs from single-view orbiter optical images, particularly for the Moon. However, DL-based methods face challenges in retrieving high-quality multiscale topographic features, especially in regions with irregular terrains or significant relief. Additionally, their generalization capability across diverse datasets is rarely evaluated. In this article, we propose an efficient DL-based single-view method with a coarse-resolution DTM as a constraint for high-quality lunar DTM reconstruction, named ELunarDTMNet. This approach introduces a hierarchical transformer-based backbone with a residual-connected mechanism, specifically designed to capture and integrate multiscale features from single-view lunar images, thereby enhancing prediction accuracy. Meanwhile, given the diverse and complex surface relief, new elevation normalization strategies are proposed to preserve terrain feature contrast while accommodating different elevation distributions. Our method performs well on diverse lunar landscapes with various topographic features and elevation changes. It outperforms the existing DL-based methods in accuracy and detail, effectively addressing their encountered challenges. Moreover, the proposed method achieves effective resolutions similar to those of the shape-from-shading (SFS) technique for subtle-scale terrain retrieval, but with enhanced elevation accuracy, illumination robustness, and approximately \\n<inline-formula> <tex-math>$850\\\\times $ </tex-math></inline-formula>\\n faster processing speed. Trained with the lunar reconnaissance orbiter (LRO) narrow angle camera (NAC) images, our model shows superior performance on other high-resolution lunar orbiter images, such as Chang’E-2 imagery.\",\"PeriodicalId\":13213,\"journal\":{\"name\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"volume\":\"62 \",\"pages\":\"1-20\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10755220\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10755220/\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10755220/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

高分辨率数字地形模型(dtm)对于支持行星探测任务和推进科学研究至关重要。最近,深度学习(DL)技术已被应用于从单视图轨道器光学图像重建高分辨率dtm,特别是月球。然而,基于dl的方法在检索高质量的多尺度地形特征方面面临挑战,特别是在地形不规则或起伏较大的地区。此外,它们在不同数据集上的泛化能力很少被评估。在本文中,我们提出了一种高效的基于dl的单视图方法,以粗分辨率DTM作为约束,用于高质量的月球DTM重建,命名为ELunarDTMNet。该方法引入了基于分层变压器的骨干网和残差连接机制,专门用于捕获和整合单视图月球图像的多尺度特征,从而提高预测精度。同时,针对地形起伏的多样性和复杂性,提出了新的高程归一化策略,在保持地形特征对比的同时适应不同的高程分布。我们的方法在具有不同地形特征和高程变化的不同月球景观上表现良好。它在准确性和细节上优于现有的基于dl的方法,有效地解决了他们遇到的挑战。此外,该方法在小尺度地形检索中获得了与形状-阴影(SFS)技术相似的有效分辨率,但具有更高的高程精度、光照鲁棒性和大约850倍的处理速度。在月球侦察轨道器(LRO)窄角相机(NAC)图像的训练下,我们的模型在其他高分辨率月球轨道器图像(如嫦娥2号图像)上显示出优越的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
ELunarDTMNet: Efficient Reconstruction of High-Resolution Lunar DTM From Single-View Orbiter Images
High-resolution digital terrain models (DTMs) are critical for supporting planetary exploration missions and advancing scientific research. Recently, deep learning (DL) techniques have been applied to reconstruct high-resolution DTMs from single-view orbiter optical images, particularly for the Moon. However, DL-based methods face challenges in retrieving high-quality multiscale topographic features, especially in regions with irregular terrains or significant relief. Additionally, their generalization capability across diverse datasets is rarely evaluated. In this article, we propose an efficient DL-based single-view method with a coarse-resolution DTM as a constraint for high-quality lunar DTM reconstruction, named ELunarDTMNet. This approach introduces a hierarchical transformer-based backbone with a residual-connected mechanism, specifically designed to capture and integrate multiscale features from single-view lunar images, thereby enhancing prediction accuracy. Meanwhile, given the diverse and complex surface relief, new elevation normalization strategies are proposed to preserve terrain feature contrast while accommodating different elevation distributions. Our method performs well on diverse lunar landscapes with various topographic features and elevation changes. It outperforms the existing DL-based methods in accuracy and detail, effectively addressing their encountered challenges. Moreover, the proposed method achieves effective resolutions similar to those of the shape-from-shading (SFS) technique for subtle-scale terrain retrieval, but with enhanced elevation accuracy, illumination robustness, and approximately $850\times $ faster processing speed. Trained with the lunar reconnaissance orbiter (LRO) narrow angle camera (NAC) images, our model shows superior performance on other high-resolution lunar orbiter images, such as Chang’E-2 imagery.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Fine-Scale Structure Reconstruction of Weather Radar Echoes via Blind Super-Resolution Generalized Iterative Sparse Maximum Likelihood Algorithm for the Detection of Buried Targets Unsupervised Snowy-Weather Point Cloud Denoising via Two-Stage Filter-Network Collaboration Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection OAADet: One-stage Anchor-free Arbitrary Oriented Object Detector via Center-ness Shift Correction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1