Jitter-Aware Restoration With Equivalent Jitter Model for Remote Sensing Push-Broom Image

IF 9.4 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2025-01-15 DOI:10.1109/TGRS.2025.3529671
Ziran Zhang;Zida Chen;Die Hu;Menghao Li;Zhihai Xu;Huajun Feng;Qi Li;Yueting Chen
{"title":"Jitter-Aware Restoration With Equivalent Jitter Model for Remote Sensing Push-Broom Image","authors":"Ziran Zhang;Zida Chen;Die Hu;Menghao Li;Zhihai Xu;Huajun Feng;Qi Li;Yueting Chen","doi":"10.1109/TGRS.2025.3529671","DOIUrl":null,"url":null,"abstract":"Push-broom imaging systems, including linear array (LA) and time delay integration (TDI) sensors, are extensively used in remote sensing for high-resolution image acquisition with continuous spatial coverage. However, platform-induced jitter introduces significant distortions and blurring, especially in TDI systems with multiple integration stages, where the cumulative effects of jitter are more pronounced. Traditional jitter models often struggle to accurately simulate these effects in the presence of measurement noise, hindering effective image restoration. In this article, we propose a novel jitter-aware restoration framework that addresses these challenges in both LA and TDI push-broom imaging systems. Central to our approach is the introduction of an equivalent jitter model (EJM) that is robust to measurement noise. By averaging time-shifted jitter curves across multiple integration stages, the EJM effectively smooths out noise-induced fluctuations, providing a reliable characterization of jitter effects. Leveraging this model, we develop a jitter-aware restoration network (JARNet), a two-stage restoration network that combines optical flow correction (OFC) with spatial-frequency residual learning to mitigate geometric distortions and motion blur. We also design a custom data synthesis pipeline to generate realistic jitter-degraded datasets, facilitating effective training of the network. Experimental results on both synthetic LA and TDI datasets demonstrate that JARNet outperforms state-of-the-art methods in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and gradient magnitude similarity deviation (GMSD) metrics. Our framework offers a robust solution for restoring high-quality remote sensing images degraded by jitter, significantly advancing the state-of-the-art in this domain. The source code will be made publicly available upon publication at <uri>https://github.com/naturezhanghn/EJM</uri>.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"63 ","pages":"1-14"},"PeriodicalIF":9.4000,"publicationDate":"2025-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10841472/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Push-broom imaging systems, including linear array (LA) and time delay integration (TDI) sensors, are extensively used in remote sensing for high-resolution image acquisition with continuous spatial coverage. However, platform-induced jitter introduces significant distortions and blurring, especially in TDI systems with multiple integration stages, where the cumulative effects of jitter are more pronounced. Traditional jitter models often struggle to accurately simulate these effects in the presence of measurement noise, hindering effective image restoration. In this article, we propose a novel jitter-aware restoration framework that addresses these challenges in both LA and TDI push-broom imaging systems. Central to our approach is the introduction of an equivalent jitter model (EJM) that is robust to measurement noise. By averaging time-shifted jitter curves across multiple integration stages, the EJM effectively smooths out noise-induced fluctuations, providing a reliable characterization of jitter effects. Leveraging this model, we develop a jitter-aware restoration network (JARNet), a two-stage restoration network that combines optical flow correction (OFC) with spatial-frequency residual learning to mitigate geometric distortions and motion blur. We also design a custom data synthesis pipeline to generate realistic jitter-degraded datasets, facilitating effective training of the network. Experimental results on both synthetic LA and TDI datasets demonstrate that JARNet outperforms state-of-the-art methods in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and gradient magnitude similarity deviation (GMSD) metrics. Our framework offers a robust solution for restoring high-quality remote sensing images degraded by jitter, significantly advancing the state-of-the-art in this domain. The source code will be made publicly available upon publication at https://github.com/naturezhanghn/EJM.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用等效抖动模型对遥感推帚图像进行抖动感知修复
推扫帚成像系统包括线性阵列(LA)和时延集成(TDI)传感器,广泛应用于遥感领域,用于连续空间覆盖的高分辨率图像采集。然而,平台引起的抖动会引入明显的失真和模糊,特别是在具有多个集成阶段的TDI系统中,其中抖动的累积效应更为明显。在存在测量噪声的情况下,传统的抖动模型往往难以准确地模拟这些影响,从而阻碍了有效的图像恢复。在本文中,我们提出了一种新的抖动感知恢复框架,以解决LA和TDI推扫帚成像系统中的这些挑战。我们方法的核心是引入等效抖动模型(EJM),该模型对测量噪声具有鲁棒性。通过对多个积分阶段的时移抖动曲线进行平均,EJM有效地平滑了噪声引起的波动,提供了抖动效果的可靠表征。利用该模型,我们开发了一个抖动感知恢复网络(JARNet),这是一个结合光流校正(OFC)和空间频率残差学习的两阶段恢复网络,以减轻几何扭曲和运动模糊。我们还设计了一个自定义的数据合成管道来生成真实的抖动退化数据集,促进网络的有效训练。在合成LA和TDI数据集上的实验结果表明,JARNet在峰值信噪比(PSNR)、结构相似指数(SSIM)和梯度幅度相似偏差(GMSD)指标方面优于最先进的方法。我们的框架提供了一个强大的解决方案,用于恢复高质量的抖动退化遥感图像,显著推进了该领域的最新技术。源代码将在https://github.com/naturezhanghn/EJM上公开发布。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Physics-Aware Multimodal Fusion Framework for Seamless Coastal Wind Retrieval based on Spaceborne GNSS-R SCALMU: Synthetically-trained Coupling of Adaptive Learned Multiplicative Updates for Hyperspectral-Multispectral Fusion CC-ICP: Cylinder-Constrained Iterative Closest Point for Robust Forest Point Cloud Registration Hierarchical State Space Model for Semantic Oriented Remote Sensing Image Super-Resolution An Incremental Learning Framework Linking Reanalysis and Radar Data for Passive Microwave Precipitation Retrievals
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1