单像素成像的梯度下降模块指导重建扩散模型

IF 2.1 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Photonics Journal Pub Date : 2024-07-29 DOI:10.1109/JPHOT.2024.3434972
Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang
{"title":"单像素成像的梯度下降模块指导重建扩散模型","authors":"Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang","doi":"10.1109/JPHOT.2024.3434972","DOIUrl":null,"url":null,"abstract":"Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.","PeriodicalId":13204,"journal":{"name":"IEEE Photonics Journal","volume":"16 4","pages":"1-10"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613365","citationCount":"0","resultStr":"{\"title\":\"Diffusion Model With Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging\",\"authors\":\"Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang\",\"doi\":\"10.1109/JPHOT.2024.3434972\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.\",\"PeriodicalId\":13204,\"journal\":{\"name\":\"IEEE Photonics Journal\",\"volume\":\"16 4\",\"pages\":\"1-10\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-07-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613365\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Photonics Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10613365/\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Photonics Journal","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10613365/","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

以少量测量重建高质量图像一直是单像素成像(SPI)的首要目标。扩散模型在图像生成方面表现出色,并在重影成像的图像重建中得到了有效尝试。然而,低采样率下的图像重建质量仍有很大的提升空间。受近端梯度下降算法(PGD)的启发,我们提出了带有梯度下降模块的扩散模型,用于指导单像素成像重建。PGD 中的梯度下降模块用于初步图像重建。初步重建作为先验信息对扩散模型进行迭代约束,使其能够生成与训练数据分布一致的目标图像。此外,扩散模型的强大映射能力取代了传统的近端算子,从而加快了收敛速度。提出了全连接采样和卷积采样作为传统高斯随机矩阵采样的替代采样方法。对采样和生成进行了联合优化,以捕捉关键图像信息并提高重建精度。模拟和实验证实,我们提出的网络能在低测量速率下显著提高图像重建质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Diffusion Model With Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging
Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Photonics Journal
IEEE Photonics Journal ENGINEERING, ELECTRICAL & ELECTRONIC-OPTICS
CiteScore
4.50
自引率
8.30%
发文量
489
审稿时长
1.4 months
期刊介绍: Breakthroughs in the generation of light and in its control and utilization have given rise to the field of Photonics, a rapidly expanding area of science and technology with major technological and economic impact. Photonics integrates quantum electronics and optics to accelerate progress in the generation of novel photon sources and in their utilization in emerging applications at the micro and nano scales spanning from the far-infrared/THz to the x-ray region of the electromagnetic spectrum. IEEE Photonics Journal is an online-only journal dedicated to the rapid disclosure of top-quality peer-reviewed research at the forefront of all areas of photonics. Contributions addressing issues ranging from fundamental understanding to emerging technologies and applications are within the scope of the Journal. The Journal includes topics in: Photon sources from far infrared to X-rays, Photonics materials and engineered photonic structures, Integrated optics and optoelectronic, Ultrafast, attosecond, high field and short wavelength photonics, Biophotonics, including DNA photonics, Nanophotonics, Magnetophotonics, Fundamentals of light propagation and interaction; nonlinear effects, Optical data storage, Fiber optics and optical communications devices, systems, and technologies, Micro Opto Electro Mechanical Systems (MOEMS), Microwave photonics, Optical Sensors.
期刊最新文献
Investigation of Entire-Space Terahertz Emission From Gas Filament Excited by a Two-Color Field High Precision Piston Error Sensing of Segmented Telescope Based on Frequency Domain Filtering FSPI-R&D: Joint Reconstruction and Detection to Enhance the Object Detection Precision of Fourier Single-Pixel Imaging Integrated Physical Layer Key Distribution by Optical Steganography in Quantum Noise Stream Cipher System Defect Density-Dependent Dynamics of Double Absorber Layered Perovskite Solar Cell
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1