Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang
{"title":"单像素成像的梯度下降模块指导重建扩散模型","authors":"Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang","doi":"10.1109/JPHOT.2024.3434972","DOIUrl":null,"url":null,"abstract":"Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.","PeriodicalId":13204,"journal":{"name":"IEEE Photonics Journal","volume":"16 4","pages":"1-10"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613365","citationCount":"0","resultStr":"{\"title\":\"Diffusion Model With Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging\",\"authors\":\"Chen Huang;Qiurong Yan;Jinwei Yan;Yi Li;Xiaolong Luo;Hui Wang\",\"doi\":\"10.1109/JPHOT.2024.3434972\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.\",\"PeriodicalId\":13204,\"journal\":{\"name\":\"IEEE Photonics Journal\",\"volume\":\"16 4\",\"pages\":\"1-10\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-07-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613365\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Photonics Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10613365/\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Photonics Journal","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10613365/","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Diffusion Model With Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging
Reconstructing high-quality images with few measurements has always been a primary goal for single-pixel imaging (SPI). Diffusion models have shown outstanding performance in image generation and have been effectively attempted in image reconstruction for ghost imaging. However, there is still a great deal of space for improvement in the quality of image reconstruction at low sampling rates. Inspired by the proximal gradient descent algorithm (PGD), we propose Diffusion Model with Gradient Descent Module Guiding Reconstruction for Single-Pixel Imaging. The gradient descent module in PGD is utilized for preliminary image reconstruction. The preliminary reconstruction serves as prior information to iteratively constrain the diffusion model, allowing it to generate target images consistent with the training data distribution. Additionally, the strong mapping ability of the diffusion model replaces the traditional proximal operator to accelerate convergence. Full connected sampling and convolutional sampling are proposed as alternative sampling methods to the traditional Gaussian random matrix sampling. Sampling and generation are optimized jointly to capture key image information and improve reconstruction accuracy. Simulations and experiments confirm that our proposed network can significantly improve the quality of image reconstruction at low measurement rates.
期刊介绍:
Breakthroughs in the generation of light and in its control and utilization have given rise to the field of Photonics, a rapidly expanding area of science and technology with major technological and economic impact. Photonics integrates quantum electronics and optics to accelerate progress in the generation of novel photon sources and in their utilization in emerging applications at the micro and nano scales spanning from the far-infrared/THz to the x-ray region of the electromagnetic spectrum. IEEE Photonics Journal is an online-only journal dedicated to the rapid disclosure of top-quality peer-reviewed research at the forefront of all areas of photonics. Contributions addressing issues ranging from fundamental understanding to emerging technologies and applications are within the scope of the Journal. The Journal includes topics in: Photon sources from far infrared to X-rays, Photonics materials and engineered photonic structures, Integrated optics and optoelectronic, Ultrafast, attosecond, high field and short wavelength photonics, Biophotonics, including DNA photonics, Nanophotonics, Magnetophotonics, Fundamentals of light propagation and interaction; nonlinear effects, Optical data storage, Fiber optics and optical communications devices, systems, and technologies, Micro Opto Electro Mechanical Systems (MOEMS), Microwave photonics, Optical Sensors.