Generative approach for lensless imaging in low-light conditions.

IF 3.3 2区 物理与天体物理 Q2 OPTICS Optics express Pub Date : 2025-01-27 DOI:10.1364/OE.544875
Ziyang Liu, Tianjiao Zeng, Xu Zhan, Xiaoling Zhang, Edmund Y Lam
{"title":"Generative approach for lensless imaging in low-light conditions.","authors":"Ziyang Liu, Tianjiao Zeng, Xu Zhan, Xiaoling Zhang, Edmund Y Lam","doi":"10.1364/OE.544875","DOIUrl":null,"url":null,"abstract":"<p><p>Lensless imaging offers a lightweight, compact alternative to traditional lens-based systems, ideal for exploration in space-constrained environments. However, the absence of a focusing lens and limited lighting in such environments often results in low-light conditions, where the measurements suffer from complex noise interference due to insufficient capture of photons. This study presents a robust reconstruction method for high-quality imaging in low-light scenarios, employing two complementary perspectives: model-driven and data-driven. First, we apply a physics-model-driven perspective to reconstruct the range space of the pseudo-inverse of the measurement model-as a first guidance to extract information in the noisy measurements. Then, we integrate a generative-model-based perspective to suppress residual noises-as the second guidance to suppress noises in the initial noisy results. Specifically, a learnable Wiener filter-based module generates an initial, noisy reconstruction. Then, for fast and, more importantly, stable generation of the clear image from the noisy version, we implement a modified conditional generative diffusion module. This module converts the raw image into the latent wavelet domain for efficiency and uses modified bidirectional training processes for stabilization. Simulations and real-world experiments demonstrate substantial improvements in overall visual quality, advancing lensless imaging in challenging low-light environments.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"33 2","pages":"3021-3039"},"PeriodicalIF":3.3000,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.544875","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Lensless imaging offers a lightweight, compact alternative to traditional lens-based systems, ideal for exploration in space-constrained environments. However, the absence of a focusing lens and limited lighting in such environments often results in low-light conditions, where the measurements suffer from complex noise interference due to insufficient capture of photons. This study presents a robust reconstruction method for high-quality imaging in low-light scenarios, employing two complementary perspectives: model-driven and data-driven. First, we apply a physics-model-driven perspective to reconstruct the range space of the pseudo-inverse of the measurement model-as a first guidance to extract information in the noisy measurements. Then, we integrate a generative-model-based perspective to suppress residual noises-as the second guidance to suppress noises in the initial noisy results. Specifically, a learnable Wiener filter-based module generates an initial, noisy reconstruction. Then, for fast and, more importantly, stable generation of the clear image from the noisy version, we implement a modified conditional generative diffusion module. This module converts the raw image into the latent wavelet domain for efficiency and uses modified bidirectional training processes for stabilization. Simulations and real-world experiments demonstrate substantial improvements in overall visual quality, advancing lensless imaging in challenging low-light environments.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
低光条件下无透镜成像的生成方法。
无透镜成像为传统的基于透镜的系统提供了一种轻便、紧凑的替代方案,非常适合在空间受限的环境中进行探索。然而,在这样的环境中,没有聚焦透镜和有限的照明通常会导致低光条件,在这种情况下,由于光子捕获不足,测量会受到复杂的噪声干扰。本研究采用模型驱动和数据驱动两种互补的视角,提出了一种用于低光场景下高质量成像的鲁棒重建方法。首先,我们应用物理模型驱动的视角重构测量模型伪逆的距离空间,作为在噪声测量中提取信息的第一个指导。然后,我们整合了基于生成模型的视角来抑制残余噪声,作为抑制初始噪声结果中的噪声的第二次指导。具体来说,一个可学习的基于维纳滤波器的模块产生一个初始的、有噪声的重构。然后,为了快速,更重要的是,稳定地从噪声版本生成清晰图像,我们实现了一个改进的条件生成扩散模块。该模块将原始图像转换为潜在小波域以提高效率,并使用改进的双向训练过程来稳定。模拟和真实世界的实验证明了整体视觉质量的实质性改进,在具有挑战性的低光环境中推进无透镜成像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Optics express
Optics express 物理-光学
CiteScore
6.60
自引率
15.80%
发文量
5182
审稿时长
2.1 months
期刊介绍: Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.
期刊最新文献
Simple method of evaluating laser diode suitability for phase-noise-based QRNG. All-optical object classification using an edge-detecting spin-differential diffractive network. High-performance photodetection using one-step CVD-fabricated SnS/SnS2 heterostructure film. Achieving a non-destructive ultra-smooth surface using a CeO2 slurry modified with asphalt. All-optical logic gates for extreme ultraviolet switching via attosecond four-wave mixing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1