解开图像在浑浊介质中传输的非定位性。

IF 3.2 2区 物理与天体物理 Q2 OPTICS Optics express Pub Date : 2024-07-15 DOI:10.1364/OE.521581
Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello
{"title":"解开图像在浑浊介质中传输的非定位性。","authors":"Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello","doi":"10.1364/OE.521581","DOIUrl":null,"url":null,"abstract":"<p><p>Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"32 15","pages":"26414-26433"},"PeriodicalIF":3.2000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unwrapping non-locality in the image transmission through turbid media.\",\"authors\":\"Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello\",\"doi\":\"10.1364/OE.521581\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.</p>\",\"PeriodicalId\":19691,\"journal\":{\"name\":\"Optics express\",\"volume\":\"32 15\",\"pages\":\"26414-26433\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics express\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/OE.521581\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.521581","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

摘要

在浑浊介质中实现高保真图像传输是人工智能和光子/光学领域面临的一项重大挑战。虽然这种能力有望用于数据传输、神经内窥镜和基于多模光纤的成像等多种应用,但传统的深度学习方法难以捕捉光传播的细微差别,导致泛化能力较弱,重建性能有限。为了解决这一局限性,我们研究了重建图像中存在的非位置性,发现传统的深度学习方法依赖于从训练数据集中提取的特定特征,而不是细致地重建每个像素。这表明,这些方法无法有效捕捉像素之间的长距离依赖关系,而这对于准确重建图像至关重要。受光在浑浊介质中传播的物理学原理启发,我们开发了一种全局注意力机制,从更广阔的视角来解决这一问题。我们的网络利用了输入和输出光纤面上特殊的非局部特征所产生的信息冗余。这种机制使性能提升了两个数量级,并高度忠实于数据背景,确保在像素到像素的重建中准确呈现复杂的细节,而不仅仅是损耗最小化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Unwrapping non-locality in the image transmission through turbid media.

Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Optics express
Optics express 物理-光学
CiteScore
6.60
自引率
15.80%
发文量
5182
审稿时长
2.1 months
期刊介绍: Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.
期刊最新文献
Adaptive generation of optical single-sideband signal with dually modulated EML. Manipulating reflection-type all-dielectric non-local metasurfaces via the parity of a particle number. SSBI counteraction technology in a single photodetector-based direct detection system receiving an independent dual-single sideband signal. Adaptive-modulated fast fluctuation super-resolution microscopy. Measurement and analysis of photoacoustic pressure induced by weak microsecond pulsed light.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1