使用物理感知深度网络的高分辨率无透镜全息显微镜。

IF 3 3区 医学 Q2 BIOCHEMICAL RESEARCH METHODS Journal of Biomedical Optics Pub Date : 2024-10-01 Epub Date: 2024-10-08 DOI:10.1117/1.JBO.29.10.106502
Ashwini S Galande, Vikas Thapa, Aswathy Vijay, Renu John
{"title":"使用物理感知深度网络的高分辨率无透镜全息显微镜。","authors":"Ashwini S Galande, Vikas Thapa, Aswathy Vijay, Renu John","doi":"10.1117/1.JBO.29.10.106502","DOIUrl":null,"url":null,"abstract":"<p><strong>Significance: </strong>Lensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.</p><p><strong>Aim: </strong>We aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.</p><p><strong>Approach: </strong>We propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.</p><p><strong>Results: </strong>Simulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).</p><p><strong>Conclusions: </strong>We showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 10","pages":"106502"},"PeriodicalIF":3.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11460617/pdf/","citationCount":"0","resultStr":"{\"title\":\"High-resolution lensless holographic microscopy using a physics-aware deep network.\",\"authors\":\"Ashwini S Galande, Vikas Thapa, Aswathy Vijay, Renu John\",\"doi\":\"10.1117/1.JBO.29.10.106502\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Significance: </strong>Lensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.</p><p><strong>Aim: </strong>We aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.</p><p><strong>Approach: </strong>We propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.</p><p><strong>Results: </strong>Simulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).</p><p><strong>Conclusions: </strong>We showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.</p>\",\"PeriodicalId\":15264,\"journal\":{\"name\":\"Journal of Biomedical Optics\",\"volume\":\"29 10\",\"pages\":\"106502\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11460617/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Biomedical Optics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1117/1.JBO.29.10.106502\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/10/8 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"BIOCHEMICAL RESEARCH METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Biomedical Optics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1117/1.JBO.29.10.106502","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/8 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
引用次数: 0

摘要

意义重大:无透镜数字内联全息显微镜(LDIHM)是一种新兴的定量相位成像模式,它使用先进的计算方法从干涉图案中进行相位检索。现有的端到端深度网络需要具有足够多样性的大型训练数据集,才能实现高保真全息图重建。为缓解这一数据要求问题,物理感知深度网络在损失函数中集成了全息物理学,无需事先训练即可重建复杂对象。然而,数据保真度项衡量的是数据与单一低分辨率全息图的一致性,而没有任何外部正则化,这导致在复杂生物数据上的性能较低。Aim: We aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.Approach.We提出了混合深度框架(Hybrid deep framework, HDIHM):我们提出了一种混合深度框架(HDPhysNet),该框架采用即插即用的方法,将经过训练和未经训练的深度模型的优势结合起来,用于 LDIHM 中的相位恢复。高分辨率相位由预先训练好的高清生成对抗网络(HDGAN)从单张低分辨率全息图生成。然后将生成的相位插入物理感知的未训练深度网络的损失函数中,以调节复杂的物体重建过程:仿真结果表明,建议方法的 SSIM 比训练过的深度网络提高了 0.07,比未训练过的深度网络提高了 0.04。在实验生物细胞(宫颈细胞和红细胞)上,平均相位-SNR 比经过训练的深度模型提高了 8.2 dB,比未经训练的深度网络提高了 9.8 dB:与训练有素的网络(HDGAN)相比,我们发现 HDPhysNet 在面对成像参数(如传播距离、光源波长和成像样本)的未知扰动时性能有所提高。LDIHM 与 HDPhysNet 相结合,是一种便携式、技术驱动型显微镜,最适合用于护理点细胞学应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
High-resolution lensless holographic microscopy using a physics-aware deep network.

Significance: Lensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.

Aim: We aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.

Approach: We propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.

Results: Simulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).

Conclusions: We showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.40
自引率
5.70%
发文量
263
审稿时长
2 months
期刊介绍: The Journal of Biomedical Optics publishes peer-reviewed papers on the use of modern optical technology for improved health care and biomedical research.
期刊最新文献
Hyperspectral imaging in neurosurgery: a review of systems, computational methods, and clinical applications. Exploring near-infrared autofluorescence properties in parathyroid tissue: an analysis of fresh and paraffin-embedded thyroidectomy specimens. Impact of signal-to-noise ratio and contrast definition on the sensitivity assessment and benchmarking of fluorescence molecular imaging systems. Comparing spatial distributions of ALA-PpIX and indocyanine green in a whole pig brain glioma model using 3D fluorescence cryotomography. Detection properties of indium-111 and IRDye800CW for intraoperative molecular imaging use across tissue phantom models.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1