Jia Ge , Zongxin Mo , Shuangyang Zhang , Xiaoming Zhang , Yutian Zhong , Zhaoyong Liang , Chaobin Hu , Wufan Chen , Li Qi
{"title":"基于深度算法展开的多光谱稀疏采样光声层析成像的图像重建","authors":"Jia Ge , Zongxin Mo , Shuangyang Zhang , Xiaoming Zhang , Yutian Zhong , Zhaoyong Liang , Chaobin Hu , Wufan Chen , Li Qi","doi":"10.1016/j.pacs.2024.100618","DOIUrl":null,"url":null,"abstract":"<div><p>Photoacoustic tomography (PAT), as a novel medical imaging technology, provides structural, functional, and metabolism information of biological tissue <em>in vivo</em>. Sparse Sampling PAT, or SS-PAT, generates images with a smaller number of detectors, yet its image reconstruction is inherently ill-posed. Model-based methods are the state-of-the-art method for SS-PAT image reconstruction, but they require design of complex handcrafted prior. Owing to their ability to derive robust prior from labeled datasets, deep-learning-based methods have achieved great success in solving inverse problems, yet their interpretability is poor. Herein, we propose a novel SS-PAT image reconstruction method based on deep algorithm unrolling (DAU), which integrates the advantages of model-based and deep-learning-based methods. We firstly provide a thorough analysis of DAU for PAT reconstruction. Then, in order to incorporate the structural prior constraint, we propose a nested DAU framework based on plug-and-play Alternating Direction Method of Multipliers (PnP-ADMM) to deal with the sparse sampling problem. Experimental results on numerical simulation, <em>in vivo</em> animal imaging, and multispectral un-mixing demonstrate that the proposed DAU image reconstruction framework outperforms state-of-the-art model-based and deep-learning-based methods.</p></div>","PeriodicalId":56025,"journal":{"name":"Photoacoustics","volume":"38 ","pages":"Article 100618"},"PeriodicalIF":7.1000,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2213597924000351/pdfft?md5=420c66cc3cf3f00790c1db6e5a3a85e8&pid=1-s2.0-S2213597924000351-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Image reconstruction of multispectral sparse sampling photoacoustic tomography based on deep algorithm unrolling\",\"authors\":\"Jia Ge , Zongxin Mo , Shuangyang Zhang , Xiaoming Zhang , Yutian Zhong , Zhaoyong Liang , Chaobin Hu , Wufan Chen , Li Qi\",\"doi\":\"10.1016/j.pacs.2024.100618\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Photoacoustic tomography (PAT), as a novel medical imaging technology, provides structural, functional, and metabolism information of biological tissue <em>in vivo</em>. Sparse Sampling PAT, or SS-PAT, generates images with a smaller number of detectors, yet its image reconstruction is inherently ill-posed. Model-based methods are the state-of-the-art method for SS-PAT image reconstruction, but they require design of complex handcrafted prior. Owing to their ability to derive robust prior from labeled datasets, deep-learning-based methods have achieved great success in solving inverse problems, yet their interpretability is poor. Herein, we propose a novel SS-PAT image reconstruction method based on deep algorithm unrolling (DAU), which integrates the advantages of model-based and deep-learning-based methods. We firstly provide a thorough analysis of DAU for PAT reconstruction. Then, in order to incorporate the structural prior constraint, we propose a nested DAU framework based on plug-and-play Alternating Direction Method of Multipliers (PnP-ADMM) to deal with the sparse sampling problem. Experimental results on numerical simulation, <em>in vivo</em> animal imaging, and multispectral un-mixing demonstrate that the proposed DAU image reconstruction framework outperforms state-of-the-art model-based and deep-learning-based methods.</p></div>\",\"PeriodicalId\":56025,\"journal\":{\"name\":\"Photoacoustics\",\"volume\":\"38 \",\"pages\":\"Article 100618\"},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-06-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2213597924000351/pdfft?md5=420c66cc3cf3f00790c1db6e5a3a85e8&pid=1-s2.0-S2213597924000351-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Photoacoustics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2213597924000351\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Photoacoustics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213597924000351","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
摘要
光声断层成像(PAT)作为一种新型医学成像技术,可提供体内生物组织的结构、功能和代谢信息。稀疏采样 PAT(或 SS-PAT)能用较少的探测器生成图像,但其图像重建本身就存在问题。基于模型的方法是最先进的 SS-PAT 图像重建方法,但需要设计复杂的手工先验。基于深度学习的方法能够从标注数据集中获得稳健的先验,因此在解决逆问题方面取得了巨大成功,但其可解释性较差。在此,我们提出了一种基于深度算法展开(DAU)的新型 SS-PAT 图像重建方法,该方法综合了基于模型和基于深度学习方法的优点。我们首先全面分析了 DAU 在 PAT 重建中的应用。然后,为了纳入结构先验约束,我们提出了基于即插即用交替方向乘法(PnP-ADMM)的嵌套 DAU 框架,以处理稀疏采样问题。数值模拟、活体动物成像和多光谱非混合的实验结果表明,所提出的 DAU 图像重建框架优于最先进的基于模型和基于深度学习的方法。
Image reconstruction of multispectral sparse sampling photoacoustic tomography based on deep algorithm unrolling
Photoacoustic tomography (PAT), as a novel medical imaging technology, provides structural, functional, and metabolism information of biological tissue in vivo. Sparse Sampling PAT, or SS-PAT, generates images with a smaller number of detectors, yet its image reconstruction is inherently ill-posed. Model-based methods are the state-of-the-art method for SS-PAT image reconstruction, but they require design of complex handcrafted prior. Owing to their ability to derive robust prior from labeled datasets, deep-learning-based methods have achieved great success in solving inverse problems, yet their interpretability is poor. Herein, we propose a novel SS-PAT image reconstruction method based on deep algorithm unrolling (DAU), which integrates the advantages of model-based and deep-learning-based methods. We firstly provide a thorough analysis of DAU for PAT reconstruction. Then, in order to incorporate the structural prior constraint, we propose a nested DAU framework based on plug-and-play Alternating Direction Method of Multipliers (PnP-ADMM) to deal with the sparse sampling problem. Experimental results on numerical simulation, in vivo animal imaging, and multispectral un-mixing demonstrate that the proposed DAU image reconstruction framework outperforms state-of-the-art model-based and deep-learning-based methods.
PhotoacousticsPhysics and Astronomy-Atomic and Molecular Physics, and Optics
CiteScore
11.40
自引率
16.50%
发文量
96
审稿时长
53 days
期刊介绍:
The open access Photoacoustics journal (PACS) aims to publish original research and review contributions in the field of photoacoustics-optoacoustics-thermoacoustics. This field utilizes acoustical and ultrasonic phenomena excited by electromagnetic radiation for the detection, visualization, and characterization of various materials and biological tissues, including living organisms.
Recent advancements in laser technologies, ultrasound detection approaches, inverse theory, and fast reconstruction algorithms have greatly supported the rapid progress in this field. The unique contrast provided by molecular absorption in photoacoustic-optoacoustic-thermoacoustic methods has allowed for addressing unmet biological and medical needs such as pre-clinical research, clinical imaging of vasculature, tissue and disease physiology, drug efficacy, surgery guidance, and therapy monitoring.
Applications of this field encompass a wide range of medical imaging and sensing applications, including cancer, vascular diseases, brain neurophysiology, ophthalmology, and diabetes. Moreover, photoacoustics-optoacoustics-thermoacoustics is a multidisciplinary field, with contributions from chemistry and nanotechnology, where novel materials such as biodegradable nanoparticles, organic dyes, targeted agents, theranostic probes, and genetically expressed markers are being actively developed.
These advanced materials have significantly improved the signal-to-noise ratio and tissue contrast in photoacoustic methods.