{"title":"Learning-based sound speed estimation and aberration correction for linear-array photoacoustic imaging","authors":"Mengjie Shi, Tom Vercauteren, Wenfeng Xia","doi":"10.1016/j.pacs.2024.100621","DOIUrl":null,"url":null,"abstract":"<div><p>Photoacoustic (PA) image reconstruction involves acoustic inversion that necessitates the specification of the speed of sound (SoS) within the medium of propagation. Due to the lack of information on the spatial distribution of the SoS within heterogeneous soft tissue, a homogeneous SoS distribution (such as 1540 m/s) is typically assumed in PA image reconstruction, similar to that of ultrasound (US) imaging. Failure to compensate for the SoS variations leads to aberration artefacts, deteriorating the image quality. Various methods have been proposed to address this issue, but they usually involve complex hardware and/or time-consuming algorithms, hindering clinical translation. In this work, we introduce a deep learning framework for SoS estimation and subsequent aberration correction in a dual-modal PA/US imaging system exploiting a clinical US probe. As the acquired PA and US images were inherently co-registered, the estimated SoS distribution from US channel data using a deep neural network was incorporated for accurate PA image reconstruction. The framework comprised an initial pre-training stage based on digital phantoms, which was further enhanced through transfer learning using physical phantom data and associated SoS maps obtained from measurements. This framework achieved a root mean square error of 10.2 m/s and 15.2 m/s for SoS estimation on digital and physical phantoms, respectively and structural similarity index measures of up to 0.88 for PA reconstructions compared to the conventional approach of 0.69. A maximum of 1.2 times improvement in the signal-to-noise ratio of PA images was further demonstrated with a human volunteer study. Our results show that the proposed framework could be valuable in various clinical and preclinical applications to enhance PA image reconstruction.</p></div>","PeriodicalId":56025,"journal":{"name":"Photoacoustics","volume":"38 ","pages":"Article 100621"},"PeriodicalIF":7.1000,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2213597924000387/pdfft?md5=844d6db0a4eeb2f6382302c2869896cd&pid=1-s2.0-S2213597924000387-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Photoacoustics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213597924000387","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Photoacoustic (PA) image reconstruction involves acoustic inversion that necessitates the specification of the speed of sound (SoS) within the medium of propagation. Due to the lack of information on the spatial distribution of the SoS within heterogeneous soft tissue, a homogeneous SoS distribution (such as 1540 m/s) is typically assumed in PA image reconstruction, similar to that of ultrasound (US) imaging. Failure to compensate for the SoS variations leads to aberration artefacts, deteriorating the image quality. Various methods have been proposed to address this issue, but they usually involve complex hardware and/or time-consuming algorithms, hindering clinical translation. In this work, we introduce a deep learning framework for SoS estimation and subsequent aberration correction in a dual-modal PA/US imaging system exploiting a clinical US probe. As the acquired PA and US images were inherently co-registered, the estimated SoS distribution from US channel data using a deep neural network was incorporated for accurate PA image reconstruction. The framework comprised an initial pre-training stage based on digital phantoms, which was further enhanced through transfer learning using physical phantom data and associated SoS maps obtained from measurements. This framework achieved a root mean square error of 10.2 m/s and 15.2 m/s for SoS estimation on digital and physical phantoms, respectively and structural similarity index measures of up to 0.88 for PA reconstructions compared to the conventional approach of 0.69. A maximum of 1.2 times improvement in the signal-to-noise ratio of PA images was further demonstrated with a human volunteer study. Our results show that the proposed framework could be valuable in various clinical and preclinical applications to enhance PA image reconstruction.
光声(PA)图像重建涉及声学反转,需要指定传播介质中的声速(SoS)。由于缺乏有关异质软组织内声速空间分布的信息,在 PA 图像重建中通常假定声速分布均匀(如 1540 米/秒),这与超声(US)成像类似。如果不对 SoS 变化进行补偿,就会产生像差伪影,从而降低图像质量。为解决这一问题,人们提出了各种方法,但这些方法通常涉及复杂的硬件和/或耗时的算法,阻碍了临床应用。在这项工作中,我们利用临床 US 探头,在 PA/US 双模态成像系统中引入了用于 SoS 估计和后续像差校正的深度学习框架。由于获取的 PA 和 US 图像本质上是共同注册的,因此使用深度神经网络从 US 信道数据中估算 SoS 分布,以实现准确的 PA 图像重建。该框架包括一个基于数字模型的初始预训练阶段,通过使用物理模型数据和从测量中获得的相关 SoS 地图进行迁移学习,进一步加强了预训练。与传统方法的 0.69 相比,该框架在数字模型和物理模型上的 SoS 估算均方根误差分别为 10.2 m/s 和 15.2 m/s,PA 重建的结构相似性指数高达 0.88。人体志愿者研究进一步证明,PA 图像的信噪比最多可提高 1.2 倍。我们的研究结果表明,所提出的框架可以在各种临床和临床前应用中提高 PA 图像重建的价值。
PhotoacousticsPhysics and Astronomy-Atomic and Molecular Physics, and Optics
CiteScore
11.40
自引率
16.50%
发文量
96
审稿时长
53 days
期刊介绍:
The open access Photoacoustics journal (PACS) aims to publish original research and review contributions in the field of photoacoustics-optoacoustics-thermoacoustics. This field utilizes acoustical and ultrasonic phenomena excited by electromagnetic radiation for the detection, visualization, and characterization of various materials and biological tissues, including living organisms.
Recent advancements in laser technologies, ultrasound detection approaches, inverse theory, and fast reconstruction algorithms have greatly supported the rapid progress in this field. The unique contrast provided by molecular absorption in photoacoustic-optoacoustic-thermoacoustic methods has allowed for addressing unmet biological and medical needs such as pre-clinical research, clinical imaging of vasculature, tissue and disease physiology, drug efficacy, surgery guidance, and therapy monitoring.
Applications of this field encompass a wide range of medical imaging and sensing applications, including cancer, vascular diseases, brain neurophysiology, ophthalmology, and diabetes. Moreover, photoacoustics-optoacoustics-thermoacoustics is a multidisciplinary field, with contributions from chemistry and nanotechnology, where novel materials such as biodegradable nanoparticles, organic dyes, targeted agents, theranostic probes, and genetically expressed markers are being actively developed.
These advanced materials have significantly improved the signal-to-noise ratio and tissue contrast in photoacoustic methods.