Rohan Nadkarni, Darin P Clark, Alex Jeffrey Allphin, Cristian T Badea
{"title":"研究用于 5D 心脏光子计数显微 CT 图像快速去噪的深度学习策略。","authors":"Rohan Nadkarni, Darin P Clark, Alex Jeffrey Allphin, Cristian T Badea","doi":"10.1088/1361-6560/ad7fc6","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>
Photon-counting detectors (PCDs) for CT imaging use energy thresholds to simultaneously acquire projections at multiple energies, making them suitable for spectral imaging and material decomposition. Unfortunately, setting multiple energy thresholds results in noisy analytical reconstructions due to low photon counts in high-energy bins. Iterative reconstruction provides high quality photon-counting CT (PCCT) images but requires enormous computation time for 5D (3D + energy + time) in vivo cardiac imaging. 

Approach. 
We recently introduced UnetU, a deep learning (DL) approach that accurately denoises axial slices from 4D (3D + energy) PCCT reconstructions at various acquisition settings. In this study, we explore UnetU configurations for 5D cardiac PCCT denoising, focusing on singular value decomposition (SVD) modifications along the energy and time dimensions and alternate network architectures such as 3D U-net, FastDVDNet, and Swin Transformer UNet. We compare our networks to multi-energy non-local means (ME NLM), an established PCCT denoising algorithm. 

Main results. 
Our evaluation, using real mouse data and the digital MOBY phantom, revealed that all DL methods were more than 16 times faster than iterative reconstruction. DL denoising with SVD along the energy dimension was most effective, consistently providing low root mean square error and spatio-temporal reduced reference entropic difference, alongside strong qualitative agreement with iterative reconstruction. This superiority was attributed to lower effective rank along the energy dimension than the time dimension in 5D cardiac PCCT reconstructions. ME NLM sometimes outperformed DL with time SVD or time and energy SVD, but lagged behind iterative reconstruction and DL with energy SVD. Among alternate DL architectures with energy SVD, none consistently outperformed UnetU Energy (2D). 

Significance. 
Our study establishes UnetU Energy as an accurate and efficient method for 5D cardiac PCCT denoising, offering a 32-fold speed increase from iterative reconstruction. This advancement sets a new benchmark for DL applications in cardiovascular imaging.</p>","PeriodicalId":20185,"journal":{"name":"Physics in medicine and biology","volume":null,"pages":null},"PeriodicalIF":3.3000,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Investigating deep learning strategies for fast denoising of 5D cardiac photon-counting micro-CT images.\",\"authors\":\"Rohan Nadkarni, Darin P Clark, Alex Jeffrey Allphin, Cristian T Badea\",\"doi\":\"10.1088/1361-6560/ad7fc6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>
Photon-counting detectors (PCDs) for CT imaging use energy thresholds to simultaneously acquire projections at multiple energies, making them suitable for spectral imaging and material decomposition. Unfortunately, setting multiple energy thresholds results in noisy analytical reconstructions due to low photon counts in high-energy bins. Iterative reconstruction provides high quality photon-counting CT (PCCT) images but requires enormous computation time for 5D (3D + energy + time) in vivo cardiac imaging. 

Approach. 
We recently introduced UnetU, a deep learning (DL) approach that accurately denoises axial slices from 4D (3D + energy) PCCT reconstructions at various acquisition settings. In this study, we explore UnetU configurations for 5D cardiac PCCT denoising, focusing on singular value decomposition (SVD) modifications along the energy and time dimensions and alternate network architectures such as 3D U-net, FastDVDNet, and Swin Transformer UNet. We compare our networks to multi-energy non-local means (ME NLM), an established PCCT denoising algorithm. 

Main results. 
Our evaluation, using real mouse data and the digital MOBY phantom, revealed that all DL methods were more than 16 times faster than iterative reconstruction. DL denoising with SVD along the energy dimension was most effective, consistently providing low root mean square error and spatio-temporal reduced reference entropic difference, alongside strong qualitative agreement with iterative reconstruction. This superiority was attributed to lower effective rank along the energy dimension than the time dimension in 5D cardiac PCCT reconstructions. ME NLM sometimes outperformed DL with time SVD or time and energy SVD, but lagged behind iterative reconstruction and DL with energy SVD. Among alternate DL architectures with energy SVD, none consistently outperformed UnetU Energy (2D). 

Significance. 
Our study establishes UnetU Energy as an accurate and efficient method for 5D cardiac PCCT denoising, offering a 32-fold speed increase from iterative reconstruction. This advancement sets a new benchmark for DL applications in cardiovascular imaging.</p>\",\"PeriodicalId\":20185,\"journal\":{\"name\":\"Physics in medicine and biology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2024-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physics in medicine and biology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1088/1361-6560/ad7fc6\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics in medicine and biology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6560/ad7fc6","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
摘要
目的:
用于 CT 成像的光子计数探测器(PCD)利用能量阈值同时获取多个能量的投影,使其适用于光谱成像和材料分解。遗憾的是,设置多个能量阈值会导致分析重建时出现噪声,原因是高能量区的光子计数较低。迭代重建可提供高质量的光子计数 CT(PCCT)图像,但对于 5D(3D + 能量 + 时间)活体心脏成像来说,需要耗费大量的计算时间。
方法。
我们最近推出了一种深度学习(DL)方法 UnetU,它能在各种采集设置下对 4D(3D + 能量)PCCT 重建的轴切片进行精确去噪。在本研究中,我们探索了用于 5D 心脏 PCCT 去噪的 UnetU 配置,重点是沿能量和时间维度的奇异值分解 (SVD) 修正,以及 3D U-net、FastDVDNet 和 Swin Transformer UNet 等替代网络架构。
主要结果。
我们使用真实小鼠数据和数字 MOBY 幻影进行评估,结果显示所有 DL 方法都比迭代重建快 16 倍以上。使用 SVD 对能量维度进行去噪的 DL 方法最为有效,其均方根误差和参考熵差的时空缩小率都很低,而且与迭代重建的定性一致。在 5D 心脏 PCCT 重构中,能量维度的有效秩比时间维度的有效秩低,因此具有这种优势。ME NLM 的表现有时优于采用时间 SVD 或时间和能量 SVD 的 DL,但落后于采用能量 SVD 的迭代重建和 DL。
Significance.
Our study establishes UnetU Energy as an accurate and efficient method for 5D cardiac PCCT denoication, providing a 32-fold speed increase from iterative reconstruction.这一进步为心血管成像中的 DL 应用树立了新的标杆。
Investigating deep learning strategies for fast denoising of 5D cardiac photon-counting micro-CT images.
Objective:
Photon-counting detectors (PCDs) for CT imaging use energy thresholds to simultaneously acquire projections at multiple energies, making them suitable for spectral imaging and material decomposition. Unfortunately, setting multiple energy thresholds results in noisy analytical reconstructions due to low photon counts in high-energy bins. Iterative reconstruction provides high quality photon-counting CT (PCCT) images but requires enormous computation time for 5D (3D + energy + time) in vivo cardiac imaging.
Approach.
We recently introduced UnetU, a deep learning (DL) approach that accurately denoises axial slices from 4D (3D + energy) PCCT reconstructions at various acquisition settings. In this study, we explore UnetU configurations for 5D cardiac PCCT denoising, focusing on singular value decomposition (SVD) modifications along the energy and time dimensions and alternate network architectures such as 3D U-net, FastDVDNet, and Swin Transformer UNet. We compare our networks to multi-energy non-local means (ME NLM), an established PCCT denoising algorithm.
Main results.
Our evaluation, using real mouse data and the digital MOBY phantom, revealed that all DL methods were more than 16 times faster than iterative reconstruction. DL denoising with SVD along the energy dimension was most effective, consistently providing low root mean square error and spatio-temporal reduced reference entropic difference, alongside strong qualitative agreement with iterative reconstruction. This superiority was attributed to lower effective rank along the energy dimension than the time dimension in 5D cardiac PCCT reconstructions. ME NLM sometimes outperformed DL with time SVD or time and energy SVD, but lagged behind iterative reconstruction and DL with energy SVD. Among alternate DL architectures with energy SVD, none consistently outperformed UnetU Energy (2D).
Significance.
Our study establishes UnetU Energy as an accurate and efficient method for 5D cardiac PCCT denoising, offering a 32-fold speed increase from iterative reconstruction. This advancement sets a new benchmark for DL applications in cardiovascular imaging.
期刊介绍:
The development and application of theoretical, computational and experimental physics to medicine, physiology and biology. Topics covered are: therapy physics (including ionizing and non-ionizing radiation); biomedical imaging (e.g. x-ray, magnetic resonance, ultrasound, optical and nuclear imaging); image-guided interventions; image reconstruction and analysis (including kinetic modelling); artificial intelligence in biomedical physics and analysis; nanoparticles in imaging and therapy; radiobiology; radiation protection and patient dose monitoring; radiation dosimetry