Solving Zero-Shot Sparse-View CT Reconstruction With Variational Score Solver

Linchao He;Wenchao Du;Peixi Liao;Fenglei Fan;Hu Chen;Hongyu Yang;Yi Zhang
{"title":"Solving Zero-Shot Sparse-View CT Reconstruction With Variational Score Solver","authors":"Linchao He;Wenchao Du;Peixi Liao;Fenglei Fan;Hu Chen;Hongyu Yang;Yi Zhang","doi":"10.1109/TMI.2024.3475516","DOIUrl":null,"url":null,"abstract":"Computed tomography (CT) stands as a ubiquitous medical diagnostic tool. Nonetheless, the radiation-related concerns associated with CT scans have raised public apprehensions. Mitigating radiation dosage in CT imaging poses an inherent challenge as it inevitably compromises the fidelity of CT reconstructions, impacting diagnostic accuracy. While previous deep learning techniques have exhibited promise in enhancing CT reconstruction quality, they remain hindered by the reliance on paired data, which is arduous to procure. In this study, we present a novel approach named Variational Score Solver (VSS) for sparse-view reconstruction without paired data. Our approach entails the acquisition of a probability distribution from densely sampled CT reconstructions, employing a latent diffusion model. High-quality reconstruction outcomes are achieved through an iterative process, wherein the diffusion model serves as the prior term, subsequently integrated with the data consistency term. Notably, rather than directly employing the prior diffusion model, we distill prior knowledge by finding the fixed point of the diffusion model. This framework empowers us to exercise precise control over the process. Moreover, we depart from modeling the reconstruction outcomes as deterministic values, opting instead for a distribution-based approach. This enables us to achieve more accurate reconstructions utilizing a trainable model. Our approach introduces a fresh perspective to the realm of zero-shot CT reconstruction, circumventing the constraints of supervised learning. Extensive qualitative and quantitative experiments unequivocally demonstrate that VSS surpasses other contemporary unsupervised and achieves comparable results compared to the most advanced supervised methods in sparse-view reconstruction tasks. Codes are available in <uri>https://github.com/fpsandnoob/vss</uri>.","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"44 9","pages":"3586-3599"},"PeriodicalIF":0.0000,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10706876/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Computed tomography (CT) stands as a ubiquitous medical diagnostic tool. Nonetheless, the radiation-related concerns associated with CT scans have raised public apprehensions. Mitigating radiation dosage in CT imaging poses an inherent challenge as it inevitably compromises the fidelity of CT reconstructions, impacting diagnostic accuracy. While previous deep learning techniques have exhibited promise in enhancing CT reconstruction quality, they remain hindered by the reliance on paired data, which is arduous to procure. In this study, we present a novel approach named Variational Score Solver (VSS) for sparse-view reconstruction without paired data. Our approach entails the acquisition of a probability distribution from densely sampled CT reconstructions, employing a latent diffusion model. High-quality reconstruction outcomes are achieved through an iterative process, wherein the diffusion model serves as the prior term, subsequently integrated with the data consistency term. Notably, rather than directly employing the prior diffusion model, we distill prior knowledge by finding the fixed point of the diffusion model. This framework empowers us to exercise precise control over the process. Moreover, we depart from modeling the reconstruction outcomes as deterministic values, opting instead for a distribution-based approach. This enables us to achieve more accurate reconstructions utilizing a trainable model. Our approach introduces a fresh perspective to the realm of zero-shot CT reconstruction, circumventing the constraints of supervised learning. Extensive qualitative and quantitative experiments unequivocally demonstrate that VSS surpasses other contemporary unsupervised and achieves comparable results compared to the most advanced supervised methods in sparse-view reconstruction tasks. Codes are available in https://github.com/fpsandnoob/vss.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用变分求解器解决零镜头稀疏视图 CT 重构问题
计算机断层扫描(CT)是一种无处不在的医学诊断工具。尽管如此,与CT扫描有关的辐射问题引起了公众的担忧。减轻CT成像中的辐射剂量是一个固有的挑战,因为它不可避免地会损害CT重建的保真度,影响诊断的准确性。虽然以前的深度学习技术在提高CT重建质量方面表现出了希望,但它们仍然受到对配对数据的依赖的阻碍,而配对数据很难获得。在这项研究中,我们提出了一种名为变分分数求解器(VSS)的新方法,用于无配对数据的稀疏视图重建。我们的方法需要从密集采样的CT重建中获取概率分布,采用潜在扩散模型。通过以扩散模型为先验项,再与数据一致性项相结合的迭代过程,获得高质量的重建结果。值得注意的是,我们不是直接使用先验扩散模型,而是通过寻找扩散模型的不动点来提取先验知识。这个框架使我们能够对过程进行精确的控制。此外,我们不再将重建结果建模为确定性值,而是选择基于分布的方法。这使我们能够利用可训练的模型实现更精确的重建。我们的方法为零射击CT重建领域引入了一个新的视角,绕过了监督学习的限制。广泛的定性和定量实验明确表明,与稀疏视图重建任务中最先进的监督方法相比,VSS超越了其他当代无监督方法,并取得了相当的结果。代码可在https://github.com/fpsandnoob/vss上获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosis. Average Calibration Losses for Reliable Uncertainty in Medical Image Segmentation. Unified and Semantically Grounded Domain Adaptation for Medical Image Segmentation. Disentangled Multi-modal Learning of Histology and Transcriptomics for Cancer Characterization. Tomographic Foundation Model-FORCE: Flow-Oriented Reconstruction Conditioning Engine.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1