首页 > 最新文献

Shape in medical imaging : International Workshop, ShapeMI 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings. ShapeMI (Workshop) (2024 : Marrakech, Morocco)最新文献

英文 中文
Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images. 未分割医学图像的弱监督贝叶斯形状建模
Jadie Adams, Krithika Iyer, Shireen Y Elhabian

Anatomical shape analysis plays a pivotal role in clinical research and hypothesis testing, where the relationship between form and function is paramount. Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics but requires a cumbersome, potentially bias-inducing construction pipeline. Traditional construction pipelines require manual and computationally expensive steps, hindering their widespread use. Furthermore, such methods utilize templates or assumptions (e.g., linearity) that can bias or limit the expressivity of the variation captured by the constructed SSM. Recent advancements in deep learning have streamlined this process in inference by providing SSM prediction directly from unsegmented medical images. However, the proposed approaches are fully supervised and require utilizing a traditional SSM construction pipeline to create training data, thus inheriting the associated burdens and limitations. To address these challenges, we introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision. Specifically, we propose reducing the supervision associated with the state-of-the-art fully Bayesian variational information bottleneck DeepSSM (BVIB-DeepSSM) model. BVIB-DeepSSM is an effective, principled framework for predicting probabilistic anatomical shapes from images with quantification of both aleatoric and epistemic uncertainties. Whereas the original BVIB-DeepSSM method requires strong supervision in the form of ground truth correspondence points, the proposed approach utilizes weak supervision via point cloud surface representations, which are more readily obtainable. Furthermore, the proposed approach learns correspondence in a completely data-driven manner without prior assumptions about the expected variability in shape cohort. Our experiments demonstrate that this approach yields similar accuracy and uncertainty estimation to the fully supervised scenario while substantially enhancing the feasibility of model training for SSM construction.

解剖形状分析在临床研究和假设检验中起着举足轻重的作用,在这些领域中,形状和功能之间的关系至关重要。基于对应关系的统计形状建模(SSM)为群体级形态计量学提供了便利,但需要繁琐且可能导致偏差的构建管道。传统的构建管道需要人工操作,计算成本高昂,阻碍了其广泛应用。此外,这些方法使用的模板或假设(如线性)可能会偏差或限制构建的 SSM 所捕获的变异的表达性。深度学习的最新进展简化了推理过程,直接从未分类的医学图像中提供 SSM 预测。然而,所提出的方法是完全有监督的,需要利用传统的 SSM 构建管道来创建训练数据,因此继承了相关的负担和局限性。为了应对这些挑战,我们引入了一种弱监督深度学习方法,利用点云监督从图像中预测 SSM。具体来说,我们建议减少与最先进的全贝叶斯变异信息瓶颈 DeepSSM(BVIB-DeepSSM)模型相关的监督。BVIB-DeepSSM 是一个有效的原则性框架,用于从图像中预测概率解剖形状,并对不确定性和认识不确定性进行量化。原始的 BVIB-DeepSSM 方法需要地面实况对应点形式的强监督,而建议的方法则通过点云表面表示利用弱监督,因为点云表面表示更容易获得。此外,所提出的方法以完全数据驱动的方式学习对应关系,无需事先假设形状队列的预期变化。我们的实验证明,这种方法可以获得与完全监督方案类似的精度和不确定性估计,同时大大提高了用于 SSM 构建的模型训练的可行性。
{"title":"Weakly Supervised Bayesian Shape Modeling from Unsegmented Medical Images.","authors":"Jadie Adams, Krithika Iyer, Shireen Y Elhabian","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Anatomical shape analysis plays a pivotal role in clinical research and hypothesis testing, where the relationship between form and function is paramount. Correspondence-based statistical shape modeling (SSM) facilitates population-level morphometrics but requires a cumbersome, potentially bias-inducing construction pipeline. Traditional construction pipelines require manual and computationally expensive steps, hindering their widespread use. Furthermore, such methods utilize templates or assumptions (e.g., linearity) that can bias or limit the expressivity of the variation captured by the constructed SSM. Recent advancements in deep learning have streamlined this process in inference by providing SSM prediction directly from unsegmented medical images. However, the proposed approaches are fully supervised and require utilizing a traditional SSM construction pipeline to create training data, thus inheriting the associated burdens and limitations. To address these challenges, we introduce a weakly supervised deep learning approach to predict SSM from images using point cloud supervision. Specifically, we propose reducing the supervision associated with the state-of-the-art fully Bayesian variational information bottleneck DeepSSM (BVIB-DeepSSM) model. BVIB-DeepSSM is an effective, principled framework for predicting probabilistic anatomical shapes from images with quantification of both aleatoric and epistemic uncertainties. Whereas the original BVIB-DeepSSM method requires strong supervision in the form of ground truth correspondence points, the proposed approach utilizes weak supervision via point cloud surface representations, which are more readily obtainable. Furthermore, the proposed approach learns correspondence in a completely data-driven manner without prior assumptions about the expected variability in shape cohort. Our experiments demonstrate that this approach yields similar accuracy and uncertainty estimation to the fully supervised scenario while substantially enhancing the feasibility of model training for SSM construction.</p>","PeriodicalId":520307,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings. ShapeMI (Workshop) (2024 : Marrakech, Morocco)","volume":"15275 ","pages":"1-17"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11590745/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142742377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images. MASSM:直接从图像进行多解剖统计形状建模的端到端深度学习框架。
Janmesh Ukey, Tushar Kataria, Shireen Y Elhabian

Statistical Shape Modeling (SSM) effectively analyzes anatomical variations within populations but is limited by the need for manual localization and segmentation, which relies on scarce medical expertise. Recent advances in deep learning have provided a promising approach that automatically generates statistical representations (as point distribution models or PDMs) from unsegmented images. Once trained, these deep learning-based models eliminate the need for manual segmentation for new subjects. Most deep learning methods still require manual prealignment of image volumes and bounding box specification around the target anatomy, leading to a partially manual inference process. Recent approaches facilitate anatomy localization but only estimate population-level statistical representations and cannot directly delineate anatomy in images. Additionally, they are limited to modeling a single anatomy. We introduce MASSM, a novel end-to-end deep learning framework that simultaneously localizes multiple anatomies, estimates population-level statistical representations, and delineates shape representations directly in image space. Our results show that MASSM, which delineates anatomy in image space and handles multiple anatomies through a multitask network, provides superior shape information compared to segmentation networks for medical imaging tasks. Estimating Statistical Shape Models (SSM) is a stronger task than segmentation, as it encodes a more robust statistical prior for the objects to be detected and delineated. MASSM allows for more accurate and comprehensive shape representations, surpassing the capabilities of traditional pixel-wise segmentation.

统计形状建模(SSM)有效地分析了群体内的解剖变化,但受到人工定位和分割的限制,这依赖于稀缺的医学专业知识。深度学习的最新进展提供了一种很有前途的方法,可以从未分割的图像中自动生成统计表示(如点分布模型或pdm)。经过训练后,这些基于深度学习的模型消除了对新主题进行人工分割的需要。大多数深度学习方法仍然需要人工对目标解剖结构周围的图像体积和边界框规范进行预对齐,导致部分人工推理过程。最近的方法有助于解剖定位,但只能估计种群水平的统计表示,不能直接描绘图像中的解剖。此外,它们仅限于对单个解剖结构进行建模。我们介绍了一种新的端到端深度学习框架MASSM,它可以同时定位多个解剖结构,估计人口水平的统计表示,并直接在图像空间中描绘形状表示。我们的研究结果表明,与医学成像任务的分割网络相比,MASSM在图像空间中描绘解剖结构并通过多任务网络处理多个解剖结构,提供了更好的形状信息。估计统计形状模型(SSM)是一项比分割更强大的任务,因为它为要检测和描绘的对象编码了更健壮的统计先验。MASSM允许更准确和全面的形状表示,超越了传统的逐像素分割的能力。
{"title":"MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images.","authors":"Janmesh Ukey, Tushar Kataria, Shireen Y Elhabian","doi":"10.1007/978-3-031-75291-9_12","DOIUrl":"10.1007/978-3-031-75291-9_12","url":null,"abstract":"<p><p>Statistical Shape Modeling (SSM) effectively analyzes anatomical variations within populations but is limited by the need for manual localization and segmentation, which relies on scarce medical expertise. Recent advances in deep learning have provided a promising approach that automatically generates statistical representations (as point distribution models or PDMs) from unsegmented images. Once trained, these deep learning-based models eliminate the need for manual segmentation for new subjects. Most deep learning methods still require manual prealignment of image volumes and bounding box specification around the target anatomy, leading to a partially manual inference process. Recent approaches facilitate anatomy localization but only estimate population-level statistical representations and cannot directly delineate anatomy in images. Additionally, they are limited to modeling a single anatomy. We introduce MASSM, a novel end-to-end deep learning framework that simultaneously localizes multiple anatomies, estimates population-level statistical representations, and delineates shape representations directly in image space. Our results show that MASSM, which delineates anatomy in image space and handles multiple anatomies through a multitask network, provides superior shape information compared to segmentation networks for medical imaging tasks. Estimating Statistical Shape Models (SSM) is a stronger task than segmentation, as it encodes a more robust statistical prior for the objects to be detected and delineated. MASSM allows for more accurate and comprehensive shape representations, surpassing the capabilities of traditional pixel-wise segmentation.</p>","PeriodicalId":520307,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings. ShapeMI (Workshop) (2024 : Marrakech, Morocco)","volume":"15275 ","pages":"149-163"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11622619/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142803718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Shape in medical imaging : International Workshop, ShapeMI 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings. ShapeMI (Workshop) (2024 : Marrakech, Morocco)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1