首页 > 最新文献

Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)最新文献

英文 中文
SlicerSALT: From Medical Images to Quantitative Insights of Anatomy. SlicerSALT:从医学影像到解剖学定量洞察。
Jared Vicory, Ye Han, Juan Carlos Prieto, David Allemang, Mathieu Leclercq, Connor Bowley, Harald Scheirich, Jean-Christophe Fillion-Robin, Steve Pizer, James Fishbaugh, Guido Gerig, Martin Styner, Beatriz Paniagua

Three-dimensional (3D) shape lies at the core of understanding the physical objects that surround us. In the biomedical field, shape analysis has been shown to be powerful in quantifying how anatomy changes with time and disease. The Shape AnaLysis Toolbox (SALT) was created as a vehicle for disseminating advanced shape methodology as an open source, free, and comprehensive software tool. We present new developments in our shape analysis software package, including easy-to-interpret statistical methods to better leverage the quantitative information contained in SALT's shape representations. We also show SlicerPipelines, a module to improve the usability of SALT by facilitating the analysis of large-scale data sets, automating workflows for non-expert users, and allowing the distribution of reproducible workflows.

三维(3D)形状是了解我们周围实物的核心。在生物医学领域,形状分析在量化解剖结构如何随时间和疾病发生变化方面具有强大的作用。形状分析工具箱(SALT)作为一种开源、免费的综合软件工具,是传播先进形状分析方法的载体。我们将介绍形状分析软件包的新进展,包括易于理解的统计方法,以便更好地利用 SALT 的形状表示法中包含的定量信息。我们还展示了 SlicerPipelines 模块,该模块通过促进大规模数据集的分析、为非专业用户实现工作流程自动化以及允许发布可复制的工作流程来提高 SALT 的可用性。
{"title":"SlicerSALT: From Medical Images to Quantitative Insights of Anatomy.","authors":"Jared Vicory, Ye Han, Juan Carlos Prieto, David Allemang, Mathieu Leclercq, Connor Bowley, Harald Scheirich, Jean-Christophe Fillion-Robin, Steve Pizer, James Fishbaugh, Guido Gerig, Martin Styner, Beatriz Paniagua","doi":"10.1007/978-3-031-46914-5_16","DOIUrl":"10.1007/978-3-031-46914-5_16","url":null,"abstract":"<p><p>Three-dimensional (3D) shape lies at the core of understanding the physical objects that surround us. In the biomedical field, shape analysis has been shown to be powerful in quantifying how anatomy changes with time and disease. The Shape AnaLysis Toolbox (SALT) was created as a vehicle for disseminating advanced shape methodology as an open source, free, and comprehensive software tool. We present new developments in our shape analysis software package, including easy-to-interpret statistical methods to better leverage the quantitative information contained in SALT's shape representations. We also show SlicerPipelines, a module to improve the usability of SALT by facilitating the analysis of large-scale data sets, automating workflows for non-expert users, and allowing the distribution of reproducible workflows.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10798161/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139513632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SADIR: Shape-Aware Diffusion Models for 3D Image Reconstruction. SADIR:用于三维图像重建的形状感知扩散模型。
Nivetha Jayakumar, Tonmoy Hossain, Miaomiao Zhang

3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep networks often fail to effectively utilize the shape structures of objects presented in images. As a result, the topology of reconstructed objects may not be well preserved, leading to the presence of artifacts such as discontinuities, holes, or mismatched connections between different parts. In this paper, we propose a shape-aware network based on diffusion models for 3D image reconstruction, named SADIR, to address these issues. In contrast to previous methods that primarily rely on spatial correlations of image intensities for 3D reconstruction, our model leverages shape priors learned from the training data to guide the reconstruction process. To achieve this, we develop a joint learning network that simultaneously learns a mean shape under deformation models. Each reconstructed image is then considered as a deformed variant of the mean shape. We validate our model, SADIR, on both brain and cardiac magnetic resonance images (MRIs). Experimental results show that our method outperforms the baselines with lower reconstruction error and better preservation of the shape structure of objects within the images.

从数量有限的二维图像重建三维图像一直是计算机视觉和图像分析领域的一项长期挑战。虽然基于深度学习的方法在这一领域取得了令人瞩目的成绩,但现有的深度网络往往不能有效利用图像中物体的形状结构。因此,重建物体的拓扑结构可能无法得到很好的保留,从而导致不同部分之间出现不连续性、孔洞或不匹配连接等人工痕迹。为了解决这些问题,我们在本文中提出了一种基于扩散模型的形状感知网络,用于三维图像重建,并命名为 SADIR。与以往主要依靠图像强度的空间相关性进行三维重建的方法不同,我们的模型利用从训练数据中学到的形状先验来指导重建过程。为此,我们开发了一个联合学习网络,同时学习变形模型下的平均形状。然后,每个重建图像都被视为平均形状的变形变体。我们在脑部和心脏磁共振图像(MRI)上验证了我们的模型 SADIR。实验结果表明,我们的方法优于基线方法,重建误差更低,而且能更好地保留图像中物体的形状结构。
{"title":"SADIR: Shape-Aware Diffusion Models for 3D Image Reconstruction.","authors":"Nivetha Jayakumar, Tonmoy Hossain, Miaomiao Zhang","doi":"10.1007/978-3-031-46914-5_23","DOIUrl":"10.1007/978-3-031-46914-5_23","url":null,"abstract":"<p><p>3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep networks often fail to effectively utilize the shape structures of objects presented in images. As a result, the topology of reconstructed objects may not be well preserved, leading to the presence of artifacts such as discontinuities, holes, or mismatched connections between different parts. In this paper, we propose a shape-aware network based on diffusion models for 3D image reconstruction, named SADIR, to address these issues. In contrast to previous methods that primarily rely on spatial correlations of image intensities for 3D reconstruction, our model leverages shape priors learned from the training data to guide the reconstruction process. To achieve this, we develop a joint learning network that simultaneously learns a mean shape under deformation models. Each reconstructed image is then considered as a deformed variant of the mean shape. We validate our model, SADIR, on both brain and cardiac magnetic resonance images (MRIs). Experimental results show that our method outperforms the baselines with lower reconstruction error and better preservation of the shape structure of objects within the images.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10977919/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140320325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling Longitudinal Optical Coherence Tomography Images for Monitoring and Analysis of Glaucoma Progression. 为纵向光学相干断层扫描图像建模,用于监测和分析青光眼进展。
James Fishbaugh, Ronald Zambrano, Joel S Schuman, Gadi Wollstein, Jared Vicory, Beatriz Paniagua

Glaucoma causes progressive visual field deterioration and is the leading cause of blindness worldwide. Glaucomatous damage is irreversible and greatly impacts quality of life. Therefore, it is critically important to detect glaucoma early and closely monitor progression to preserve functional vision. Glaucoma is routinely monitored in the clinical setting using optical coherence tomography (OCT) for derived measures such as the thickness of important visual structures. There is not a consensus of what measures represent the most relevant biomarkers of glaucoma progression. Further, despite the increasing availability of longitudinal OCT data, a quantitative model of 3D structural change over time associated with glaucoma does not exist. In this paper we present an algorithm that will perform hierarchical geodesic modeling at the imaging level, considering 3D OCT images as observations of structural change over time. Hierarchical modeling includes subject-wise trajectories as geodesics in the space of diffeomorphisms and population level (glaucoma vs control) trajectories are also geodesics which explain subject-wise trajectories as deviations from the mean. Our preliminary experiments demonstrate a greater magnitude of structural change associated with glaucoma compared to normal aging. Our algorithm has the potential application in patient-specific monitoring and analysis of glaucoma progression as well as a statistical model of population trends and population variability.

青光眼会导致视野逐渐恶化,是全球失明的主要原因。青光眼的损害是不可逆的,对生活质量有很大影响。因此,早期发现青光眼并密切监测其进展情况以保护功能性视力至关重要。在临床上,青光眼的常规监测方法是使用光学相干断层扫描(OCT)进行衍生测量,如重要视觉结构的厚度。对于哪些指标代表青光眼进展最相关的生物标志物,目前还没有达成共识。此外,尽管纵向 OCT 数据越来越多,但与青光眼相关的三维结构随时间变化的定量模型并不存在。在本文中,我们提出了一种算法,将三维 OCT 图像视为结构随时间变化的观测结果,在成像层面执行分层大地构造。分层建模将受试者轨迹作为差分空间中的大地线,而群体水平(青光眼与对照组)轨迹也是大地线,将受试者轨迹解释为平均值的偏差。我们的初步实验表明,与正常衰老相比,青光眼引起的结构变化幅度更大。我们的算法有可能应用于特定患者青光眼进展的监测和分析,以及人口趋势和人口变异的统计模型。
{"title":"Modeling Longitudinal Optical Coherence Tomography Images for Monitoring and Analysis of Glaucoma Progression.","authors":"James Fishbaugh, Ronald Zambrano, Joel S Schuman, Gadi Wollstein, Jared Vicory, Beatriz Paniagua","doi":"10.1007/978-3-031-46914-5_19","DOIUrl":"10.1007/978-3-031-46914-5_19","url":null,"abstract":"<p><p>Glaucoma causes progressive visual field deterioration and is the leading cause of blindness worldwide. Glaucomatous damage is irreversible and greatly impacts quality of life. Therefore, it is critically important to detect glaucoma early and closely monitor progression to preserve functional vision. Glaucoma is routinely monitored in the clinical setting using optical coherence tomography (OCT) for derived measures such as the thickness of important visual structures. There is not a consensus of what measures represent the most relevant biomarkers of glaucoma progression. Further, despite the increasing availability of longitudinal OCT data, a quantitative model of 3D structural change over time associated with glaucoma does not exist. In this paper we present an algorithm that will perform hierarchical geodesic modeling at the imaging level, considering 3D OCT images as observations of structural change over time. Hierarchical modeling includes subject-wise trajectories as geodesics in the space of diffeomorphisms and population level (glaucoma vs control) trajectories are also geodesics which explain subject-wise trajectories as deviations from the mean. Our preliminary experiments demonstrate a greater magnitude of structural change associated with glaucoma compared to normal aging. Our algorithm has the potential application in patient-specific monitoring and analysis of glaucoma progression as well as a statistical model of population trends and population variability.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10798144/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139513631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Geodesic Logistic Analysis of Lumbar Spine Intervertebral Disc Shapes in Supine and Standing Positions. 仰卧位和站立位腰椎间盘形状的测地逻辑分析
Ye Han, James Fishbaugh, Christian E Gonzalez, Donald A Aboyotes, Jared Vicory, Simon Y Tang, Beatriz Paniagua

Non-specific lower back pain (LBP) is a world-wide public health problem that affects people of all ages. Despite the high prevalence of non-specific LBP and the associated economic burdens, the pathoanatomical mechanisms for the development and course of the condition remain unclear. While intervertebral disc degeneration (IDD) is associated with LBP, there is overlapping occurrence of IDD in symptomatic and asymptomatic individuals, suggesting that degeneration alone cannot identify LBP populations. Previous work has been done trying to relate linear measurements of compression obtained from Magnetic Resonance Imaging (MRI) to pain unsuccessfully. To bridge this gap, we propose to use advanced non-Euclidean statistical shape analysis methods to develop biomarkers that can help identify symptomatic and asymptomatic adults who might be susceptible to standing-induced LBP. We scanned 4 male and 7 female participants who exhibited lower back pain after prolonged standing using an Open Upright MRI. Supine and standing MRIs were obtained for each participant. Patients reported their pain intensity every fifteen minutes within a period of 2 h. Using our proposed geodesic logistic regression, we related the structure of their lower spine to pain and computed a regression model that can delineate lower spine structures using reported pain intensities. These results indicate the feasibility of identifying individuals who may suffer from lower back pain solely based on their spinal anatomy. Our proposed spinal shape analysis methodology have the potential to provide powerful information to the clinicians so they can make better treatment decisions.

非特异性下背痛(LBP)是一个影响各年龄段人群的世界性公共卫生问题。尽管非特异性下背痛的发病率很高,并造成了相关的经济负担,但其发病和病程的病理解剖学机制仍不清楚。虽然椎间盘退变(IDD)与椎间盘突出症有关,但在有症状和无症状的人群中,IDD 的发生率是重叠的,这表明仅凭退变并不能识别椎间盘突出症人群。以前曾有人试图将磁共振成像(MRI)获得的压缩线性测量值与疼痛联系起来,但没有成功。为了弥补这一缺陷,我们建议使用先进的非欧几里得统计形状分析方法来开发生物标志物,以帮助识别有症状和无症状的成年人,他们可能容易受到站立引起的腰背痛的影响。我们使用开放式直立磁共振成像对长时间站立后出现下背痛的 4 名男性和 7 名女性参与者进行了扫描。我们为每位受试者进行了仰卧位和站立位核磁共振成像。患者在 2 小时内每 15 分钟报告一次疼痛强度。利用我们提出的大地逻辑回归,我们将患者的下脊柱结构与疼痛联系起来,并计算出一个回归模型,该模型可以利用报告的疼痛强度来划分下脊柱结构。这些结果表明,仅根据脊柱解剖结构来识别可能患有下背部疼痛的人是可行的。我们提出的脊柱形状分析方法有可能为临床医生提供有力的信息,使他们能够做出更好的治疗决定。
{"title":"Geodesic Logistic Analysis of Lumbar Spine Intervertebral Disc Shapes in Supine and Standing Positions.","authors":"Ye Han, James Fishbaugh, Christian E Gonzalez, Donald A Aboyotes, Jared Vicory, Simon Y Tang, Beatriz Paniagua","doi":"10.1007/978-3-031-46914-5_15","DOIUrl":"10.1007/978-3-031-46914-5_15","url":null,"abstract":"<p><p>Non-specific lower back pain (LBP) is a world-wide public health problem that affects people of all ages. Despite the high prevalence of non-specific LBP and the associated economic burdens, the pathoanatomical mechanisms for the development and course of the condition remain unclear. While intervertebral disc degeneration (IDD) is associated with LBP, there is overlapping occurrence of IDD in symptomatic and asymptomatic individuals, suggesting that degeneration alone cannot identify LBP populations. Previous work has been done trying to relate linear measurements of compression obtained from Magnetic Resonance Imaging (MRI) to pain unsuccessfully. To bridge this gap, we propose to use advanced non-Euclidean statistical shape analysis methods to develop biomarkers that can help identify symptomatic and asymptomatic adults who might be susceptible to standing-induced LBP. We scanned 4 male and 7 female participants who exhibited lower back pain after prolonged standing using an Open Upright MRI. Supine and standing MRIs were obtained for each participant. Patients reported their pain intensity every fifteen minutes within a period of 2 h. Using our proposed geodesic logistic regression, we related the structure of their lower spine to pain and computed a regression model that can delineate lower spine structures using reported pain intensities. These results indicate the feasibility of identifying individuals who may suffer from lower back pain solely based on their spinal anatomy. Our proposed spinal shape analysis methodology have the potential to provide powerful information to the clinicians so they can make better treatment decisions.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10801698/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139522017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images. ADASSM:图像统计形状模型中的对抗性数据增强。
Mokshagna Sai Teja Karanam, Tushar Kataria, Krithika Iyer, Shireen Y Elhabian

Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.

统计形状模型(SSM)已被公认为是一种极好的工具,可用于识别潜在人群中解剖形态的变化。形状模型在给定队列中的所有样本中使用一致的形状表示,这有助于比较形状和识别可检测病理和帮助制定治疗计划的变异。在医学成像中,从 CT/MRI 扫描中计算这些形状表示需要耗费大量时间进行预处理操作,包括但不限于解剖分割注释、配准和纹理去噪。深度学习模型在直接从容积图像中学习形状表征方面表现出了卓越的能力,从而产生了高效的 "图像-到-SSM "网络。然而,这些模型对数据的要求很高,而且由于医疗数据的可用性有限,深度学习模型往往会过度拟合。离线数据增强技术使用基于核密度估计(KDE)的方法生成形状增强样本,成功地帮助图像到 SMM 网络实现了与传统 SSM 方法相当的准确性。然而,这些增强方法侧重于形状增强,而深度学习模型则表现出基于图像的纹理偏差,从而导致次优模型的产生。本文通过利用与数据相关的噪声生成或纹理增强,为图像到 SSM 框架引入了一种新的即时数据增强策略。所提出的框架是作为图像-到-SSM 网络的对手进行训练的,它增强了各种具有挑战性的噪声样本。我们的方法通过鼓励模型关注底层几何而非仅仅依赖像素值来提高准确性。
{"title":"ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images.","authors":"Mokshagna Sai Teja Karanam, Tushar Kataria, Krithika Iyer, Shireen Y Elhabian","doi":"10.1007/978-3-031-46914-5_8","DOIUrl":"10.1007/978-3-031-46914-5_8","url":null,"abstract":"<p><p>Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11251192/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141636371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IcoConv : Explainable brain cortical surface analysis for ASD classification. IcoConv : 用于 ASD 分类的可解释大脑皮层表面分析。
Ugo Rodriguez, Tahya Deddah, Sun Hyung Kim, Mark Shen, Kelly N Botteron, D Louis Collins, Stephen R Dager, Annette M Estes, Alan C Evans, Heather C Hazlett, Robert McKinstry, Robert T Shultz, Joseph Piven, Quyen Dang, Martin Styner, Juan Carlos Prieto

In this study, we introduce a novel approach for the analysis and interpretation of 3D shapes, particularly applied in the context of neuroscientific research. Our method captures 2D perspectives from various vantage points of a 3D object. These perspectives are subsequently analyzed using 2D Convolutional Neural Networks (CNNs), uniquely modified with custom pooling mechanisms. We sought to assess the efficacy of our approach through a binary classification task involving subjects at high risk for Autism Spectrum Disorder (ASD). The task entailed differentiating between high-risk positive and high-risk negative ASD cases. To do this, we employed brain attributes like cortical thickness, surface area, and extra-axial cerebral spinal measurements. We then mapped these measurements onto the surface of a sphere and subsequently analyzed them via our bespoke method. One distinguishing feature of our method is the pooling of data from diverse views using our icosahedron convolution operator. This operator facilitates the efficient sharing of information between neighboring views. A significant contribution of our method is the generation of gradient-based explainability maps, which can be visualized on the brain surface. The insights derived from these explainability images align with prior research findings, particularly those detailing the brain regions typically impacted by ASD. Our innovative approach thereby substantiates the known understanding of this disorder while potentially unveiling novel areas of study.

在本研究中,我们介绍了一种分析和解读三维形状的新方法,尤其适用于神经科学研究。我们的方法从三维物体的不同视点捕捉二维视角。这些视角随后使用二维卷积神经网络(CNN)进行分析,CNN 采用定制的汇集机制进行了独特的修改。我们试图通过一项涉及自闭症谱系障碍(ASD)高风险受试者的二元分类任务来评估我们方法的有效性。该任务需要区分自闭症高风险阳性病例和高风险阴性病例。为此,我们采用了大脑皮层厚度、表面积和轴外大脑脊柱测量等大脑属性。然后,我们将这些测量值映射到一个球体的表面,随后通过我们定制的方法对其进行分析。我们方法的一个显著特点是利用二十面体卷积算子汇集来自不同视角的数据。该算子有助于在相邻视图之间有效共享信息。我们的方法的一个重要贡献是生成了基于梯度的可解释性图,这些图可以在大脑表面可视化。从这些可解释性图像中得出的见解与之前的研究成果相吻合,尤其是那些详细描述受 ASD 典型影响的大脑区域的研究成果。因此,我们的创新方法证实了人们对这种疾病的已知理解,同时也可能揭示出新的研究领域。
{"title":"IcoConv : Explainable brain cortical surface analysis for ASD classification.","authors":"Ugo Rodriguez, Tahya Deddah, Sun Hyung Kim, Mark Shen, Kelly N Botteron, D Louis Collins, Stephen R Dager, Annette M Estes, Alan C Evans, Heather C Hazlett, Robert McKinstry, Robert T Shultz, Joseph Piven, Quyen Dang, Martin Styner, Juan Carlos Prieto","doi":"10.1007/978-3-031-46914-5_20","DOIUrl":"10.1007/978-3-031-46914-5_20","url":null,"abstract":"<p><p>In this study, we introduce a novel approach for the analysis and interpretation of 3D shapes, particularly applied in the context of neuroscientific research. Our method captures 2D perspectives from various vantage points of a 3D object. These perspectives are subsequently analyzed using 2D Convolutional Neural Networks (CNNs), uniquely modified with custom pooling mechanisms. We sought to assess the efficacy of our approach through a binary classification task involving subjects at high risk for Autism Spectrum Disorder (ASD). The task entailed differentiating between high-risk positive and high-risk negative ASD cases. To do this, we employed brain attributes like cortical thickness, surface area, and extra-axial cerebral spinal measurements. We then mapped these measurements onto the surface of a sphere and subsequently analyzed them via our bespoke method. One distinguishing feature of our method is the pooling of data from diverse views using our icosahedron convolution operator. This operator facilitates the efficient sharing of information between neighboring views. A significant contribution of our method is the generation of gradient-based explainability maps, which can be visualized on the brain surface. The insights derived from these explainability images align with prior research findings, particularly those detailing the brain regions typically impacted by ASD. Our innovative approach thereby substantiates the known understanding of this disorder while potentially unveiling novel areas of study.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10902712/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139998750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Progressive DeepSSM: Training Methodology for Image-To-Shape Deep Models. 渐进式 DeepSSM:图像到形状深度模型的训练方法。
Abu Zahid Bin Aziz, Jadie Adams, Shireen Elhabian

Statistical shape modeling (SSM) is an enabling quantitative tool to study anatomical shapes in various medical applications. However, directly using 3D images in these applications still has a long way to go. Recent deep learning methods have paved the way for reducing the substantial preprocessing steps to construct SSMs directly from unsegmented images. Nevertheless, the performance of these models is not up to the mark. Inspired by multiscale/multiresolution learning, we propose a new training strategy, progressive DeepSSM, to train image-to-shape deep learning models. The training is performed in multiple scales, and each scale utilizes the output from the previous scale. This strategy enables the model to learn coarse shape features in the first scales and gradually learn detailed fine shape features in the later scales. We leverage shape priors via segmentation-guided multi-task learning and employ deep supervision loss to ensure learning at each scale. Experiments show the superiority of models trained by the proposed strategy from both quantitative and qualitative perspectives. This training methodology can be employed to improve the stability and accuracy of any deep learning method for inferring statistical representations of anatomies from medical images and can be adopted by existing deep learning methods to improve model accuracy and training stability.

统计形状建模(SSM)是在各种医疗应用中研究解剖形状的一种有效定量工具。然而,在这些应用中直接使用三维图像还有很长的路要走。最近的深度学习方法为减少大量预处理步骤,直接从未分类的图像中构建 SSM 铺平了道路。然而,这些模型的性能并不达标。受多尺度/多分辨率学习的启发,我们提出了一种新的训练策略--渐进式 DeepSSM,用于训练图像到形状的深度学习模型。训练分多个尺度进行,每个尺度利用上一个尺度的输出。这种策略能让模型在第一个尺度上学习粗略的形状特征,并在后面的尺度上逐渐学习详细的精细形状特征。我们通过分割引导的多任务学习来利用形状先验,并采用深度监督损失来确保每个尺度的学习效果。实验表明,从定量和定性的角度来看,采用所提出的策略训练的模型都具有优越性。这种训练方法可用于提高任何深度学习方法的稳定性和准确性,从而从医学图像中推断出解剖的统计表示,现有的深度学习方法也可采用这种方法来提高模型的准确性和训练的稳定性。
{"title":"Progressive DeepSSM: Training Methodology for Image-To-Shape Deep Models.","authors":"Abu Zahid Bin Aziz, Jadie Adams, Shireen Elhabian","doi":"10.1007/978-3-031-46914-5_13","DOIUrl":"10.1007/978-3-031-46914-5_13","url":null,"abstract":"<p><p>Statistical shape modeling (SSM) is an enabling quantitative tool to study anatomical shapes in various medical applications. However, directly using 3D images in these applications still has a long way to go. Recent deep learning methods have paved the way for reducing the substantial preprocessing steps to construct SSMs directly from unsegmented images. Nevertheless, the performance of these models is not up to the mark. Inspired by multiscale/multiresolution learning, we propose a new training strategy, progressive DeepSSM, to train image-to-shape deep learning models. The training is performed in multiple scales, and each scale utilizes the output from the previous scale. This strategy enables the model to learn coarse shape features in the first scales and gradually learn detailed fine shape features in the later scales. We leverage shape priors via segmentation-guided multi-task learning and employ deep supervision loss to ensure learning at each scale. Experiments show the superiority of models trained by the proposed strategy from both quantitative and qualitative perspectives. This training methodology can be employed to improve the stability and accuracy of any deep learning method for inferring statistical representations of anatomies from medical images and can be adopted by existing deep learning methods to improve model accuracy and training stability.</p>","PeriodicalId":516531,"journal":{"name":"Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11090218/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140923504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Shape in medical imaging : International Workshop, ShapeMI 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, Proceedings. ShapeMI (Workshop) (2023 : Vancouver, B.C.)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1