首页 > 最新文献

Proceedings. IEEE International Symposium on Biomedical Imaging最新文献

英文 中文
DEEP NETWORK-BASED FEATURE SELECTION FOR IMAGING GENETICS: APPLICATION TO IDENTIFYING BIOMARKERS FOR PARKINSON'S DISEASE. 基于深度网络的成像遗传学特征选择:在帕金森病生物标志物识别中的应用。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098471
Mansu Kim, Ji Hye Won, Jisu Hong, Junmo Kwon, Hyunjin Park, Li Shen

Imaging genetics is a methodology for discovering associations between imaging and genetic variables. Many studies adopted sparse models such as sparse canonical correlation analysis (SCCA) for imaging genetics. These methods are limited to modeling the linear imaging genetics relationship and cannot capture the non-linear high-level relationship between the explored variables. Deep learning approaches are underexplored in imaging genetics, compared to their great successes in many other biomedical domains such as image segmentation and disease classification. In this work, we proposed a deep learning model to select genetic features that can explain the imaging features well. Our empirical study on simulated and real datasets demonstrated that our method outperformed the widely used SCCA method and was able to select important genetic features in a robust fashion. These promising results indicate our deep learning model has the potential to reveal new biomarkers to improve mechanistic understanding of the studied brain disorders.

成像遗传学是一种发现成像和遗传变量之间关联的方法。许多研究采用稀疏典型相关分析(SCCA)等稀疏模型进行成像遗传学研究。这些方法仅限于线性成像遗传关系的建模,而不能捕获所探索变量之间的非线性高层关系。与在许多其他生物医学领域(如图像分割和疾病分类)取得巨大成功相比,深度学习方法在成像遗传学方面的探索不足。在这项工作中,我们提出了一个深度学习模型来选择能够很好地解释成像特征的遗传特征。我们对模拟和真实数据集的实证研究表明,我们的方法优于广泛使用的SCCA方法,并且能够以稳健的方式选择重要的遗传特征。这些有希望的结果表明,我们的深度学习模型有潜力揭示新的生物标志物,以提高对所研究的大脑疾病的机制理解。
{"title":"DEEP NETWORK-BASED FEATURE SELECTION FOR IMAGING GENETICS: APPLICATION TO IDENTIFYING BIOMARKERS FOR PARKINSON'S DISEASE.","authors":"Mansu Kim,&nbsp;Ji Hye Won,&nbsp;Jisu Hong,&nbsp;Junmo Kwon,&nbsp;Hyunjin Park,&nbsp;Li Shen","doi":"10.1109/isbi45749.2020.9098471","DOIUrl":"https://doi.org/10.1109/isbi45749.2020.9098471","url":null,"abstract":"<p><p>Imaging genetics is a methodology for discovering associations between imaging and genetic variables. Many studies adopted sparse models such as sparse canonical correlation analysis (SCCA) for imaging genetics. These methods are limited to modeling the linear imaging genetics relationship and cannot capture the non-linear high-level relationship between the explored variables. Deep learning approaches are underexplored in imaging genetics, compared to their great successes in many other biomedical domains such as image segmentation and disease classification. In this work, we proposed a deep learning model to select genetic features that can explain the imaging features well. Our empirical study on simulated and real datasets demonstrated that our method outperformed the widely used SCCA method and was able to select important genetic features in a robust fashion. These promising results indicate our deep learning model has the potential to reveal new biomarkers to improve mechanistic understanding of the studied brain disorders.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/isbi45749.2020.9098471","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39498848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
AUTOMATIC LABELING OF CORTICAL SULCI USING SPHERICAL CONVOLUTIONAL NEURAL NETWORKS IN A DEVELOPMENTAL COHORT. 使用球形卷积神经网络自动标记发育队列中的皮质沟。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098414
Lingyan Hao, Shunxing Bao, Yucheng Tang, Riqiang Gao, Prasanna Parvathaneni, Jacob A Miller, Willa Voorhies, Jewelia Yao, Silvia A Bunge, Kevin S Weiner, Bennett A Landman, Ilwoo Lyu

In this paper, we present the automatic labeling framework for sulci in the human lateral prefrontal cortex (PFC). We adapt an existing spherical U-Net architecture with our recent surface data augmentation technique to improve the sulcal labeling accuracy in a developmental cohort. Specifically, our framework consists of the following key components: (1) augmented geometrical features being generated during cortical surface registration, (2) spherical U-Net architecture to efficiently fit the augmented features, and (3) postrefinement of sulcal labeling by optimizing spatial coherence via a graph cut technique. We validate our method on 30 healthy subjects with manual labeling of sulcal regions within PFC. In the experiments, we demonstrate significantly improved labeling performance (0.7749) in mean Dice overlap compared to that of multi-atlas (0.6410) and standard spherical U-Net (0.7011) approaches, respectively (p < 0.05). Additionally, the proposed method achieves a full set of sulcal labels in 20 seconds in this developmental cohort.

在本文中,我们介绍了人类外侧前额叶皮层(PFC)沟的自动标记框架。我们将现有的球形 U-Net 架构与最新的表面数据增强技术相结合,提高了发育队列中沟槽标注的准确性。具体来说,我们的框架由以下关键部分组成:(1) 在皮层表面注册过程中生成增强几何特征;(2) 采用球形 U-Net 架构有效拟合增强特征;(3) 通过图切割技术优化空间一致性,对颅沟标记进行后精炼。我们在 30 名健康受试者身上验证了我们的方法,并对前脑功能区内的脑沟区域进行了人工标注。实验表明,与多图谱法(0.6410)和标准球形 U-Net 法(0.7011)相比,我们的平均 Dice 重叠率(0.7749)显著提高(p < 0.05)。此外,在这一发育队列中,所提出的方法可在 20 秒内完成全套脑沟标签。
{"title":"AUTOMATIC LABELING OF CORTICAL SULCI USING SPHERICAL CONVOLUTIONAL NEURAL NETWORKS IN A DEVELOPMENTAL COHORT.","authors":"Lingyan Hao, Shunxing Bao, Yucheng Tang, Riqiang Gao, Prasanna Parvathaneni, Jacob A Miller, Willa Voorhies, Jewelia Yao, Silvia A Bunge, Kevin S Weiner, Bennett A Landman, Ilwoo Lyu","doi":"10.1109/isbi45749.2020.9098414","DOIUrl":"10.1109/isbi45749.2020.9098414","url":null,"abstract":"<p><p>In this paper, we present the automatic labeling framework for sulci in the human lateral prefrontal cortex (PFC). We adapt an existing spherical U-Net architecture with our recent surface data augmentation technique to improve the sulcal labeling accuracy in a developmental cohort. Specifically, our framework consists of the following key components: (1) augmented geometrical features being generated during cortical surface registration, (2) spherical U-Net architecture to efficiently fit the augmented features, and (3) postrefinement of sulcal labeling by optimizing spatial coherence via a graph cut technique. We validate our method on 30 healthy subjects with manual labeling of sulcal regions within PFC. In the experiments, we demonstrate significantly improved labeling performance (0.7749) in mean Dice overlap compared to that of multi-atlas (0.6410) and standard spherical U-Net (0.7011) approaches, respectively (p < 0.05). Additionally, the proposed method achieves a full set of sulcal labels in 20 seconds in this developmental cohort.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"412-415"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7296783/pdf/nihms-1597608.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38057501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
LOCALLY ADAPTIVE HALF-MAX METHODS FOR AIRWAY LUMEN-AREA AND WALL-THICKNESS AND THEIR REPEAT CT SCAN REPRODUCIBILITY. 气道腔面积和壁厚的局部自适应半最大值方法及其重复 CT 扫描的再现性。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098558
Syed Ahmed Nadeem, Eric A Hoffman, Alejandro P Comellas, Punam K Saha

Quantitative computed tomography (CT)-based characterization of bronchial metrics is increasingly being used to investigate chronic obstructive pulmonary disease (COPD)-related phenotypes. Automated methods for airway measurements benefit large multi-site studies by reducing cost and subjectivity errors. Critical challenges for CT-based analysis of airway morphology are related to location of lumen and wall transitions in the presence of varying scales and intensity-contrasts from proximal to distal sites. This paper introduces locally adaptive half-max methods to locate airway lumen and wall transitions and compute cross-sectional lumen area and wall-thickness. Also, the method uses a consistency analysis of wall-thickness to avoid adjoining-structure-artifacts. Experimental results show that computed bronchial measures at individual anatomic airway tree locations are repeat CT scan reproducible with intra-class correlation coefficient (ICC) values exceeding 0.9 and 0.8 for lumen-area and wall-thickness, respectively. Observed ICC values for derived morphologic measures, e.g., lumen-area compactness (ICC>0.67) and tapering (ICC>0.47) are relatively lower.

基于计算机断层扫描(CT)的支气管指标定量分析正越来越多地用于研究慢性阻塞性肺病(COPD)相关表型。气道测量的自动化方法可降低成本和主观误差,有利于大型多站点研究。基于 CT 的气道形态分析面临的关键挑战是,在从近端到远端存在不同尺度和强度对比的情况下,如何确定管腔和管壁过渡的位置。本文介绍了局部自适应半最大值方法,用于定位气道管腔和管壁过渡,并计算横截面管腔面积和管壁厚度。此外,该方法还使用了壁厚一致性分析,以避免邻近结构伪影。实验结果表明,在个别解剖气道树位置计算出的支气管测量值具有重复 CT 扫描的可重复性,管腔面积和管壁厚度的类内相关系数 (ICC) 值分别超过 0.9 和 0.8。衍生形态测量的观察 ICC 值相对较低,例如管腔面积紧密度(ICC>0.67)和锥度(ICC>0.47)。
{"title":"LOCALLY ADAPTIVE HALF-MAX METHODS FOR AIRWAY LUMEN-AREA AND WALL-THICKNESS AND THEIR REPEAT CT SCAN REPRODUCIBILITY.","authors":"Syed Ahmed Nadeem, Eric A Hoffman, Alejandro P Comellas, Punam K Saha","doi":"10.1109/isbi45749.2020.9098558","DOIUrl":"10.1109/isbi45749.2020.9098558","url":null,"abstract":"<p><p>Quantitative computed tomography (CT)-based characterization of bronchial metrics is increasingly being used to investigate chronic obstructive pulmonary disease (COPD)-related phenotypes. Automated methods for airway measurements benefit large multi-site studies by reducing cost and subjectivity errors. Critical challenges for CT-based analysis of airway morphology are related to location of lumen and wall transitions in the presence of varying scales and intensity-contrasts from proximal to distal sites. This paper introduces locally adaptive half-max methods to locate airway lumen and wall transitions and compute cross-sectional lumen area and wall-thickness. Also, the method uses a consistency analysis of wall-thickness to avoid adjoining-structure-artifacts. Experimental results show that computed bronchial measures at individual anatomic airway tree locations are repeat CT scan reproducible with intra-class correlation coefficient (ICC) values exceeding 0.9 and 0.8 for lumen-area and wall-thickness, respectively. Observed ICC values for derived morphologic measures, e.g., lumen-area compactness (ICC>0.67) and tapering (ICC>0.47) are relatively lower.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8375398/pdf/nihms-1571624.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39335062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Architectural configurations, atlas granularity and functional connectivity with diagnostic value in Autism Spectrum Disorder. 架构配置、图谱粒度和功能连通性对自闭症谱系障碍的诊断价值。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/ISBI45749.2020.9098555
Cooper J Mellema, Alex Treacher, Kevin P Nguyen, Albert Montillo

Currently, the diagnosis of Autism Spectrum Disorder (ASD) is dependent upon a subjective, time-consuming evaluation of behavioral tests by an expert clinician. Non-invasive functional MRI (fMRI) characterizes brain connectivity and may be used to inform diagnoses and democratize medicine. However, successful construction of predictive models, such as deep learning models, from fMRI requires addressing key choices about the model's architecture, including the number of layers and number of neurons per layer. Meanwhile, deriving functional connectivity (FC) features from fMRI requires choosing an atlas with an appropriate level of granularity. Once an accurate diagnostic model has been built, it is vital to determine which features are predictive of ASD and if similar features are learned across atlas granularity levels. Identifying new important features extends our understanding of the biological underpinnings of ASD, while identifying features that corroborate past findings and extend across atlas levels instills model confidence. To identify aptly suited architectural configurations, probability distributions of the configurations of high versus low performing models are compared. To determine the effect of atlas granularity, connectivity features are derived from atlases with 3 levels of granularity and important features are ranked with permutation feature importance. Results show the highest performing models use between 2-4 hidden layers and 16-64 neurons per layer, granularity dependent. Connectivity features identified as important across all 3 atlas granularity levels include FC to the supplementary motor gyrus and language association cortex, regions whose abnormal development are associated with deficits in social and sensory processing common in ASD. Importantly, the cerebellum, often not included in functional analyses, is also identified as a region whose abnormal connectivity is highly predictive of ASD. Results of this study identify important regions to include in future studies of ASD, help assist in the selection of network architectures, and help identify appropriate levels of granularity to facilitate the development of accurate diagnostic models of ASD.

目前,自闭症谱系障碍(ASD)的诊断依赖于临床专家对行为测试的主观、耗时的评估。非侵入性功能MRI (fMRI)表征大脑连接,可用于告知诊断和民主化医学。然而,从功能磁共振成像成功构建预测模型,如深度学习模型,需要解决模型架构的关键选择,包括层数和每层神经元的数量。同时,从fMRI中获得功能连接(FC)特征需要选择具有适当粒度的图谱。一旦建立了准确的诊断模型,确定哪些特征可以预测ASD以及是否在图谱粒度级别上学习到类似的特征是至关重要的。识别新的重要特征扩展了我们对ASD生物学基础的理解,而识别证实过去发现的特征和跨图谱水平的扩展则给模型注入了信心。为了确定合适的体系结构配置,将比较高性能模型与低性能模型配置的概率分布。为了确定地图集粒度的影响,从具有3个粒度级别的地图集中获得连通性特征,并根据排列特征的重要性对重要特征进行排序。结果表明,性能最好的模型使用2-4个隐藏层,每层使用16-64个神经元,这取决于粒度。在所有3个图谱粒度水平上被确定为重要的连通性特征包括FC到辅助运动回和语言关联皮层,这些区域的异常发育与ASD中常见的社交和感觉处理缺陷有关。重要的是,小脑,通常不包括在功能分析中,也被确定为一个区域,其异常连接是ASD的高度预测。本研究的结果确定了未来ASD研究的重要区域,有助于帮助选择网络架构,并有助于确定适当的粒度水平,以促进ASD准确诊断模型的发展。
{"title":"Architectural configurations, atlas granularity and functional connectivity with diagnostic value in Autism Spectrum Disorder.","authors":"Cooper J Mellema,&nbsp;Alex Treacher,&nbsp;Kevin P Nguyen,&nbsp;Albert Montillo","doi":"10.1109/ISBI45749.2020.9098555","DOIUrl":"https://doi.org/10.1109/ISBI45749.2020.9098555","url":null,"abstract":"<p><p>Currently, the diagnosis of Autism Spectrum Disorder (ASD) is dependent upon a subjective, time-consuming evaluation of behavioral tests by an expert clinician. Non-invasive functional MRI (fMRI) characterizes brain connectivity and may be used to inform diagnoses and democratize medicine. However, successful construction of predictive models, such as deep learning models, from fMRI requires addressing key choices about the model's architecture, including the number of layers and number of neurons per layer. Meanwhile, deriving functional connectivity (FC) features from fMRI requires choosing an atlas with an appropriate level of granularity. Once an accurate diagnostic model has been built, it is vital to determine which features are predictive of ASD and if similar features are learned across atlas granularity levels. Identifying new important features extends our understanding of the biological underpinnings of ASD, while identifying features that corroborate past findings and extend across atlas levels instills model confidence. To identify aptly suited architectural configurations, probability distributions of the configurations of high versus low performing models are compared. To determine the effect of atlas granularity, connectivity features are derived from atlases with 3 levels of granularity and important features are ranked with permutation feature importance. Results show the highest performing models use between 2-4 hidden layers and 16-64 neurons per layer, granularity dependent. Connectivity features identified as important across all 3 atlas granularity levels include FC to the supplementary motor gyrus and language association cortex, regions whose abnormal development are associated with deficits in social and sensory processing common in ASD. Importantly, the cerebellum, often not included in functional analyses, is also identified as a region whose abnormal connectivity is highly predictive of ASD. Results of this study identify important regions to include in future studies of ASD, help assist in the selection of network architectures, and help identify appropriate levels of granularity to facilitate the development of accurate diagnostic models of ASD.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"1022-1025"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/ISBI45749.2020.9098555","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25517923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
LEARNING TO DETECT BRAIN LESIONS FROM NOISY ANNOTATIONS. 学习从嘈杂的注释中检测脑损伤。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098599
Davood Karimi, Jurriaan M Peters, Abdelhakim Ouaalam, Sanjay P Prabhu, Mustafa Sahin, Darcy A Krueger, Alexander Kolevzon, Charis Eng, Simon K Warfield, Ali Gholipour

Supervised training of deep neural networks in medical imaging applications relies heavily on expert-provided annotations. These annotations, however, are often imperfect, as voxel-by-voxel labeling of structures on 3D images is difficult and laborious. In this paper, we focus on one common type of label imperfection, namely, false negatives. Focusing on brain lesion detection, we propose a method to train a convolutional neural network (CNN) to segment lesions while simultaneously improving the quality of the training labels by identifying false negatives and adding them to the training labels. To identify lesions missed by annotators in the training data, our method makes use of the 1) CNN predictions, 2) prediction uncertainty estimated during training, and 3) prior knowledge about lesion size and features. On a dataset of 165 scans of children with tuberous sclerosis complex from five centers, our method achieved better lesion detection and segmentation accuracy than the baseline CNN trained on the noisy labels, and than several alternative techniques.

医学成像应用中深度神经网络的监督训练在很大程度上依赖于专家提供的注释。然而,这些注释往往是不完美的,因为在3D图像上逐体素标记结构是困难和费力的。在本文中,我们关注一种常见的标签缺陷类型,即假阴性。针对脑损伤检测,我们提出了一种训练卷积神经网络(CNN)分割病变的方法,同时通过识别假阴性并将其添加到训练标签中来提高训练标签的质量。为了识别训练数据中标注者遗漏的病变,我们的方法使用了1)CNN预测,2)训练时估计的预测不确定性,以及3)病变大小和特征的先验知识。在来自五个中心的165个结节性硬化症儿童扫描数据集上,我们的方法比在噪声标签上训练的基线CNN获得了更好的病变检测和分割精度,并且比几种替代技术更好。
{"title":"LEARNING TO DETECT BRAIN LESIONS FROM NOISY ANNOTATIONS.","authors":"Davood Karimi, Jurriaan M Peters, Abdelhakim Ouaalam, Sanjay P Prabhu, Mustafa Sahin, Darcy A Krueger, Alexander Kolevzon, Charis Eng, Simon K Warfield, Ali Gholipour","doi":"10.1109/isbi45749.2020.9098599","DOIUrl":"10.1109/isbi45749.2020.9098599","url":null,"abstract":"<p><p>Supervised training of deep neural networks in medical imaging applications relies heavily on expert-provided annotations. These annotations, however, are often imperfect, as voxel-by-voxel labeling of structures on 3D images is difficult and laborious. In this paper, we focus on one common type of label imperfection, namely, false negatives. Focusing on brain lesion detection, we propose a method to train a convolutional neural network (CNN) to segment lesions while simultaneously improving the quality of the training labels by identifying false negatives and adding them to the training labels. To identify lesions missed by annotators in the training data, our method makes use of the 1) CNN predictions, 2) prediction uncertainty estimated during training, and 3) prior knowledge about lesion size and features. On a dataset of 165 scans of children with tuberous sclerosis complex from five centers, our method achieved better lesion detection and segmentation accuracy than the baseline CNN trained on the noisy labels, and than several alternative techniques.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"1910-1914"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/isbi45749.2020.9098599","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38340495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Multi-scale Unrolled Deep Learning Framework for Accelerated Magnetic Resonance Imaging. 加速磁共振成像的多尺度展开深度学习框架。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098684
Ukash Nakarmi, Joseph Y Cheng, Edgar P Rios, Morteza Mardani, John M Pauly, Leslie Ying, Shreyas S Vasanawala

Accelerating data acquisition in magnetic resonance imaging (MRI) has been of perennial interest due to its prohibitively slow data acquisition process. Recent trends in accelerating MRI employ data-centric deep learning frameworks due to its fast inference time and 'one-parameter-fit-all' principle unlike in traditional model-based acceleration techniques. Unrolled deep learning framework that combines the deep priors and model knowledge are robust compared to naive deep learning based framework. In this paper, we propose a novel multi-scale unrolled deep learning framework which learns deep image priors through multi-scale CNN and is combined with unrolled framework to enforce data-consistency and model knowledge. Essentially, this framework combines the best of both learning paradigms:model-based and data-centric learning paradigms. Proposed method is verified using several experiments on numerous data sets.

加速数据采集在磁共振成像(MRI)一直是长期的兴趣,由于其令人望而却步的数据采集过程缓慢。加速MRI的最新趋势采用以数据为中心的深度学习框架,因为它具有快速的推理时间和与传统基于模型的加速技术不同的“单参数适用”原则。与基于朴素深度学习的框架相比,结合深度先验和模型知识的展开深度学习框架具有鲁棒性。在本文中,我们提出了一种新的多尺度展开深度学习框架,该框架通过多尺度CNN学习深度图像先验,并与展开框架相结合来增强数据一致性和模型知识。本质上,这个框架结合了两种学习范式的优点:基于模型的学习范式和以数据为中心的学习范式。在多个数据集上进行了实验验证。
{"title":"Multi-scale Unrolled Deep Learning Framework for Accelerated Magnetic Resonance Imaging.","authors":"Ukash Nakarmi, Joseph Y Cheng, Edgar P Rios, Morteza Mardani, John M Pauly, Leslie Ying, Shreyas S Vasanawala","doi":"10.1109/isbi45749.2020.9098684","DOIUrl":"10.1109/isbi45749.2020.9098684","url":null,"abstract":"<p><p>Accelerating data acquisition in magnetic resonance imaging (MRI) has been of perennial interest due to its prohibitively slow data acquisition process. Recent trends in accelerating MRI employ data-centric deep learning frameworks due to its fast inference time and 'one-parameter-fit-all' principle unlike in traditional model-based acceleration techniques. Unrolled deep learning framework that combines the deep priors and model knowledge are robust compared to naive deep learning based framework. In this paper, we propose a novel multi-scale unrolled deep learning framework which learns deep image priors through multi-scale CNN and is combined with unrolled framework to enforce data-consistency and model knowledge. Essentially, this framework combines the best of both learning paradigms:model-based and data-centric learning paradigms. Proposed method is verified using several experiments on numerous data sets.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"1056-1059"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/isbi45749.2020.9098684","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38679063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
FREE-BREATHING CARDIOVASCULAR MRI USING A PLUG-AND-PLAY METHOD WITH LEARNED DENOISER. 自由呼吸心血管mri使用即插即用方法与学习去噪。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098453
Sizhuo Liu, Edward Reehorst, Philip Schniter, Rizwan Ahmad

Cardiac magnetic resonance imaging (CMR) is a noninvasive imaging modality that provides a comprehensive evaluation of the cardiovascular system. The clinical utility of CMR is hampered by long acquisition times, however. In this work, we propose and validate a plug-and-play (PnP) method for CMR reconstruction from undersampled multicoil data. To fully exploit the rich image structure inherent in CMR, we pair the PnP framework with a deep learning (DL)-based denoiser that is trained using spatiotemporal patches from high-quality, breath-held cardiac cine images. The resulting "PnP-DL" method iterates over data consistency and denoising subroutines. We compare the reconstruction performance of PnP-DL to that of compressed sensing (CS) using eight breath-held and ten real-time (RT) free-breathing cardiac cine datasets. We find that, for breath-held datasets, PnP-DL offers more than one dB advantage over commonly used CS methods. For RT free-breathing datasets, where ground truth is not available, PnP-DL receives higher scores in qualitative evaluation. The results highlight the potential of PnP-DL to accelerate RT CMR.

心脏磁共振成像(CMR)是一种对心血管系统进行全面评估的无创成像方式。然而,CMR的临床应用受到长期获取时间的阻碍。在这项工作中,我们提出并验证了一种即插即用(PnP)方法,用于从欠采样多线圈数据中重建CMR。为了充分利用CMR固有的丰富图像结构,我们将PnP框架与基于深度学习(DL)的去噪器相结合,该去噪器使用来自高质量、屏息心脏电影图像的时空补丁进行训练。由此产生的“PnP-DL”方法迭代数据一致性和去噪子程序。我们使用8个屏气和10个实时(RT)自由呼吸心脏电影数据集比较了PnP-DL与压缩感知(CS)的重建性能。我们发现,对于屏息数据集,PnP-DL比常用的CS方法提供了一个以上的dB优势。对于无法获得地面真实值的RT自由呼吸数据集,PnP-DL在定性评估中获得更高的分数。这些结果突出了PnP-DL加速RT CMR的潜力。
{"title":"FREE-BREATHING CARDIOVASCULAR MRI USING A PLUG-AND-PLAY METHOD WITH LEARNED DENOISER.","authors":"Sizhuo Liu,&nbsp;Edward Reehorst,&nbsp;Philip Schniter,&nbsp;Rizwan Ahmad","doi":"10.1109/isbi45749.2020.9098453","DOIUrl":"https://doi.org/10.1109/isbi45749.2020.9098453","url":null,"abstract":"<p><p>Cardiac magnetic resonance imaging (CMR) is a noninvasive imaging modality that provides a comprehensive evaluation of the cardiovascular system. The clinical utility of CMR is hampered by long acquisition times, however. In this work, we propose and validate a plug-and-play (PnP) method for CMR reconstruction from undersampled multicoil data. To fully exploit the rich image structure inherent in CMR, we pair the PnP framework with a deep learning (DL)-based denoiser that is trained using spatiotemporal patches from high-quality, breath-held cardiac cine images. The resulting \"PnP-DL\" method iterates over data consistency and denoising subroutines. We compare the reconstruction performance of PnP-DL to that of compressed sensing (CS) using eight breath-held and ten real-time (RT) free-breathing cardiac cine datasets. We find that, for breath-held datasets, PnP-DL offers more than one dB advantage over commonly used CS methods. For RT free-breathing datasets, where ground truth is not available, PnP-DL receives higher scores in qualitative evaluation. The results highlight the potential of PnP-DL to accelerate RT CMR.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"1748-1751"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/isbi45749.2020.9098453","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39834656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
BENDING LOSS REGULARIZED NETWORK FOR NUCLEI SEGMENTATION IN HISTOPATHOLOGY IMAGES. 用于组织病理学图像中细胞核分割的弯曲损失正则化网络
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098611
Haotian Wang, Min Xian, Aleksandar Vakanski

Separating overlapped nuclei is a major challenge in histopathology image analysis. Recently published approaches have achieved promising overall performance on public datasets; however, their performance in segmenting overlapped nuclei are limited. To address the issue, we propose the bending loss regularized network for nuclei segmentation. The proposed bending loss defines high penalties to contour points with large curvatures, and applies small penalties to contour points with small curvature. Minimizing the bending loss can avoid generating contours that encompass multiple nuclei. The proposed approach is validated on the MoNuSeg dataset using five quantitative metrics. It outperforms six state-of-the-art approaches on the following metrics: Aggregate Jaccard Index, Dice, Recognition Quality, and Panoptic Quality.

分离重叠的细胞核是组织病理学图像分析的一大挑战。最近发表的方法在公共数据集上取得了可喜的整体性能,但在分割重叠的细胞核方面性能有限。为了解决这个问题,我们提出了用于细胞核分割的弯曲损失正则化网络。所提出的弯曲损失对曲率大的轮廓点进行高惩罚,对曲率小的轮廓点进行小惩罚。最小化弯曲损失可以避免生成包含多个核的轮廓。我们使用五个量化指标在 MoNuSeg 数据集上对所提出的方法进行了验证。在以下指标上,该方法优于六种最先进的方法:综合杰卡指数、骰子、识别质量和全景质量。
{"title":"BENDING LOSS REGULARIZED NETWORK FOR NUCLEI SEGMENTATION IN HISTOPATHOLOGY IMAGES.","authors":"Haotian Wang, Min Xian, Aleksandar Vakanski","doi":"10.1109/isbi45749.2020.9098611","DOIUrl":"10.1109/isbi45749.2020.9098611","url":null,"abstract":"<p><p>Separating overlapped nuclei is a major challenge in histopathology image analysis. Recently published approaches have achieved promising overall performance on public datasets; however, their performance in segmenting overlapped nuclei are limited. To address the issue, we propose the bending loss regularized network for nuclei segmentation. The proposed bending loss defines high penalties to contour points with large curvatures, and applies small penalties to contour points with small curvature. Minimizing the bending loss can avoid generating contours that encompass multiple nuclei. The proposed approach is validated on the MoNuSeg dataset using five quantitative metrics. It outperforms six state-of-the-art approaches on the following metrics: Aggregate Jaccard Index, Dice, Recognition Quality, and Panoptic Quality.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"258-262"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7733529/pdf/nihms-1651655.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38716840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
STAN: SMALL TUMOR-AWARE NETWORK FOR BREAST ULTRASOUND IMAGE SEGMENTATION. stan:用于乳腺超声图像分割的小型肿瘤感知网络。
Pub Date : 2020-04-01 Epub Date: 2020-05-22 DOI: 10.1109/isbi45749.2020.9098691
Bryar Shareef, Min Xian, Aleksandar Vakanski

Breast tumor segmentation provides accurate tumor boundary, and serves as a key step toward further cancer quantification. Although deep learning-based approaches have been proposed and achieved promising results, existing approaches have difficulty in detecting small breast tumors. The capacity to detecting small tumors is particularly important in finding early stage cancers using computer-aided diagnosis (CAD) systems. In this paper, we propose a novel deep learning architecture called Small Tumor-Aware Network (STAN), to improve the performance of segmenting tumors with different size. The new architecture integrates both rich context information and high-resolution image features. We validate the proposed approach using seven quantitative metrics on two public breast ultrasound datasets. The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors.

乳腺肿瘤分割可提供准确的肿瘤边界,是进一步量化癌症的关键一步。虽然基于深度学习的方法已被提出并取得了可喜的成果,但现有方法在检测小乳腺肿瘤方面存在困难。检测小肿瘤的能力对于使用计算机辅助诊断(CAD)系统发现早期癌症尤为重要。在本文中,我们提出了一种名为 "小肿瘤感知网络(STAN)"的新型深度学习架构,以提高分割不同大小肿瘤的性能。新架构集成了丰富的上下文信息和高分辨率图像特征。我们在两个公开的乳腺超声数据集上使用七个定量指标验证了所提出的方法。在分割小型乳腺肿瘤方面,所提出的方法优于最先进的方法。
{"title":"STAN: SMALL TUMOR-AWARE NETWORK FOR BREAST ULTRASOUND IMAGE SEGMENTATION.","authors":"Bryar Shareef, Min Xian, Aleksandar Vakanski","doi":"10.1109/isbi45749.2020.9098691","DOIUrl":"10.1109/isbi45749.2020.9098691","url":null,"abstract":"<p><p>Breast tumor segmentation provides accurate tumor boundary, and serves as a key step toward further cancer quantification. Although deep learning-based approaches have been proposed and achieved promising results, existing approaches have difficulty in detecting small breast tumors. The capacity to detecting small tumors is particularly important in finding early stage cancers using computer-aided diagnosis (CAD) systems. In this paper, we propose a novel deep learning architecture called Small Tumor-Aware Network (STAN), to improve the performance of segmenting tumors with different size. The new architecture integrates both rich context information and high-resolution image features. We validate the proposed approach using seven quantitative metrics on two public breast ultrasound datasets. The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":" ","pages":"1469-1473"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7733528/pdf/nihms-1651650.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38716841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Braided Networks for Scan-Aware MRI Brain Tissue Segmentation 扫描感知MRI脑组织分割的编织网络
Pub Date : 2020-04-01 DOI: 10.1109/isbi45749.2020.9098601
Mahmoud Mostapha, B. Mailhé, Xiao Chen, P. Ceccaldi, Y. Yoo, M. Nadar
Recent advances in supervised deep learning, mainly using convolutional neural networks, enabled the fast acquisition of high-quality brain tissue segmentation from structural magnetic resonance brain images (MRI). However, the robustness of such deep learning models is limited by the existing training datasets acquired with a homogeneous MRI acquisition protocol. Moreover, current models fail to utilize commonly available relevant non-imaging information (i.e., meta-data). In this paper, the notion of a braided block is introduced as a generalization of convolutional or fully connected layers for learning from paired data (meta-data, images). For robust MRI tissue segmentation, a braided 3D U-Net architecture is implemented as a combination of such braided blocks with scanner information, MRI sequence parameters, geometrical information, and task-specific prior information used as meta-data. When applied to a large (> 16,000 scans) and highly heterogeneous (wide range of MRI protocols) dataset, our method generates highly accurate segmentation results (Dice scores > 0.9) within seconds****The concepts and information presented in this paper are based on research results that are not commercially available..
监督深度学习的最新进展,主要使用卷积神经网络,使得能够从结构磁共振脑图像(MRI)中快速获取高质量的脑组织分割。然而,这种深度学习模型的稳健性受到用同质MRI采集协议采集的现有训练数据集的限制。此外,当前的模型未能利用通常可用的相关非成像信息(即元数据)。在本文中,引入了编织块的概念,作为卷积层或全连接层的推广,用于从配对数据(元数据、图像)中学习。对于稳健的MRI组织分割,编织的3D U-Net架构被实现为这种编织块与用作元数据的扫描器信息、MRI序列参数、几何信息和任务特定先验信息的组合。当应用于大型(>16000次扫描)和高度异构(广泛的MRI协议)数据集时,我们的方法在几秒钟内生成高度准确的分割结果(Dice分数>0.9)***本文中提出的概念和信息基于商业上没有的研究结果。。
{"title":"Braided Networks for Scan-Aware MRI Brain Tissue Segmentation","authors":"Mahmoud Mostapha, B. Mailhé, Xiao Chen, P. Ceccaldi, Y. Yoo, M. Nadar","doi":"10.1109/isbi45749.2020.9098601","DOIUrl":"https://doi.org/10.1109/isbi45749.2020.9098601","url":null,"abstract":"Recent advances in supervised deep learning, mainly using convolutional neural networks, enabled the fast acquisition of high-quality brain tissue segmentation from structural magnetic resonance brain images (MRI). However, the robustness of such deep learning models is limited by the existing training datasets acquired with a homogeneous MRI acquisition protocol. Moreover, current models fail to utilize commonly available relevant non-imaging information (i.e., meta-data). In this paper, the notion of a braided block is introduced as a generalization of convolutional or fully connected layers for learning from paired data (meta-data, images). For robust MRI tissue segmentation, a braided 3D U-Net architecture is implemented as a combination of such braided blocks with scanner information, MRI sequence parameters, geometrical information, and task-specific prior information used as meta-data. When applied to a large (> 16,000 scans) and highly heterogeneous (wide range of MRI protocols) dataset, our method generates highly accurate segmentation results (Dice scores > 0.9) within seconds****The concepts and information presented in this paper are based on research results that are not commercially available..","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"1 1","pages":"136-139"},"PeriodicalIF":0.0,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/isbi45749.2020.9098601","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47139494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Proceedings. IEEE International Symposium on Biomedical Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1