Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635712
Jun-En Ding, Chien-Chin Hsu, Feng Liu
Parkinson's Disease (PD) affects millions globally, impacting movement. Prior research utilized deep learning for PD prediction, primarily focusing on medical images, neglecting the data's underlying manifold structure. This work proposes a multimodal approach encompassing both image and non-image features, leveraging contrastive cross-view graph fusion for PD classification. We introduce a novel multimodal co-attention module, integrating embeddings from separate graph views derived from low-dimensional representations of images and clinical features. This enables more robust and structured feature extraction for improved multi-view data analysis. Additionally, a simplified contrastive loss-based fusion method is devised to enhance cross-view fusion learning. Our graph-view multimodal approach achieves an accuracy of 91% and an area under the receiver operating characteristic curve (AUC) of 92.8% in five-fold cross-validation. It also demonstrates superior predictive capabilities on non-image data compared to solely machine learning-based methods.
{"title":"PARKINSON'S DISEASE CLASSIFICATION USING CONTRASTIVE GRAPH CROSS-VIEW LEARNING WITH MULTIMODAL FUSION OF SPECT IMAGES AND CLINICAL FEATURES.","authors":"Jun-En Ding, Chien-Chin Hsu, Feng Liu","doi":"10.1109/isbi56570.2024.10635712","DOIUrl":"https://doi.org/10.1109/isbi56570.2024.10635712","url":null,"abstract":"<p><p>Parkinson's Disease (PD) affects millions globally, impacting movement. Prior research utilized deep learning for PD prediction, primarily focusing on medical images, neglecting the data's underlying manifold structure. This work proposes a multimodal approach encompassing both image and non-image features, leveraging contrastive cross-view graph fusion for PD classification. We introduce a novel multimodal co-attention module, integrating embeddings from separate graph views derived from low-dimensional representations of images and clinical features. This enables more robust and structured feature extraction for improved multi-view data analysis. Additionally, a simplified contrastive loss-based fusion method is devised to enhance cross-view fusion learning. Our graph-view multimodal approach achieves an accuracy of 91% and an area under the receiver operating characteristic curve (AUC) of 92.8% in five-fold cross-validation. It also demonstrates superior predictive capabilities on non-image data compared to solely machine learning-based methods.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11467967/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142482684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635530
Merve Gülle, Mehmet Akçakaya
Real-time dynamic MRI is important for visualizing time-varying processes in several applications, including cardiac imaging, where it enables free-breathing images of the beating heart without ECG gating. However, current real-time MRI techniques commonly face challenges in achieving the required spatio-temporal resolutions due to limited acceleration rates. In this study, we propose a deep learning (DL) technique for improving the estimation of stationary outer-volume signal from shifted time-interleaved undersampling patterns. Our approach utilizes the pseudo-periodic nature of the ghosting artifacts arising from the moving organs. Subsequently, this estimated outer-volume signal is subtracted from individual timeframes of the real-time MR time series, and each timeframe is reconstructed individually using physics-driven DL methods. Results show improved image quality at high acceleration rates, where conventional methods fail.
{"title":"ROBUST OUTER VOLUME SUBTRACTION WITH DEEP LEARNING GHOSTING DETECTION FOR HIGHLY-ACCELERATED REAL-TIME DYNAMIC MRI.","authors":"Merve Gülle, Mehmet Akçakaya","doi":"10.1109/isbi56570.2024.10635530","DOIUrl":"10.1109/isbi56570.2024.10635530","url":null,"abstract":"<p><p>Real-time dynamic MRI is important for visualizing time-varying processes in several applications, including cardiac imaging, where it enables free-breathing images of the beating heart without ECG gating. However, current real-time MRI techniques commonly face challenges in achieving the required spatio-temporal resolutions due to limited acceleration rates. In this study, we propose a deep learning (DL) technique for improving the estimation of stationary outer-volume signal from shifted time-interleaved undersampling patterns. Our approach utilizes the pseudo-periodic nature of the ghosting artifacts arising from the moving organs. Subsequently, this estimated outer-volume signal is subtracted from individual timeframes of the real-time MR time series, and each timeframe is reconstructed individually using physics-driven DL methods. Results show improved image quality at high acceleration rates, where conventional methods fail.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11742269/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143017997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635581
Zixuan Wen, Jingxuan Bao, Shu Yang, Junhao Wen, Qipeng Zhan, Yuhan Cui, Guray Erus, Zhijian Yang, Paul M Thompson, Yize Zhao, Christos Davatzikos, Li Shen
Morphometricity examines the global statistical association between brain morphology and an observable trait, and is defined as the proportion of the trait variation attributable to brain morphology. In this work, we propose an accurate morphometricity estimator based on the generalized random effects (GRE) model, and perform morphometricity analyses on five cognitive traits in an Alzheimer's study. Our empirical study shows that the proposed GRE model outperforms the widely used LME model on both simulation and real data. In addition, we extend morphometricity estimation from the whole brain to the focal-brain level, and examine and quantify both global and regional neuroanatomical signatures of the cognitive traits. Our global analysis reveals 1) a relatively strong anatomical basis for ADAS13, 2) intermediate ones for MMSE, CDRSB and FAQ, and 3) a relatively weak one for RAVLT.learning. The top associations identified from our regional morphometricity analysis include those between all five cognitive traits and multiple regions such as hippocampus, amygdala, and inferior lateral ventricles. As expected, the identified regional associations are weaker than the global ones. While the whole brain analysis is more powerful in identifying higher morphometricity, the regional analysis could localize the neuroanatomical signatures of the studied cognitive traits and thus provide valuable information in imaging and cognitive biomarker discovery for normal and/or disordered brain research.
形态计量学研究大脑形态与可观察特质之间的整体统计关联,其定义是大脑形态在特质变异中所占的比例。在这项工作中,我们提出了一种基于广义随机效应(GRE)模型的精确形态计量学估计方法,并在一项阿尔茨海默氏症研究中对五种认知特质进行了形态计量学分析。我们的实证研究表明,所提出的 GRE 模型在模拟和真实数据上都优于广泛使用的 LME 模型。此外,我们还将形态计量估计从全脑扩展到了局灶脑水平,并对认知特征的全局和区域神经解剖特征进行了研究和量化。我们的全局分析表明:1)ADAS13 的解剖学基础相对较强;2)MMSE、CDRSB 和 FAQ 的解剖学基础居中;3)RAVLT.learning 的解剖学基础相对较弱。从我们的区域形态计量学分析中发现的首要关联包括所有五个认知特质与多个区域(如海马、杏仁核和下侧脑室)之间的关联。不出所料,区域关联弱于整体关联。虽然全脑分析在识别更高的形态计量学方面更强大,但区域分析可以定位所研究认知特征的神经解剖特征,从而为正常和/或失调大脑研究的成像和认知生物标记物发现提供有价值的信息。
{"title":"MULTISCALE ESTIMATION OF MORPHOMETRICITY FOR REVEALING NEUROANATOMICAL BASIS OF COGNITIVE TRAITS.","authors":"Zixuan Wen, Jingxuan Bao, Shu Yang, Junhao Wen, Qipeng Zhan, Yuhan Cui, Guray Erus, Zhijian Yang, Paul M Thompson, Yize Zhao, Christos Davatzikos, Li Shen","doi":"10.1109/isbi56570.2024.10635581","DOIUrl":"10.1109/isbi56570.2024.10635581","url":null,"abstract":"<p><p>Morphometricity examines the global statistical association between brain morphology and an observable trait, and is defined as the proportion of the trait variation attributable to brain morphology. In this work, we propose an accurate morphometricity estimator based on the generalized random effects (GRE) model, and perform morphometricity analyses on five cognitive traits in an Alzheimer's study. Our empirical study shows that the proposed GRE model outperforms the widely used LME model on both simulation and real data. In addition, we extend morphometricity estimation from the whole brain to the focal-brain level, and examine and quantify both global and regional neuroanatomical signatures of the cognitive traits. Our global analysis reveals 1) a relatively strong anatomical basis for ADAS13, 2) intermediate ones for MMSE, CDRSB and FAQ, and 3) a relatively weak one for RAVLT.learning. The top associations identified from our regional morphometricity analysis include those between all five cognitive traits and multiple regions such as hippocampus, amygdala, and inferior lateral ventricles. As expected, the identified regional associations are weaker than the global ones. While the whole brain analysis is more powerful in identifying higher morphometricity, the regional analysis could localize the neuroanatomical signatures of the studied cognitive traits and thus provide valuable information in imaging and cognitive biomarker discovery for normal and/or disordered brain research.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11452152/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142382698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635307
William Kelley, Nathan Ngo, Adrian V Dalca, Bruce Fischl, Lilla Zöllei, Malte Hoffmann
Skull-stripping is the removal of background and non-brain anatomical features from brain images. While many skull-stripping tools exist, few target pediatric populations. With the emergence of multi-institutional pediatric data acquisition efforts to broaden the understanding of perinatal brain development, it is essential to develop robust and well-tested tools ready for the relevant data processing. However, the broad range of neuroanatomical variation in the developing brain, combined with additional challenges such as high motion levels, as well as shoulder and chest signal in the images, leaves many adult-specific tools ill-suited for pediatric skull-stripping. Building on an existing framework for robust and accurate skull-stripping, we propose developmental SynthStrip (d-SynthStrip), a skull-stripping model tailored to pediatric images. This framework exposes networks to highly variable images synthesized from label maps. Our model substantially outperforms pediatric baselines across scan types and age cohorts. In addition, the <1-minute runtime of our tool compares favorably to the fastest baselines. We distribute our model at https://w3id.org/synthstrip.
{"title":"BOOSTING SKULL-STRIPPING PERFORMANCE FOR PEDIATRIC BRAIN IMAGES.","authors":"William Kelley, Nathan Ngo, Adrian V Dalca, Bruce Fischl, Lilla Zöllei, Malte Hoffmann","doi":"10.1109/isbi56570.2024.10635307","DOIUrl":"10.1109/isbi56570.2024.10635307","url":null,"abstract":"<p><p>Skull-stripping is the removal of background and non-brain anatomical features from brain images. While many skull-stripping tools exist, few target pediatric populations. With the emergence of multi-institutional pediatric data acquisition efforts to broaden the understanding of perinatal brain development, it is essential to develop robust and well-tested tools ready for the relevant data processing. However, the broad range of neuroanatomical variation in the developing brain, combined with additional challenges such as high motion levels, as well as shoulder and chest signal in the images, leaves many adult-specific tools ill-suited for pediatric skull-stripping. Building on an existing framework for robust and accurate skull-stripping, we propose developmental SynthStrip (d-SynthStrip), a skull-stripping model tailored to pediatric images. This framework exposes networks to highly variable images synthesized from label maps. Our model substantially outperforms pediatric baselines across scan types and age cohorts. In addition, the <1-minute runtime of our tool compares favorably to the fastest baselines. We distribute our model at https://w3id.org/synthstrip.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11451993/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142382695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635393
Soumyanil Banerjee, Ming Dong, Carri Glide-Hurst
U-shaped networks and its variants have demonstrated exceptional results for medical image segmentation. In this paper, we propose a novel dual self-distillation (DSD) framework for U-shaped networks for 3D medical image segmentation. DSD distills knowledge from the ground-truth segmentation labels to the decoder layers and also between the encoder and decoder layers of a single U-shaped network. DSD is a generalized training strategy that could be attached to the backbone architecture of any U-shaped network to further improve its segmentation performance. We attached DSD on two state-of-the-art U-shaped backbones, and extensive experiments on two public 3D medical image segmentation datasets demonstrated significant improvement over those backbones, with negligible increase in trainable parameters and training time. The source code is publicly available at https://github.com/soumbane/DualSelfDistillation.
{"title":"DUAL SELF-DISTILLATION OF U-SHAPED NETWORKS FOR 3D MEDICAL IMAGE SEGMENTATION.","authors":"Soumyanil Banerjee, Ming Dong, Carri Glide-Hurst","doi":"10.1109/isbi56570.2024.10635393","DOIUrl":"10.1109/isbi56570.2024.10635393","url":null,"abstract":"<p><p>U-shaped networks and its variants have demonstrated exceptional results for medical image segmentation. In this paper, we propose a novel dual self-distillation (DSD) framework for U-shaped networks for 3D medical image segmentation. DSD distills knowledge from the ground-truth segmentation labels to the decoder layers and also between the encoder and decoder layers of a single U-shaped network. DSD is a generalized training strategy that could be attached to the backbone architecture of any U-shaped network to further improve its segmentation performance. We attached DSD on two state-of-the-art U-shaped backbones, and extensive experiments on two public 3D medical image segmentation datasets demonstrated significant improvement over those backbones, with negligible increase in trainable parameters and training time. The source code is publicly available at https://github.com/soumbane/DualSelfDistillation.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11666255/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142883949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635805
Y Djebra, X Liu, T Marin, A Tiss, M Dhaynaut, N Guehl, K Johnson, G El Fakhri, C Ma, J Ouyang
Positron Emission Tomography (PET) is a valuable imaging method for studying molecular-level processes in the body, such as hyperphosphorylated tau (p-tau) protein aggregates, a hallmark of several neurodegenerative diseases including Alzheimer's disease. P-tau density and cerebral perfusion can be quantified from PET data using tracer kinetic modeling techniques. However, noise in PET images leads to uncertainty in the estimated kinetic parameters. This can be quantified in a Bayesian framework by the posterior distribution of kinetic parameters given PET measurements. Markov Chain Monte Carlo (MCMC) techniques can be employed to estimate the posterior distribution, although with significant computational needs. In this paper, we propose to leverage deep learning inference efficiency to infer the posterior distribution. A novel approach using denoising diffusion probabilistic model (DDPM) is introduced. The performance of the proposed method was evaluated on a [18F]MK6240 study and compared to an MCMC method. Our approach offered significant reduction in computation time (over 30 times faster than MCMC) and consistently predicted accurate (< 0.8 % mean error) and precise (< 5.77 % standard deviation error) posterior distributions.
正电子发射断层扫描(PET)是研究体内分子水平过程的一种重要成像方法,例如高磷酸化 tau(p-tau)蛋白聚集,这是包括阿尔茨海默病在内的多种神经退行性疾病的标志。利用示踪剂动力学建模技术,可以从 PET 数据中量化 P-tau 密度和脑灌注。然而,PET 图像中的噪声会导致估计动力学参数的不确定性。这可以在贝叶斯框架中通过给定 PET 测量值的动力学参数后验分布来量化。马尔可夫链蒙特卡罗(MCMC)技术可用于估计后验分布,但需要大量计算。在本文中,我们建议利用深度学习推理的效率来推断后验分布。本文介绍了一种使用去噪扩散概率模型(DDPM)的新方法。我们在[18F]MK6240 研究中评估了所提方法的性能,并将其与 MCMC 方法进行了比较。我们的方法大大减少了计算时间(比 MCMC 方法快 30 多倍),并能持续预测准确(平均误差小于 0.8%)和精确(标准偏差误差小于 5.77%)的后验分布。
{"title":"DIFFUSION MODEL-BASED POSTERIOR DISTRIBUTION PREDICTION FOR KINETIC PARAMETER ESTIMATION IN DYNAMIC PET.","authors":"Y Djebra, X Liu, T Marin, A Tiss, M Dhaynaut, N Guehl, K Johnson, G El Fakhri, C Ma, J Ouyang","doi":"10.1109/isbi56570.2024.10635805","DOIUrl":"https://doi.org/10.1109/isbi56570.2024.10635805","url":null,"abstract":"<p><p>Positron Emission Tomography (PET) is a valuable imaging method for studying molecular-level processes in the body, such as hyperphosphorylated tau (p-tau) protein aggregates, a hallmark of several neurodegenerative diseases including Alzheimer's disease. P-tau density and cerebral perfusion can be quantified from PET data using tracer kinetic modeling techniques. However, noise in PET images leads to uncertainty in the estimated kinetic parameters. This can be quantified in a Bayesian framework by the posterior distribution of kinetic parameters given PET measurements. Markov Chain Monte Carlo (MCMC) techniques can be employed to estimate the posterior distribution, although with significant computational needs. In this paper, we propose to leverage deep learning inference efficiency to infer the posterior distribution. A novel approach using denoising diffusion probabilistic model (DDPM) is introduced. The performance of the proposed method was evaluated on a [18F]MK6240 study and compared to an MCMC method. Our approach offered significant reduction in computation time (over 30 times faster than MCMC) and consistently predicted accurate (< 0.8 % mean error) and precise (< 5.77 % standard deviation error) posterior distributions.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11554386/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142633903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635753
Peiyu Duan, Nicha C Dvornek, Jiyao Wang, Jeffrey Eilbott, Yuexi Du, Denis G Sukhodolsky, James S Duncan
Children with Autism Spectrum Disorder (ASD) frequently exhibit comorbid anxiety, which contributes to impairment and requires treatment. Therefore, it is critical to investigate co-occurring autism and anxiety with functional imaging tools to understand the brain mechanisms of this comorbidity. Multidimensional Anxiety Scale for Children, 2nd edition (MASC-2) score is a common tool to evaluate the daily anxiety level in autistic children. Predicting MASC-2 score with Functional Magnetic Resonance Imaging (fMRI) data will help gain more insights into the brain functional networks of children with ASD complicated by anxiety. However, most of the current graph neural network (GNN) studies using fMRI only focus on graph operations but ignore the spectral features. In this paper, we explored the feasibility of using spectral features to predict the MASC-2 total scores. We proposed SpectBGNN, a graph-based network, which uses spectral features and integrates graph spectral filtering layers to extract hidden information. We experimented with multiple spectral analysis algorithms and compared the performance of the SpectBGNN model with CPM, GAT, and BrainGNN on a dataset consisting of 26 typically developing and 70 ASD children with 5-fold cross-validation. We showed that among all spectral analysis algorithms tested, using the Fast Fourier Transform (FFT) or Welch's Power Spectrum Density (PSD) as node features performs significantly better than correlation features, and adding the graph spectral filtering layer significantly increases the network's performance.
{"title":"SPECTRAL BRAIN GRAPH NEURAL NETWORK FOR PREDICTION OF ANXIETY IN CHILDREN WITH AUTISM SPECTRUM DISORDER.","authors":"Peiyu Duan, Nicha C Dvornek, Jiyao Wang, Jeffrey Eilbott, Yuexi Du, Denis G Sukhodolsky, James S Duncan","doi":"10.1109/isbi56570.2024.10635753","DOIUrl":"10.1109/isbi56570.2024.10635753","url":null,"abstract":"<p><p>Children with Autism Spectrum Disorder (ASD) frequently exhibit comorbid anxiety, which contributes to impairment and requires treatment. Therefore, it is critical to investigate co-occurring autism and anxiety with functional imaging tools to understand the brain mechanisms of this comorbidity. Multidimensional Anxiety Scale for Children, 2nd edition (MASC-2) score is a common tool to evaluate the daily anxiety level in autistic children. Predicting MASC-2 score with Functional Magnetic Resonance Imaging (fMRI) data will help gain more insights into the brain functional networks of children with ASD complicated by anxiety. However, most of the current graph neural network (GNN) studies using fMRI only focus on graph operations but ignore the spectral features. In this paper, we explored the feasibility of using spectral features to predict the MASC-2 total scores. We proposed SpectBGNN, a graph-based network, which uses spectral features and integrates graph spectral filtering layers to extract hidden information. We experimented with multiple spectral analysis algorithms and compared the performance of the SpectBGNN model with CPM, GAT, and BrainGNN on a dataset consisting of 26 typically developing and 70 ASD children with 5-fold cross-validation. We showed that among all spectral analysis algorithms tested, using the Fast Fourier Transform (FFT) or Welch's Power Spectrum Density (PSD) as node features performs significantly better than correlation features, and adding the graph spectral filtering layer significantly increases the network's performance.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11655121/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142856866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635897
Sayantan Kumar, Philip Payne, Aristeidis Sotiras
Normative models in neuroimaging learn the brain patterns of healthy population distribution and estimate how disease subjects like Alzheimer's Disease (AD) deviate from the norm. Existing variational autoencoder (VAE)-based normative models using multimodal neuroimaging data aggregate information from multiple modalities by estimating product or averaging of unimodal latent posteriors. This can often lead to uninformative joint latent distributions which affects the estimation of subject-level deviations. In this work, we addressed the prior limitations by adopting the Mixture-of-Product-of-Experts (MoPoE) technique which allows better modelling of the joint latent posterior. Our model labelled subjects as outliers by calculating deviations from the multimodal latent space. Further, we identified which latent dimensions and brain regions were associated with abnormal deviations due to AD pathology.
{"title":"IMPROVING NORMATIVE MODELING FOR MULTI-MODAL NEUROIMAGING DATA USING MIXTURE-OF-PRODUCT-OF-EXPERTS VARIATIONAL AUTOENCODERS.","authors":"Sayantan Kumar, Philip Payne, Aristeidis Sotiras","doi":"10.1109/isbi56570.2024.10635897","DOIUrl":"10.1109/isbi56570.2024.10635897","url":null,"abstract":"<p><p>Normative models in neuroimaging learn the brain patterns of healthy population distribution and estimate how disease subjects like Alzheimer's Disease (AD) deviate from the norm. Existing variational autoencoder (VAE)-based normative models using multimodal neuroimaging data aggregate information from multiple modalities by estimating product or averaging of unimodal latent posteriors. This can often lead to uninformative joint latent distributions which affects the estimation of subject-level deviations. In this work, we addressed the prior limitations by adopting the Mixture-of-Product-of-Experts (MoPoE) technique which allows better modelling of the joint latent posterior. Our model labelled subjects as outliers by calculating deviations from the multimodal latent space. Further, we identified which latent dimensions and brain regions were associated with abnormal deviations due to AD pathology.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11600985/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142752610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/isbi56570.2024.10635855
Toygan Kilic, Jürgen Herrler, Patrick Liebig, Ömer Burak Demirel, Armin Nagel, Mingyi Hong, Georgios B Giannakis, Kamil Ugurbil, Mehmet Akçakaya
Parallel transmission (pTx) is an important technique for reducing transmit field inhomogeneities at ultrahigh-field (UHF) MRI. pTx typically involves solving an optimization problem for radiofrequency pulse design, with hard constraints on specific-absorption rate (SAR) and/or power, which may be time-consuming. In this work, we propose a novel approach towards incorporating hard constraints to physics-driven neural networks. Our method unrolls an extension of the log-barrier method, where the central path problems are solved via the gradient descent method whose optimal step sizes are learned with a neural network. Results indicate that our method is substantially faster compared to traditional convex optimization techniques, while achieving similar performance.
{"title":"TOWARDS FAST HARD-CONSTRAINED PARALLEL TRANSMIT DESIGN IN ULTRAHIGH FIELD MRI WITH PHYSICS-DRIVEN NEURAL NETWORKS.","authors":"Toygan Kilic, Jürgen Herrler, Patrick Liebig, Ömer Burak Demirel, Armin Nagel, Mingyi Hong, Georgios B Giannakis, Kamil Ugurbil, Mehmet Akçakaya","doi":"10.1109/isbi56570.2024.10635855","DOIUrl":"10.1109/isbi56570.2024.10635855","url":null,"abstract":"<p><p>Parallel transmission (pTx) is an important technique for reducing transmit field inhomogeneities at ultrahigh-field (UHF) MRI. pTx typically involves solving an optimization problem for radiofrequency pulse design, with hard constraints on specific-absorption rate (SAR) and/or power, which may be time-consuming. In this work, we propose a novel approach towards incorporating hard constraints to physics-driven neural networks. Our method unrolls an extension of the log-barrier method, where the central path problems are solved via the gradient descent method whose optimal step sizes are learned with a neural network. Results indicate that our method is substantially faster compared to traditional convex optimization techniques, while achieving similar performance.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11736015/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143017999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-08-22DOI: 10.1109/ISBI56570.2024.10635723
Yuexi Du, Regina J Hooley, John Lewin, Nicha C Dvornek
Digital Breast Tomosynthesis (DBT) is a widely used medical imaging modality for breast cancer screening and diagnosis, offering higher spatial resolution and greater detail through its 3D-like breast volume imaging capability. However, the increased data volume also introduces pronounced data imbalance challenges, where only a small fraction of the volume contains suspicious tissue. This further exacerbates the data imbalance due to the case-level distribution in real-world data and leads to learning a trivial classification model that only predicts the majority class. To address this, we propose a novel method using view-level contrastive Self-supervised Initialization and Fine-Tuning for identifying abnormal DBT images, namely SIFT-DBT. We further introduce a patch-level multi-instance learning method to preserve spatial resolution. The proposed method achieves 92.69% volume-wise AUC on an evaluation of 970 unique studies.
{"title":"SIFT-DBT: SELF-SUPERVISED INITIALIZATION AND FINE-TUNING FOR IMBALANCED DIGITAL BREAST TOMOSYNTHESIS IMAGE CLASSIFICATION.","authors":"Yuexi Du, Regina J Hooley, John Lewin, Nicha C Dvornek","doi":"10.1109/ISBI56570.2024.10635723","DOIUrl":"https://doi.org/10.1109/ISBI56570.2024.10635723","url":null,"abstract":"<p><p>Digital Breast Tomosynthesis (DBT) is a widely used medical imaging modality for breast cancer screening and diagnosis, offering higher spatial resolution and greater detail through its 3D-like breast volume imaging capability. However, the increased data volume also introduces pronounced data imbalance challenges, where only a small fraction of the volume contains suspicious tissue. This further exacerbates the data imbalance due to the case-level distribution in real-world data and leads to learning a trivial classification model that only predicts the majority class. To address this, we propose a novel method using view-level contrastive <b>S</b>elf-supervised <b>I</b>nitialization and <b>F</b>ine-<b>T</b>uning for identifying abnormal <b>DBT</b> images, namely <b>SIFT-DBT</b>. We further introduce a patch-level multi-instance learning method to preserve spatial resolution. The proposed method achieves 92.69% volume-wise AUC on an evaluation of 970 unique studies.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11386909/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142302996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}