使用 3D-StyleGAN 建立威利斯环的生成模型。

IF 4.7 2区 医学 Q1 NEUROIMAGING NeuroImage Pub Date : 2024-11-23 DOI:10.1016/j.neuroimage.2024.120936
Orhun Utku Aydin , Adam Hilbert , Alexander Koch , Felix Lohrke , Jana Rieger , Satoru Tanioka , Dietmar Frey
{"title":"使用 3D-StyleGAN 建立威利斯环的生成模型。","authors":"Orhun Utku Aydin ,&nbsp;Adam Hilbert ,&nbsp;Alexander Koch ,&nbsp;Felix Lohrke ,&nbsp;Jana Rieger ,&nbsp;Satoru Tanioka ,&nbsp;Dietmar Frey","doi":"10.1016/j.neuroimage.2024.120936","DOIUrl":null,"url":null,"abstract":"<div><div>The circle of Willis (CoW) is a network of cerebral arteries with significant inter-individual anatomical variations. Deep learning has been used to characterize and quantify the status of the CoW in various applications for the diagnosis and treatment of cerebrovascular disease. In medical imaging, the performance of deep learning models is limited by the diversity and size of training datasets. To address medical data scarcity, generative AI models have been applied to generate synthetic vessel neuroimaging data. However, the proposed methods produce synthetic data with limited anatomical fidelity or downstream utility in tasks concerning vessel characteristics.</div><div>We adapted the StyleGANv2 architecture to 3D to synthesize Time-of-Flight Magnetic Resonance Angiography (TOF MRA) volumes of the CoW. For generative modeling, we used 1782 individual TOF MRA scans from 6 open source datasets. To train the adapted 3D StyleGAN model with limited data we employed differentiable data augmentations, used mixed precision and a cropped region of interest of size 32 × 128 × 128 to tackle computational constraints. The performance was evaluated quantitatively using the Fréchet Inception Distance (FID), MedicalNet distance (MD) and Area Under the Curve of the Precision and Recall Curve for Distributions (AUC-PRD). Qualitative analysis was performed via a visual Turing test. We demonstrated the utility of generated data in a downstream task of multiclass semantic segmentation of CoW arteries. Vessel segmentation performance was assessed quantitatively using the Dice coefficient and the Hausdorff distance.</div><div>The best-performing 3D StyleGANv2 architecture generated high-quality and diverse synthetic TOF MRA volumes (FID: 12.17, MD: 0.00078, AUC-PRD: 0.9610). Multiclass vessel segmentation models trained on synthetic data alone achieved comparable performance to models trained using real data in most arteries. The addition of synthetic data to a baseline training set improved segmentation performance in underrepresented artery segments, similar to the addition of real data.</div><div>In conclusion, generative modeling of the Circle of Willis via synthesis of 3D TOF MRA data paves the way for generalizable deep learning applications in cerebrovascular disease. In the future, the extensions of the provided methodology to other medical imaging problems or modalities with the inclusion of pathological datasets has the potential to advance the development of more robust AI models for clinical applications.</div></div>","PeriodicalId":19299,"journal":{"name":"NeuroImage","volume":"304 ","pages":"Article 120936"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Generative modeling of the Circle of Willis using 3D-StyleGAN\",\"authors\":\"Orhun Utku Aydin ,&nbsp;Adam Hilbert ,&nbsp;Alexander Koch ,&nbsp;Felix Lohrke ,&nbsp;Jana Rieger ,&nbsp;Satoru Tanioka ,&nbsp;Dietmar Frey\",\"doi\":\"10.1016/j.neuroimage.2024.120936\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The circle of Willis (CoW) is a network of cerebral arteries with significant inter-individual anatomical variations. Deep learning has been used to characterize and quantify the status of the CoW in various applications for the diagnosis and treatment of cerebrovascular disease. In medical imaging, the performance of deep learning models is limited by the diversity and size of training datasets. To address medical data scarcity, generative AI models have been applied to generate synthetic vessel neuroimaging data. However, the proposed methods produce synthetic data with limited anatomical fidelity or downstream utility in tasks concerning vessel characteristics.</div><div>We adapted the StyleGANv2 architecture to 3D to synthesize Time-of-Flight Magnetic Resonance Angiography (TOF MRA) volumes of the CoW. For generative modeling, we used 1782 individual TOF MRA scans from 6 open source datasets. To train the adapted 3D StyleGAN model with limited data we employed differentiable data augmentations, used mixed precision and a cropped region of interest of size 32 × 128 × 128 to tackle computational constraints. The performance was evaluated quantitatively using the Fréchet Inception Distance (FID), MedicalNet distance (MD) and Area Under the Curve of the Precision and Recall Curve for Distributions (AUC-PRD). Qualitative analysis was performed via a visual Turing test. We demonstrated the utility of generated data in a downstream task of multiclass semantic segmentation of CoW arteries. Vessel segmentation performance was assessed quantitatively using the Dice coefficient and the Hausdorff distance.</div><div>The best-performing 3D StyleGANv2 architecture generated high-quality and diverse synthetic TOF MRA volumes (FID: 12.17, MD: 0.00078, AUC-PRD: 0.9610). Multiclass vessel segmentation models trained on synthetic data alone achieved comparable performance to models trained using real data in most arteries. The addition of synthetic data to a baseline training set improved segmentation performance in underrepresented artery segments, similar to the addition of real data.</div><div>In conclusion, generative modeling of the Circle of Willis via synthesis of 3D TOF MRA data paves the way for generalizable deep learning applications in cerebrovascular disease. In the future, the extensions of the provided methodology to other medical imaging problems or modalities with the inclusion of pathological datasets has the potential to advance the development of more robust AI models for clinical applications.</div></div>\",\"PeriodicalId\":19299,\"journal\":{\"name\":\"NeuroImage\",\"volume\":\"304 \",\"pages\":\"Article 120936\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-11-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"NeuroImage\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1053811924004336\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"NEUROIMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"NeuroImage","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1053811924004336","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROIMAGING","Score":null,"Total":0}
引用次数: 0

摘要

威利斯圈(CoW)是一个脑动脉网络,其解剖结构在个体间存在显著差异。在诊断和治疗脑血管疾病的各种应用中,深度学习已被用于表征和量化威利斯圈的状态。在医学成像领域,深度学习模型的性能受限于训练数据集的多样性和规模。为了解决医疗数据稀缺的问题,生成式人工智能模型已被用于生成合成血管神经成像数据。然而,所提出的方法生成的合成数据解剖保真度有限,在有关血管特征的任务中的下游效用也有限。我们对 StyleGANv2 架构进行了三维调整,以合成飞行时间磁共振血管成像(TOF MRA)的 CoW 容积。在生成模型时,我们使用了来自 6 个开源数据集的 1782 个 TOF MRA 扫描。为了用有限的数据训练经过调整的 3D StyleGAN 模型,我们采用了可变数据增强、混合精度和 32 × 128 × 128 大小的裁剪感兴趣区来解决计算限制问题。我们使用弗雷谢特起始距离(FID)、医学网距离(MD)以及精确度和召回率分布曲线下面积(AUC-PRD)对性能进行了定量评估。定性分析通过视觉图灵测试进行。我们展示了生成的数据在下游任务(CoW 动脉的多类语义分割)中的实用性。我们使用 Dice 系数和 Hausdorff 距离对血管分割性能进行了定量评估。表现最佳的 3D StyleGANv2 架构生成了高质量和多样化的合成 TOF MRA 容量(FID:12.17,MD:0.00078,AUC-PRD:0.9610)。在大多数动脉中,仅使用合成数据训练的多分类血管分割模型与使用真实数据训练的模型性能相当。将合成数据添加到基线训练集后,在代表性不足的动脉区段的分割性能得到了提高,这与添加真实数据的效果类似。总之,通过合成三维 TOF MRA 数据对威利斯环进行生成建模,为脑血管疾病中可推广的深度学习应用铺平了道路。未来,将所提供的方法扩展到其他医学影像问题或模式,并纳入病理数据集,有可能推动临床应用中更强大的人工智能模型的开发。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Generative modeling of the Circle of Willis using 3D-StyleGAN
The circle of Willis (CoW) is a network of cerebral arteries with significant inter-individual anatomical variations. Deep learning has been used to characterize and quantify the status of the CoW in various applications for the diagnosis and treatment of cerebrovascular disease. In medical imaging, the performance of deep learning models is limited by the diversity and size of training datasets. To address medical data scarcity, generative AI models have been applied to generate synthetic vessel neuroimaging data. However, the proposed methods produce synthetic data with limited anatomical fidelity or downstream utility in tasks concerning vessel characteristics.
We adapted the StyleGANv2 architecture to 3D to synthesize Time-of-Flight Magnetic Resonance Angiography (TOF MRA) volumes of the CoW. For generative modeling, we used 1782 individual TOF MRA scans from 6 open source datasets. To train the adapted 3D StyleGAN model with limited data we employed differentiable data augmentations, used mixed precision and a cropped region of interest of size 32 × 128 × 128 to tackle computational constraints. The performance was evaluated quantitatively using the Fréchet Inception Distance (FID), MedicalNet distance (MD) and Area Under the Curve of the Precision and Recall Curve for Distributions (AUC-PRD). Qualitative analysis was performed via a visual Turing test. We demonstrated the utility of generated data in a downstream task of multiclass semantic segmentation of CoW arteries. Vessel segmentation performance was assessed quantitatively using the Dice coefficient and the Hausdorff distance.
The best-performing 3D StyleGANv2 architecture generated high-quality and diverse synthetic TOF MRA volumes (FID: 12.17, MD: 0.00078, AUC-PRD: 0.9610). Multiclass vessel segmentation models trained on synthetic data alone achieved comparable performance to models trained using real data in most arteries. The addition of synthetic data to a baseline training set improved segmentation performance in underrepresented artery segments, similar to the addition of real data.
In conclusion, generative modeling of the Circle of Willis via synthesis of 3D TOF MRA data paves the way for generalizable deep learning applications in cerebrovascular disease. In the future, the extensions of the provided methodology to other medical imaging problems or modalities with the inclusion of pathological datasets has the potential to advance the development of more robust AI models for clinical applications.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
NeuroImage
NeuroImage 医学-核医学
CiteScore
11.30
自引率
10.50%
发文量
809
审稿时长
63 days
期刊介绍: NeuroImage, a Journal of Brain Function provides a vehicle for communicating important advances in acquiring, analyzing, and modelling neuroimaging data and in applying these techniques to the study of structure-function and brain-behavior relationships. Though the emphasis is on the macroscopic level of human brain organization, meso-and microscopic neuroimaging across all species will be considered if informative for understanding the aforementioned relationships.
期刊最新文献
Sex differences in autism spectrum disorder using class imbalance adjusted functional connectivity A first-in-human application of OPM-MEG for localizing motor activity area: compared to functional MRI. Differentiating atypical parkinsonian syndromes with hyperbolic few-shot contrastive learning Exploring the relationship between hallucination proneness and brain morphology Biological mechanism of sex differences in mental rotation: Evidence from multimodal MRI, transcriptomic and receptor/transporter data
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1