Jiyao Wang, Nicha C Dvornek, Lawrence H Staib, James S Duncan
{"title":"在基于任务的 fMRI 中学习序列信息,以实现合成数据增强。","authors":"Jiyao Wang, Nicha C Dvornek, Lawrence H Staib, James S Duncan","doi":"10.1007/978-3-031-44858-4_8","DOIUrl":null,"url":null,"abstract":"<p><p>Insufficiency of training data is a persistent issue in medical image analysis, especially for task-based functional magnetic resonance images (fMRI) with spatio-temporal imaging data acquired using specific cognitive tasks. In this paper, we propose an approach for generating synthetic fMRI sequences that can then be used to create augmented training datasets in downstream learning tasks. To synthesize high-resolution task-specific fMRI, we adapt the <i>α</i>-GAN structure, leveraging advantages of both GAN and variational autoencoder models, and propose different alternatives in aggregating temporal information. The synthetic images are evaluated from multiple perspectives including visualizations and an autism spectrum disorder (ASD) classification task. The results show that the synthetic task-based fMRI can provide effective data augmentation in learning the ASD classification task.</p>","PeriodicalId":510900,"journal":{"name":"Machine learning in clinical neuroimaging : 6th international workshop, MLCN 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MLCN (Workshop) (6th : 2023 : Vancouver, B.C.)","volume":"14312 ","pages":"79-88"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11395879/pdf/","citationCount":"0","resultStr":"{\"title\":\"Learning Sequential Information in Task-based fMRI for Synthetic Data Augmentation.\",\"authors\":\"Jiyao Wang, Nicha C Dvornek, Lawrence H Staib, James S Duncan\",\"doi\":\"10.1007/978-3-031-44858-4_8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Insufficiency of training data is a persistent issue in medical image analysis, especially for task-based functional magnetic resonance images (fMRI) with spatio-temporal imaging data acquired using specific cognitive tasks. In this paper, we propose an approach for generating synthetic fMRI sequences that can then be used to create augmented training datasets in downstream learning tasks. To synthesize high-resolution task-specific fMRI, we adapt the <i>α</i>-GAN structure, leveraging advantages of both GAN and variational autoencoder models, and propose different alternatives in aggregating temporal information. The synthetic images are evaluated from multiple perspectives including visualizations and an autism spectrum disorder (ASD) classification task. The results show that the synthetic task-based fMRI can provide effective data augmentation in learning the ASD classification task.</p>\",\"PeriodicalId\":510900,\"journal\":{\"name\":\"Machine learning in clinical neuroimaging : 6th international workshop, MLCN 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MLCN (Workshop) (6th : 2023 : Vancouver, B.C.)\",\"volume\":\"14312 \",\"pages\":\"79-88\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11395879/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Machine learning in clinical neuroimaging : 6th international workshop, MLCN 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MLCN (Workshop) (6th : 2023 : Vancouver, B.C.)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-44858-4_8\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine learning in clinical neuroimaging : 6th international workshop, MLCN 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MLCN (Workshop) (6th : 2023 : Vancouver, B.C.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-44858-4_8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Learning Sequential Information in Task-based fMRI for Synthetic Data Augmentation.
Insufficiency of training data is a persistent issue in medical image analysis, especially for task-based functional magnetic resonance images (fMRI) with spatio-temporal imaging data acquired using specific cognitive tasks. In this paper, we propose an approach for generating synthetic fMRI sequences that can then be used to create augmented training datasets in downstream learning tasks. To synthesize high-resolution task-specific fMRI, we adapt the α-GAN structure, leveraging advantages of both GAN and variational autoencoder models, and propose different alternatives in aggregating temporal information. The synthetic images are evaluated from multiple perspectives including visualizations and an autism spectrum disorder (ASD) classification task. The results show that the synthetic task-based fMRI can provide effective data augmentation in learning the ASD classification task.