Chiara Manini, Markus Hüllebrand, Lars Walczak, Sarah Nordmeyer, Lina Jarmatz, Titus Kuehne, Heiko Stern, Christian Meierhofer, Andreas Harloff, Jennifer Erley, Sebastian Kelle, Peter Bannas, Ralf Felix Trauzeddel, Jeanette Schulz-Menger, Anja Hennemuth
{"title":"训练数据组成对 4D 流磁共振成像中 CNN 主动脉横截面分割通用性的影响。","authors":"Chiara Manini, Markus Hüllebrand, Lars Walczak, Sarah Nordmeyer, Lina Jarmatz, Titus Kuehne, Heiko Stern, Christian Meierhofer, Andreas Harloff, Jennifer Erley, Sebastian Kelle, Peter Bannas, Ralf Felix Trauzeddel, Jeanette Schulz-Menger, Anja Hennemuth","doi":"10.1016/j.jocmr.2024.101081","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Four-dimensional cardiovascular magnetic resonance flow imaging (4D flow CMR) plays an important role in assessing cardiovascular diseases. However, the manual or semi-automatic segmentation of aortic vessel boundaries in 4D flow data introduces variability and limits the reproducibility of aortic hemodynamics visualization and quantitative flow-related parameter computation. This paper explores the potential of deep learning to improve 4D flow CMR segmentation by developing models for automatic segmentation and analyzes the impact of the training data on the generalization of the model across different sites, scanner vendors, sequences, and pathologies.</p><p><strong>Methods: </strong>The study population consists of 260 4D flow CMR datasets, including subjects without known aortic pathology, healthy volunteers, and patients with bicuspid aortic valve (BAV) examined at different hospitals. The dataset was split to train segmentation models on subsets with different representations of characteristics, such as pathology, gender, age, scanner model, vendor, and field strength. An enhanced three-dimensional U-net convolutional neural network (CNN) architecture with residual units was trained for time-resolved two-dimensional aortic cross-sectional segmentation. Model performance was evaluated using Dice score, Hausdorff distance, and average symmetric surface distance on test data, datasets with characteristics not represented in the training set (model-specific), and an overall evaluation set. Standard diagnostic flow parameters were computed and compared with manual segmentation results using Bland-Altman analysis and interclass correlation.</p><p><strong>Results: </strong>The representation of technical factors, such as scanner vendor and field strength, in the training dataset had the strongest influence on the overall segmentation performance. Age had a greater impact than gender. Models solely trained on BAV patients' datasets performed well on datasets of healthy subjects but not vice versa.</p><p><strong>Conclusion: </strong>This study highlights the importance of considering a heterogeneous dataset for the training of widely applicable automatic CNN segmentations in 4D flow CMR, with a particular focus on the inclusion of different pathologies and technical aspects of data acquisition.</p>","PeriodicalId":15221,"journal":{"name":"Journal of Cardiovascular Magnetic Resonance","volume":" ","pages":"101081"},"PeriodicalIF":4.2000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11422555/pdf/","citationCount":"0","resultStr":"{\"title\":\"Impact of training data composition on the generalizability of convolutional neural network aortic cross-section segmentation in four-dimensional magnetic resonance flow imaging.\",\"authors\":\"Chiara Manini, Markus Hüllebrand, Lars Walczak, Sarah Nordmeyer, Lina Jarmatz, Titus Kuehne, Heiko Stern, Christian Meierhofer, Andreas Harloff, Jennifer Erley, Sebastian Kelle, Peter Bannas, Ralf Felix Trauzeddel, Jeanette Schulz-Menger, Anja Hennemuth\",\"doi\":\"10.1016/j.jocmr.2024.101081\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Four-dimensional cardiovascular magnetic resonance flow imaging (4D flow CMR) plays an important role in assessing cardiovascular diseases. However, the manual or semi-automatic segmentation of aortic vessel boundaries in 4D flow data introduces variability and limits the reproducibility of aortic hemodynamics visualization and quantitative flow-related parameter computation. This paper explores the potential of deep learning to improve 4D flow CMR segmentation by developing models for automatic segmentation and analyzes the impact of the training data on the generalization of the model across different sites, scanner vendors, sequences, and pathologies.</p><p><strong>Methods: </strong>The study population consists of 260 4D flow CMR datasets, including subjects without known aortic pathology, healthy volunteers, and patients with bicuspid aortic valve (BAV) examined at different hospitals. The dataset was split to train segmentation models on subsets with different representations of characteristics, such as pathology, gender, age, scanner model, vendor, and field strength. An enhanced three-dimensional U-net convolutional neural network (CNN) architecture with residual units was trained for time-resolved two-dimensional aortic cross-sectional segmentation. Model performance was evaluated using Dice score, Hausdorff distance, and average symmetric surface distance on test data, datasets with characteristics not represented in the training set (model-specific), and an overall evaluation set. Standard diagnostic flow parameters were computed and compared with manual segmentation results using Bland-Altman analysis and interclass correlation.</p><p><strong>Results: </strong>The representation of technical factors, such as scanner vendor and field strength, in the training dataset had the strongest influence on the overall segmentation performance. Age had a greater impact than gender. Models solely trained on BAV patients' datasets performed well on datasets of healthy subjects but not vice versa.</p><p><strong>Conclusion: </strong>This study highlights the importance of considering a heterogeneous dataset for the training of widely applicable automatic CNN segmentations in 4D flow CMR, with a particular focus on the inclusion of different pathologies and technical aspects of data acquisition.</p>\",\"PeriodicalId\":15221,\"journal\":{\"name\":\"Journal of Cardiovascular Magnetic Resonance\",\"volume\":\" \",\"pages\":\"101081\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11422555/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Cardiovascular Magnetic Resonance\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.jocmr.2024.101081\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CARDIAC & CARDIOVASCULAR SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Cardiovascular Magnetic Resonance","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jocmr.2024.101081","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CARDIAC & CARDIOVASCULAR SYSTEMS","Score":null,"Total":0}
Impact of training data composition on the generalizability of convolutional neural network aortic cross-section segmentation in four-dimensional magnetic resonance flow imaging.
Background: Four-dimensional cardiovascular magnetic resonance flow imaging (4D flow CMR) plays an important role in assessing cardiovascular diseases. However, the manual or semi-automatic segmentation of aortic vessel boundaries in 4D flow data introduces variability and limits the reproducibility of aortic hemodynamics visualization and quantitative flow-related parameter computation. This paper explores the potential of deep learning to improve 4D flow CMR segmentation by developing models for automatic segmentation and analyzes the impact of the training data on the generalization of the model across different sites, scanner vendors, sequences, and pathologies.
Methods: The study population consists of 260 4D flow CMR datasets, including subjects without known aortic pathology, healthy volunteers, and patients with bicuspid aortic valve (BAV) examined at different hospitals. The dataset was split to train segmentation models on subsets with different representations of characteristics, such as pathology, gender, age, scanner model, vendor, and field strength. An enhanced three-dimensional U-net convolutional neural network (CNN) architecture with residual units was trained for time-resolved two-dimensional aortic cross-sectional segmentation. Model performance was evaluated using Dice score, Hausdorff distance, and average symmetric surface distance on test data, datasets with characteristics not represented in the training set (model-specific), and an overall evaluation set. Standard diagnostic flow parameters were computed and compared with manual segmentation results using Bland-Altman analysis and interclass correlation.
Results: The representation of technical factors, such as scanner vendor and field strength, in the training dataset had the strongest influence on the overall segmentation performance. Age had a greater impact than gender. Models solely trained on BAV patients' datasets performed well on datasets of healthy subjects but not vice versa.
Conclusion: This study highlights the importance of considering a heterogeneous dataset for the training of widely applicable automatic CNN segmentations in 4D flow CMR, with a particular focus on the inclusion of different pathologies and technical aspects of data acquisition.
期刊介绍:
Journal of Cardiovascular Magnetic Resonance (JCMR) publishes high-quality articles on all aspects of basic, translational and clinical research on the design, development, manufacture, and evaluation of cardiovascular magnetic resonance (CMR) methods applied to the cardiovascular system. Topical areas include, but are not limited to:
New applications of magnetic resonance to improve the diagnostic strategies, risk stratification, characterization and management of diseases affecting the cardiovascular system.
New methods to enhance or accelerate image acquisition and data analysis.
Results of multicenter, or larger single-center studies that provide insight into the utility of CMR.
Basic biological perceptions derived by CMR methods.