A Hybrid Transformer-Convolutional Neural Network for Segmentation of Intracerebral Hemorrhage and Perihematomal Edema on Non-Contrast Head Computed Tomography (CT) with Uncertainty Quantification to Improve Confidence.
Anh T Tran, Dmitriy Desser, Tal Zeevi, Gaby Abou Karam, Fiona Dierksen, Andrea Dell'Orco, Helge Kniep, Uta Hanning, Jens Fiehler, Julia Zietz, Pina C Sanelli, Ajay Malhotra, James S Duncan, Sanjay Aneja, Guido J Falcone, Adnan I Qureshi, Kevin N Sheth, Jawed Nawabi, Seyedmehdi Payabvash
{"title":"A Hybrid Transformer-Convolutional Neural Network for Segmentation of Intracerebral Hemorrhage and Perihematomal Edema on Non-Contrast Head Computed Tomography (CT) with Uncertainty Quantification to Improve Confidence.","authors":"Anh T Tran, Dmitriy Desser, Tal Zeevi, Gaby Abou Karam, Fiona Dierksen, Andrea Dell'Orco, Helge Kniep, Uta Hanning, Jens Fiehler, Julia Zietz, Pina C Sanelli, Ajay Malhotra, James S Duncan, Sanjay Aneja, Guido J Falcone, Adnan I Qureshi, Kevin N Sheth, Jawed Nawabi, Seyedmehdi Payabvash","doi":"10.3390/bioengineering11121274","DOIUrl":null,"url":null,"abstract":"<p><p>Intracerebral hemorrhage (ICH) and perihematomal edema (PHE) are key imaging markers of primary and secondary brain injury in hemorrhagic stroke. Accurate segmentation and quantification of ICH and PHE can help with prognostication and guide treatment planning. In this study, we combined Swin-Unet Transformers with nnU-NETv2 convolutional network for segmentation of ICH and PHE on non-contrast head CTs. We also applied test-time data augmentations to assess individual-level prediction uncertainty, ensuring high confidence in prediction. The model was trained on 1782 CT scans from a multicentric trial and tested in two independent datasets from Yale (n = 396) and University of Berlin Charité Hospital and University Medical Center Hamburg-Eppendorf (n = 943). Model performance was evaluated with the Dice coefficient and Volume Similarity (VS). Our dual Swin-nnUNET model achieved a median (95% confidence interval) Dice = 0.93 (0.90-0.95) and VS = 0.97 (0.95-0.98) for ICH, and Dice = 0.70 (0.64-0.75) and VS = 0.87 (0.80-0.93) for PHE segmentation in the Yale cohort. Dice = 0.86 (0.80-0.90) and VS = 0.91 (0.85-0.95) for ICH and Dice = 0.65 (0.56-0.70) and VS = 0.86 (0.77-0.93) for PHE segmentation in the Berlin/Hamburg-Eppendorf cohort. Prediction uncertainty was associated with lower segmentation accuracy, smaller ICH/PHE volumes, and infratentorial location. Our results highlight the benefits of a dual transformer-convolutional neural network architecture for ICH/PHE segmentation and test-time augmentation for uncertainty quantification.</p>","PeriodicalId":8874,"journal":{"name":"Bioengineering","volume":"11 12","pages":""},"PeriodicalIF":3.8000,"publicationDate":"2024-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11672977/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bioengineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/bioengineering11121274","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Intracerebral hemorrhage (ICH) and perihematomal edema (PHE) are key imaging markers of primary and secondary brain injury in hemorrhagic stroke. Accurate segmentation and quantification of ICH and PHE can help with prognostication and guide treatment planning. In this study, we combined Swin-Unet Transformers with nnU-NETv2 convolutional network for segmentation of ICH and PHE on non-contrast head CTs. We also applied test-time data augmentations to assess individual-level prediction uncertainty, ensuring high confidence in prediction. The model was trained on 1782 CT scans from a multicentric trial and tested in two independent datasets from Yale (n = 396) and University of Berlin Charité Hospital and University Medical Center Hamburg-Eppendorf (n = 943). Model performance was evaluated with the Dice coefficient and Volume Similarity (VS). Our dual Swin-nnUNET model achieved a median (95% confidence interval) Dice = 0.93 (0.90-0.95) and VS = 0.97 (0.95-0.98) for ICH, and Dice = 0.70 (0.64-0.75) and VS = 0.87 (0.80-0.93) for PHE segmentation in the Yale cohort. Dice = 0.86 (0.80-0.90) and VS = 0.91 (0.85-0.95) for ICH and Dice = 0.65 (0.56-0.70) and VS = 0.86 (0.77-0.93) for PHE segmentation in the Berlin/Hamburg-Eppendorf cohort. Prediction uncertainty was associated with lower segmentation accuracy, smaller ICH/PHE volumes, and infratentorial location. Our results highlight the benefits of a dual transformer-convolutional neural network architecture for ICH/PHE segmentation and test-time augmentation for uncertainty quantification.
期刊介绍:
Aims
Bioengineering (ISSN 2306-5354) provides an advanced forum for the science and technology of bioengineering. It publishes original research papers, comprehensive reviews, communications and case reports. Our aim is to encourage scientists to publish their experimental and theoretical results in as much detail as possible. All aspects of bioengineering are welcomed from theoretical concepts to education and applications. There is no restriction on the length of the papers. The full experimental details must be provided so that the results can be reproduced. There are, in addition, four key features of this Journal:
● We are introducing a new concept in scientific and technical publications “The Translational Case Report in Bioengineering”. It is a descriptive explanatory analysis of a transformative or translational event. Understanding that the goal of bioengineering scholarship is to advance towards a transformative or clinical solution to an identified transformative/clinical need, the translational case report is used to explore causation in order to find underlying principles that may guide other similar transformative/translational undertakings.
● Manuscripts regarding research proposals and research ideas will be particularly welcomed.
● Electronic files and software regarding the full details of the calculation and experimental procedure, if unable to be published in a normal way, can be deposited as supplementary material.
● We also accept manuscripts communicating to a broader audience with regard to research projects financed with public funds.
Scope
● Bionics and biological cybernetics: implantology; bio–abio interfaces
● Bioelectronics: wearable electronics; implantable electronics; “more than Moore” electronics; bioelectronics devices
● Bioprocess and biosystems engineering and applications: bioprocess design; biocatalysis; bioseparation and bioreactors; bioinformatics; bioenergy; etc.
● Biomolecular, cellular and tissue engineering and applications: tissue engineering; chromosome engineering; embryo engineering; cellular, molecular and synthetic biology; metabolic engineering; bio-nanotechnology; micro/nano technologies; genetic engineering; transgenic technology
● Biomedical engineering and applications: biomechatronics; biomedical electronics; biomechanics; biomaterials; biomimetics; biomedical diagnostics; biomedical therapy; biomedical devices; sensors and circuits; biomedical imaging and medical information systems; implants and regenerative medicine; neurotechnology; clinical engineering; rehabilitation engineering
● Biochemical engineering and applications: metabolic pathway engineering; modeling and simulation
● Translational bioengineering