Integrating a deep neural network and Transformer architecture for the automatic segmentation and survival prediction in cervical cancer.

IF 2.9 2区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Quantitative Imaging in Medicine and Surgery Pub Date : 2024-08-01 Epub Date: 2024-07-16 DOI:10.21037/qims-24-560
Shitao Zhu, Ling Lin, Qin Liu, Jing Liu, Yanwen Song, Qin Xu
{"title":"Integrating a deep neural network and Transformer architecture for the automatic segmentation and survival prediction in cervical cancer.","authors":"Shitao Zhu, Ling Lin, Qin Liu, Jing Liu, Yanwen Song, Qin Xu","doi":"10.21037/qims-24-560","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Automated tumor segmentation and survival prediction are critical to clinical diagnosis and treatment. This study aimed to develop deep-learning models for automatic tumor segmentation and survival prediction in magnetic resonance imaging (MRI) of cervical cancer (CC) by combining deep neural networks and Transformer architecture.</p><p><strong>Methods: </strong>This study included 406 patients with CC, each with comprehensive clinical information and MRI scans. We randomly divided patients into training, validation, and independent test cohorts in a 6:2:2 ratio. During the model training, we employed two architecture types: one being a hybrid model combining convolutional neural network (CNN) and ransformer (CoTr) and one of pure CNNs. For survival prediction, the hybrid model combined tumor image features extracted by segmentation models with clinical information. The performance of the segmentation models was evaluated using the Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). The performance of the survival models was assessed using the concordance index.</p><p><strong>Results: </strong>The CoTr model performed well in both contrast-enhanced T1-weighted (ceT1W) and T2-weighted (T2W) imaging segmentation tasks, with average DSCs of 0.827 and 0.820, respectively, which outperformed other the CNN models such as U-Net (DSC: 0.807 and 0.808), attention U-Net (DSC: 0.814 and 0.811), and V-Net (DSC: 0.805 and 0.807). For survival prediction, the proposed deep-learning model significantly outperformed traditional methods, yielding a concordance index of 0.732. Moreover, it effectively divided patients into low-risk and high-risk groups for disease progression (P<0.001).</p><p><strong>Conclusions: </strong>Combining Transformer architecture with a CNN can improve MRI tumor segmentation, and this deep-learning model excelled in the survival prediction of patients with CC as compared to traditional methods.</p>","PeriodicalId":54267,"journal":{"name":"Quantitative Imaging in Medicine and Surgery","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11320496/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quantitative Imaging in Medicine and Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.21037/qims-24-560","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/16 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Automated tumor segmentation and survival prediction are critical to clinical diagnosis and treatment. This study aimed to develop deep-learning models for automatic tumor segmentation and survival prediction in magnetic resonance imaging (MRI) of cervical cancer (CC) by combining deep neural networks and Transformer architecture.

Methods: This study included 406 patients with CC, each with comprehensive clinical information and MRI scans. We randomly divided patients into training, validation, and independent test cohorts in a 6:2:2 ratio. During the model training, we employed two architecture types: one being a hybrid model combining convolutional neural network (CNN) and ransformer (CoTr) and one of pure CNNs. For survival prediction, the hybrid model combined tumor image features extracted by segmentation models with clinical information. The performance of the segmentation models was evaluated using the Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). The performance of the survival models was assessed using the concordance index.

Results: The CoTr model performed well in both contrast-enhanced T1-weighted (ceT1W) and T2-weighted (T2W) imaging segmentation tasks, with average DSCs of 0.827 and 0.820, respectively, which outperformed other the CNN models such as U-Net (DSC: 0.807 and 0.808), attention U-Net (DSC: 0.814 and 0.811), and V-Net (DSC: 0.805 and 0.807). For survival prediction, the proposed deep-learning model significantly outperformed traditional methods, yielding a concordance index of 0.732. Moreover, it effectively divided patients into low-risk and high-risk groups for disease progression (P<0.001).

Conclusions: Combining Transformer architecture with a CNN can improve MRI tumor segmentation, and this deep-learning model excelled in the survival prediction of patients with CC as compared to traditional methods.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
整合深度神经网络和 Transformer 架构,实现宫颈癌的自动分割和生存预测。
背景:肿瘤自动分割和生存预测对临床诊断和治疗至关重要。本研究旨在通过结合深度神经网络和 Transformer 架构,开发用于宫颈癌(CC)磁共振成像(MRI)肿瘤自动分割和生存预测的深度学习模型:本研究纳入了 406 名宫颈癌患者,每名患者都有全面的临床信息和 MRI 扫描结果。我们按 6:2:2 的比例将患者随机分为训练组、验证组和独立测试组。在模型训练过程中,我们采用了两种结构类型:一种是卷积神经网络(CNN)和变压器(CoTr)相结合的混合模型,另一种是纯粹的 CNN。在生存预测方面,混合模型将分割模型提取的肿瘤图像特征与临床信息相结合。分割模型的性能使用 Dice 相似系数(DSC)和 95% Hausdorff 距离(HD95)进行评估。生存模型的性能使用一致性指数进行评估:CoTr模型在对比度增强T1加权(ceT1W)和T2加权(T2W)成像分割任务中表现良好,平均DSC分别为0.827和0.820,优于其他CNN模型,如U-Net(DSC:0.807和0.808)、attention U-Net(DSC:0.814和0.811)和V-Net(DSC:0.805和0.807)。在生存预测方面,所提出的深度学习模型明显优于传统方法,其一致性指数为 0.732。此外,它还有效地将患者分为疾病进展的低风险组和高风险组(PConclusions:与传统方法相比,该深度学习模型在CC患者的生存预测方面表现出色。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Quantitative Imaging in Medicine and Surgery
Quantitative Imaging in Medicine and Surgery Medicine-Radiology, Nuclear Medicine and Imaging
CiteScore
4.20
自引率
17.90%
发文量
252
期刊介绍: Information not localized
期刊最新文献
Deep learning-based quantitative morphological study of anteroposterior digital radiographs of the lumbar spine. Automatic measurement of anatomical parameters of the lumbar vertebral body and the intervertebral disc on radiographs by deep learning. Bone age assessment by multi-granularity and multi-attention feature encoding. Can cereal-based oral contrast agents-assisted ultrasound become an alternative to non-contrast magnetic resonance imaging (MRI) in radiological follow-up for pancreatic cystic lesions? Cardiac intravoxel incoherent motion diffusion-weighted imaging to assess myocardial microcirculation dysfunction in hypertension.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1