Hierarchical Relational Inference for Few-Shot Learning in 3D Left Atrial Segmentation

IF 5.3 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE IEEE Transactions on Emerging Topics in Computational Intelligence Pub Date : 2024-04-02 DOI:10.1109/TETCI.2024.3377267
Xuejiao Li;Jun Chen;Heye Zhang;Yongwon Cho;Sung Ho Hwang;Zhifan Gao;Guang Yang
{"title":"Hierarchical Relational Inference for Few-Shot Learning in 3D Left Atrial Segmentation","authors":"Xuejiao Li;Jun Chen;Heye Zhang;Yongwon Cho;Sung Ho Hwang;Zhifan Gao;Guang Yang","doi":"10.1109/TETCI.2024.3377267","DOIUrl":null,"url":null,"abstract":"Three-dimensional left atrial (LA) segmentation from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images is of great significance in the prevention and treatment of atrial fibrillation. Despite deep learning-based approaches have made significant progress in 3D LA segmentation, they usually require a large number of labeled images for training. Few-shot learning can quickly adapt to novel tasks with only a few data samples. However, the resolution discrepancy of LGE CMR images presents challenges for few-shot learning in 3D LA segmentation. To address this issue, we propose the Hierarchical Relational Inference Network (HRIN), which extracts the interactive features of support and query volumes through a bidirectional hierarchical relationship learning module. HRIN learns the commonality and discrepancy between support and query volumes by modeling the higher-order relations. Notably, we embed the bidirectional interaction information between support and query volumes into the prototypes to adaptively predict the query. Additionally, we leverage prior knowledge of foreground and background information in the support volume to model queries. We validated the performance of our method on a total of 369 scans from two centers. Our proposed HRIN achieves higher segmentation performance compared to other state-of-the-art segmentation methods. With only 5% data samples, the average Dice Similarity Coefficient of the two centers respectively reaches 0.8454 and 0.8110. Compared with other methods under the same conditions, the highest values only reach 0.7012 and 0.6898. Our approach improves the adaptability and generalization of few-shot segmentation from LGE CMR images, enabling precise evaluation of LA remodeling.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"8 5","pages":"3352-3367"},"PeriodicalIF":5.3000,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10486934/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Three-dimensional left atrial (LA) segmentation from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images is of great significance in the prevention and treatment of atrial fibrillation. Despite deep learning-based approaches have made significant progress in 3D LA segmentation, they usually require a large number of labeled images for training. Few-shot learning can quickly adapt to novel tasks with only a few data samples. However, the resolution discrepancy of LGE CMR images presents challenges for few-shot learning in 3D LA segmentation. To address this issue, we propose the Hierarchical Relational Inference Network (HRIN), which extracts the interactive features of support and query volumes through a bidirectional hierarchical relationship learning module. HRIN learns the commonality and discrepancy between support and query volumes by modeling the higher-order relations. Notably, we embed the bidirectional interaction information between support and query volumes into the prototypes to adaptively predict the query. Additionally, we leverage prior knowledge of foreground and background information in the support volume to model queries. We validated the performance of our method on a total of 369 scans from two centers. Our proposed HRIN achieves higher segmentation performance compared to other state-of-the-art segmentation methods. With only 5% data samples, the average Dice Similarity Coefficient of the two centers respectively reaches 0.8454 and 0.8110. Compared with other methods under the same conditions, the highest values only reach 0.7012 and 0.6898. Our approach improves the adaptability and generalization of few-shot segmentation from LGE CMR images, enabling precise evaluation of LA remodeling.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
三维左心房分段中的分层关系推理(Hierarchical Relational Inference for Few-Shot Learning in 3D Left Atrial Segmentation
从晚期钆增强心脏磁共振(LGE CMR)图像中进行三维左心房(LA)分割对预防和治疗心房颤动具有重要意义。尽管基于深度学习的方法在三维 LA 分割方面取得了重大进展,但它们通常需要大量标记图像进行训练。少量学习只需少量数据样本就能快速适应新任务。然而,LGE CMR 图像的分辨率差异给三维 LA 分割中的少量学习带来了挑战。为解决这一问题,我们提出了层次关系推理网络(HRIN),通过双向层次关系学习模块提取支持量和查询量的交互特征。HRIN 通过对高阶关系建模来学习支持量和查询量之间的共性和差异。值得注意的是,我们将支持量和查询量之间的双向交互信息嵌入到原型中,以便自适应地预测查询。此外,我们还利用支持卷中的前景和背景信息的先验知识对查询进行建模。我们在两个中心的总共 369 次扫描中验证了我们方法的性能。与其他最先进的分割方法相比,我们提出的 HRIN 实现了更高的分割性能。在只有 5%数据样本的情况下,两个中心的平均骰子相似系数分别达到了 0.8454 和 0.8110。与相同条件下的其他方法相比,最高值仅为 0.7012 和 0.6898。我们的方法提高了从 LGE CMR 图像中进行少次分割的适应性和通用性,从而能够精确评估 LA 重塑情况。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
10.30
自引率
7.50%
发文量
147
期刊介绍: The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys. TETCI is an electronics only publication. TETCI publishes six issues per year. Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.
期刊最新文献
Table of Contents Guest Editorial Special Issue on Resource Sustainable Computational and Artificial Intelligence IEEE Transactions on Emerging Topics in Computational Intelligence Publication Information IEEE Transactions on Emerging Topics in Computational Intelligence Information for Authors IEEE Computational Intelligence Society Information
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1