Miao Liao , Shuanhu Di , Yuqian Zhao , Wei Liang , Zhen Yang
{"title":"FA-Net: A hierarchical feature fusion and interactive attention-based network for dose prediction in liver cancer patients","authors":"Miao Liao , Shuanhu Di , Yuqian Zhao , Wei Liang , Zhen Yang","doi":"10.1016/j.artmed.2024.102961","DOIUrl":null,"url":null,"abstract":"<div><p>Dose prediction is a crucial step in automated radiotherapy planning for liver cancer. Several deep learning-based approaches for dose prediction have been proposed to enhance the design efficiency and quality of radiotherapy plan. However, these approaches usually take CT images and contours of organs at risk (OARs) and planning target volume (PTV) as a multi-channel input and is thus difficult to extract sufficient feature information from each input, which results in unsatisfactory dose distribution. In this paper, we propose a novel dose prediction network for liver cancer based on hierarchical feature fusion and interactive attention. A feature extraction module is first constructed to extract multi-scale features from different inputs, and a hierarchical feature fusion module is then built to fuse these multi-scale features hierarchically. A decoder based on attention mechanism is designed to gradually reconstruct the fused features into dose distribution. Additionally, we design an autoencoder network to generate a perceptual loss during training stage, which is used to improve the accuracy of dose prediction. The proposed method is tested on private clinical dataset and obtains HI and CI of 0.31 and 0.87, respectively. The experimental results are better than those by several existing methods, indicating that the dose distribution generated by the proposed method is close to that approved in clinics. The codes are available at <span><span>https://github.com/hired-ld/FA-Net</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":55458,"journal":{"name":"Artificial Intelligence in Medicine","volume":"156 ","pages":"Article 102961"},"PeriodicalIF":6.1000,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Medicine","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0933365724002033","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Dose prediction is a crucial step in automated radiotherapy planning for liver cancer. Several deep learning-based approaches for dose prediction have been proposed to enhance the design efficiency and quality of radiotherapy plan. However, these approaches usually take CT images and contours of organs at risk (OARs) and planning target volume (PTV) as a multi-channel input and is thus difficult to extract sufficient feature information from each input, which results in unsatisfactory dose distribution. In this paper, we propose a novel dose prediction network for liver cancer based on hierarchical feature fusion and interactive attention. A feature extraction module is first constructed to extract multi-scale features from different inputs, and a hierarchical feature fusion module is then built to fuse these multi-scale features hierarchically. A decoder based on attention mechanism is designed to gradually reconstruct the fused features into dose distribution. Additionally, we design an autoencoder network to generate a perceptual loss during training stage, which is used to improve the accuracy of dose prediction. The proposed method is tested on private clinical dataset and obtains HI and CI of 0.31 and 0.87, respectively. The experimental results are better than those by several existing methods, indicating that the dose distribution generated by the proposed method is close to that approved in clinics. The codes are available at https://github.com/hired-ld/FA-Net.
剂量预测是肝癌自动化放疗计划的关键步骤。目前已提出了几种基于深度学习的剂量预测方法,以提高放疗计划的设计效率和质量。然而,这些方法通常将CT图像以及危险器官(OAR)和计划靶体积(PTV)的轮廓作为多通道输入,因此很难从每个输入中提取足够的特征信息,从而导致剂量分布不理想。本文提出了一种基于分层特征融合和交互关注的新型肝癌剂量预测网络。首先构建一个特征提取模块,从不同输入中提取多尺度特征,然后构建一个分层特征融合模块,对这些多尺度特征进行分层融合。我们设计了一个基于注意力机制的解码器,将融合后的特征逐步重构为剂量分布。此外,我们还设计了一个自动编码器网络,在训练阶段产生感知损失,用于提高剂量预测的准确性。所提出的方法在私人临床数据集上进行了测试,得到的 HI 和 CI 分别为 0.31 和 0.87。实验结果优于现有的几种方法,表明所提方法生成的剂量分布接近临床认可的剂量分布。代码见 https://github.com/hired-ld/FA-Net。
期刊介绍:
Artificial Intelligence in Medicine publishes original articles from a wide variety of interdisciplinary perspectives concerning the theory and practice of artificial intelligence (AI) in medicine, medically-oriented human biology, and health care.
Artificial intelligence in medicine may be characterized as the scientific discipline pertaining to research studies, projects, and applications that aim at supporting decision-based medical tasks through knowledge- and/or data-intensive computer-based solutions that ultimately support and improve the performance of a human care provider.