Duo Tan;Jiayang Liu;Shanxiong Chen;Rui Yao;Yongmei Li;Shiyu Zhu;Linfeng Li
{"title":"基于特征融合注意力网络模型的多期脑CTA侧支循环的自动评价。","authors":"Duo Tan;Jiayang Liu;Shanxiong Chen;Rui Yao;Yongmei Li;Shiyu Zhu;Linfeng Li","doi":"10.1109/TNB.2023.3283049","DOIUrl":null,"url":null,"abstract":"Stroke is one of the main causes of disability and death, and it can be divided into hemorrhagic stroke and ischemic stroke. Ischemic stroke is more common, and about 8 out of 10 stroke patients suffer from ischemic stroke. In clinical practice, doctors diagnose stroke by using computed tomography angiography (CTA) image to accurately evaluate the collateral circulation in stroke patients. This imaging information is of great significance in assisting doctors to determine the patient’s treatment plan and prognosis. Currently, great progress has been made in the field of computer-aided diagnosis technology in medicine by using artificial intelligence. However, in related research based on deep learning algorithms, researchers usually only use single-phase data for training, lacking the temporal dimension information of multi-phase image data. This makes it difficult for the model to learn more comprehensive and effective collateral circulation feature representation, thereby limiting its performance. Therefore, combining data for training is expected to improve the accuracy and reliability of collateral circulation evaluation. In this study, we propose an effective hybrid mechanism to assist the feature encoding network in evaluating the degree of collateral circulation in the brain. By using a hybrid attention mechanism, additional guidance and regularization are provided to enhance the collateral circulation feature representation across multiple stages. Time dimension information is added to the input, and multiple feature-level fusion modules are designed in the multi-branch network. The first fusion module in the single-stage feature extraction network completes the fusion of deep and shallow vessel features in the single-branch network, followed by the multi-stage network feature fusion module, which achieves feature fusion for four stages. Tested on a dataset of multi-phase cranial CTA images, the accuracy rate exceeding 90.43%. The experimental results demonstrate that the addition of these modules can fully explore collateral vessel features, improve feature expression capabilities, and optimize the performance of deep learning network model.","PeriodicalId":13264,"journal":{"name":"IEEE Transactions on NanoBioscience","volume":"22 4","pages":"789-799"},"PeriodicalIF":3.7000,"publicationDate":"2023-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic Evaluating of Multi-Phase Cranial CTA Collateral Circulation Based on Feature Fusion Attention Network Model\",\"authors\":\"Duo Tan;Jiayang Liu;Shanxiong Chen;Rui Yao;Yongmei Li;Shiyu Zhu;Linfeng Li\",\"doi\":\"10.1109/TNB.2023.3283049\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Stroke is one of the main causes of disability and death, and it can be divided into hemorrhagic stroke and ischemic stroke. Ischemic stroke is more common, and about 8 out of 10 stroke patients suffer from ischemic stroke. In clinical practice, doctors diagnose stroke by using computed tomography angiography (CTA) image to accurately evaluate the collateral circulation in stroke patients. This imaging information is of great significance in assisting doctors to determine the patient’s treatment plan and prognosis. Currently, great progress has been made in the field of computer-aided diagnosis technology in medicine by using artificial intelligence. However, in related research based on deep learning algorithms, researchers usually only use single-phase data for training, lacking the temporal dimension information of multi-phase image data. This makes it difficult for the model to learn more comprehensive and effective collateral circulation feature representation, thereby limiting its performance. Therefore, combining data for training is expected to improve the accuracy and reliability of collateral circulation evaluation. In this study, we propose an effective hybrid mechanism to assist the feature encoding network in evaluating the degree of collateral circulation in the brain. By using a hybrid attention mechanism, additional guidance and regularization are provided to enhance the collateral circulation feature representation across multiple stages. Time dimension information is added to the input, and multiple feature-level fusion modules are designed in the multi-branch network. The first fusion module in the single-stage feature extraction network completes the fusion of deep and shallow vessel features in the single-branch network, followed by the multi-stage network feature fusion module, which achieves feature fusion for four stages. Tested on a dataset of multi-phase cranial CTA images, the accuracy rate exceeding 90.43%. The experimental results demonstrate that the addition of these modules can fully explore collateral vessel features, improve feature expression capabilities, and optimize the performance of deep learning network model.\",\"PeriodicalId\":13264,\"journal\":{\"name\":\"IEEE Transactions on NanoBioscience\",\"volume\":\"22 4\",\"pages\":\"789-799\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2023-06-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on NanoBioscience\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10144353/\",\"RegionNum\":4,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"BIOCHEMICAL RESEARCH METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on NanoBioscience","FirstCategoryId":"99","ListUrlMain":"https://ieeexplore.ieee.org/document/10144353/","RegionNum":4,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
Automatic Evaluating of Multi-Phase Cranial CTA Collateral Circulation Based on Feature Fusion Attention Network Model
Stroke is one of the main causes of disability and death, and it can be divided into hemorrhagic stroke and ischemic stroke. Ischemic stroke is more common, and about 8 out of 10 stroke patients suffer from ischemic stroke. In clinical practice, doctors diagnose stroke by using computed tomography angiography (CTA) image to accurately evaluate the collateral circulation in stroke patients. This imaging information is of great significance in assisting doctors to determine the patient’s treatment plan and prognosis. Currently, great progress has been made in the field of computer-aided diagnosis technology in medicine by using artificial intelligence. However, in related research based on deep learning algorithms, researchers usually only use single-phase data for training, lacking the temporal dimension information of multi-phase image data. This makes it difficult for the model to learn more comprehensive and effective collateral circulation feature representation, thereby limiting its performance. Therefore, combining data for training is expected to improve the accuracy and reliability of collateral circulation evaluation. In this study, we propose an effective hybrid mechanism to assist the feature encoding network in evaluating the degree of collateral circulation in the brain. By using a hybrid attention mechanism, additional guidance and regularization are provided to enhance the collateral circulation feature representation across multiple stages. Time dimension information is added to the input, and multiple feature-level fusion modules are designed in the multi-branch network. The first fusion module in the single-stage feature extraction network completes the fusion of deep and shallow vessel features in the single-branch network, followed by the multi-stage network feature fusion module, which achieves feature fusion for four stages. Tested on a dataset of multi-phase cranial CTA images, the accuracy rate exceeding 90.43%. The experimental results demonstrate that the addition of these modules can fully explore collateral vessel features, improve feature expression capabilities, and optimize the performance of deep learning network model.
期刊介绍:
The IEEE Transactions on NanoBioscience reports on original, innovative and interdisciplinary work on all aspects of molecular systems, cellular systems, and tissues (including molecular electronics). Topics covered in the journal focus on a broad spectrum of aspects, both on foundations and on applications. Specifically, methods and techniques, experimental aspects, design and implementation, instrumentation and laboratory equipment, clinical aspects, hardware and software data acquisition and analysis and computer based modelling are covered (based on traditional or high performance computing - parallel computers or computer networks).