Pon Deepika, Prasad Sistla, G. Subramaniam, M. Rao
{"title":"基于深度学习的颅内出血自动筛查和非对比头部计算机断层扫描的GRAD-CAM可视化","authors":"Pon Deepika, Prasad Sistla, G. Subramaniam, M. Rao","doi":"10.1109/BHI56158.2022.9926782","DOIUrl":null,"url":null,"abstract":"Intracranial Hemorrhage is a serious medical emer-gency which requires immediate medical attention. With most of the countries facing acute shortage of radiologists, it is important to develop an automated system which analyses the radiographic images and prioritise cases that require urgent medical attention. In this context, there has been attempts to apply deep learning (DL) techniques to the Head Computed Tomography (CT) slices to detect hemorrhage adequately in the past, where annotation effort is spent for individual slices of the CT volume for building a model. Our work aims to develop a robust model for the annotated CT volume dataset, which does not require slice level information for the presence of hemorrhage so that the annotation effort could be cut down substantially. A novel DL pipeline architecture based on the combination of convolutional neural network (CNN) and bi-directional long-short-term-memory (biLSTM) to capture both intra and inter slice level features for diagnosing hemorrhage from the non-contrast head CT volumes is introduced. The proposed model achieved a high accuracy score of 98.15 %, specificity of 1, sensitivity of 0.96 and F1 score of 0.98 with 95.3 % mitigation in the labelling effort of radiologists. However the performance scores are very well comparable to the scores achieved by the state-of-the-art models trained over the CT Volumes with slice wise annotation pertaining to intracranial hemorrhage detection. Additionally, the novel contribution is in integrating Gradient-weighted Class Activation Mapping (GRAD-CAM) visualization to the system, to offer visual explanations for the decisions made and provide supplementary information forming a strong advocate to radiologists in the clinical evaluation stage. The novel system is a first step towards building a robust autonomous assistive technology for radiologists, and leads to develop similar pipelined DL architecture for extracting information pertaining to other neurological disorders from Non-Contrast Head CT volumes.","PeriodicalId":347210,"journal":{"name":"2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI)","volume":"209 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Deep Learning based Automated Screening for Intracranial Hemorrhages and GRAD-CAM Visualizations on Non-Contrast Head Computed Tomography Volumes\",\"authors\":\"Pon Deepika, Prasad Sistla, G. Subramaniam, M. Rao\",\"doi\":\"10.1109/BHI56158.2022.9926782\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Intracranial Hemorrhage is a serious medical emer-gency which requires immediate medical attention. With most of the countries facing acute shortage of radiologists, it is important to develop an automated system which analyses the radiographic images and prioritise cases that require urgent medical attention. In this context, there has been attempts to apply deep learning (DL) techniques to the Head Computed Tomography (CT) slices to detect hemorrhage adequately in the past, where annotation effort is spent for individual slices of the CT volume for building a model. Our work aims to develop a robust model for the annotated CT volume dataset, which does not require slice level information for the presence of hemorrhage so that the annotation effort could be cut down substantially. A novel DL pipeline architecture based on the combination of convolutional neural network (CNN) and bi-directional long-short-term-memory (biLSTM) to capture both intra and inter slice level features for diagnosing hemorrhage from the non-contrast head CT volumes is introduced. The proposed model achieved a high accuracy score of 98.15 %, specificity of 1, sensitivity of 0.96 and F1 score of 0.98 with 95.3 % mitigation in the labelling effort of radiologists. However the performance scores are very well comparable to the scores achieved by the state-of-the-art models trained over the CT Volumes with slice wise annotation pertaining to intracranial hemorrhage detection. Additionally, the novel contribution is in integrating Gradient-weighted Class Activation Mapping (GRAD-CAM) visualization to the system, to offer visual explanations for the decisions made and provide supplementary information forming a strong advocate to radiologists in the clinical evaluation stage. The novel system is a first step towards building a robust autonomous assistive technology for radiologists, and leads to develop similar pipelined DL architecture for extracting information pertaining to other neurological disorders from Non-Contrast Head CT volumes.\",\"PeriodicalId\":347210,\"journal\":{\"name\":\"2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI)\",\"volume\":\"209 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/BHI56158.2022.9926782\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BHI56158.2022.9926782","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
摘要
颅内出血是一种严重的医疗紧急情况,需要立即就医。由于大多数国家面临放射科医生的严重短缺,开发一个自动化系统来分析放射图像并优先考虑需要紧急医疗照顾的病例是很重要的。在这种情况下,过去已经有人尝试将深度学习(DL)技术应用于头部计算机断层扫描(CT)切片以充分检测出血,其中注释工作花费在CT体积的单个切片上以建立模型。我们的工作旨在为注释的CT体积数据集开发一个健壮的模型,该模型不需要存在出血的切片水平信息,从而可以大大减少注释的工作量。本文提出了一种基于卷积神经网络(CNN)和双向长短期记忆(biLSTM)相结合的DL管道结构,用于非对比头部CT体积的出血诊断。该模型的准确率为98.15%,特异性为1,敏感性为0.96,F1评分为0.98,减少了放射科医生标记工作的95.3%。然而,性能分数与在CT体积上训练的最先进的模型所获得的分数非常相似,这些模型带有与颅内出血检测相关的切片注释。此外,该系统还将梯度加权类激活映射(Gradient-weighted Class Activation Mapping, GRAD-CAM)可视化集成到系统中,为所做的决定提供可视化解释,并提供补充信息,为放射科医生在临床评估阶段提供强有力的支持。该新系统是为放射科医生建立强大的自主辅助技术的第一步,并导致开发类似的流水线DL架构,用于从非对比头部CT卷中提取有关其他神经系统疾病的信息。
Deep Learning based Automated Screening for Intracranial Hemorrhages and GRAD-CAM Visualizations on Non-Contrast Head Computed Tomography Volumes
Intracranial Hemorrhage is a serious medical emer-gency which requires immediate medical attention. With most of the countries facing acute shortage of radiologists, it is important to develop an automated system which analyses the radiographic images and prioritise cases that require urgent medical attention. In this context, there has been attempts to apply deep learning (DL) techniques to the Head Computed Tomography (CT) slices to detect hemorrhage adequately in the past, where annotation effort is spent for individual slices of the CT volume for building a model. Our work aims to develop a robust model for the annotated CT volume dataset, which does not require slice level information for the presence of hemorrhage so that the annotation effort could be cut down substantially. A novel DL pipeline architecture based on the combination of convolutional neural network (CNN) and bi-directional long-short-term-memory (biLSTM) to capture both intra and inter slice level features for diagnosing hemorrhage from the non-contrast head CT volumes is introduced. The proposed model achieved a high accuracy score of 98.15 %, specificity of 1, sensitivity of 0.96 and F1 score of 0.98 with 95.3 % mitigation in the labelling effort of radiologists. However the performance scores are very well comparable to the scores achieved by the state-of-the-art models trained over the CT Volumes with slice wise annotation pertaining to intracranial hemorrhage detection. Additionally, the novel contribution is in integrating Gradient-weighted Class Activation Mapping (GRAD-CAM) visualization to the system, to offer visual explanations for the decisions made and provide supplementary information forming a strong advocate to radiologists in the clinical evaluation stage. The novel system is a first step towards building a robust autonomous assistive technology for radiologists, and leads to develop similar pipelined DL architecture for extracting information pertaining to other neurological disorders from Non-Contrast Head CT volumes.