K Villringer, R Sokiranski, R Opfer, L Spies, M Hamann, A Bormann, M Brehmer, I Galinovic, J B Fiebach
{"title":"An Artificial Intelligence Algorithm Integrated into the Clinical Workflow Can Ensure High Quality Acute Intracranial Hemorrhage CT Diagnostic.","authors":"K Villringer, R Sokiranski, R Opfer, L Spies, M Hamann, A Bormann, M Brehmer, I Galinovic, J B Fiebach","doi":"10.1007/s00062-024-01461-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Intracranial hemorrhage (ICH) is a life-threatening condition requiring rapid diagnostic and therapeutic action. This study evaluates whether Artificial intelligence (AI) can provide high-quality ICH diagnostics and turnaround times suitable for routine radiological practice.</p><p><strong>Methods: </strong>A convolutional neural network (CNN) was trained and validated to detect ICHs on DICOM images of cranial CT (CCT) scans, utilizing about 674,000 individually labeled slices. The CNN was then incorporated into a commercial AI engine and seamlessly integrated into three pilot centers in Germany. A real-world test-dataset was extracted and manually annotated by two experienced experts. The performance of the AI algorithm against the two raters was assessed and compared to the inter-rater agreement. The overall time ranging from data acquisition to the delivery of the AI results was analyzed.</p><p><strong>Results: </strong>Out of 6284 CCT examinations acquired in three different centers, 947 (15%) had ICH. Breakdowns of hemorrhage types included 8% intraparenchymal, 3% intraventricular, 6% subarachnoidal, 7% subdural, < 1% epidural hematomas. Comparing the AI's performance on a subset of 255 patients with two expert raters, it achieved a sensitivity of 0.90, a specificity of 0.96, an accuracy of 0.96. The corresponding inter-rater agreement was 0.84, 0.98, and 0.96. The overall median processing times for the three centers were 9, 11, and 12 min, respectively.</p><p><strong>Conclusion: </strong>We showed that an AI algorithm for the automatic detection of ICHs can be seamlessly integrated into clinical workflows with minimal turnaround time. The accuracy was on par with radiology experts, making the system suitable for routine clinical use.</p>","PeriodicalId":10391,"journal":{"name":"Clinical Neuroradiology","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neuroradiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00062-024-01461-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Intracranial hemorrhage (ICH) is a life-threatening condition requiring rapid diagnostic and therapeutic action. This study evaluates whether Artificial intelligence (AI) can provide high-quality ICH diagnostics and turnaround times suitable for routine radiological practice.
Methods: A convolutional neural network (CNN) was trained and validated to detect ICHs on DICOM images of cranial CT (CCT) scans, utilizing about 674,000 individually labeled slices. The CNN was then incorporated into a commercial AI engine and seamlessly integrated into three pilot centers in Germany. A real-world test-dataset was extracted and manually annotated by two experienced experts. The performance of the AI algorithm against the two raters was assessed and compared to the inter-rater agreement. The overall time ranging from data acquisition to the delivery of the AI results was analyzed.
Results: Out of 6284 CCT examinations acquired in three different centers, 947 (15%) had ICH. Breakdowns of hemorrhage types included 8% intraparenchymal, 3% intraventricular, 6% subarachnoidal, 7% subdural, < 1% epidural hematomas. Comparing the AI's performance on a subset of 255 patients with two expert raters, it achieved a sensitivity of 0.90, a specificity of 0.96, an accuracy of 0.96. The corresponding inter-rater agreement was 0.84, 0.98, and 0.96. The overall median processing times for the three centers were 9, 11, and 12 min, respectively.
Conclusion: We showed that an AI algorithm for the automatic detection of ICHs can be seamlessly integrated into clinical workflows with minimal turnaround time. The accuracy was on par with radiology experts, making the system suitable for routine clinical use.
期刊介绍:
Clinical Neuroradiology provides current information, original contributions, and reviews in the field of neuroradiology. An interdisciplinary approach is accomplished by diagnostic and therapeutic contributions related to associated subjects.
The international coverage and relevance of the journal is underlined by its being the official journal of the German, Swiss, and Austrian Societies of Neuroradiology.