Clinical Validation of a Deep Learning Algorithm for Automated Coronary Artery Disease Detection and Classification Using a Heterogeneous Multivendor Coronary Computed Tomography Angiography Data Set.
Emanuele Muscogiuri, Marly van Assen, Giovanni Tessarin, Alexander C Razavi, Max Schoebinger, Michael Wels, Mehmet Akif Gulsun, Puneet Sharma, George S K Fung, Carlo N De Cecco
{"title":"Clinical Validation of a Deep Learning Algorithm for Automated Coronary Artery Disease Detection and Classification Using a Heterogeneous Multivendor Coronary Computed Tomography Angiography Data Set.","authors":"Emanuele Muscogiuri, Marly van Assen, Giovanni Tessarin, Alexander C Razavi, Max Schoebinger, Michael Wels, Mehmet Akif Gulsun, Puneet Sharma, George S K Fung, Carlo N De Cecco","doi":"10.1097/RTI.0000000000000798","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>We sought to clinically validate a fully automated deep learning (DL) algorithm for coronary artery disease (CAD) detection and classification in a heterogeneous multivendor cardiac computed tomography angiography data set.</p><p><strong>Materials and methods: </strong>In this single-centre retrospective study, we included patients who underwent cardiac computed tomography angiography scans between 2010 and 2020 with scanners from 4 vendors (Siemens Healthineers, Philips, General Electrics, and Canon). Coronary Artery Disease-Reporting and Data System (CAD-RADS) classification was performed by a DL algorithm and by an expert reader (reader 1, R1), the gold standard. Variability analysis was performed with a second reader (reader 2, R2) and the radiologic reports on a subset of cases. Statistical analysis was performed stratifying patients according to the presence of CAD (CAD-RADS >0) and obstructive CAD (CAD-RADS ≥3).</p><p><strong>Results: </strong>Two hundred ninety-six patients (average age: 53.66 ± 13.65, 169 males) were enrolled. For the detection of CAD only, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 95.3%, 79.7%, 87.5%, and 87.5%, respectively. For the detection of obstructive CAD, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 89.4%, 92.8%, 92.2%, and 91.1%, respectively. The variability analysis for the detection of obstructive CAD showed an accuracy of 92.5% comparing the DL algorithm with R1, and 96.2% comparing R1 with R2 and radiology reports. The time of analysis was lower using the DL algorithm compared with R1 (P < 0.001).</p><p><strong>Conclusions: </strong>The DL algorithm demonstrated robust performance and excellent agreement with the expert readers' analysis for the evaluation of CAD, which also corresponded with significantly reduced image analysis time.</p>","PeriodicalId":49974,"journal":{"name":"Journal of Thoracic Imaging","volume":" ","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Thoracic Imaging","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/RTI.0000000000000798","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: We sought to clinically validate a fully automated deep learning (DL) algorithm for coronary artery disease (CAD) detection and classification in a heterogeneous multivendor cardiac computed tomography angiography data set.
Materials and methods: In this single-centre retrospective study, we included patients who underwent cardiac computed tomography angiography scans between 2010 and 2020 with scanners from 4 vendors (Siemens Healthineers, Philips, General Electrics, and Canon). Coronary Artery Disease-Reporting and Data System (CAD-RADS) classification was performed by a DL algorithm and by an expert reader (reader 1, R1), the gold standard. Variability analysis was performed with a second reader (reader 2, R2) and the radiologic reports on a subset of cases. Statistical analysis was performed stratifying patients according to the presence of CAD (CAD-RADS >0) and obstructive CAD (CAD-RADS ≥3).
Results: Two hundred ninety-six patients (average age: 53.66 ± 13.65, 169 males) were enrolled. For the detection of CAD only, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 95.3%, 79.7%, 87.5%, and 87.5%, respectively. For the detection of obstructive CAD, the DL algorithm showed sensitivity, specificity, accuracy, and area under the curve of 89.4%, 92.8%, 92.2%, and 91.1%, respectively. The variability analysis for the detection of obstructive CAD showed an accuracy of 92.5% comparing the DL algorithm with R1, and 96.2% comparing R1 with R2 and radiology reports. The time of analysis was lower using the DL algorithm compared with R1 (P < 0.001).
Conclusions: The DL algorithm demonstrated robust performance and excellent agreement with the expert readers' analysis for the evaluation of CAD, which also corresponded with significantly reduced image analysis time.
期刊介绍:
Journal of Thoracic Imaging (JTI) provides authoritative information on all aspects of the use of imaging techniques in the diagnosis of cardiac and pulmonary diseases. Original articles and analytical reviews published in this timely journal provide the very latest thinking of leading experts concerning the use of chest radiography, computed tomography, magnetic resonance imaging, positron emission tomography, ultrasound, and all other promising imaging techniques in cardiopulmonary radiology.
Official Journal of the Society of Thoracic Radiology:
Japanese Society of Thoracic Radiology
Korean Society of Thoracic Radiology
European Society of Thoracic Imaging.