Waldemar E. Wysokinski MD, PhD, Ryan A. Meverden PA-C, Francisco Lopez-Jimenez MD, MBA, David M. Harmon MD, Betsy J. Medina Inojosa MD, Abraham Baez Suarez PhD, MS, Kan Liu PhD, Jose R. Medina Inojosa MD, Ana I. Casanegra MD, Robert D. McBane MD, Damon E. Houghton MD, MS
{"title":"利用机器学习模型进行心电图信号分析可预测肺栓塞的存在,其准确性取决于栓塞负担","authors":"Waldemar E. Wysokinski MD, PhD, Ryan A. Meverden PA-C, Francisco Lopez-Jimenez MD, MBA, David M. Harmon MD, Betsy J. Medina Inojosa MD, Abraham Baez Suarez PhD, MS, Kan Liu PhD, Jose R. Medina Inojosa MD, Ana I. Casanegra MD, Robert D. McBane MD, Damon E. Houghton MD, MS","doi":"10.1016/j.mcpdig.2024.03.009","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>To develop an artificial intelligence deep neural network (AI-DNN) algorithm to analyze 12-lead electrocardiogram (ECG) for detection of acute pulmonary embolism (PE) and PE categories.</p></div><div><h3>Patients and Methods</h3><p>A cohort of patients seen between January 1, 1999, and December 31, 2020, from across the Mayo Clinic Enterprise with computed tomography pulmonary angiogram (CTPA) and ECG performed ±6 hours was identified. Natural language processing algorithms were applied to radiology reports to determine the diagnosis of acute PE, acute right ventricular strain pulmonary embolism (RVSPE), saddle pulmonary embolism (SADPE), or no PE. Diagnostic performance parameters of the AI-DNN reported were area under the receiver operating characteristics curve (AUROC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).</p></div><div><h3>Results</h3><p>A cohort of patients with CTPA report and ECG consisted of 79,894 patients including 7423 (9.3%) with acute PE, among whom 1138 patients had RVSPE or SADPE. Artificial intelligence deep neural network predicted acute PE with a modest accuracy of AUROC of 0.69 (95% CI, 0.68-0.71), sensitivity of 63.5%, specificity of 64.7%, PPV of 15.6%, and NPV of 94.5%. The AI-DNN prediction using the same algorithm for RVSPE or SADPE was higher (AUROC, 0.84; 95% CI, 0.81-0.86) with a sensitivity of 80.8%, specificity of 64.7.8%, PPV of 3.5%, and NPV of 99.5%.</p></div><div><h3>Conclusion</h3><p>An AI-based analysis of 12-lead ECG shows modest detection power for acute PE in patients who underwent CTPA, with higher accuracy for high-risk PE. Moreover, with the high NPV, it has the clinical potential to exclude high-risk PE quickly and correctly.</p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 3","pages":"Pages 453-462"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761224000336/pdfft?md5=37397978693133143ba8101acf52268a&pid=1-s2.0-S2949761224000336-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Electrocardiogram Signal Analysis With a Machine Learning Model Predicts the Presence of Pulmonary Embolism With Accuracy Dependent on Embolism Burden\",\"authors\":\"Waldemar E. Wysokinski MD, PhD, Ryan A. Meverden PA-C, Francisco Lopez-Jimenez MD, MBA, David M. Harmon MD, Betsy J. Medina Inojosa MD, Abraham Baez Suarez PhD, MS, Kan Liu PhD, Jose R. Medina Inojosa MD, Ana I. Casanegra MD, Robert D. McBane MD, Damon E. Houghton MD, MS\",\"doi\":\"10.1016/j.mcpdig.2024.03.009\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><p>To develop an artificial intelligence deep neural network (AI-DNN) algorithm to analyze 12-lead electrocardiogram (ECG) for detection of acute pulmonary embolism (PE) and PE categories.</p></div><div><h3>Patients and Methods</h3><p>A cohort of patients seen between January 1, 1999, and December 31, 2020, from across the Mayo Clinic Enterprise with computed tomography pulmonary angiogram (CTPA) and ECG performed ±6 hours was identified. Natural language processing algorithms were applied to radiology reports to determine the diagnosis of acute PE, acute right ventricular strain pulmonary embolism (RVSPE), saddle pulmonary embolism (SADPE), or no PE. Diagnostic performance parameters of the AI-DNN reported were area under the receiver operating characteristics curve (AUROC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).</p></div><div><h3>Results</h3><p>A cohort of patients with CTPA report and ECG consisted of 79,894 patients including 7423 (9.3%) with acute PE, among whom 1138 patients had RVSPE or SADPE. Artificial intelligence deep neural network predicted acute PE with a modest accuracy of AUROC of 0.69 (95% CI, 0.68-0.71), sensitivity of 63.5%, specificity of 64.7%, PPV of 15.6%, and NPV of 94.5%. The AI-DNN prediction using the same algorithm for RVSPE or SADPE was higher (AUROC, 0.84; 95% CI, 0.81-0.86) with a sensitivity of 80.8%, specificity of 64.7.8%, PPV of 3.5%, and NPV of 99.5%.</p></div><div><h3>Conclusion</h3><p>An AI-based analysis of 12-lead ECG shows modest detection power for acute PE in patients who underwent CTPA, with higher accuracy for high-risk PE. Moreover, with the high NPV, it has the clinical potential to exclude high-risk PE quickly and correctly.</p></div>\",\"PeriodicalId\":74127,\"journal\":{\"name\":\"Mayo Clinic Proceedings. Digital health\",\"volume\":\"2 3\",\"pages\":\"Pages 453-462\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2949761224000336/pdfft?md5=37397978693133143ba8101acf52268a&pid=1-s2.0-S2949761224000336-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mayo Clinic Proceedings. Digital health\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2949761224000336\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mayo Clinic Proceedings. Digital health","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949761224000336","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Electrocardiogram Signal Analysis With a Machine Learning Model Predicts the Presence of Pulmonary Embolism With Accuracy Dependent on Embolism Burden
Objective
To develop an artificial intelligence deep neural network (AI-DNN) algorithm to analyze 12-lead electrocardiogram (ECG) for detection of acute pulmonary embolism (PE) and PE categories.
Patients and Methods
A cohort of patients seen between January 1, 1999, and December 31, 2020, from across the Mayo Clinic Enterprise with computed tomography pulmonary angiogram (CTPA) and ECG performed ±6 hours was identified. Natural language processing algorithms were applied to radiology reports to determine the diagnosis of acute PE, acute right ventricular strain pulmonary embolism (RVSPE), saddle pulmonary embolism (SADPE), or no PE. Diagnostic performance parameters of the AI-DNN reported were area under the receiver operating characteristics curve (AUROC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).
Results
A cohort of patients with CTPA report and ECG consisted of 79,894 patients including 7423 (9.3%) with acute PE, among whom 1138 patients had RVSPE or SADPE. Artificial intelligence deep neural network predicted acute PE with a modest accuracy of AUROC of 0.69 (95% CI, 0.68-0.71), sensitivity of 63.5%, specificity of 64.7%, PPV of 15.6%, and NPV of 94.5%. The AI-DNN prediction using the same algorithm for RVSPE or SADPE was higher (AUROC, 0.84; 95% CI, 0.81-0.86) with a sensitivity of 80.8%, specificity of 64.7.8%, PPV of 3.5%, and NPV of 99.5%.
Conclusion
An AI-based analysis of 12-lead ECG shows modest detection power for acute PE in patients who underwent CTPA, with higher accuracy for high-risk PE. Moreover, with the high NPV, it has the clinical potential to exclude high-risk PE quickly and correctly.