Sang-Hyup Lee MD , Kyu Lee Jeon BS , Yong-Joon Lee MD , Seng Chan You MD , Seung-Jun Lee MD , Sung-Jin Hong MD , Chul-Min Ahn MD , Jung-Sun Kim MD , Byeong-Keuk Kim MD , Young-Guk Ko MD , Donghoon Choi MD , Myeong-Ki Hong MD
{"title":"Development of Clinically Validated Artificial Intelligence Model for Detecting ST-segment Elevation Myocardial Infarction","authors":"Sang-Hyup Lee MD , Kyu Lee Jeon BS , Yong-Joon Lee MD , Seng Chan You MD , Seung-Jun Lee MD , Sung-Jin Hong MD , Chul-Min Ahn MD , Jung-Sun Kim MD , Byeong-Keuk Kim MD , Young-Guk Ko MD , Donghoon Choi MD , Myeong-Ki Hong MD","doi":"10.1016/j.annemergmed.2024.06.004","DOIUrl":null,"url":null,"abstract":"<div><h3>Study objective</h3><div>Although the importance of primary percutaneous coronary intervention has been emphasized for ST-segment elevation myocardial infarction (STEMI), the appropriateness of the cardiac catheterization laboratory activation remains suboptimal. This study aimed to develop a precise artificial intelligence (AI) model for the diagnosis of STEMI and accurate cardiac catheterization laboratory activation.</div></div><div><h3>Methods</h3><div>We used electrocardiography (ECG) waveform data from a prospective percutaneous coronary intervention registry in Korea in this study. Two independent board-certified cardiologists established a criterion standard (STEMI or Not STEMI) for each ECG based on corresponding coronary angiography data. We developed a deep ensemble model by combining 5 convolutional neural networks. In addition, we performed clinical validation based on a symptom-based ECG data set, comparisons with clinical physicians, and external validation.</div></div><div><h3>Results</h3><div>We used 18,697 ECGs for the model development data set, and 1,745 (9.3%) were STEMI. The AI model achieved an accuracy of 92.1%, sensitivity of 95.4%, and specificity of 91.8 %. The performances of the AI model were well balanced and outstanding in the clinical validation, comparison with clinical physicians, and the external validation.</div></div><div><h3>Conclusion</h3><div>The deep ensemble AI model showed a well-balanced and outstanding performance. As visualized with gradient-weighted class activation mapping, the AI model has a reasonable explainability. Further studies with prospective validation regarding clinical benefit in a real-world setting should be warranted.</div></div>","PeriodicalId":8236,"journal":{"name":"Annals of emergency medicine","volume":"84 5","pages":"Pages 540-548"},"PeriodicalIF":5.0000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of emergency medicine","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0196064424003275","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"EMERGENCY MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Study objective
Although the importance of primary percutaneous coronary intervention has been emphasized for ST-segment elevation myocardial infarction (STEMI), the appropriateness of the cardiac catheterization laboratory activation remains suboptimal. This study aimed to develop a precise artificial intelligence (AI) model for the diagnosis of STEMI and accurate cardiac catheterization laboratory activation.
Methods
We used electrocardiography (ECG) waveform data from a prospective percutaneous coronary intervention registry in Korea in this study. Two independent board-certified cardiologists established a criterion standard (STEMI or Not STEMI) for each ECG based on corresponding coronary angiography data. We developed a deep ensemble model by combining 5 convolutional neural networks. In addition, we performed clinical validation based on a symptom-based ECG data set, comparisons with clinical physicians, and external validation.
Results
We used 18,697 ECGs for the model development data set, and 1,745 (9.3%) were STEMI. The AI model achieved an accuracy of 92.1%, sensitivity of 95.4%, and specificity of 91.8 %. The performances of the AI model were well balanced and outstanding in the clinical validation, comparison with clinical physicians, and the external validation.
Conclusion
The deep ensemble AI model showed a well-balanced and outstanding performance. As visualized with gradient-weighted class activation mapping, the AI model has a reasonable explainability. Further studies with prospective validation regarding clinical benefit in a real-world setting should be warranted.
期刊介绍:
Annals of Emergency Medicine, the official journal of the American College of Emergency Physicians, is an international, peer-reviewed journal dedicated to improving the quality of care by publishing the highest quality science for emergency medicine and related medical specialties. Annals publishes original research, clinical reports, opinion, and educational information related to the practice, teaching, and research of emergency medicine. In addition to general emergency medicine topics, Annals regularly publishes articles on out-of-hospital emergency medical services, pediatric emergency medicine, injury and disease prevention, health policy and ethics, disaster management, toxicology, and related topics.