Diagnostic accuracy of a machine learning algorithm using point-of-care high-sensitivity cardiac troponin I for rapid rule-out of myocardial infarction: a retrospective study.

IF 23.8 1区 医学 Q1 MEDICAL INFORMATICS Lancet Digital Health Pub Date : 2024-08-29 DOI:10.1016/S2589-7500(24)00191-2
Betül Toprak, Hugo Solleder, Eleonora Di Carluccio, Jaimi H Greenslade, William A Parsonage, Karen Schulz, Louise Cullen, Fred S Apple, Andreas Ziegler, Stefan Blankenberg
{"title":"Diagnostic accuracy of a machine learning algorithm using point-of-care high-sensitivity cardiac troponin I for rapid rule-out of myocardial infarction: a retrospective study.","authors":"Betül Toprak, Hugo Solleder, Eleonora Di Carluccio, Jaimi H Greenslade, William A Parsonage, Karen Schulz, Louise Cullen, Fred S Apple, Andreas Ziegler, Stefan Blankenberg","doi":"10.1016/S2589-7500(24)00191-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Point-of-care (POC) high-sensitivity cardiac troponin (hs-cTn) assays have been shown to provide similar analytical precision despite substantially shorter turnaround times compared with laboratory-based hs-cTn assays. We applied the previously developed machine learning based personalised Artificial Intelligence in Suspected Myocardial Infarction Study (ARTEMIS) algorithm, which can predict the individual probability of myocardial infarction, with a single POC hs-cTn measurement, and compared its diagnostic performance with standard-of-care pathways for rapid rule-out of myocardial infarction.</p><p><strong>Methods: </strong>We retrospectively analysed pooled data from consecutive patients of two prospective observational cohorts in geographically distinct regions (the Safe Emergency Department Discharge Rate cohort from the USA and the Suspected Acute Myocardial Infarction in Emergency cohort from Australia) who presented to the emergency department with suspected myocardial infarction. Patients with ST-segment elevation myocardial infarction were excluded. Safety and efficacy of direct rule-out of myocardial infarction by the ARTEMIS algorithm (at a pre-specified probability threshold of <0·5%) were compared with the European Society of Cardiology (ESC)-recommended and the American College of Cardiology (ACC)-recommended 0 h pathways using a single POC high-sensitivity cardiac troponin I (hs-cTnI) measurement (Siemens Atellica VTLi as investigational assay). The primary diagnostic outcome was an adjudicated index diagnosis of type 1 or type 2 myocardial infarction according to the Fourth Universal Definition of Myocardial Infarction. The safety outcome was a composite of incident myocardial infarction and cardiovascular death (follow-up events) at 30 days. Additional analyses were performed for type I myocardial infarction only (secondary diagnostic outcome), and for each cohort separately. Subgroup analyses were performed for age (<65 years vs ≥65 years), sex, symptom onset (≤3 h vs >3 h), estimated glomerular filtration rate (<60 mL/min per 1·73 m<sup>2</sup>vs ≥60 mL/min per 1·73 m<sup>2</sup>), and absence or presence of arterial hypertension, diabetes, a history of coronary artery disease, myocardial infarction, or heart failure, smoking, and ischaemic electrocardiogram signs.</p><p><strong>Findings: </strong>Among 2560 patients (1075 [42%] women, median age 58 years [IQR 48·0-69·0]), prevalence of myocardial infarction was 6·5% (166/2560). The ARTEMIS-POC algorithm classified 899 patients (35·1%) as suitable for rapid rule-out with a negative predictive value of 99·96% (95% CI 99·64-99·96) and a sensitivity of 99·68% (97·21-99·70). For type I myocardial infarction only, negative predictive value and sensitivity were both 100%. Proportions of missed index myocardial infarction (0·05% [0·04-0·42]) and follow-up events at 30 days (0·07% [95% CI 0·06-0·59]) were low. While maintaining high safety, the ARTEMIS-POC algorithm identified more than twice as many patients as eligible for direct rule-out compared with guideline-recommended ESC 0 h (15·2%) and ACC 0 h (13·8%) pathways. Superior efficacy persisted across all clinically relevant subgroups.</p><p><strong>Interpretation: </strong>The patient-tailored, medical decision support ARTEMIS-POC algorithm applied with a single POC hs-cTnI measurement allows for very rapid, safe, and more efficient direct rule-out of myocardial infarction than guideline-recommended pathways. It has the potential to expedite the safe discharge of low-risk patients from the emergency department including early presenters with symptom onset less than 3 h at the time of admission and might open new opportunities for the triage of patients with suspected myocardial infarction even in ambulatory, preclinical, or geographically isolated care settings.</p><p><strong>Funding: </strong>The German Center for Cardiovascular Research (DZHK).</p>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":null,"pages":null},"PeriodicalIF":23.8000,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Lancet Digital Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/S2589-7500(24)00191-2","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Point-of-care (POC) high-sensitivity cardiac troponin (hs-cTn) assays have been shown to provide similar analytical precision despite substantially shorter turnaround times compared with laboratory-based hs-cTn assays. We applied the previously developed machine learning based personalised Artificial Intelligence in Suspected Myocardial Infarction Study (ARTEMIS) algorithm, which can predict the individual probability of myocardial infarction, with a single POC hs-cTn measurement, and compared its diagnostic performance with standard-of-care pathways for rapid rule-out of myocardial infarction.

Methods: We retrospectively analysed pooled data from consecutive patients of two prospective observational cohorts in geographically distinct regions (the Safe Emergency Department Discharge Rate cohort from the USA and the Suspected Acute Myocardial Infarction in Emergency cohort from Australia) who presented to the emergency department with suspected myocardial infarction. Patients with ST-segment elevation myocardial infarction were excluded. Safety and efficacy of direct rule-out of myocardial infarction by the ARTEMIS algorithm (at a pre-specified probability threshold of <0·5%) were compared with the European Society of Cardiology (ESC)-recommended and the American College of Cardiology (ACC)-recommended 0 h pathways using a single POC high-sensitivity cardiac troponin I (hs-cTnI) measurement (Siemens Atellica VTLi as investigational assay). The primary diagnostic outcome was an adjudicated index diagnosis of type 1 or type 2 myocardial infarction according to the Fourth Universal Definition of Myocardial Infarction. The safety outcome was a composite of incident myocardial infarction and cardiovascular death (follow-up events) at 30 days. Additional analyses were performed for type I myocardial infarction only (secondary diagnostic outcome), and for each cohort separately. Subgroup analyses were performed for age (<65 years vs ≥65 years), sex, symptom onset (≤3 h vs >3 h), estimated glomerular filtration rate (<60 mL/min per 1·73 m2vs ≥60 mL/min per 1·73 m2), and absence or presence of arterial hypertension, diabetes, a history of coronary artery disease, myocardial infarction, or heart failure, smoking, and ischaemic electrocardiogram signs.

Findings: Among 2560 patients (1075 [42%] women, median age 58 years [IQR 48·0-69·0]), prevalence of myocardial infarction was 6·5% (166/2560). The ARTEMIS-POC algorithm classified 899 patients (35·1%) as suitable for rapid rule-out with a negative predictive value of 99·96% (95% CI 99·64-99·96) and a sensitivity of 99·68% (97·21-99·70). For type I myocardial infarction only, negative predictive value and sensitivity were both 100%. Proportions of missed index myocardial infarction (0·05% [0·04-0·42]) and follow-up events at 30 days (0·07% [95% CI 0·06-0·59]) were low. While maintaining high safety, the ARTEMIS-POC algorithm identified more than twice as many patients as eligible for direct rule-out compared with guideline-recommended ESC 0 h (15·2%) and ACC 0 h (13·8%) pathways. Superior efficacy persisted across all clinically relevant subgroups.

Interpretation: The patient-tailored, medical decision support ARTEMIS-POC algorithm applied with a single POC hs-cTnI measurement allows for very rapid, safe, and more efficient direct rule-out of myocardial infarction than guideline-recommended pathways. It has the potential to expedite the safe discharge of low-risk patients from the emergency department including early presenters with symptom onset less than 3 h at the time of admission and might open new opportunities for the triage of patients with suspected myocardial infarction even in ambulatory, preclinical, or geographically isolated care settings.

Funding: The German Center for Cardiovascular Research (DZHK).

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
使用床旁高敏心肌肌钙蛋白 I 快速排除心肌梗死的机器学习算法的诊断准确性:一项回顾性研究。
背景:已有研究表明,与基于实验室的高敏心肌肌钙蛋白(hs-cTn)检测法相比,床旁(POC)高敏心肌肌钙蛋白(hs-cTn)检测法尽管周转时间大大缩短,但却能提供相似的分析精度。我们应用了之前开发的基于机器学习的个性化人工智能疑似心肌梗死研究(ARTEMIS)算法,该算法可通过单次 POC hs-cTn 测量预测心肌梗死的个体概率,并将其诊断性能与快速排除心肌梗死的标准护理路径进行了比较:我们回顾性分析了地理位置不同地区的两个前瞻性观察队列(美国的安全急诊科出院率队列和澳大利亚的急诊科疑似急性心肌梗死队列)中因疑似心肌梗死而到急诊科就诊的连续患者的汇总数据。ST段抬高型心肌梗死患者被排除在外。通过 ARTEMIS 算法(预先指定的概率阈值为 3 小时)、估计肾小球滤过率(2vs ≥60 mL/min 每 1-73 m2)、无或有动脉高血压、糖尿病、冠心病、心肌梗死或心力衰竭病史、吸烟和缺血性心电图体征直接排除心肌梗死的安全性和有效性:在 2560 名患者中(女性 1075 人[42%],中位年龄 58 岁[IQR 48-0-69-0]),心肌梗死发病率为 6-5%(166/2560)。ARTEMIS-POC 算法将 899 名患者(35-1%)归类为适合快速排除的患者,其阴性预测值为 99-96%(95% CI 99-64-99-96),灵敏度为 99-68%(97-21-99-70)。仅就 I 型心肌梗死而言,阴性预测值和灵敏度均为 100%。漏诊指数心肌梗死(0-05% [0-04-0-42])和30天随访事件(0-07% [95% CI 0-06-0-59])的比例较低。与指南推荐的ESC 0 h(15-2%)和ACC 0 h(13-8%)路径相比,ARTEMIS-POC算法在保持高安全性的同时,识别出的符合直接排除条件的患者人数是后者的两倍多。在所有临床相关的亚组中,疗效都很好:患者定制的医疗决策支持 ARTEMIS-POC 算法应用于单次 POC hs-cTnI 测量,与指南推荐的路径相比,可非常快速、安全、高效地直接排除心肌梗死。它有可能加快急诊科低风险患者(包括入院时症状出现不到 3 小时的早期患者)的安全出院,并有可能为疑似心肌梗死患者的分诊带来新的机遇,即使是在非住院、临床前或地理位置偏僻的医疗环境中:德国心血管研究中心(DZHK)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
41.20
自引率
1.60%
发文量
232
审稿时长
13 weeks
期刊介绍: The Lancet Digital Health publishes important, innovative, and practice-changing research on any topic connected with digital technology in clinical medicine, public health, and global health. The journal’s open access content crosses subject boundaries, building bridges between health professionals and researchers.By bringing together the most important advances in this multidisciplinary field,The Lancet Digital Health is the most prominent publishing venue in digital health. We publish a range of content types including Articles,Review, Comment, and Correspondence, contributing to promoting digital technologies in health practice worldwide.
期刊最新文献
Correction to Lancet Digit Health 2024; 6: e281-90. Challenges for augmenting intelligence in cardiac imaging. Diagnostic accuracy of a machine learning algorithm using point-of-care high-sensitivity cardiac troponin I for rapid rule-out of myocardial infarction: a retrospective study. Digital technology and new care pathways will redefine the cardiovascular workforce. Digital tools in heart failure: addressing unmet needs.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1