针对严重基础诊断的简短已解决不明原因事件预测规则的外部验证。

IF 24.7 1区 医学 Q1 PEDIATRICS JAMA Pediatrics Pub Date : 2025-02-01 DOI:10.1001/jamapediatrics.2024.4399
Nassr Nama, Ye Shen, Jeffrey N Bone, Zerlyn Lee, Kara Picco, Falla Jin, Jessica L Foulds, Josée Anne Gagnon, Chris Novak, Brigitte Parisien, Matthew Donlan, Ran D Goldman, Anupam Sehgal, Joanna Holland, Sanjay Mahant, Joel S Tieder, Peter J Gill
{"title":"针对严重基础诊断的简短已解决不明原因事件预测规则的外部验证。","authors":"Nassr Nama, Ye Shen, Jeffrey N Bone, Zerlyn Lee, Kara Picco, Falla Jin, Jessica L Foulds, Josée Anne Gagnon, Chris Novak, Brigitte Parisien, Matthew Donlan, Ran D Goldman, Anupam Sehgal, Joanna Holland, Sanjay Mahant, Joel S Tieder, Peter J Gill","doi":"10.1001/jamapediatrics.2024.4399","DOIUrl":null,"url":null,"abstract":"<p><strong>Importance: </strong>The American Academy of Pediatrics (AAP) higher-risk criteria for brief resolved unexplained events (BRUE) have a low positive predictive value (4.8%) and misclassify most infants as higher risk (>90%). New BRUE prediction rules from a US cohort of 3283 infants showed improved discrimination; however, these rules have not been validated in an external cohort.</p><p><strong>Objective: </strong>To externally validate new BRUE prediction rules and compare them with the AAP higher-risk criteria.</p><p><strong>Design, setting, and participants: </strong>This was a retrospective multicenter cohort study conducted from 2017 to 2021 and monitored for 90 days after index presentation. The setting included infants younger than 1 year with a BRUE identified through retrospective chart review from 11 Canadian hospitals. Study data were analyzed from March 2022 to March 2024.</p><p><strong>Exposures: </strong>The BRUE prediction rules.</p><p><strong>Main outcome and measure: </strong>The primary outcome was a serious underlying diagnosis, defined as conditions where a delay in diagnosis could lead to increased morbidity or mortality.</p><p><strong>Results: </strong>Of 1042 patients (median [IQR] age, 41 [13-84] days; 529 female [50.8%]), 977 (93.8%) were classified as higher risk by the AAP criteria. A total of 79 patients (7.6%) had a serious underlying diagnosis. For this outcome, the AAP criteria demonstrated a sensitivity of 100.0% (95% CI, 95.4%-100.0%), a specificity of 6.7% (95% CI, 5.2%-8.5%), a positive likelihood ratio (LR+) of 1.07 (95% CI, 1.05-1.09), and an AUC of 0.53 (95% CI, 0.53-0.54). The BRUE prediction rule for discerning serious diagnoses displayed an AUC of 0.60 (95% CI, 0.54-0.67; calibration intercept: 0.60), which improved to an AUC of 0.71 (95% CI, 0.65-0.76; P < .001; calibration intercept: 0.00) after model revision. Event recurrence was noted in 163 patients (15.6%). For this outcome, the AAP criteria yielded a sensitivity of 99.4% (95% CI, 96.6%-100.0%), a specificity of 7.3% (95% CI, 5.7%-9.2%), an LR+ of 1.07 (95% CI, 1.05-1.10), and an AUC of 0.58 (95% CI, 0.56-0.58). The AUC of the prediction rule stood at 0.67 (95% CI, 0.62-0.72; calibration intercept: 0.15).</p><p><strong>Conclusions and relevance: </strong>Results of this multicenter cohort study show that the BRUE prediction rules outperformed the AAP higher-risk criteria on external geographical validation, and performance improved after recalibration. These rules provide clinicians and families with a more precise tool to support decision-making, grounded in individual risk tolerance.</p>","PeriodicalId":14683,"journal":{"name":"JAMA Pediatrics","volume":" ","pages":"188-196"},"PeriodicalIF":24.7000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11791710/pdf/","citationCount":"0","resultStr":"{\"title\":\"External Validation of Brief Resolved Unexplained Events Prediction Rules for Serious Underlying Diagnosis.\",\"authors\":\"Nassr Nama, Ye Shen, Jeffrey N Bone, Zerlyn Lee, Kara Picco, Falla Jin, Jessica L Foulds, Josée Anne Gagnon, Chris Novak, Brigitte Parisien, Matthew Donlan, Ran D Goldman, Anupam Sehgal, Joanna Holland, Sanjay Mahant, Joel S Tieder, Peter J Gill\",\"doi\":\"10.1001/jamapediatrics.2024.4399\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Importance: </strong>The American Academy of Pediatrics (AAP) higher-risk criteria for brief resolved unexplained events (BRUE) have a low positive predictive value (4.8%) and misclassify most infants as higher risk (>90%). New BRUE prediction rules from a US cohort of 3283 infants showed improved discrimination; however, these rules have not been validated in an external cohort.</p><p><strong>Objective: </strong>To externally validate new BRUE prediction rules and compare them with the AAP higher-risk criteria.</p><p><strong>Design, setting, and participants: </strong>This was a retrospective multicenter cohort study conducted from 2017 to 2021 and monitored for 90 days after index presentation. The setting included infants younger than 1 year with a BRUE identified through retrospective chart review from 11 Canadian hospitals. Study data were analyzed from March 2022 to March 2024.</p><p><strong>Exposures: </strong>The BRUE prediction rules.</p><p><strong>Main outcome and measure: </strong>The primary outcome was a serious underlying diagnosis, defined as conditions where a delay in diagnosis could lead to increased morbidity or mortality.</p><p><strong>Results: </strong>Of 1042 patients (median [IQR] age, 41 [13-84] days; 529 female [50.8%]), 977 (93.8%) were classified as higher risk by the AAP criteria. A total of 79 patients (7.6%) had a serious underlying diagnosis. For this outcome, the AAP criteria demonstrated a sensitivity of 100.0% (95% CI, 95.4%-100.0%), a specificity of 6.7% (95% CI, 5.2%-8.5%), a positive likelihood ratio (LR+) of 1.07 (95% CI, 1.05-1.09), and an AUC of 0.53 (95% CI, 0.53-0.54). The BRUE prediction rule for discerning serious diagnoses displayed an AUC of 0.60 (95% CI, 0.54-0.67; calibration intercept: 0.60), which improved to an AUC of 0.71 (95% CI, 0.65-0.76; P < .001; calibration intercept: 0.00) after model revision. Event recurrence was noted in 163 patients (15.6%). For this outcome, the AAP criteria yielded a sensitivity of 99.4% (95% CI, 96.6%-100.0%), a specificity of 7.3% (95% CI, 5.7%-9.2%), an LR+ of 1.07 (95% CI, 1.05-1.10), and an AUC of 0.58 (95% CI, 0.56-0.58). The AUC of the prediction rule stood at 0.67 (95% CI, 0.62-0.72; calibration intercept: 0.15).</p><p><strong>Conclusions and relevance: </strong>Results of this multicenter cohort study show that the BRUE prediction rules outperformed the AAP higher-risk criteria on external geographical validation, and performance improved after recalibration. These rules provide clinicians and families with a more precise tool to support decision-making, grounded in individual risk tolerance.</p>\",\"PeriodicalId\":14683,\"journal\":{\"name\":\"JAMA Pediatrics\",\"volume\":\" \",\"pages\":\"188-196\"},\"PeriodicalIF\":24.7000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11791710/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JAMA Pediatrics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1001/jamapediatrics.2024.4399\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PEDIATRICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMA Pediatrics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1001/jamapediatrics.2024.4399","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PEDIATRICS","Score":null,"Total":0}
引用次数: 0

摘要

重要性:美国儿科学会(AAP)对短暂解决的不明原因事件(BRUE)的高风险标准阳性预测值较低(4.8%),并将大多数婴儿错误分类为高风险(>90%)。来自美国3283名婴儿队列的新布鲁预测规则显示出更好的歧视;然而,这些规则尚未在外部队列中得到验证。目的:外部验证新的BRUE预测规则,并与AAP高危标准进行比较。设计、环境和参与者:这是一项回顾性多中心队列研究,于2017年至2021年进行,并在指数呈现后90天进行监测。该研究包括来自11家加拿大医院的回顾性图表审查确定的1岁以下的BRUE婴儿。研究数据分析时间为2022年3月至2024年3月。曝光:布鲁预测规则。主要结局和衡量标准:主要结局是严重的潜在诊断,定义为诊断延误可能导致发病率或死亡率增加的情况。结果:1042例患者(中位[IQR]年龄41[13-84]天;529例女性(50.8%),977例(93.8%)按AAP标准归为高危。79例患者(7.6%)有严重的基础诊断。对于该结果,AAP标准的敏感性为100.0% (95% CI, 95.4%-100.0%),特异性为6.7% (95% CI, 5.2%-8.5%),阳性似然比(LR+)为1.07 (95% CI, 1.05-1.09), AUC为0.53 (95% CI, 0.53-0.54)。识别严重诊断的BRUE预测规则显示AUC为0.60 (95% CI, 0.54-0.67;校准截距:0.60),其AUC提高到0.71 (95% CI, 0.65-0.76;P结论及相关性:本多中心队列研究结果表明,BRUE预测规则在外部地理验证方面优于AAP高风险标准,并且在重新校准后性能有所提高。这些规则为临床医生和家庭提供了更精确的工具,以支持基于个人风险承受能力的决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
External Validation of Brief Resolved Unexplained Events Prediction Rules for Serious Underlying Diagnosis.

Importance: The American Academy of Pediatrics (AAP) higher-risk criteria for brief resolved unexplained events (BRUE) have a low positive predictive value (4.8%) and misclassify most infants as higher risk (>90%). New BRUE prediction rules from a US cohort of 3283 infants showed improved discrimination; however, these rules have not been validated in an external cohort.

Objective: To externally validate new BRUE prediction rules and compare them with the AAP higher-risk criteria.

Design, setting, and participants: This was a retrospective multicenter cohort study conducted from 2017 to 2021 and monitored for 90 days after index presentation. The setting included infants younger than 1 year with a BRUE identified through retrospective chart review from 11 Canadian hospitals. Study data were analyzed from March 2022 to March 2024.

Exposures: The BRUE prediction rules.

Main outcome and measure: The primary outcome was a serious underlying diagnosis, defined as conditions where a delay in diagnosis could lead to increased morbidity or mortality.

Results: Of 1042 patients (median [IQR] age, 41 [13-84] days; 529 female [50.8%]), 977 (93.8%) were classified as higher risk by the AAP criteria. A total of 79 patients (7.6%) had a serious underlying diagnosis. For this outcome, the AAP criteria demonstrated a sensitivity of 100.0% (95% CI, 95.4%-100.0%), a specificity of 6.7% (95% CI, 5.2%-8.5%), a positive likelihood ratio (LR+) of 1.07 (95% CI, 1.05-1.09), and an AUC of 0.53 (95% CI, 0.53-0.54). The BRUE prediction rule for discerning serious diagnoses displayed an AUC of 0.60 (95% CI, 0.54-0.67; calibration intercept: 0.60), which improved to an AUC of 0.71 (95% CI, 0.65-0.76; P < .001; calibration intercept: 0.00) after model revision. Event recurrence was noted in 163 patients (15.6%). For this outcome, the AAP criteria yielded a sensitivity of 99.4% (95% CI, 96.6%-100.0%), a specificity of 7.3% (95% CI, 5.7%-9.2%), an LR+ of 1.07 (95% CI, 1.05-1.10), and an AUC of 0.58 (95% CI, 0.56-0.58). The AUC of the prediction rule stood at 0.67 (95% CI, 0.62-0.72; calibration intercept: 0.15).

Conclusions and relevance: Results of this multicenter cohort study show that the BRUE prediction rules outperformed the AAP higher-risk criteria on external geographical validation, and performance improved after recalibration. These rules provide clinicians and families with a more precise tool to support decision-making, grounded in individual risk tolerance.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
JAMA Pediatrics
JAMA Pediatrics PEDIATRICS-
CiteScore
31.60
自引率
1.90%
发文量
357
期刊介绍: JAMA Pediatrics, the oldest continuously published pediatric journal in the US since 1911, is an international peer-reviewed publication and a part of the JAMA Network. Published weekly online and in 12 issues annually, it garners over 8.4 million article views and downloads yearly. All research articles become freely accessible online after 12 months without any author fees, and through the WHO's HINARI program, the online version is accessible to institutions in developing countries. With a focus on advancing the health of infants, children, and adolescents, JAMA Pediatrics serves as a platform for discussing crucial issues and policies in child and adolescent health care. Leveraging the latest technology, it ensures timely access to information for its readers worldwide.
期刊最新文献
Receipt of Federal Income Support by Eligible Low-Birth-Weight Infants Mental and Somatic Conditions in Children With the Broad Avoidant Restrictive Food Intake Disorder Phenotype Maternal Downward Neighborhood Income Mobility and Ensuing Severe Neonatal Morbidity NICHD Magnetic Resonance Brain Imaging Score in Term Infants With Hypoxic-Ischemic Encephalopathy: A Secondary Analysis of a Randomized Clinical Trial. Supplemental Security Income for Low-Birth-Weight Infants-Addressing Gaps in Coverage.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1