Standardizing phenotypic algorithms for the classification of degenerative rotator cuff tear from electronic health record systems.

IF 3.4 Q2 HEALTH CARE SCIENCES & SERVICES JAMIA Open Pub Date : 2025-03-18 eCollection Date: 2025-04-01 DOI:10.1093/jamiaopen/ooaf014
Simone D Herzberg, Nelly-Estefanie Garduno-Rapp, Henry H Ong, Srushti Gangireddy, Anoop S Chandrashekar, Wei-Qi Wei, Lance E LeClere, Wanqing Wen, Katherine E Hartmann, Nitin B Jain, Ayush Giri
{"title":"Standardizing phenotypic algorithms for the classification of degenerative rotator cuff tear from electronic health record systems.","authors":"Simone D Herzberg, Nelly-Estefanie Garduno-Rapp, Henry H Ong, Srushti Gangireddy, Anoop S Chandrashekar, Wei-Qi Wei, Lance E LeClere, Wanqing Wen, Katherine E Hartmann, Nitin B Jain, Ayush Giri","doi":"10.1093/jamiaopen/ooaf014","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Degenerative rotator cuff tears (DCTs) are the leading cause of shoulder pain, affecting 30%-50% of individuals over 50. Current phenotyping strategies for DCT use heterogeneous combinations of procedural and diagnostic codes and are concerning for misclassification. The objective of this study was to create standardized phenotypic algorithms to classify DCT status across electronic health record (EHR) systems.</p><p><strong>Materials and methods: </strong>Using a de-identified EHR system, containing chart level data for ∼3.5 million individuals from January 1998 to December 2023, we developed and validated 2 types of algorithms-one requiring and one without imaging verification-to identify DCT cases and controls. The algorithms used combinations of International Classification of Diseases (ICD) / Current Procedural Terminology (CPT) codes and natural language processing (NLP) to increase diagnostic certainty. These hand-crafted algorithms underwent iterative refinement with manual chart review by trained personnel blinded to case-control determinations to compute positive predictive value (PPV) and negative predictive value (NPV).</p><p><strong>Results: </strong>The algorithm development process resulted in 5 algorithms to identify patients with or without DCT with an overall predictive value of 94.5%: (1) code only cases that required imaging confirmation (PPV = 89%), (2) code only cases that did not require imaging verification (PPV = 92%), (3) NLP-based cases that did not require imaging verification (PPV = 89%), (4) code-based controls that required imaging confirmation (NPV = 90%), and (5) code and NLP-based controls that did not require imaging verification (NPV = 100%). External validation demonstrated 94% sensitivity and 75% specificity for the code-only algorithms.</p><p><strong>Discussion: </strong>This work highlights the inaccuracy of previous approaches to phenotypic assessment of DCT reliant solely on ICD and CPT codes and demonstrate that integrating temporal and frequency requirements, as well as NLP, substantially increases predictive value. However, while the inclusion of imaging verification enhances diagnostic confidence, it also reduces sample size without necessarily improving predictive value, underscoring the need for a balance between precision and scalability in phenotypic definitions for large-scale genetic and clinical research.</p><p><strong>Conclusions: </strong>These algorithms represent an improvement over prior DCT phenotyping strategies and can be useful in large-scale EHR studies.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 2","pages":"ooaf014"},"PeriodicalIF":3.4000,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11917214/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMIA Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jamiaopen/ooaf014","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: Degenerative rotator cuff tears (DCTs) are the leading cause of shoulder pain, affecting 30%-50% of individuals over 50. Current phenotyping strategies for DCT use heterogeneous combinations of procedural and diagnostic codes and are concerning for misclassification. The objective of this study was to create standardized phenotypic algorithms to classify DCT status across electronic health record (EHR) systems.

Materials and methods: Using a de-identified EHR system, containing chart level data for ∼3.5 million individuals from January 1998 to December 2023, we developed and validated 2 types of algorithms-one requiring and one without imaging verification-to identify DCT cases and controls. The algorithms used combinations of International Classification of Diseases (ICD) / Current Procedural Terminology (CPT) codes and natural language processing (NLP) to increase diagnostic certainty. These hand-crafted algorithms underwent iterative refinement with manual chart review by trained personnel blinded to case-control determinations to compute positive predictive value (PPV) and negative predictive value (NPV).

Results: The algorithm development process resulted in 5 algorithms to identify patients with or without DCT with an overall predictive value of 94.5%: (1) code only cases that required imaging confirmation (PPV = 89%), (2) code only cases that did not require imaging verification (PPV = 92%), (3) NLP-based cases that did not require imaging verification (PPV = 89%), (4) code-based controls that required imaging confirmation (NPV = 90%), and (5) code and NLP-based controls that did not require imaging verification (NPV = 100%). External validation demonstrated 94% sensitivity and 75% specificity for the code-only algorithms.

Discussion: This work highlights the inaccuracy of previous approaches to phenotypic assessment of DCT reliant solely on ICD and CPT codes and demonstrate that integrating temporal and frequency requirements, as well as NLP, substantially increases predictive value. However, while the inclusion of imaging verification enhances diagnostic confidence, it also reduces sample size without necessarily improving predictive value, underscoring the need for a balance between precision and scalability in phenotypic definitions for large-scale genetic and clinical research.

Conclusions: These algorithms represent an improvement over prior DCT phenotyping strategies and can be useful in large-scale EHR studies.

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
电子健康记录系统中退行性肩袖撕裂分类的标准化表型算法。
目的:退行性肩袖撕裂(DCTs)是导致肩痛的主要原因,影响了30 -50%的50岁以上人群。目前的DCT表型策略使用程序代码和诊断代码的异质组合,并且涉及错误分类。本研究的目的是创建标准化的表型算法,对电子健康记录(EHR)系统中的DCT状态进行分类。材料和方法:使用一个去识别的EHR系统,包含1998年1月至2023年12月约350万人的图表级数据,我们开发并验证了两种类型的算法,一种需要图像验证,一种不需要图像验证,以识别DCT病例和对照。该算法结合了国际疾病分类(ICD) /现行程序术语(CPT)代码和自然语言处理(NLP)来提高诊断的确定性。这些手工制作的算法经过反复的改进,由经过培训的人员进行手工图表审查,以计算阳性预测值(PPV)和阴性预测值(NPV)。结果:算法开发过程中产生了5种识别有无DCT患者的算法,总体预测值为94.5%:(1)只编码需要成像确认的病例(PPV = 89%),(2)只编码不需要成像验证的病例(PPV = 92%),(3)不需要成像验证的基于nlp的病例(PPV = 89%),(4)需要成像确认的基于代码的对照(NPV = 90%),(5)不需要成像验证的基于代码和基于nlp的对照(NPV = 100%)。外部验证表明,仅编码算法的灵敏度为94%,特异性为75%。讨论:这项工作强调了以前仅依赖ICD和CPT代码的DCT表型评估方法的不准确性,并证明了整合时间和频率要求以及NLP,大大提高了预测价值。然而,虽然包括影像学验证增强了诊断的信心,但它也减少了样本量,而不一定提高预测价值,强调了在大规模遗传和临床研究中表型定义的准确性和可扩展性之间的平衡。结论:这些算法代表了先前的DCT表型策略的改进,可以用于大规模的电子病历研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
JAMIA Open
JAMIA Open Medicine-Health Informatics
CiteScore
4.10
自引率
4.80%
发文量
102
审稿时长
16 weeks
期刊最新文献
Privacy-preserving verification of preprocessing in federated learning for genomic data. Converting unstructured cardiac catheterization and echocardiography reports into structured data using transformer-based language models. The effect of adding visual summaries to data visualizations on patient judgments of hypertension control. Patient perspectives about deployment of artificial intelligence decision support tools in a safety-net healthcare system. Advanced artificial intelligence vs simpler models for 1-year death prediction among patients receiving hemodialysis.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1