Standardizing phenotypic algorithms for the classification of degenerative rotator cuff tear from electronic health record systems.

IF 2.5 Q2 HEALTH CARE SCIENCES & SERVICES JAMIA Open Pub Date : 2025-03-18 eCollection Date: 2025-04-01 DOI:10.1093/jamiaopen/ooaf014
Simone D Herzberg, Nelly-Estefanie Garduno-Rapp, Henry H Ong, Srushti Gangireddy, Anoop S Chandrashekar, Wei-Qi Wei, Lance E LeClere, Wanqing Wen, Katherine E Hartmann, Nitin B Jain, Ayush Giri
{"title":"Standardizing phenotypic algorithms for the classification of degenerative rotator cuff tear from electronic health record systems.","authors":"Simone D Herzberg, Nelly-Estefanie Garduno-Rapp, Henry H Ong, Srushti Gangireddy, Anoop S Chandrashekar, Wei-Qi Wei, Lance E LeClere, Wanqing Wen, Katherine E Hartmann, Nitin B Jain, Ayush Giri","doi":"10.1093/jamiaopen/ooaf014","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Degenerative rotator cuff tears (DCTs) are the leading cause of shoulder pain, affecting 30%-50% of individuals over 50. Current phenotyping strategies for DCT use heterogeneous combinations of procedural and diagnostic codes and are concerning for misclassification. The objective of this study was to create standardized phenotypic algorithms to classify DCT status across electronic health record (EHR) systems.</p><p><strong>Materials and methods: </strong>Using a de-identified EHR system, containing chart level data for ∼3.5 million individuals from January 1998 to December 2023, we developed and validated 2 types of algorithms-one requiring and one without imaging verification-to identify DCT cases and controls. The algorithms used combinations of International Classification of Diseases (ICD) / Current Procedural Terminology (CPT) codes and natural language processing (NLP) to increase diagnostic certainty. These hand-crafted algorithms underwent iterative refinement with manual chart review by trained personnel blinded to case-control determinations to compute positive predictive value (PPV) and negative predictive value (NPV).</p><p><strong>Results: </strong>The algorithm development process resulted in 5 algorithms to identify patients with or without DCT with an overall predictive value of 94.5%: (1) code only cases that required imaging confirmation (PPV = 89%), (2) code only cases that did not require imaging verification (PPV = 92%), (3) NLP-based cases that did not require imaging verification (PPV = 89%), (4) code-based controls that required imaging confirmation (NPV = 90%), and (5) code and NLP-based controls that did not require imaging verification (NPV = 100%). External validation demonstrated 94% sensitivity and 75% specificity for the code-only algorithms.</p><p><strong>Discussion: </strong>This work highlights the inaccuracy of previous approaches to phenotypic assessment of DCT reliant solely on ICD and CPT codes and demonstrate that integrating temporal and frequency requirements, as well as NLP, substantially increases predictive value. However, while the inclusion of imaging verification enhances diagnostic confidence, it also reduces sample size without necessarily improving predictive value, underscoring the need for a balance between precision and scalability in phenotypic definitions for large-scale genetic and clinical research.</p><p><strong>Conclusions: </strong>These algorithms represent an improvement over prior DCT phenotyping strategies and can be useful in large-scale EHR studies.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 2","pages":"ooaf014"},"PeriodicalIF":2.5000,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11917214/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMIA Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jamiaopen/ooaf014","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: Degenerative rotator cuff tears (DCTs) are the leading cause of shoulder pain, affecting 30%-50% of individuals over 50. Current phenotyping strategies for DCT use heterogeneous combinations of procedural and diagnostic codes and are concerning for misclassification. The objective of this study was to create standardized phenotypic algorithms to classify DCT status across electronic health record (EHR) systems.

Materials and methods: Using a de-identified EHR system, containing chart level data for ∼3.5 million individuals from January 1998 to December 2023, we developed and validated 2 types of algorithms-one requiring and one without imaging verification-to identify DCT cases and controls. The algorithms used combinations of International Classification of Diseases (ICD) / Current Procedural Terminology (CPT) codes and natural language processing (NLP) to increase diagnostic certainty. These hand-crafted algorithms underwent iterative refinement with manual chart review by trained personnel blinded to case-control determinations to compute positive predictive value (PPV) and negative predictive value (NPV).

Results: The algorithm development process resulted in 5 algorithms to identify patients with or without DCT with an overall predictive value of 94.5%: (1) code only cases that required imaging confirmation (PPV = 89%), (2) code only cases that did not require imaging verification (PPV = 92%), (3) NLP-based cases that did not require imaging verification (PPV = 89%), (4) code-based controls that required imaging confirmation (NPV = 90%), and (5) code and NLP-based controls that did not require imaging verification (NPV = 100%). External validation demonstrated 94% sensitivity and 75% specificity for the code-only algorithms.

Discussion: This work highlights the inaccuracy of previous approaches to phenotypic assessment of DCT reliant solely on ICD and CPT codes and demonstrate that integrating temporal and frequency requirements, as well as NLP, substantially increases predictive value. However, while the inclusion of imaging verification enhances diagnostic confidence, it also reduces sample size without necessarily improving predictive value, underscoring the need for a balance between precision and scalability in phenotypic definitions for large-scale genetic and clinical research.

Conclusions: These algorithms represent an improvement over prior DCT phenotyping strategies and can be useful in large-scale EHR studies.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
求助全文
约1分钟内获得全文 去求助
来源期刊
JAMIA Open
JAMIA Open Medicine-Health Informatics
CiteScore
4.10
自引率
4.80%
发文量
102
审稿时长
16 weeks
期刊最新文献
Barriers to telehealth uptake and use: a scoping review. Standardizing phenotypic algorithms for the classification of degenerative rotator cuff tear from electronic health record systems. LLM-IE: a python package for biomedical generative information extraction with large language models. Standards and infrastructure for multisite deployment of the research participant perception survey. Aligning prediction models with clinical information needs: infant sepsis case study.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1