Victoria C Merritt, Alicia W Chen, Clara-Lea Bonzel, Chuan Hong, Rahul Sangar, Sara Morini Sweet, Scott F Sorg, Catherine Chanfreau-Coffinier
{"title":"开发和验证基于电子健康记录的算法,用于识别退伍军人事务部的创伤性脑损伤:退伍军人事务部百万退伍军人计划研究。","authors":"Victoria C Merritt, Alicia W Chen, Clara-Lea Bonzel, Chuan Hong, Rahul Sangar, Sara Morini Sweet, Scott F Sorg, Catherine Chanfreau-Coffinier","doi":"10.1080/02699052.2024.2373920","DOIUrl":null,"url":null,"abstract":"<p><p>The purpose of this study was to develop and validate an algorithm for identifying Veterans with a history of traumatic brain injury (TBI) in the Veterans Affairs (VA) electronic health record using VA Million Veteran Program (MVP) data. Manual chart review (<i>n</i> = 200) was first used to establish 'gold standard' diagnosis labels for TBI ('Yes TBI' vs. 'No TBI'). To develop our algorithm, we used PheCAP, a semi-supervised pipeline that relied on the chart review diagnosis labels to train and create a prediction model for TBI. Cross-validation was used to train and evaluate the proposed algorithm, 'TBI-PheCAP.' TBI-PheCAP performance was compared to existing TBI algorithms and phenotyping methods, and the final algorithm was run on all MVP participants (<i>n</i> = 702,740) to assign a predicted probability for TBI and a binary classification status choosing specificity = 90%. The TBI-PheCAP algorithm had an area under the receiver operating characteristic curve of 0.92, sensitivity of 84%, and positive predictive value (PPV) of 98% at specificity = 90%. TBI-PheCAP generally performed better than other classification methods, with equivalent or higher sensitivity and PPV than existing rules-based TBI algorithms and MVP TBI-related survey data. Given its strong classification metrics, the TBI-PheCAP algorithm is recommended for use in future population-based TBI research.</p>","PeriodicalId":9082,"journal":{"name":"Brain injury","volume":" ","pages":"1084-1092"},"PeriodicalIF":1.5000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and validation of an electronic health record-based algorithm for identifying TBI in the VA: A VA Million Veteran Program study.\",\"authors\":\"Victoria C Merritt, Alicia W Chen, Clara-Lea Bonzel, Chuan Hong, Rahul Sangar, Sara Morini Sweet, Scott F Sorg, Catherine Chanfreau-Coffinier\",\"doi\":\"10.1080/02699052.2024.2373920\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The purpose of this study was to develop and validate an algorithm for identifying Veterans with a history of traumatic brain injury (TBI) in the Veterans Affairs (VA) electronic health record using VA Million Veteran Program (MVP) data. Manual chart review (<i>n</i> = 200) was first used to establish 'gold standard' diagnosis labels for TBI ('Yes TBI' vs. 'No TBI'). To develop our algorithm, we used PheCAP, a semi-supervised pipeline that relied on the chart review diagnosis labels to train and create a prediction model for TBI. Cross-validation was used to train and evaluate the proposed algorithm, 'TBI-PheCAP.' TBI-PheCAP performance was compared to existing TBI algorithms and phenotyping methods, and the final algorithm was run on all MVP participants (<i>n</i> = 702,740) to assign a predicted probability for TBI and a binary classification status choosing specificity = 90%. The TBI-PheCAP algorithm had an area under the receiver operating characteristic curve of 0.92, sensitivity of 84%, and positive predictive value (PPV) of 98% at specificity = 90%. TBI-PheCAP generally performed better than other classification methods, with equivalent or higher sensitivity and PPV than existing rules-based TBI algorithms and MVP TBI-related survey data. Given its strong classification metrics, the TBI-PheCAP algorithm is recommended for use in future population-based TBI research.</p>\",\"PeriodicalId\":9082,\"journal\":{\"name\":\"Brain injury\",\"volume\":\" \",\"pages\":\"1084-1092\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Brain injury\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/02699052.2024.2373920\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/7/14 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q4\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain injury","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/02699052.2024.2373920","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/14 0:00:00","PubModel":"Epub","JCR":"Q4","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
Development and validation of an electronic health record-based algorithm for identifying TBI in the VA: A VA Million Veteran Program study.
The purpose of this study was to develop and validate an algorithm for identifying Veterans with a history of traumatic brain injury (TBI) in the Veterans Affairs (VA) electronic health record using VA Million Veteran Program (MVP) data. Manual chart review (n = 200) was first used to establish 'gold standard' diagnosis labels for TBI ('Yes TBI' vs. 'No TBI'). To develop our algorithm, we used PheCAP, a semi-supervised pipeline that relied on the chart review diagnosis labels to train and create a prediction model for TBI. Cross-validation was used to train and evaluate the proposed algorithm, 'TBI-PheCAP.' TBI-PheCAP performance was compared to existing TBI algorithms and phenotyping methods, and the final algorithm was run on all MVP participants (n = 702,740) to assign a predicted probability for TBI and a binary classification status choosing specificity = 90%. The TBI-PheCAP algorithm had an area under the receiver operating characteristic curve of 0.92, sensitivity of 84%, and positive predictive value (PPV) of 98% at specificity = 90%. TBI-PheCAP generally performed better than other classification methods, with equivalent or higher sensitivity and PPV than existing rules-based TBI algorithms and MVP TBI-related survey data. Given its strong classification metrics, the TBI-PheCAP algorithm is recommended for use in future population-based TBI research.
期刊介绍:
Brain Injury publishes critical information relating to research and clinical practice, adult and pediatric populations. The journal covers a full range of relevant topics relating to clinical, translational, and basic science research. Manuscripts address emergency and acute medical care, acute and post-acute rehabilitation, family and vocational issues, and long-term supports. Coverage includes assessment and interventions for functional, communication, neurological and psychological disorders.