Karl Aharonian, Maggie Sanders, Tal Schlesinger, Victoria Winter, Edward Simanton
{"title":"Predictive Validity of Preclerkship Performance Metrics on USMLE Step 2 CK Outcomes in the Step 1 Pass/Fail Era.","authors":"Karl Aharonian, Maggie Sanders, Tal Schlesinger, Victoria Winter, Edward Simanton","doi":"10.2147/AMEP.S505612","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>With the transition of USMLE Step 1 to pass/fail, Step 2 CK has become a critical factor in residency selection. This study evaluates the predictive value of preclinical academic metrics for Step 2 CK outcomes to help students assess their metrics for residency before starting clerkships.</p><p><strong>Methods: </strong>We analyzed data from 58 students at the Kirk Kerkorian School of Medicine at UNLV. Academic metrics included MCAT scores, NBME-style Phase 1 exam performance, and CBSE scores. Pearson correlation coefficients were calculated between each predictor and Step 2 CK scores. Binary logistic regression was used, with Step 2 CK upper quartile (score >255) as the dependent variable and thresholds for each predictor as independent variables.</p><p><strong>Results: </strong>MCAT scores showed a moderate positive correlation with Step 2 CK (r=0.37, p=0.004). Students scoring >510 on the MCAT were significantly more likely to achieve >255 on Step 2 CK. Phase 1 NBME exam performance had the strongest correlation (r=0.67, p<0.0001), with students scoring above the national mean on >75% of exams more likely to achieve >255. While CBSE scores showed a similar correlation (r=0.67, p<0.0001), logistic regression analysis revealed that their predictive ability was less consistent for students in the middle performance range, indicating variability in classification utility.</p><p><strong>Conclusion: </strong>Preclinical NBME exam performance emerged as the strongest predictor of Step 2 CK success in our cohort, with MCAT and CBSE scores offering additional, though less robust, predictive value. These findings highlight the importance of early academic guidance to optimize residency preparedness and provide actionable insights for students assessing their readiness within the new Step 1 pass/fail framework. Further multi-institutional research is warranted to validate and generalize these results.</p>","PeriodicalId":47404,"journal":{"name":"Advances in Medical Education and Practice","volume":"16 ","pages":"323-330"},"PeriodicalIF":1.8000,"publicationDate":"2025-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11871918/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Medical Education and Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2147/AMEP.S505612","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
摘要
目的:随着 USMLE 第 1 步过渡到通过/失败,第 2 步 CK 已成为住院医师选择的关键因素。本研究评估了临床前学术指标对第 2 步 CK 结果的预测价值,以帮助学生在开始实习前评估自己的住院医师指标:我们分析了来自UNLV的Kirk Kerkorian医学院58名学生的数据。学术指标包括 MCAT 分数、NBME-style 第一阶段考试成绩和 CBSE 分数。计算了每个预测指标与第二阶段 CK 分数之间的皮尔逊相关系数。采用二元逻辑回归法,将步骤 2 CK 上四分位数(得分大于 255 分)作为因变量,将各预测因子的阈值作为自变量:MCAT分数与第二阶段CK呈中度正相关(r=0.37,p=0.004)。MCAT考试成绩大于510分的学生在第二阶段CK考试中成绩大于255分的可能性明显更大。第一阶段NBME考试成绩的相关性最强(r=0.67,p75%的考试成绩更有可能达到255分以上。而CBSE分数也显示出类似的相关性(r=0.67,p结论:临床前NBME考试成绩是我们队列中第二步CK成功率的最强预测因素,而MCAT和CBSE成绩则提供了额外的预测价值,尽管这种预测价值并不那么强大。这些发现强调了早期学术指导对优化住院医师培训准备的重要性,并为学生在新的第 1 步通过/未通过框架内评估自己的准备情况提供了可操作的见解。有必要进一步开展多机构研究,以验证和推广这些结果。
Predictive Validity of Preclerkship Performance Metrics on USMLE Step 2 CK Outcomes in the Step 1 Pass/Fail Era.
Purpose: With the transition of USMLE Step 1 to pass/fail, Step 2 CK has become a critical factor in residency selection. This study evaluates the predictive value of preclinical academic metrics for Step 2 CK outcomes to help students assess their metrics for residency before starting clerkships.
Methods: We analyzed data from 58 students at the Kirk Kerkorian School of Medicine at UNLV. Academic metrics included MCAT scores, NBME-style Phase 1 exam performance, and CBSE scores. Pearson correlation coefficients were calculated between each predictor and Step 2 CK scores. Binary logistic regression was used, with Step 2 CK upper quartile (score >255) as the dependent variable and thresholds for each predictor as independent variables.
Results: MCAT scores showed a moderate positive correlation with Step 2 CK (r=0.37, p=0.004). Students scoring >510 on the MCAT were significantly more likely to achieve >255 on Step 2 CK. Phase 1 NBME exam performance had the strongest correlation (r=0.67, p<0.0001), with students scoring above the national mean on >75% of exams more likely to achieve >255. While CBSE scores showed a similar correlation (r=0.67, p<0.0001), logistic regression analysis revealed that their predictive ability was less consistent for students in the middle performance range, indicating variability in classification utility.
Conclusion: Preclinical NBME exam performance emerged as the strongest predictor of Step 2 CK success in our cohort, with MCAT and CBSE scores offering additional, though less robust, predictive value. These findings highlight the importance of early academic guidance to optimize residency preparedness and provide actionable insights for students assessing their readiness within the new Step 1 pass/fail framework. Further multi-institutional research is warranted to validate and generalize these results.