首页 > 最新文献

AEM Education and Training最新文献

英文 中文
Development and Initial Validity Evidence for the EvaLeR Tool: Assessing Quality of Emergency Medicine Educational Resources EvaLeR工具的开发和初步有效性证据:评估急诊医学教育资源的质量
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-26 DOI: 10.1002/aet2.70063
Carl Preiksaitis, Rachel Barber, Holly Caretta-Weyer, Sara Krzyzaniak, Teresa M. Chan, Michael A. Gisondi

Background

Emergency medicine (EM) residents increasingly favor digital educational resources over traditional textbooks, with studies showing over 90% regularly using blogs, podcasts, and other online platforms. No standardized instruments exist to comparatively assess quality across both formats, leading to uncertainty in resource selection and potential inconsistencies in learning. We developed the Evaluation of Learning Resources (EvaLeR) tool and gathered initial validity evidence for its use in assessing both textbooks and digital EM educational resources.

Methods

This two-phase mixed-methods study developed the EvaLeR tool and gathered validity evidence for its use. Phase 1 comprised a systematic literature review, quality indicator analysis, and expert consultation. In Phase 2, 34 EM faculty evaluated 20 resources (10 textbook chapters, 10 blog posts) using EvaLeR. We collected evidence for reliability, internal consistency, and relationships with other variables.

Results

The EvaLeR tool showed excellent average-measure reliability (Intraclass correlation coefficient = 0.97, 95% CI [0.94–0.99]). We found high internal consistency (Cronbach's α = 0.86) and moderate correlation with educator gestalt ratings (r = 0.53, p < 0.001). The tool performed similarly across resource types, with no significant differences between textbook chapters (13.34/18, SD 3.41) and digital resources (13.21/18, SD 3.25; p = 0.62).

Conclusions

Initial validity evidence supports the use of EvaLeR for quality assessment of both textbooks and digital EM educational resources. This tool provides educators with an evidence-based approach to resource selection, moving beyond format-based assumptions to focus on content quality, and represents the first standardized instrument for comparative evaluation across educational resource formats.

急诊医学(EM)的居民越来越喜欢数字教育资源,而不是传统的教科书,研究显示,超过90%的人经常使用博客、播客和其他在线平台。没有标准化的工具来比较评估两种格式的质量,导致资源选择的不确定性和学习中的潜在不一致性。我们开发了学习资源评估(EvaLeR)工具,并收集了用于评估教科书和数字EM教育资源的初步有效性证据。方法本研究采用两阶段混合方法,开发了EvaLeR工具,并为其使用收集了效度证据。第一阶段包括系统的文献综述、质量指标分析和专家咨询。在第二阶段,34名EM教师使用EvaLeR评估了20个资源(10个教科书章节,10个博客文章)。我们收集了可靠性、内部一致性和与其他变量关系的证据。结果EvaLeR工具表现出优异的平均测量信度(类内相关系数= 0.97,95% CI[0.94-0.99])。我们发现内部一致性高(Cronbach's α = 0.86),与教育者完形量表评分有中等相关性(r = 0.53, p < 0.001)。该工具在不同类型的资源中表现相似,在教科书章节(13.34/18,SD 3.41)和数字资源(13.21/18,SD 3.25;p = 0.62)。结论初步效度证据支持使用EvaLeR对教科书和数字EM教育资源进行质量评估。该工具为教育工作者提供了一种基于证据的资源选择方法,超越了基于格式的假设,专注于内容质量,并代表了跨教育资源格式比较评估的第一个标准化工具。
{"title":"Development and Initial Validity Evidence for the EvaLeR Tool: Assessing Quality of Emergency Medicine Educational Resources","authors":"Carl Preiksaitis,&nbsp;Rachel Barber,&nbsp;Holly Caretta-Weyer,&nbsp;Sara Krzyzaniak,&nbsp;Teresa M. Chan,&nbsp;Michael A. Gisondi","doi":"10.1002/aet2.70063","DOIUrl":"https://doi.org/10.1002/aet2.70063","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Emergency medicine (EM) residents increasingly favor digital educational resources over traditional textbooks, with studies showing over 90% regularly using blogs, podcasts, and other online platforms. No standardized instruments exist to comparatively assess quality across both formats, leading to uncertainty in resource selection and potential inconsistencies in learning. We developed the Evaluation of Learning Resources (EvaLeR) tool and gathered initial validity evidence for its use in assessing both textbooks and digital EM educational resources.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>This two-phase mixed-methods study developed the EvaLeR tool and gathered validity evidence for its use. Phase 1 comprised a systematic literature review, quality indicator analysis, and expert consultation. In Phase 2, 34 EM faculty evaluated 20 resources (10 textbook chapters, 10 blog posts) using EvaLeR. We collected evidence for reliability, internal consistency, and relationships with other variables.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The EvaLeR tool showed excellent average-measure reliability (Intraclass correlation coefficient = 0.97, 95% CI [0.94–0.99]). We found high internal consistency (Cronbach's <i>α</i> = 0.86) and moderate correlation with educator gestalt ratings (<i>r</i> = 0.53, <i>p</i> &lt; 0.001). The tool performed similarly across resource types, with no significant differences between textbook chapters (13.34/18, SD 3.41) and digital resources (13.21/18, SD 3.25; <i>p</i> = 0.62).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Initial validity evidence supports the use of EvaLeR for quality assessment of both textbooks and digital EM educational resources. This tool provides educators with an evidence-based approach to resource selection, moving beyond format-based assumptions to focus on content quality, and represents the first standardized instrument for comparative evaluation across educational resource formats.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aet2.70063","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144482365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Educational Download: Examinations Over Time by the Numbers 教育下载:考试随着时间的推移的数字
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-26 DOI: 10.1002/aet2.70061
Sally A. Santen, Jessica Baez, Susan Promes, Anne Messman

Standardized examinations such as the United States Medical Licensing Examination (USMLE) and American Board of Emergency Medicine Qualifying Examination (ABEM-QE), the written examinations, serve as measures of medical knowledge and application of knowledge to patient care. These are intended to serve as gateways to licensure and practice and thus serve as key outcomes for training in Emergency Medicine (EM).

Flynn observed that over the past decades, there has been an increase in scores on some standardized tests, such as the Intelligence Quotient (IQ) tests [1]. Similarly, USMLE Step 2 scores have been rising [2]. Starting before COVID and amplified during COVID, EM has seen a decrease in scores on EM-specific first-time examinations, which is concerning [3].

The purpose of this Educational Download is to provide a snapshot of examination scores over the continuum of training. Thus, we follow a cohort of trainees from USMLE Steps 1 and 2 (and COMLEX 1 and 2) [4], through In-Training Examination (ITE) scores to board qualification (the written ABEM-QE). We followed the index cohort through their series of examinations (assuming a 3-year residency program).

Since the change of Step 1 to pass/fail, pass rates have decreased while Step 2 pass rates and scores are high. Importantly, there are decreases in EM ITE and ABEM-QE scores and pass rates during and since COVID.

One caveat is that the majority of these examinations are equated, a process by which scores from one test may be weighted so as to have equal meaning with scores from another test. Another limitation is that some examinations report on the calendar year (December–January) while others report on the academic year (July–June); exact alignment of the scores for cohorts is not possible versus scaled scores. Scoring of examinations is imprecise, and the fluctuations in scores could be within the standard error of measurement [6]. Finally, some examinations have equating changes or standard settings related cut score changes that are not reflected here.

Sally A. Santen: conceptualization; writing – original draft; visualization; writing – review and editing. Jessica Baez: conceptualization; writing – original draft. Susan Promes: conceptualization; writing – original draft; writing – review and editing. Anne Messman: writing – original draft; conceptualization; writing – review and editing.

Dr. Sally A. Santen is an ABEM oral board examiner and serves on a NBME committee. Dr. Anne Messman is on the NBME Council.

The authors declare no conflicts of interest.

标准化考试,如美国医师执照考试(USMLE)和美国急诊医学委员会资格考试(ABEM-QE),笔试,是衡量医学知识和将知识应用于病人护理的措施。这些旨在作为获得执照和实践的门户,从而作为急诊医学(EM)培训的关键成果。弗林观察到,在过去的几十年里,一些标准化测试的分数有所提高,比如智商(IQ)测试。同样,USMLE第2步的分数也一直在上升。从COVID之前开始,在COVID期间扩大,EM在EM特定的首次检查中得分下降,约为[3]。此教育下载的目的是提供连续培训期间的考试成绩概览。因此,我们从USMLE步骤1和2(以及complex 1和2)[4]跟踪一批受训人员,通过培训考试(ITE)分数获得董事会资格(书面ABEM-QE)。我们通过一系列的检查(假设是3年的住院医师项目)跟踪了指标队列。自从第一步改为及格/不及格后,通过率下降了,而第二步的通过率和分数很高。重要的是,在COVID期间和之后,EM ITE和ABEM-QE分数和通过率都有所下降。一个警告是,这些考试中的大多数都是等同的,一个考试的分数可能被加权,以便与另一个考试的分数具有相同的意义。另一个限制是,一些考试在日历年(12月至1月)报告,而另一些考试在学年(7月至6月)报告;与比例分数相比,不可能对队列的分数进行精确对齐。考试评分不精确,分数的波动可能在测量的标准误差范围内。最后,一些考试有相等的变化或标准设置相关的分数变化,没有反映在这里。Sally A. Santen:概念化;写作——原稿;可视化;写作——审阅和编辑。杰西卡·贝兹:概念化;写作-原稿。苏珊·普罗姆斯:概念化;写作——原稿;写作——审阅和编辑。安妮·梅斯曼:写作-原稿;概念化;写作-审查和编辑。Sally a . Santen是ABEM口头委员会考官,并在NBME委员会任职。安妮·梅斯曼博士是NBME委员会成员。作者声明无利益冲突。
{"title":"Educational Download: Examinations Over Time by the Numbers","authors":"Sally A. Santen,&nbsp;Jessica Baez,&nbsp;Susan Promes,&nbsp;Anne Messman","doi":"10.1002/aet2.70061","DOIUrl":"https://doi.org/10.1002/aet2.70061","url":null,"abstract":"<p>Standardized examinations such as the United States Medical Licensing Examination (USMLE) and American Board of Emergency Medicine Qualifying Examination (ABEM-QE), the written examinations, serve as measures of medical knowledge and application of knowledge to patient care. These are intended to serve as gateways to licensure and practice and thus serve as key outcomes for training in Emergency Medicine (EM).</p><p>Flynn observed that over the past decades, there has been an increase in scores on some standardized tests, such as the Intelligence Quotient (IQ) tests [<span>1</span>]. Similarly, USMLE Step 2 scores have been rising [<span>2</span>]. Starting before COVID and amplified during COVID, EM has seen a decrease in scores on EM-specific first-time examinations, which is concerning [<span>3</span>].</p><p>The purpose of this Educational Download is to provide a <i>snapshot</i> of examination scores over the continuum of training. Thus, we follow a cohort of trainees from USMLE Steps 1 and 2 (and COMLEX 1 and 2) [<span>4</span>], through In-Training Examination (ITE) scores to board qualification (the written ABEM-QE). We followed the index cohort through their series of examinations (assuming a 3-year residency program).</p><p>Since the change of Step 1 to pass/fail, pass rates have decreased while Step 2 pass rates and scores are high. Importantly, there are decreases in EM ITE and ABEM-QE scores and pass rates during and since COVID.</p><p>One caveat is that the majority of these examinations are equated, a process by which scores from one test may be weighted so as to have equal meaning with scores from another test. Another limitation is that some examinations report on the calendar year (December–January) while others report on the academic year (July–June); exact alignment of the scores for cohorts is not possible versus scaled scores. Scoring of examinations is imprecise, and the fluctuations in scores could be within the standard error of measurement [<span>6</span>]. Finally, some examinations have equating changes or standard settings related cut score changes that are not reflected here.</p><p><b>Sally A. Santen:</b> conceptualization; writing – original draft; visualization; writing – review and editing. <b>Jessica Baez:</b> conceptualization; writing – original draft. <b>Susan Promes:</b> conceptualization; writing – original draft; writing – review and editing. <b>Anne Messman:</b> writing – original draft; conceptualization; writing – review and editing.</p><p>Dr. Sally A. Santen is an ABEM oral board examiner and serves on a NBME committee. Dr. Anne Messman is on the NBME Council.</p><p>The authors declare no conflicts of interest.</p>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/aet2.70061","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144482369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patient Volume Requirements: Evaluation of the 2025 ACGME Proposal for Emergency Medicine Residency Programs 病人数量要求:评估2025年ACGME建议急诊医学住院医师计划
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-25 DOI: 10.1002/aet2.70071
Carlisle E. W. Topping, Craig Rothenberg, Cameron J. Gettel, Rohit B. Sangal, Katja Goldflam, Andrew Ulrich, Pooja Agrawal, D. Mark Courtney, Arjun K. Venkatesh

Objectives

The 2025 ACGME proposed that all EM residency programs must be 4 years and achieve a minimum of 3000 patients per resident. We characterize the current residency program patient volume per resident based on the proposed requirements. Secondarily, we describe the number of programs that meet the proposed visit volume requirement and the estimated impact of the 4-year length mandate.

Methods

We conducted a cross-sectional analysis utilizing a linked dataset of the 2023 American Hospital Association Annual Survey and 2025 EM program information from ACGME's website. Hospital zip codes were linked with Rural-Urban Commuting Area Codes. We calculated the estimated residency program patient volume per resident as proposed by ACGME. Secondarily, we calculated the estimated change in patient volume if 3-year programs converted to 4 years.

Results

Of 286 programs, the median program patient volume was 7300 (IQR: 5190–10,207). Among the 232 (81%) 3-year programs, the median volume was 7616 (IQR: 5292–10,639), while the 54 (19%) 4-year programs demonstrated a median of 6520 (IQR: 4930–9304). Rural programs (3%) had a median patient volume of 7744 (IQR: 5453–13,209), compared to 7300 (IQR: 5190–10,207) for urban programs (97%). Nine programs (3%) were below the 3000-patient volume threshold; 7 of these were 3-year programs, and transitioning to 4 years could bring 6 above the threshold.

Conclusions

Currently, 97% of EM programs meet the proposed 3000-patient volume threshold, with a median volume well over double this value and similar volumes across program lengths and rurality. Transitioning from 3 to 4 years may enable all but one current 3-year program to meet the new volume requirement. Therefore, the proposed ACGME changes may not increase the minimum required clinical exposure for EM residents as originally intended and should prompt re-examination.

2025年ACGME建议所有EM住院医师项目必须为4年,每位住院医师至少接待3000名患者。我们根据提出的要求描述当前住院医师计划的每位住院医师的患者数量。其次,我们描述了满足拟议访问量要求的项目数量和4年授权的估计影响。方法:利用2023年美国医院协会年度调查的关联数据集和ACGME网站上的2025年EM计划信息进行了横断面分析。医院的邮政编码与城乡通勤区号相关联。我们根据ACGME的建议计算了住院医师项目中每位住院医师的估计患者数量。其次,我们计算了如果将3年计划转换为4年,患者数量的估计变化。结果在286个项目中,中位项目患者数量为7300人(IQR: 5190-10,207)。在232个(81%)3年制课程中,中位数为7616 (IQR: 5292-10,639),而54个(19%)4年制课程的中位数为6520 (IQR: 4930-9304)。农村项目(3%)的中位患者量为7744 (IQR: 5453 - 13209),而城市项目(97%)的中位患者量为7300 (IQR: 5190-10,207)。9个项目(3%)低于3000例患者的容量阈值;其中7个是3年的项目,过渡到4年可能会使6个超过门槛。目前,97%的EM项目达到了建议的3000患者容量阈值,中位容量远远超过了该值的两倍,并且项目长度和农村地区的容量相似。从3年到4年的过渡可能会使所有目前的3年计划满足新的数量要求。因此,拟议的ACGME变更可能不会像最初预期的那样增加EM居民的最低临床暴露要求,并且应该促使重新检查。
{"title":"Patient Volume Requirements: Evaluation of the 2025 ACGME Proposal for Emergency Medicine Residency Programs","authors":"Carlisle E. W. Topping,&nbsp;Craig Rothenberg,&nbsp;Cameron J. Gettel,&nbsp;Rohit B. Sangal,&nbsp;Katja Goldflam,&nbsp;Andrew Ulrich,&nbsp;Pooja Agrawal,&nbsp;D. Mark Courtney,&nbsp;Arjun K. Venkatesh","doi":"10.1002/aet2.70071","DOIUrl":"https://doi.org/10.1002/aet2.70071","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>The 2025 ACGME proposed that all EM residency programs must be 4 years and achieve a minimum of 3000 patients per resident. We characterize the current residency program patient volume per resident based on the proposed requirements. Secondarily, we describe the number of programs that meet the proposed visit volume requirement and the estimated impact of the 4-year length mandate.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a cross-sectional analysis utilizing a linked dataset of the 2023 American Hospital Association Annual Survey and 2025 EM program information from ACGME's website. Hospital zip codes were linked with Rural-Urban Commuting Area Codes. We calculated the estimated residency program patient volume per resident as proposed by ACGME. Secondarily, we calculated the estimated change in patient volume if 3-year programs converted to 4 years.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Of 286 programs, the median program patient volume was 7300 (IQR: 5190–10,207). Among the 232 (81%) 3-year programs, the median volume was 7616 (IQR: 5292–10,639), while the 54 (19%) 4-year programs demonstrated a median of 6520 (IQR: 4930–9304). Rural programs (3%) had a median patient volume of 7744 (IQR: 5453–13,209), compared to 7300 (IQR: 5190–10,207) for urban programs (97%). Nine programs (3%) were below the 3000-patient volume threshold; 7 of these were 3-year programs, and transitioning to 4 years could bring 6 above the threshold.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Currently, 97% of EM programs meet the proposed 3000-patient volume threshold, with a median volume well over double this value and similar volumes across program lengths and rurality. Transitioning from 3 to 4 years may enable all but one current 3-year program to meet the new volume requirement. Therefore, the proposed ACGME changes may not increase the minimum required clinical exposure for EM residents as originally intended and should prompt re-examination.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144482041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing Emergency Medicine and Neurology Residents in Assessing Stroke Severity Using the NIHSS 比较急诊科和神经科住院医师使用NIHSS评估脑卒中严重程度
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-25 DOI: 10.1002/aet2.70069
Trinidad Alcala-Arcos, Esther H. Chen, Newton Addo, Matthew Roces, Michael J. Boyle, Meghan Hewlett, Reginald Nguyen, Angela Wong, Debbie Y. Madhok

Background

The National Institutes of Health Stroke Scale (NIHSS) is used to assess acute stroke severity and plays a critical role in guiding treatment. There is no requirement for emergency medicine (EM) residents to be certified in NIHSS determination to assess acute stroke severity, even though they may be the primary stroke providers in future practice. We implemented NIHSS training and certification into the residency's core content in neurological emergencies.

Methods

In April 2022, all EM residents and attending physicians completed a faculty-moderated, interactive NIHSS training module. In the 6-month pilot, we prospectively assessed EM and neurology residents in their NIHSS assignment, indication for thrombolytic therapy, and large vessel occlusion (LVO) diagnosis using a Qualtrics survey completed for each acute stroke activation. Mean overall NIHSS scores from EM and neurology residents were compared using Spearman's correlation. Inter-rater agreement for each clinical category and treatment decision was calculated using Cohen's κ coefficient.

Results

Twenty-nine matched EM and neurology surveys were analyzed. Mean overall NIHSS scores were similar between EM and neurology residents, 6.6 (IQR = 2, 10) and 6.7 (IQR = 1, 10), (p < 0.001), respectively, with substantial agreement between groups (84.4%, κ = 0.63). Individual NIHSS scores showed moderate to substantial agreement, except for horizontal extraocular movement (75.9%, κ = 0.30). There was fair agreement for indication for thrombolytic therapy (75.9%, κ = 0.39) and moderate agreement for LVO diagnosis and indication for embolization (82.8%, κ = 0.51).

Conclusions

Dedicated NIHSS training was effective in teaching EM residents to assess stroke severity, with moderate to substantial agreement in individual and overall NIHSS scores, except for horizontal eye movement assessment. EM residents may benefit from focused NIHSS training to support their rapid assessment of suspected stroke patients.

背景美国国立卫生研究院卒中量表(NIHSS)用于评估急性卒中严重程度,在指导治疗中起着至关重要的作用。急诊医师(EM)在NIHSS评估急性脑卒中严重程度时不需要获得认证,即使他们在未来的实践中可能是主要的脑卒中提供者。我们将NIHSS培训和认证纳入住院医师在神经急症方面的核心内容。方法:2022年4月,所有急诊住院医师和主治医生完成了教师主持的交互式NIHSS培训模块。在为期6个月的试验中,我们前瞻性地评估了EM和神经内科住院医生的NIHSS分配、溶栓治疗的适应症和大血管闭塞(LVO)诊断,并对每次急性卒中激活进行了Qualtrics调查。EM和神经内科住院医师的NIHSS平均总分采用Spearman相关性进行比较。使用Cohen’s κ系数计算每个临床类别和治疗决策的评分者间一致性。结果分析了29份匹配的EM和神经病学调查。EM和神经内科住院患者的NIHSS平均总分相似,分别为6.6 (IQR = 2,10)和6.7 (IQR = 1,10), (p < 0.001),两组之间基本一致(84.4%,κ = 0.63)。除了水平眼外运动(75.9%,κ = 0.30)外,个体NIHSS评分显示中度至基本一致。对于溶栓治疗的适应症有一般的一致性(75.9%,κ = 0.39),对于LVO诊断和栓塞的适应症有中等的一致性(82.8%,κ = 0.51)。结论:专门的NIHSS培训在教授EM住院医师评估卒中严重程度方面是有效的,除了水平眼动评估外,个人和总体NIHSS评分中等到基本一致。急诊住院医师可以从集中的NIHSS培训中受益,以支持他们快速评估疑似中风患者。
{"title":"Comparing Emergency Medicine and Neurology Residents in Assessing Stroke Severity Using the NIHSS","authors":"Trinidad Alcala-Arcos,&nbsp;Esther H. Chen,&nbsp;Newton Addo,&nbsp;Matthew Roces,&nbsp;Michael J. Boyle,&nbsp;Meghan Hewlett,&nbsp;Reginald Nguyen,&nbsp;Angela Wong,&nbsp;Debbie Y. Madhok","doi":"10.1002/aet2.70069","DOIUrl":"https://doi.org/10.1002/aet2.70069","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>The National Institutes of Health Stroke Scale (NIHSS) is used to assess acute stroke severity and plays a critical role in guiding treatment. There is no requirement for emergency medicine (EM) residents to be certified in NIHSS determination to assess acute stroke severity, even though they may be the primary stroke providers in future practice. We implemented NIHSS training and certification into the residency's core content in neurological emergencies.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>In April 2022, all EM residents and attending physicians completed a faculty-moderated, interactive NIHSS training module. In the 6-month pilot, we prospectively assessed EM and neurology residents in their NIHSS assignment, indication for thrombolytic therapy, and large vessel occlusion (LVO) diagnosis using a Qualtrics survey completed for each acute stroke activation. Mean overall NIHSS scores from EM and neurology residents were compared using Spearman's correlation. Inter-rater agreement for each clinical category and treatment decision was calculated using Cohen's <i>κ</i> coefficient.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Twenty-nine matched EM and neurology surveys were analyzed. Mean overall NIHSS scores were similar between EM and neurology residents, 6.6 (IQR = 2, 10) and 6.7 (IQR = 1, 10), (<i>p</i> &lt; 0.001), respectively, with substantial agreement between groups (84.4%, <i>κ</i> = 0.63). Individual NIHSS scores showed moderate to substantial agreement, except for horizontal extraocular movement (75.9%, <i>κ</i> = 0.30). There was fair agreement for indication for thrombolytic therapy (75.9%, <i>κ</i> = 0.39) and moderate agreement for LVO diagnosis and indication for embolization (82.8%, <i>κ</i> = 0.51).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Dedicated NIHSS training was effective in teaching EM residents to assess stroke severity, with moderate to substantial agreement in individual and overall NIHSS scores, except for horizontal eye movement assessment. EM residents may benefit from focused NIHSS training to support their rapid assessment of suspected stroke patients.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144482323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Program Signaling in Emergency Medicine: Applicant Trends and Outcomes From the 2023 and 2024 Match 急诊医学项目信号:2023年和2024年匹配的申请人趋势和结果
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-25 DOI: 10.1002/aet2.70070
Andrew D. Luo, Christopher Zeuthen, Elizabeth Barrall Werley, Eric Shappell, Alexis Pelletier-Bui, Molly Estes, Megan Fix, Carl Preiksaitis, Angela P. Mihalic, Daniel J. Egan

Background

Program signals were introduced to the emergency medicine (EM) residency application process during the 2022–2023 and 2023–2024 application cycles, allowing applicants to express interest in specific programs. Despite widespread adoption, the relationship between signal usage and applicant outcomes remains poorly understood. This study evaluates patterns of signal utilization and their association with interview offers and match outcomes during the initial implementation in EM.

Methods

We conducted a retrospective analysis of the Texas Seeking Transparency in Application to Residency (Texas STAR) database, examining US allopathic and osteopathic senior medical students applying to EM residency programs during two application cycles (2022–2023 and 2023–2024). We analyzed program signal (PS) distribution patterns using χ2 testing and employed multivariable logistic regression to assess the relationship between PS usage and both interview offers and match outcomes.

Results

The study included 967 EM applicants across two application cycles (478 in 2022–2023, 489 in 2023–2024), who sent 1919 signals in 2022–2023 and 3170 in 2023–2024. Signal distribution was highly concentrated, with the top 10% of programs receiving 35% of all signals in both application cycles. Interview yield was higher at signaled programs (2023 cycle: 76.3%, 2024 cycle: 78.9%) compared to programs overall (2023 cycle: 51.3%, 2024 cycle: 43.5%). In logistic regression analysis, sending a program signal was associated with increased odds of receiving an interview offer (2023 cycle: OR 4.40, 95% CI 3.90–4.92; 2024 cycle: OR 3.79, 95% CI 3.42–4.14), and matching after interviewing (2023 cycle: OR 5.13, 95% CI 4.08–6.47; 2024 cycle: OR 4.94, 95% CI 3.98–6.15).

Conclusion

Program signals are associated with improved odds of receiving interviews and matching at EM programs. Future studies should investigate how signals affect the likelihood of receiving interview offers for applicants across different levels of competitiveness.

在2022-2023和2023-2024申请周期,急诊医学(EM)住院医师申请过程中引入了项目信号,允许申请人表达对特定项目的兴趣。尽管被广泛采用,但信号使用与申请人结果之间的关系仍然知之甚少。本研究评估了EM初始实施过程中信号利用模式及其与面试机会和匹配结果的关系。方法我们对德克萨斯州寻求住院申请透明度(Texas STAR)数据库进行了回顾性分析。研究了在两个申请周期(2022-2023和2023-2024)申请EM住院医师项目的美国对抗疗法和整骨疗法高级医学生。我们使用χ2检验分析了节目信号(PS)的分布模式,并采用多变量逻辑回归来评估PS使用与面试机会和匹配结果之间的关系。该研究包括两个申请周期的967名EM申请人(2022-2023年为478人,2023-2024年为489人),他们在2022-2023年发送了1919个信号,在2023-2024年发送了3170个信号。信号分布高度集中,在两个应用周期中,前10%的程序接收了35%的信号。与整体项目(2023周期:51.3%,2024周期:43.5%)相比,信号项目(2023周期:76.3%,2024周期:78.9%)的面试率更高。在逻辑回归分析中,发送程序信号与获得面试机会的几率增加有关(2023周期:OR 4.40, 95% CI 3.90-4.92;2024周期:OR 3.79, 95% CI 3.42-4.14),以及访谈后的匹配(2023周期:OR 5.13, 95% CI 4.08-6.47;2024周期:OR 4.94, 95% CI 3.98-6.15)。结论:程序信号与EM程序中接受访谈和匹配的几率提高有关。未来的研究应该调查信号是如何影响不同竞争水平的求职者获得面试机会的可能性的。
{"title":"Program Signaling in Emergency Medicine: Applicant Trends and Outcomes From the 2023 and 2024 Match","authors":"Andrew D. Luo,&nbsp;Christopher Zeuthen,&nbsp;Elizabeth Barrall Werley,&nbsp;Eric Shappell,&nbsp;Alexis Pelletier-Bui,&nbsp;Molly Estes,&nbsp;Megan Fix,&nbsp;Carl Preiksaitis,&nbsp;Angela P. Mihalic,&nbsp;Daniel J. Egan","doi":"10.1002/aet2.70070","DOIUrl":"https://doi.org/10.1002/aet2.70070","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Program signals were introduced to the emergency medicine (EM) residency application process during the 2022–2023 and 2023–2024 application cycles, allowing applicants to express interest in specific programs. Despite widespread adoption, the relationship between signal usage and applicant outcomes remains poorly understood. This study evaluates patterns of signal utilization and their association with interview offers and match outcomes during the initial implementation in EM.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a retrospective analysis of the Texas Seeking Transparency in Application to Residency (Texas STAR) database, examining US allopathic and osteopathic senior medical students applying to EM residency programs during two application cycles (2022–2023 and 2023–2024). We analyzed program signal (PS) distribution patterns using <i>χ</i><sup>2</sup> testing and employed multivariable logistic regression to assess the relationship between PS usage and both interview offers and match outcomes.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The study included 967 EM applicants across two application cycles (478 in 2022–2023, 489 in 2023–2024), who sent 1919 signals in 2022–2023 and 3170 in 2023–2024. Signal distribution was highly concentrated, with the top 10% of programs receiving 35% of all signals in both application cycles. Interview yield was higher at signaled programs (2023 cycle: 76.3%, 2024 cycle: 78.9%) compared to programs overall (2023 cycle: 51.3%, 2024 cycle: 43.5%). In logistic regression analysis, sending a program signal was associated with increased odds of receiving an interview offer (2023 cycle: OR 4.40, 95% CI 3.90–4.92; 2024 cycle: OR 3.79, 95% CI 3.42–4.14), and matching after interviewing (2023 cycle: OR 5.13, 95% CI 4.08–6.47; 2024 cycle: OR 4.94, 95% CI 3.98–6.15).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>Program signals are associated with improved odds of receiving interviews and matching at EM programs. Future studies should investigate how signals affect the likelihood of receiving interview offers for applicants across different levels of competitiveness.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144482324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bridging the language gap: Simulation-based education improves communication, confidence, and knowledge for emergency medicine residents working with interpreters 弥合语言差距:基于模拟的教育提高了与口译员一起工作的急诊医学住院医师的沟通、信心和知识
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-24 DOI: 10.1002/aet2.70056
William Mundo MD, MPH, Jacqueline Ward-Gaines MD, Molly Thiessen MD, Benjamin Li MD, MS, Maria Pamboukis MD, Emily Hopkins MSPH, Jean Hoffman MD, Maria Moreira MD, Jason Haukoos MD, MSc, Steven Lowenstein MD, MPH

Introduction

Language barriers present unique challenges to health care delivery in emergency medicine (EM). There is a gap in understanding the impact of education and training on EM residents’ ability to work effectively with interpreters. We developed and piloted a simulation to improve residents' knowledge and confidence in working with medical interpreters (MIs).

Methods

We conducted a pre–post quasi-experiment involving Denver Health EM residents. Participants engaged in a 120-min simulation exercise, including five 20-min scenarios involving Spanish-, American Sign Language–, Russian-, and Vietnamese-speaking standardized patients. Learning objectives focused on acquiring essential skills needed to communicate effectively with patients while working with MIs. We compared pre- and postsimulation knowledge and self-rated confidence.

Results

Of 68 eligible EM residents, 17 (25%) participated in the elective simulation, including mostly female (71%) and non-Hispanic White (77%) individuals; most were members of the PGY-1 and PGY-2 classes (82% and 12%, respectively). English-only proficiency was reported in 82% of residents. After the simulation, participants reported increased confidence in working with MIs, accessing MIs promptly, identifying the optimal mode of interpretation, and addressing common barriers to MI use. There was improvement in identifying when family and another ad hoc interpreter may be used and understanding the differences between interpretation and translation.

Conclusions

Among EM residents, simulation-based training enhanced understanding of, and confidence with, working effectively with MIs. These results demonstrate the utility of using simulation-based learning to impart important communication skills for working with various language groups in medical training.

语言障碍对急诊医学(EM)的医疗服务提供提出了独特的挑战。在理解教育和培训对新兴市场居民与口译员有效合作能力的影响方面存在差距。我们开发并试行了一种模拟,以提高居民与医疗口译员(MIs)合作的知识和信心。方法对丹佛医疗中心急诊住院医师进行了前后准实验。参与者进行了120分钟的模拟练习,包括五个20分钟的场景,涉及说西班牙语、美国手语、俄语和越南语的标准化患者。学习目标集中在获得必要的技能,以有效地与病人沟通,同时与MIs工作。我们比较了模拟前后的知识和自评信心。结果在68名符合条件的EM居民中,17人(25%)参加了选修模拟,其中大部分是女性(71%)和非西班牙裔白人(77%);大多数为PGY-1和PGY-2类(分别为82%和12%)。82%的居民精通英语。在模拟之后,参与者报告说,他们在使用信息管理系统、及时访问信息管理系统、确定最佳解释模式和解决使用信息管理系统的常见障碍方面增加了信心。在确定何时可以使用家庭和其他临时口译员以及理解口译和笔译之间的差异方面有所改善。结论:在EM居民中,基于模拟的培训增强了对MIs的理解和信心,并有效地与MIs合作。这些结果表明,利用基于模拟的学习来传授重要的沟通技巧,有助于在医疗培训中与不同语言群体合作。
{"title":"Bridging the language gap: Simulation-based education improves communication, confidence, and knowledge for emergency medicine residents working with interpreters","authors":"William Mundo MD, MPH,&nbsp;Jacqueline Ward-Gaines MD,&nbsp;Molly Thiessen MD,&nbsp;Benjamin Li MD, MS,&nbsp;Maria Pamboukis MD,&nbsp;Emily Hopkins MSPH,&nbsp;Jean Hoffman MD,&nbsp;Maria Moreira MD,&nbsp;Jason Haukoos MD, MSc,&nbsp;Steven Lowenstein MD, MPH","doi":"10.1002/aet2.70056","DOIUrl":"https://doi.org/10.1002/aet2.70056","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Language barriers present unique challenges to health care delivery in emergency medicine (EM). There is a gap in understanding the impact of education and training on EM residents’ ability to work effectively with interpreters. We developed and piloted a simulation to improve residents' knowledge and confidence in working with medical interpreters (MIs).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a pre–post quasi-experiment involving Denver Health EM residents. Participants engaged in a 120-min simulation exercise, including five 20-min scenarios involving Spanish-, American Sign Language–, Russian-, and Vietnamese-speaking standardized patients. Learning objectives focused on acquiring essential skills needed to communicate effectively with patients while working with MIs. We compared pre- and postsimulation knowledge and self-rated confidence.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Of 68 eligible EM residents, 17 (25%) participated in the elective simulation, including mostly female (71%) and non-Hispanic White (77%) individuals; most were members of the PGY-1 and PGY-2 classes (82% and 12%, respectively). English-only proficiency was reported in 82% of residents. After the simulation, participants reported increased confidence in working with MIs, accessing MIs promptly, identifying the optimal mode of interpretation, and addressing common barriers to MI use. There was improvement in identifying when family and another ad hoc interpreter may be used and understanding the differences between interpretation and translation.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Among EM residents, simulation-based training enhanced understanding of, and confidence with, working effectively with MIs. These results demonstrate the utility of using simulation-based learning to impart important communication skills for working with various language groups in medical training.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144473009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Meeting Our Needs: Rural Training Experiences in Emergency Medicine Residencies 满足我们的需求:急诊医学住院医师的农村培训经验
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-24 DOI: 10.1002/aet2.70067
Melody Campbell, Doug Franzen, Jason Heiner

Background

Board-certified emergency medicine (BCEM) physicians make up less than half the clinician workforce in rural emergency departments (EDs). Fewer of these specialists are entering rural EDs annually than are leaving, and this discrepancy is projected to increase in the next decade. We sought to investigate the current landscape of EM residency rural rotations in the US, including barriers to offering rural rotations, in order to identify potential residency-level interventions that could bolster the population of BCEM physicians in rural EDs.

Methods

Surveys were sent to program directors (PDs) of all 290 EM residences currently accredited by the Accreditation Council for Graduate Medical Education (ACGME) in the US and its territories. PDs were asked about the availability of rural rotations and how they were established. We also obtained information regarding the initial job selection of graduating residents from 2023 to 2024. Descriptive statistics and analyses were performed using IBM SPSS Statistics.

Results

We received responses from 174 (60%) EM residencies describing 3411 graduates over the last 2 years. Of all respondents, 48% (83) did not offer rural rotations while 52% (91) offered rural rotations, of which 47% (43) were required and 52% (47) were elective, with one program not specifying. Residents were more likely to enter the rural ED workforce immediately upon graduation from programs with rural rotations (15%), compared to those without (8%, Z = 6.28, p < 0.001), and especially if rotations were required (21%) versus elective (11%, Z = 6.35, p < 0.001).

Conclusions

Rural ED rotation experience in residency is associated with an increased likelihood of graduates entering the rural workforce, especially if rural rotations are required as opposed to elective. The addition of rural rotations to EM residency programs may increase the presence of BCEM physicians in rural emergency medicine settings.

背景委员会认证的急诊医学(BCEM)医生在农村急诊科(ed)的临床医生队伍中占不到一半。每年进入农村急诊科的专家比离开的要少,预计这一差距在未来十年将会扩大。我们试图调查美国EM住院医师农村轮转的现状,包括提供农村轮转的障碍,以确定潜在的住院医师水平的干预措施,这些干预措施可以增加农村急诊科BCEM医生的数量。方法对美国及其领土上所有290所目前由研究生医学教育认证委员会(ACGME)认证的EM住宅的项目主任(pd)进行调查。向警务司询问了农村轮岗的情况以及如何建立这种轮岗。我们还获得了2023 - 2024年毕业居民的初始就业选择信息。采用IBM SPSS statistics进行描述性统计和分析。结果我们收到174位(60%)新兴市场住院医师的回复,描述了过去两年3411名毕业生。在所有受访者中,48%(83)不提供农村轮转,52%(91)提供农村轮转,其中47%(43)是必修课,52%(47)是选修课,有一个项目没有明确规定。与没有进行农村轮转的住院医生相比(8%,Z = 6.28, p < 0.001),住院医生毕业后更有可能立即进入农村急诊科工作(15%),特别是如果需要轮转(21%)而不是选修(11%,Z = 6.35, p < 0.001)。农村急诊科住院医师的轮转经验与毕业生进入农村劳动力的可能性增加有关,特别是如果农村轮转是必需的,而不是选择性的。在EM住院医师计划中增加农村轮转可能会增加BCEM医生在农村急诊医学环境中的存在。
{"title":"Meeting Our Needs: Rural Training Experiences in Emergency Medicine Residencies","authors":"Melody Campbell,&nbsp;Doug Franzen,&nbsp;Jason Heiner","doi":"10.1002/aet2.70067","DOIUrl":"https://doi.org/10.1002/aet2.70067","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Board-certified emergency medicine (BCEM) physicians make up less than half the clinician workforce in rural emergency departments (EDs). Fewer of these specialists are entering rural EDs annually than are leaving, and this discrepancy is projected to increase in the next decade. We sought to investigate the current landscape of EM residency rural rotations in the US, including barriers to offering rural rotations, in order to identify potential residency-level interventions that could bolster the population of BCEM physicians in rural EDs.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Surveys were sent to program directors (PDs) of all 290 EM residences currently accredited by the Accreditation Council for Graduate Medical Education (ACGME) in the US and its territories. PDs were asked about the availability of rural rotations and how they were established. We also obtained information regarding the initial job selection of graduating residents from 2023 to 2024. Descriptive statistics and analyses were performed using IBM SPSS Statistics.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We received responses from 174 (60%) EM residencies describing 3411 graduates over the last 2 years. Of all respondents, 48% (83) did not offer rural rotations while 52% (91) offered rural rotations, of which 47% (43) were required and 52% (47) were elective, with one program not specifying. Residents were more likely to enter the rural ED workforce immediately upon graduation from programs with rural rotations (15%), compared to those without (8%, <i>Z</i> = 6.28, <i>p</i> &lt; 0.001), and especially if rotations were required (21%) versus elective (11%, <i>Z</i> = 6.35, <i>p</i> &lt; 0.001).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Rural ED rotation experience in residency is associated with an increased likelihood of graduates entering the rural workforce, especially if rural rotations are required as opposed to elective. The addition of rural rotations to EM residency programs may increase the presence of BCEM physicians in rural emergency medicine settings.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144472999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computer-Based Competency Assessment in Point-Of-Care Ultrasound: A Systematic Review 基于计算机的护理点超声能力评估:系统回顾
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-24 DOI: 10.1002/aet2.70072
Lao-Tzu Allan-Blitz, Madeline Schwid, Nicole M. Duggan, Rayan Ebnali Harari, Lauren Selame, Carrie Walsh, Katerina Papa, David Chu, Roger Dias, Andrew J. Goldsmith

Background

Point of care ultrasound (POCUS) is a critical skill for physicians across multiple medical specialties, yet substantial heterogeneity exists in how competency is assessed. Computer-based approaches can be used to deliver, grade, and analyze learner performance, and may be more objective and reliable than traditional approaches using expert assessments. This study aimed to systematically review and summarize the existing literature surrounding computer-based approaches to assessing POCUS competency.

Methods

We searched six online databases (MEDLINE, IEEE Xplore Digital Library, Association for Computing Machinery Digital Library, PsycINFO (Ovid), EMBASE, Web of Science Core Collection). We included original peer-reviewed studies that assessed computer-based metrics of POCUS competence among any learner group performing POCUS. We also reviewed reference lists of all included studies. We extracted data elements that included the specialty of participants, POCUS experience, POCUS modality used, and type and results of computer-based competency assessments. At least two authors conducted title and abstract screening, full text review, and data extraction, with discrepancies adjudicated by a third author. We present a qualitative synthesis of study findings.

Results

Of 7375 identified studies, we included 28 in our final analysis. Computer-based metrics were used to assess knowledge (n = 10), skills (n = 25), and cognitive load (n = 1) using hand tracking (n = 14), eye tracking (n = 7), image analysis (n = 6), and simulation scores (n = 1). In general, hand tracking analysis showed that experts had shorter probe path lengths, took less time to identify areas of interest, and had fewer discrete movements compared with novices. Eye tracking assessment showed increased dwell time was associated with successful completion of procedures and increased accuracy in interpreting images.

Conclusion

We identified four computer-based metrics for assessing POCUS competence, many of which demonstrated consistent performance in distinguishing skill level. Further work is needed to standardize and validate those approaches.

背景:护理点超声(POCUS)是跨多个医学专业的医生的一项关键技能,但在如何评估能力方面存在实质性的异质性。基于计算机的方法可以用来传递、评分和分析学习者的表现,并且可能比使用专家评估的传统方法更客观和可靠。本研究旨在系统地回顾和总结现有的基于计算机的POCUS能力评估方法的文献。方法检索MEDLINE、IEEE Xplore数字图书馆、美国计算机协会数字图书馆、PsycINFO (Ovid)、EMBASE、Web of Science Core Collection 6个在线数据库。我们纳入了原始的同行评议研究,评估了在任何执行POCUS的学习者群体中基于计算机的POCUS能力指标。我们还查阅了所有纳入研究的参考文献。我们提取的数据元素包括参与者的专业、POCUS经验、使用的POCUS模式以及基于计算机的能力评估的类型和结果。至少有两位作者进行标题和摘要筛选、全文审查和数据提取,差异由第三位作者裁决。我们提出了研究结果的定性综合。在7375项确定的研究中,我们将28项纳入最终分析。使用基于计算机的指标评估知识(n = 10)、技能(n = 25)和认知负荷(n = 1),包括手部追踪(n = 14)、眼动追踪(n = 7)、图像分析(n = 6)和模拟得分(n = 1)。一般来说,手部跟踪分析表明,与新手相比,专家的探针路径长度更短,识别感兴趣的区域花费的时间更少,离散运动也更少。眼动追踪评估显示,停留时间的增加与手术的成功完成和图像解释准确性的提高有关。结论:我们确定了评估POCUS能力的四个基于计算机的指标,其中许多指标在区分技能水平方面表现一致。需要进一步的工作来标准化和验证这些方法。
{"title":"Computer-Based Competency Assessment in Point-Of-Care Ultrasound: A Systematic Review","authors":"Lao-Tzu Allan-Blitz,&nbsp;Madeline Schwid,&nbsp;Nicole M. Duggan,&nbsp;Rayan Ebnali Harari,&nbsp;Lauren Selame,&nbsp;Carrie Walsh,&nbsp;Katerina Papa,&nbsp;David Chu,&nbsp;Roger Dias,&nbsp;Andrew J. Goldsmith","doi":"10.1002/aet2.70072","DOIUrl":"https://doi.org/10.1002/aet2.70072","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Point of care ultrasound (POCUS) is a critical skill for physicians across multiple medical specialties, yet substantial heterogeneity exists in how competency is assessed. Computer-based approaches can be used to deliver, grade, and analyze learner performance, and may be more objective and reliable than traditional approaches using expert assessments. This study aimed to systematically review and summarize the existing literature surrounding computer-based approaches to assessing POCUS competency.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We searched six online databases (MEDLINE, IEEE Xplore Digital Library, Association for Computing Machinery Digital Library, PsycINFO (Ovid), EMBASE, Web of Science Core Collection). We included original peer-reviewed studies that assessed computer-based metrics of POCUS competence among any learner group performing POCUS. We also reviewed reference lists of all included studies. We extracted data elements that included the specialty of participants, POCUS experience, POCUS modality used, and type and results of computer-based competency assessments. At least two authors conducted title and abstract screening, full text review, and data extraction, with discrepancies adjudicated by a third author. We present a qualitative synthesis of study findings.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Of 7375 identified studies, we included 28 in our final analysis. Computer-based metrics were used to assess knowledge (<i>n</i> = 10), skills (<i>n</i> = 25), and cognitive load (<i>n</i> = 1) using hand tracking (<i>n</i> = 14), eye tracking (<i>n</i> = 7), image analysis (<i>n</i> = 6), and simulation scores (<i>n</i> = 1). In general, hand tracking analysis showed that experts had shorter probe path lengths, took less time to identify areas of interest, and had fewer discrete movements compared with novices. Eye tracking assessment showed increased dwell time was associated with successful completion of procedures and increased accuracy in interpreting images.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>We identified four computer-based metrics for assessing POCUS competence, many of which demonstrated consistent performance in distinguishing skill level. Further work is needed to standardize and validate those approaches.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144473008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Intersectional Bias and Coded Language in Emergency-Medicine Evaluations: A Response to Gonzalez et al. 急诊医学评估中的交叉偏差和编码语言:对Gonzalez等人的回应。
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-23 DOI: 10.1002/aet2.70066
Yi-Lun Li, Lien-Chung Wei
{"title":"Intersectional Bias and Coded Language in Emergency-Medicine Evaluations: A Response to Gonzalez et al.","authors":"Yi-Lun Li,&nbsp;Lien-Chung Wei","doi":"10.1002/aet2.70066","DOIUrl":"https://doi.org/10.1002/aet2.70066","url":null,"abstract":"","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144367349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing an Outlook on Other Realities: A Curriculum Model Targeting the Importance of Patient Realities in the Emergency Department 发展对其他现实的展望:一种针对急诊科患者现实重要性的课程模式
IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-06-23 DOI: 10.1002/aet2.70068
Justin Behlke, Ashley Pavlic, Sehr Khan, Taylor Sonnenberg

Background

The DOORs curriculum is designed to equip emergency medicine (EM) residents with the knowledge and skills needed to address social determinants of health (SDH) and provide compassionate, patient-centered care. Vulnerable patient populations often experience disparities in healthcare access and outcomes, furthering a need for a curriculum that fosters awareness, empathy, and resource utilization. The curriculum aims to integrate ethical considerations, social factors, and resource navigation into EM training.

Methods

The DOORs curriculum was integrated into the weekly departmental conference, featuring eight or more 30–60-min sessions annually. Initial sessions assessed residents' familiarity with vulnerable populations and available resources. Topics included incarcerated individuals, refugees, homeless patients, sex workers, and others. Sessions included expert lectures, interactive discussions, and ethics case reviews. Resident demographics and pre-existing knowledge were analyzed through surveys.

Results

Over 4 years, resident awareness of ED resources improved significantly. In 2020, 52% of residents reported that the curriculum influenced their practice, increasing to 62.5% in 2022. Pre- and post-curriculum surveys demonstrated statistically significant increases in awareness of resources for refugee populations (1.76–2.76) and hemodialysis patients (2.36–3.35). Residents valued sessions with speakers who had lived experiences and highlighted community engagement.

Conclusion

The DOORs curriculum works to enhance EM residents' ability to address SDH, utilize resources, and engage in meaningful community partnerships. Future directions include expanding to other specialties and strengthening collaborations with national and local programs to improve SDH education in medical training.

Discussion

Our curriculum highlights the value of integrating social determinants of health (SDH) into resident education to deepen awareness and community connection. We found that tailoring content based on resident feedback, particularly emphasizing lived experience and community partnership, was essential for engagement. Notably, strong local support made implementation more feasible and cost-effective than expected, reinforcing the potential for scalability in similar settings.

DOORs课程旨在为急诊医学(EM)居民提供解决健康社会决定因素(SDH)所需的知识和技能,并提供富有同情心的、以患者为中心的护理。弱势患者群体通常在医疗保健获取和结果方面存在差异,进一步需要培养意识、同理心和资源利用的课程。该课程旨在将伦理考虑、社会因素和资源导航整合到电子商务培训中。方法将DOORs课程纳入每周部门会议,每年举行8次或更多30 - 60分钟的会议。最初的会议评估了居民对弱势群体和可用资源的熟悉程度。主题包括被监禁的人、难民、无家可归的病人、性工作者等。会议包括专家讲座、互动讨论和道德案例回顾。通过调查分析了居民人口统计和已有知识。结果4年多来,居民对ED资源的认识有了明显提高。2020年,52%的居民报告说课程影响了他们的实践,到2022年这一比例上升到62.5%。课前和课后调查显示,难民人口(1.76-2.76)和血液透析患者(2.36-3.35)对资源的认识在统计上有显著提高。居民们很重视与有生活经验的演讲者交谈,并强调社区参与。DOORs课程旨在提高新兴市场居民解决SDH问题、利用资源和参与有意义的社区伙伴关系的能力。未来的发展方向包括扩展到其他专业,并加强与国家和地方项目的合作,以改善医学培训中的SDH教育。我们的课程强调将健康的社会决定因素(SDH)纳入居民教育的价值,以加深意识和社区联系。我们发现,根据居民反馈定制内容,特别是强调生活体验和社区伙伴关系,对参与至关重要。值得注意的是,强大的本地支持使实施比预期的更可行和更具成本效益,从而加强了在类似环境中可扩展性的潜力。
{"title":"Developing an Outlook on Other Realities: A Curriculum Model Targeting the Importance of Patient Realities in the Emergency Department","authors":"Justin Behlke,&nbsp;Ashley Pavlic,&nbsp;Sehr Khan,&nbsp;Taylor Sonnenberg","doi":"10.1002/aet2.70068","DOIUrl":"https://doi.org/10.1002/aet2.70068","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>The DOORs curriculum is designed to equip emergency medicine (EM) residents with the knowledge and skills needed to address social determinants of health (SDH) and provide compassionate, patient-centered care. Vulnerable patient populations often experience disparities in healthcare access and outcomes, furthering a need for a curriculum that fosters awareness, empathy, and resource utilization. The curriculum aims to integrate ethical considerations, social factors, and resource navigation into EM training.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The DOORs curriculum was integrated into the weekly departmental conference, featuring eight or more 30–60-min sessions annually. Initial sessions assessed residents' familiarity with vulnerable populations and available resources. Topics included incarcerated individuals, refugees, homeless patients, sex workers, and others. Sessions included expert lectures, interactive discussions, and ethics case reviews. Resident demographics and pre-existing knowledge were analyzed through surveys.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Over 4 years, resident awareness of ED resources improved significantly. In 2020, 52% of residents reported that the curriculum influenced their practice, increasing to 62.5% in 2022. Pre- and post-curriculum surveys demonstrated statistically significant increases in awareness of resources for refugee populations (1.76–2.76) and hemodialysis patients (2.36–3.35). Residents valued sessions with speakers who had lived experiences and highlighted community engagement.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The DOORs curriculum works to enhance EM residents' ability to address SDH, utilize resources, and engage in meaningful community partnerships. Future directions include expanding to other specialties and strengthening collaborations with national and local programs to improve SDH education in medical training.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Discussion</h3>\u0000 \u0000 <p>Our curriculum highlights the value of integrating social determinants of health (SDH) into resident education to deepen awareness and community connection. We found that tailoring content based on resident feedback, particularly emphasizing lived experience and community partnership, was essential for engagement. Notably, strong local support made implementation more feasible and cost-effective than expected, reinforcing the potential for scalability in similar settings.</p>\u0000 </section>\u0000 </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 3","pages":""},"PeriodicalIF":1.7,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144367347","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
AEM Education and Training
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1