Program Signaling in Emergency Medicine: The 2022-2023 Program Director Experience.

Abstract

Introduction: Program signaling (PS), which enables residency applicants to signal their preference for a specific program, was introduced in emergency medicine (EM) in the 2022-2023 residency application cycle. In this study we evaluated EM program directors' (PD) utilization of PS in application review and ranking. This study also explores the relationship between program characteristics and number of signals received as well as the relative importance and utilization of signals related to the number of signals received.

Methods: This is an institutional review board-approved, cross-sectional study of PDs at Accreditation Council for Graduate Medical Education-accredited EM residency programs. We used descriptive statistics to describe the characteristics of residency programs and practices around PS. Measures of central tendency and dispersion summarized continuous variables. We used chi-square analysis or the Fisher exact test for comparisons between groups for categorical variables. Comparisons for continuous variables were made using the t-test for independent samples or analysis of variance.

Results: The response rate was 41% (n = 113/277 EM programs). Most programs participated in PS (n = 261/277 EM programs, 94.2%). Mean number of signals received was 60 (range 2-203). Signals received varied based on program characteristics including geographic location and program type, duration, environment, and longevity. Most used PS in holistic review (52.2%), but other uses varied by proportion of applications that were signaled. The importance of PS in application review (mean 2.9; 1-5 scale, 1 = not important, 5 = extremely important) and rank list preparation (2.1) was relatively low compared to other application elements such as standardized letters of evaluation (4.97 for review, 4.90 for ranking).

Conclusion: The study provides insights into PS utilization in EM's inaugural year. We have identified patterns of signal use based on program characteristics and number of signals received that can inform signal allocation and utilization on an individual applicant and program level. A more nuanced understanding of signal use can provide valuable insight as the specialty of EM grapples with fluctuations in its applicant numbers and shifting demographics of its applicant pool.