Background: "One-minute preceptor" (OMP) is a well-established educational technique; however, primary literature on OMP lacks a tool to assess behavioral change after delivery of curricula.Primary aim of this pilot study was to design a checklist for direct observation of teachers using OMP on general medicine rounds and obtain inter-rater reliability evidence for the checklist.
Methods: This study pilots an internally designed 6-item checklist to assess change in directly observed behavior. We describe the process of developing the checklist and training the observers. We calculated a percent agreement and Cohen's kappa to assess inter-rater reliability.
Results: Raters had a high percent agreement ranging from 0.8 to 0.9 for each step of OMP. Cohen's kappa ranged from 0.49 to 0.77 for the five OMP steps. The highest kappa obtained was for getting a commitment (κ = 0.77) step, whereas the lowest agreement was for correcting mistakes (κ = 0.49).
Conclusion: We showed a percent agreement ≥0.8 and moderate agreement based on Cohen's kappa with most steps of OMP on our checklist. A reliable OMP checklist is an important step in further improving the assessment and feedback of resident teaching skills on general medicine wards.
Abstract: The information systems designed to support clinical care have evolved separately from those that support health professions education. This has resulted in a considerable digital divide between patient care and education, one that poorly serves practitioners and organizations, even as learning becomes ever more important to both. In this perspective, we advocate for the enhancement of existing health information systems so that they intentionally facilitate learning. We describe three well-regarded frameworks for learning that can point toward how health care information systems can best evolve to support learning. The Master Adaptive Learner model suggests ways that the individual practitioner can best organize their activities to ensure continual self-improvement. The PDSA cycle similarly proposes actions for improvement but at a health care organization's workflow level. Senge's Five Disciplines of the Learning Organization, a more general framework from the business literature, serves to further inform how disparate information and knowledge flows can be managed for continual improvement. Our main thesis holds that these types of learning frameworks should inform the design and integration of information systems serving the health professions. An underutilized mediator of educational improvement is the ubiquitous electronic health record. The authors list learning analytic opportunities, including potential modifications of learning management systems and the electronic health record, that would enhance health professions education and support the shared goal of delivering high-quality evidence-based health care.
Introduction: Although physicians gain clinical knowledge in their specialty, it does not mean they receive adequate instruction to teach and provide feedback. Using smart glasses (SG) to provide educators with a first-person learner perspective has not been explored in faculty development such as Objective Structured Teaching Exercises (OSTEs).
Methods: Integrated within a 6-session continuing medical education-bearing certificate course, this descriptive study involved one session where participants provided feedback to a standardized student in an OSTE. Participants were recorded by mounted wall cameras (MWCs) and SG. They received verbal feedback on their performance based on a self-designed assessment tool. Participants reviewed the recorded content and identified areas for improvement, completed a survey about their experience with SG, and wrote a narrative reflection.
Results: Seventeen physicians at the assistant professor level participated in the session; data were analyzed on the 14 who had both MWC and SG recordings and who also completed the survey and reflection. All were comfortable with the standardized student wearing SG and indicated it did not affect communication. Eighty-five percent of the participants felt the SG provided additional feedback not available with the MWC, with majority noting additional feedback was related to eye contact, body language, voice inflection, and tone. Eighty-six percent see value in using SG for faculty development, and 79% felt that periodically using SG in their teaching would improve quality.
Conclusion: Use of SG during an OSTE on giving feedback was a nondistracting and positive experience. SG provided affective feedback otherwise not perceived from a standard MWC.
Introduction: Although sexual assault (SA) is a substantial public health problem, emergency physicians do not universally undergo continuing education on caring for survivors of SA. The goal of this intervention was to develop a training course that improves physician understanding of trauma-sensitive care in the emergency department and equips physicians with knowledge of the specialized care required to treat SA survivors.
Methods: Thirty-nine attending emergency physicians underwent a 4-hour training on trauma-sensitive care for survivors of SA and completed prequestionnaires and postquestionnaires to assess training efficacy in improving knowledge base and comfort level providing care. The training consisted of didactic portions focused on the neurobiology of trauma, communication skills, and forensic evidence collection techniques and a simulation portion with standardized patients to practice evidence collection and a trauma-sensitive anogenital examination.
Results: Physicians demonstrated significantly improved performance (P < .05) on 12 of 18 knowledge-based questions. Physicians also showed significant improvement (P < .001) on 11 of 11 Likert scale questions that assessed comfort level communicating with survivors and using trauma-sensitive techniques during medical and forensic examinations.
Conclusion: Physicians who received the training course demonstrated a significantly improved knowledge base and comfort level treating survivors of SA. Considering the prevalence of sexual violence, it is imperative that physicians are appropriately educated on trauma-sensitive care.