Advances in Health Sciences Education最新文献

Medical educator portfolios (MEP) are increasingly recognized as a tool for developing and documenting teaching performance in Health Professions Education. However, there is a need to better understand the complex interplay between institutional guidelines and how teachers decode those guidelines and assign value to teaching merits. To gain a deeper understanding of this dynamic, this study employed a sociological analysis to understand how medical educators aspiring to professorships use MEPs to display their teaching merits and how cultural capital is reflected in these artefacts. We collected 36 medical educator portfolios for promotion from a large research-intensive university and conducted a deductive content analysis using institutional guidelines that distinguished between mandatory (accounting for the total body of teaching conducted) and optional content (arguing for pedagogical choices and evidencing the quality, respectively). Our analysis showed that the portfolios primarily included quantifiable data about teaching activities, e.g., numbers of students, topics and classes taught. Notably, they often lacked evidence of quality and scholarship of teaching. Looking at these findings through a Bourdieusian lens revealed that teachers in this social field exchange objectified evidence of hours spent on teaching into teaching capital recognized by their institution. Our findings highlight how institutional guidelines for MEPs construct a pedagogical battlefield, where educators try to decode and exchange the “right” and recognized teaching capital. This indicates that MEPs reflect the norms and practices of the academic field more than individual teaching quality.

The learning environment (LE) includes social interactions, organizational culture, structures, and physical and virtual spaces that influence the learning experiences of students. Despite numerous studies exploring the perception of healthcare professional students (HCPS) of their LE, the validity evidence of the utilized questionnaires remains unclear. This scoping review aimed to identify questionnaires used to examine the perception of undergraduate HCPS of their LE and to assess their validity evidence. Five key concepts were used: (1) higher education; (2) questionnaire; (3) LE; (4) perception; and (5) health professions (HP). PubMed, ERIC, ProQuest, and Cochrane databases were searched for studies developing or adapting questionnaires to examine LE. This review employed the APERA standards of validity evidence and Beckman et al. (J Gen Intern Med 20:1159–1164, 2005) interpretation of these standards according to 5 categories: content, internal structure, response process, relation to other variables, and consequences. Out of 41 questionnaires included in this review, the analysis revealed a predominant emphasis on content and internal structure categories. However, less than 10% of the included questionnaires provided information in relation to other variables, consequences, and response process categories. Most of the identified questionnaires received extensive coverage in the fields of medicine and nursing, followed by dentistry. This review identified diverse questionnaires utilized for examining the perception of students of their LE across different HPs. Given the limited validity evidence for existing questionnaires, future research should prioritize the development and validation of psychometric measures. This will ultimately ensure sound and evidence-based quality improvement measures of the LE in HP education programs.

Introduction

Research in various areas indicates that expert judgment can be highly inconsistent. However, expert judgment is indispensable in many contexts. In medical education, experts often function as examiners in rater-based assessments. Here, disagreement between examiners can have far-reaching consequences. The literature suggests that inconsistencies in ratings depend on the level of performance a to-be-evaluated candidate shows. This possibility has not been addressed deliberately and with appropriate statistical methods. By adopting the theoretical lens of ecological rationality, we evaluate if easily implementable strategies can enhance decision making in real-world assessment contexts.

Methods

We address two objectives. First, we investigate the dependence of rater-consistency on performance levels. We recorded videos of mock-exams and had examiners (N=10) evaluate four students’ performances and compare inconsistencies in performance ratings between examiner-pairs using a bootstrapping procedure. Our second objective is to provide an approach that aids decision making by implementing simple heuristics.

Results

We found that discrepancies were largely a function of the level of performance the candidates showed. Lower performances were rated more inconsistently than excellent performances. Furthermore, our analyses indicated that the use of simple heuristics might improve decisions in examiner pairs.

Discussion

Inconsistencies in performance judgments continue to be a matter of concern, and we provide empirical evidence for them to be related to candidate performance. We discuss implications for research and the advantages of adopting the perspective of ecological rationality. We point to directions both for further research and for development of assessment practices.

While explicit conceptual models help to inform research, they are left out of much of the health professions education (HPE) literature. One reason may be the limited understanding about how to develop conceptual models with intention and rigor. Group concept mapping (GCM) is a mixed methods conceptualization approach that has been used to develop frameworks for planning and evaluation, but GCM has not been common in HPE. The purpose of this article is to describe GCM in order to make it more accessible for HPE scholars. We recount the origins and evolution of GCM and summarize its core features: GCM can combine multiple stakeholder perspectives in a systematic and inclusive manner to generate explicit conceptual models. Based on the literature and prior experience using GCM, we detail seven steps in GCM: (1) brainstorming ideas to a specific “focus prompt,” (2) preparing ideas by removing duplicates and editing for consistency, (3) sorting ideas according to conceptual similarity, (4) generating the point map through quantitative analysis, (5) interpreting cluster map options, (6) summarizing the final concept map, and (7) reporting and using the map. We provide illustrative examples from HPE studies and compare GCM to other conceptualization methods. GCM has great potential to add to the myriad of methodologies open to HPE researchers. Its alignment with principles of diversity and inclusivity, as well as the need to be systematic in applying theoretical and conceptual frameworks to practice, make it a method well suited for the complexities of contemporary HPE scholarship.

This column is intended to address the kinds of knotty problems and dilemmas with which many scholars grapple in studying health professions education. In this article, the authors address the question of whether one should conduct a literature review or knowledge synthesis, considering the why, when, and how, as well as its potential pitfalls. The goal is to guide supervisors and students who are considering whether to embark on a literature review in education research.

Adaptive teacher support fosters effective learning in one-to-one teaching sessions, which are a common way of learning complex visual tasks in the health sciences. Adaptive support is tailored to student needs, and this is difficult in complex visual tasks as visual problem-solving processes are covert and thus cannot be directly observed by the teacher. Eye-tracking apparatus can measure covert processes and make them visible in gaze displays: visualizations of where a student looks while executing a task. We investigate whether live dynamic gaze displays help teachers in being more adaptive to students’ needs when teaching optical coherence tomography interpretation in one-to-one teaching sessions and whether this fosters learning. Forty-nine students and 10 teachers participated in a one-to-one teaching session in clinical optometry. In the control condition, teachers saw the learning task of the student and could discuss it with them, whereas in the gaze-display condition, teachers could additionally see where the student looked. After the 15-minute teaching session, a test was administered to examine achievement. Furthermore, students filled in the ‘questionnaire on teacher support adaptivity’, and teachers rated how adaptive their support was. Bayesian analyses provide some initial evidence that students did not experience support to be more adaptive in the gaze-display condition versus the control condition, nor were their post-test scores higher. Teachers rated their provided support as being more adaptive in the gaze-display versus the control condition. Further research could investigate if live dynamic gaze displays impact adaptive teaching when used over longer periods or with more teacher training.

China hosts around 68,000 international medical students (IMSs) primarily from lower income countries in Africa and Asia, who have the potential to contribute to international medical services. Understanding how these IMSs make career decisions can help better address the issue of global medical workforce shortage. However, such research is limited. Our study aims to explore the career decision-making process of China-educated IMSs, the challenges they experienced and the strategies they employed.

In this exploratory qualitative study, we conducted semi-structured interviews with IMSs educated in China in 2022 using purposeful sampling. Twenty virtual one-on-one interviews were conducted, and data were analysed through directed qualitative content analysis. Cognitive Information Processing (CIP) theory was applied as the guiding framework for organising and analysing the data.

The career decision-making process of the participants generally followed the stages of decision-making cycle in CIP theory, with a combination of urgent migration decisions and specialisation considerations adding layers of complexity to their career trajectories. Identified challenges encompassed lack of knowledge about oneself and career options, lack of decision-making skills, concerns of contextual complexities that limited the career decision-making process, low motivation and negative thoughts. Specific challenges due to their role as IMSs arose, which were related to career information access, self-capability evaluation, degree accreditation, employment competitiveness and mental states. Participants’ proposed strategies were categorised into personal and institutional aspects, providing insights into addressing these challenges.

This study substantiates and expands the application of the CIP theory within the sphere of the particular cultural and educational context of IMSs educated in China. It highlights the significance of integrating migration decision-making into career guidance for IMSs, and contributes to the literature by proposing an evidence-based tiered career intervention programme for IMSs.

Serious games, as a learning resource, enhance their game character by embedding game design elements that are typically used in entertainment games. Serious games in its entirety have already proven their teaching effectiveness in different educational contexts including medical education. The embedded game design elements play an essential role for a game’s effectiveness and thus they should be selected based on evidence-based theories. For game design elements embedded in serious games used for the education of medical and healthcare professions, an overview of theories for the selection lacks. Additionally, it is still unclear whether and how single game design elements affect the learning effectiveness. Therefore, the main aim of this systematic review is threefold. Firstly, light will be shed on the single game design elements used in serious games in this area. Second, the game design elements’ underlying theories will be worked out, and third, the game design elements’ effectiveness on student learning outcome will be assessed. Two literature searches were conducted in November 2021 and May 2022 in six literature databases with keywords covering the fields of educational game design, serious game, and medical education. Out of 1006 initial records, 91 were included after applying predefined exclusion criteria. Data analysis revealed that the three most common game design elements were points, storyline, and feedback. Only four underlying theories were mentioned, and no study evaluated specific game design elements. Since game design elements should be based on theories to ensure meaningful evaluations, the conceptual GATE framework is introduced, which facilitates the selection of evidence-based game design elements for serious games.

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants’ estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.