Pub Date : 2025-12-01Epub Date: 2024-10-29DOI: 10.1177/01632787241286911
Juliette Macabrey, Laura-Lou Wuest, David Buetti
Program evaluation is essential for medical schools to demonstrate social accountability and identify areas for improvement in medical education (MEd). Although stakeholder engagement is crucial in program evaluation, no previous review has specifically examined the stakeholders involved in MEd program evaluation. This scoping review addresses this gap by identifying the stakeholders, their roles, and their levels of engagement in evaluating MEd programs, along with the facilitators and barriers to their participation. Through a systematic search across four databases, we identified 53 relevant studies out of 7206 screened. Our findings reveal seven primary stakeholder groups, with students and program directors being the most frequent participants. However, a significant gap exists in the representation of community members and patients, indicating a need for greater inclusion of these key stakeholders. Additionally, we found that stakeholders are primarily engaged as passive participants providing feedback rather than actively shaping the evaluation process. Facilitators and barriers to participation were identified from the participants' perspective, highlighting the need for further research to understand the viewpoints of active stakeholders, such as faculty and administrators. Future studies should also explore the impact of different evaluation approaches on stakeholder engagement to develop more inclusive and effective MEd program evaluations.
{"title":"Who's at the Table? A Scoping Review of Stakeholder Engagement in Medical Education Program Evaluation.","authors":"Juliette Macabrey, Laura-Lou Wuest, David Buetti","doi":"10.1177/01632787241286911","DOIUrl":"10.1177/01632787241286911","url":null,"abstract":"<p><p>Program evaluation is essential for medical schools to demonstrate social accountability and identify areas for improvement in medical education (MEd). Although stakeholder engagement is crucial in program evaluation, no previous review has specifically examined the stakeholders involved in MEd program evaluation. This scoping review addresses this gap by identifying the stakeholders, their roles, and their levels of engagement in evaluating MEd programs, along with the facilitators and barriers to their participation. Through a systematic search across four databases, we identified 53 relevant studies out of 7206 screened. Our findings reveal seven primary stakeholder groups, with students and program directors being the most frequent participants. However, a significant gap exists in the representation of community members and patients, indicating a need for greater inclusion of these key stakeholders. Additionally, we found that stakeholders are primarily engaged as passive participants providing feedback rather than actively shaping the evaluation process. Facilitators and barriers to participation were identified from the participants' perspective, highlighting the need for further research to understand the viewpoints of active stakeholders, such as faculty and administrators. Future studies should also explore the impact of different evaluation approaches on stakeholder engagement to develop more inclusive and effective MEd program evaluations.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"387-416"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12518888/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142544591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This systematic review provides an overview of the unique challenges allied health professions face in the translation and implementation of evidence into practice, which remain relatively under reported and uninformed by a theoretical basis of behaviour change. MEDLINE, EMBASE, CINAHL and Scopus databases from 2010 to 2022 were searched for primary study designs resulting in 21 articles included in this review (PROSPERO: 2022 CRD42022314996). Allied health disciplines reported in the review were mainly from occupational therapy, physiotherapy, dietetics, and speech pathology. The most frequently reported implementation determinants across the Theoretical Domains Framework were identified as 'environmental context and resources', and 'knowledge'. The results also identified a greater influence of 'social influences' and 'beliefs about consequences' in implementation. Implementing evidence into clinical practice is a multifaceted, complex process, and the use of the Theoretical Domains Framework provided a systematic approach to understanding the drivers behind the target behaviours. However, there is a paucity of studies across the allied health professions that describe implementation strategies used and their impact. Many of the studies focused on implementation by the individual clinician rather than the role organizations can play in the translation of evidence into practice.
{"title":"Factors Influencing the Translation of Evidence Into Clinical Practice for Hospital Allied Health Professionals in Terms of the Domains of Behaviour Change Theory: A Systematic Review.","authors":"Jacqueline Batchelor, Cameron Hemmert, Isabelle Meulenbroeks, Crystal Tang, Reema Harrison, Rajna Ogrin, Andrew Baillie, Mitchell Sarkies","doi":"10.1177/01632787241285993","DOIUrl":"10.1177/01632787241285993","url":null,"abstract":"<p><p>This systematic review provides an overview of the unique challenges allied health professions face in the translation and implementation of evidence into practice, which remain relatively under reported and uninformed by a theoretical basis of behaviour change. MEDLINE, EMBASE, CINAHL and Scopus databases from 2010 to 2022 were searched for primary study designs resulting in 21 articles included in this review (PROSPERO: 2022 CRD42022314996). Allied health disciplines reported in the review were mainly from occupational therapy, physiotherapy, dietetics, and speech pathology. The most frequently reported implementation determinants across the Theoretical Domains Framework were identified as 'environmental context and resources', and 'knowledge'. The results also identified a greater influence of 'social influences' and 'beliefs about consequences' in implementation. Implementing evidence into clinical practice is a multifaceted, complex process, and the use of the Theoretical Domains Framework provided a systematic approach to understanding the drivers behind the target behaviours. However, there is a paucity of studies across the allied health professions that describe implementation strategies used and their impact. Many of the studies focused on implementation by the individual clinician rather than the role organizations can play in the translation of evidence into practice.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"471-489"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12518880/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142307474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2025-01-03DOI: 10.1177/01632787241311360
Katya Peri, Mark J Eisenberg
The goal of maintenance of certification (MOC) activities is to ensure physicians are up to date on current practices and demonstrate the knowledge and skills required to provide patients with optimal care. The program's aim is to promote professional development, lifelong learning and quality assurance for the public and medical community. However, physicians are not happy with the current structure of the program, claiming it to be time-consuming, expensive and ineffective for their practice. The lack of concrete evidence confirming the efficacy of MOC in improving knowledge and clinical outcomes causes many to question how this system can be improved to better serve practitioners and the public. In this commentary, we provide an overview of the current MOC situation for U.S. specialists and highlight the importance of increasing research to inform evidence-based changes that can be applied to clinical situations.
保持认证(MOC)活动的目标是确保医生掌握最新的实践知识,并展示为患者提供最佳护理所需的知识和技能。该计划旨在促进公众和医疗界的专业发展、终身学习和质量保证。然而,医生们对该计划目前的结构并不满意,他们声称该计划耗时长、费用高,而且对他们的实践没有效果。由于缺乏具体证据证实 MOC 在提高知识水平和临床疗效方面的功效,许多人对如何改进这一制度以便更好地为从业人员和公众服务提出了质疑。在这篇评论中,我们概述了美国专科医生的 MOC 现状,并强调了加强研究的重要性,以便为可应用于临床情况的循证变革提供信息。
{"title":"Commentary: Review of Mandatory Maintenance of Certification in the USA.","authors":"Katya Peri, Mark J Eisenberg","doi":"10.1177/01632787241311360","DOIUrl":"10.1177/01632787241311360","url":null,"abstract":"<p><p>The goal of maintenance of certification (MOC) activities is to ensure physicians are up to date on current practices and demonstrate the knowledge and skills required to provide patients with optimal care. The program's aim is to promote professional development, lifelong learning and quality assurance for the public and medical community. However, physicians are not happy with the current structure of the program, claiming it to be time-consuming, expensive and ineffective for their practice. The lack of concrete evidence confirming the efficacy of MOC in improving knowledge and clinical outcomes causes many to question how this system can be improved to better serve practitioners and the public. In this commentary, we provide an overview of the current MOC situation for U.S. specialists and highlight the importance of increasing research to inform evidence-based changes that can be applied to clinical situations.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"494-499"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12518884/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142921019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2024-08-29DOI: 10.1177/01632787241277826
Raymond Boon Tar Lim, Kelly Voo, Claire Gek Ling Tan, Huili Zheng
Effective feedback is crucial for educating health professions students. This systematic review investigates the impact of extrinsic feedback on health professions students, encompassing medical, dental, and nursing fields. Through meticulous gathering and analysis of 37 studies, this review highlights verbal and visual feedback as predominant forms, often delivered immediately by instructors and supplemented by peer or simulated input. Notably, technology is increasingly utilised to enhance the provision of feedback. The impacts of feedback span various domains, including surgical skills and patient communication, revealing notable improvements in procedural skills such as suturing and knot-tying, as well as general patient communication proficiency. Meta-analyses underscore significant enhancements in communication skills and provide nuanced insights into chest compression techniques. Overall, the findings provide initial evidence that extrinsic feedback enhances surgical procedural skills and general patient communication proficiency among health professions students. The evolving role of technology in feedback provision is promising. Future studies should assess extrinsic feedback across different health professions to better understand its impacts and alignment with specific educational needs and accreditation standards, thereby enhancing learning outcomes.
{"title":"A Systematic Review: What Are the Impacts of Receiving Extrinsic Feedback on Health Professions Students in Higher Education?","authors":"Raymond Boon Tar Lim, Kelly Voo, Claire Gek Ling Tan, Huili Zheng","doi":"10.1177/01632787241277826","DOIUrl":"10.1177/01632787241277826","url":null,"abstract":"<p><p>Effective feedback is crucial for educating health professions students. This systematic review investigates the impact of extrinsic feedback on health professions students, encompassing medical, dental, and nursing fields. Through meticulous gathering and analysis of 37 studies, this review highlights verbal and visual feedback as predominant forms, often delivered immediately by instructors and supplemented by peer or simulated input. Notably, technology is increasingly utilised to enhance the provision of feedback. The impacts of feedback span various domains, including surgical skills and patient communication, revealing notable improvements in procedural skills such as suturing and knot-tying, as well as general patient communication proficiency. Meta-analyses underscore significant enhancements in communication skills and provide nuanced insights into chest compression techniques. Overall, the findings provide initial evidence that extrinsic feedback enhances surgical procedural skills and general patient communication proficiency among health professions students. The evolving role of technology in feedback provision is promising. Future studies should assess extrinsic feedback across different health professions to better understand its impacts and alignment with specific educational needs and accreditation standards, thereby enhancing learning outcomes.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"417-429"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142105971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2025-09-03DOI: 10.1177/01632787251377057
Elizabeth D Auckley, Jack Geiger, Amy Farkas, Cecilia Scholcoff, Katherine Gavinski, Jeffrey L Jackson
This study's purpose was to assess the prevalence and characteristics of highly and poorly rated attending physicians as well as the evaluation's reliability and validity. Medicine residents evaluated attending physicians (2013-2024) on eight teaching domains (clarity, supervision, skills, decision-making, expectations, feedback, approachability and overall effectiveness). Overall teaching effectiveness was dichotomized into "highly rated" (scores of 5) and "poorly rated" (scores of ≤3). We assessed correlates of highly and poorly rated attending physicians using generalized latent and linear and mixed methods. Validity and reliability were assessed using factor analysis, Cronbach's alpha and intra-class correlation coefficients. Among 20,150 evaluations of 668 attending physicians by 814 residents, 67% were rated highly (n = 12,801) and 9% were poorly rated (n = 1,754). Highly rated attendings explained decisions (OR: 5.1, 95% CI: 3.l-7.0), were clear (OR: 3.2, 95% CI: 2.4-4.4), approachable (OR: 2.9, 95% CI: 2.2-3.9) and demonstrated skills (OR: 3.2, 95% CI: 2.4-4.3). Poorly rated attending physicians received multiple poor ratings (74%) and lower scores on all teaching domains. Ratings were reliable and consistent, but had low levels of agreement by residents. We conclude that attending physicians were commonly highly rated. While uncommon, poor ratings are better discriminators of teaching quality than highly rated ones.
{"title":"Internal Medicine Resident Evaluations of Attending Physicians.","authors":"Elizabeth D Auckley, Jack Geiger, Amy Farkas, Cecilia Scholcoff, Katherine Gavinski, Jeffrey L Jackson","doi":"10.1177/01632787251377057","DOIUrl":"10.1177/01632787251377057","url":null,"abstract":"<p><p>This study's purpose was to assess the prevalence and characteristics of highly and poorly rated attending physicians as well as the evaluation's reliability and validity. Medicine residents evaluated attending physicians (2013-2024) on eight teaching domains (clarity, supervision, skills, decision-making, expectations, feedback, approachability and overall effectiveness). Overall teaching effectiveness was dichotomized into \"highly rated\" (scores of 5) and \"poorly rated\" (scores of ≤3). We assessed correlates of highly and poorly rated attending physicians using generalized latent and linear and mixed methods. Validity and reliability were assessed using factor analysis, Cronbach's alpha and intra-class correlation coefficients. Among 20,150 evaluations of 668 attending physicians by 814 residents, 67% were rated highly (n = 12,801) and 9% were poorly rated (n = 1,754). Highly rated attendings explained decisions (OR: 5.1, 95% CI: 3.l-7.0), were clear (OR: 3.2, 95% CI: 2.4-4.4), approachable (OR: 2.9, 95% CI: 2.2-3.9) and demonstrated skills (OR: 3.2, 95% CI: 2.4-4.3). Poorly rated attending physicians received multiple poor ratings (74%) and lower scores on all teaching domains. Ratings were reliable and consistent, but had low levels of agreement by residents. We conclude that attending physicians were commonly highly rated. While uncommon, poor ratings are better discriminators of teaching quality than highly rated ones.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"458-462"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144948431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2025-04-28DOI: 10.1177/01632787251333780
Jessica Nobrega Dantas, Marco Antonio Dias da Silva
Dental education faces a significant challenge in preparing future professionals for a world increasingly driven by Digital Health (DH) innovations. However, it is not known whether or how DH content is being included in the training of future dental teachers in Brazil. This study aimed to evaluate the extent of DH content integration in Brazilian Dentistry Master's programs. From April to June 2023, data from the Sucupira platform and institutional websites were utilized to evaluate all Dentistry Master's programs in Brazil. Statistical analysis assessed the impacts of five factors: geographical location, program type, administrative category, program score, and association with a Teledentistry unit on offering up-to-date content. Out of 92 identified programs, 77 had available documents for analysis. A total of 2,161 courses were found, 1,523 with detailed information. DH curricular content was found in 4 courses. No relationship was observed between the offering of DH and factors like program type (professional or academic) (p = 1.00), university administrative category (public or private) (p = .144), region (p = .638), program quality rating (p = .792), or association with a Teledentistry unit (p = 1.00). These findings highlight a concerning gap in the incorporation of DH-related content into Brazil's dentistry master's programs, underscoring the need to address this deficiency.
{"title":"A Descriptive and Correlational Study Assessing the Integration of Digital Health into Brazil's Dentistry Master's Degree Programs.","authors":"Jessica Nobrega Dantas, Marco Antonio Dias da Silva","doi":"10.1177/01632787251333780","DOIUrl":"10.1177/01632787251333780","url":null,"abstract":"<p><p>Dental education faces a significant challenge in preparing future professionals for a world increasingly driven by Digital Health (DH) innovations. However, it is not known whether or how DH content is being included in the training of future dental teachers in Brazil. This study aimed to evaluate the extent of DH content integration in Brazilian Dentistry Master's programs. From April to June 2023, data from the Sucupira platform and institutional websites were utilized to evaluate all Dentistry Master's programs in Brazil. Statistical analysis assessed the impacts of five factors: geographical location, program type, administrative category, program score, and association with a Teledentistry unit on offering up-to-date content. Out of 92 identified programs, 77 had available documents for analysis. A total of 2,161 courses were found, 1,523 with detailed information. DH curricular content was found in 4 courses. No relationship was observed between the offering of DH and factors like program type (professional or academic) (<i>p</i> = 1.00), university administrative category (public or private) (<i>p</i> = .144), region (<i>p</i> = .638), program quality rating (<i>p</i> = .792), or association with a Teledentistry unit (<i>p</i> = 1.00). These findings highlight a concerning gap in the incorporation of DH-related content into Brazil's dentistry master's programs, underscoring the need to address this deficiency.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"463-470"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143980599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2024-08-20DOI: 10.1177/01632787241276210
Elizabeth Loftus
The evolving landscape of healthcare necessitates a paradigm shift in professional education, blending clinical expertise with business acumen. This paper delves into the need for healthcare professionals to acquire a comprehensive understanding of both clinical intricacies and business dynamics while examining the emergence of joint degree programs aimed to equip graduates with multifaceted skills required to navigate the complexities our of modern healthcare delivery systems. Drawing from a diverse literature review, this paper highlights the pros and cons of this dual-degree education and the benefits that it brings given today's challenging healthcare landscape. It explores the profound impact of such programs on student outcomes, emphasizing the cultivation of leadership, financial acumen, and strategic thinking alongside clinical competencies. Moreover, it addresses concerns regarding academic rigor and the feasibility of integrating business education into an already demanding healthcare curricula. Analysis of current trends and future projections underscores the growing demand for professionals who possess hybrid skill sets. With healthcare workforce shortages and evolving industry challenges, individuals equipped with both clinical and business proficiencies are poised to lead innovation and drive organizational success.
{"title":"Combining Business Education With Clinical Acumen … is it Necessary?","authors":"Elizabeth Loftus","doi":"10.1177/01632787241276210","DOIUrl":"10.1177/01632787241276210","url":null,"abstract":"<p><p>The evolving landscape of healthcare necessitates a paradigm shift in professional education, blending clinical expertise with business acumen. This paper delves into the need for healthcare professionals to acquire a comprehensive understanding of both clinical intricacies and business dynamics while examining the emergence of joint degree programs aimed to equip graduates with multifaceted skills required to navigate the complexities our of modern healthcare delivery systems. Drawing from a diverse literature review, this paper highlights the pros and cons of this dual-degree education and the benefits that it brings given today's challenging healthcare landscape. It explores the profound impact of such programs on student outcomes, emphasizing the cultivation of leadership, financial acumen, and strategic thinking alongside clinical competencies. Moreover, it addresses concerns regarding academic rigor and the feasibility of integrating business education into an already demanding healthcare curricula. Analysis of current trends and future projections underscores the growing demand for professionals who possess hybrid skill sets. With healthcare workforce shortages and evolving industry challenges, individuals equipped with both clinical and business proficiencies are poised to lead innovation and drive organizational success.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"490-493"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142003933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2024-10-03DOI: 10.1177/01632787241288849
Binbin Zheng, Ting Sun
Self-regulated learning (SRL) plays a pivotal role in medical education. There is a pressing need for a meta-analytical review to comprehensively evaluate the effect sizes of SRL strategies across diverse learning outcomes and levels of medical trainees. A meta-analysis was executed by searching five databases and resulted in 61 studies that met our inclusion criteria. A three-level meta-analysis was performed to examine the association between SRL strategies and various levels of learning outcomes (i.e., affective, cognitive, and behavioral learning outcomes). Moderator analyses were conducted using meta-regression, considering factors such as types of learning outcomes, training levels, SRL subscales, and quality of the studies. The analysis yielded an average effect size of .212, using Pearson's correlation coefficient, demonstrating a positive and significant association between SRL strategies and overall learning outcomes. Although our moderator analyses indicated that SRL subscales and study quality did not significantly influence the relationship between SRL strategies and learning outcomes, SRL strategies had a more pronounced effect on affective outcomes than on test scores, behavioral outcomes, and mental health outcomes. In addition, the association between SRL strategies and learning outcomes were significantly higher among the clerkship phase of undergraduate medical education than the pre-clerkship phase.
{"title":"Self-Regulated Learning and Learning Outcomes in Undergraduate and Graduate Medical Education: A Meta-Analysis.","authors":"Binbin Zheng, Ting Sun","doi":"10.1177/01632787241288849","DOIUrl":"10.1177/01632787241288849","url":null,"abstract":"<p><p>Self-regulated learning (SRL) plays a pivotal role in medical education. There is a pressing need for a meta-analytical review to comprehensively evaluate the effect sizes of SRL strategies across diverse learning outcomes and levels of medical trainees. A meta-analysis was executed by searching five databases and resulted in 61 studies that met our inclusion criteria. A three-level meta-analysis was performed to examine the association between SRL strategies and various levels of learning outcomes (i.e., affective, cognitive, and behavioral learning outcomes). Moderator analyses were conducted using meta-regression, considering factors such as types of learning outcomes, training levels, SRL subscales, and quality of the studies. The analysis yielded an average effect size of .212, using Pearson's correlation coefficient, demonstrating a positive and significant association between SRL strategies and overall learning outcomes. Although our moderator analyses indicated that SRL subscales and study quality did not significantly influence the relationship between SRL strategies and learning outcomes, SRL strategies had a more pronounced effect on affective outcomes than on test scores, behavioral outcomes, and mental health outcomes. In addition, the association between SRL strategies and learning outcomes were significantly higher among the clerkship phase of undergraduate medical education than the pre-clerkship phase.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"430-450"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142371427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-12-01Epub Date: 2024-09-28DOI: 10.1177/01632787241286912
Anna Byszewski, Alexander Pearson, Heather Lochnan, Donna L Johnston, Sharon Whiting, Timothy J Wood
Role modelling is important in developing professionalism with a need for reliable, evidence-based tools to assess professionalism in the learning environment (LE). The Learning Environment for Professionalism (LEP) survey is brief, anonymous and balanced assessing medical trainees' and attendings' positive and negative professionalism behaviours that can be tracked longitudinally and identify problem areas in the LE. Seven training programs agreed to facilitate administration of the LEP survey at four hospitals in Ottawa, Canada. The survey was carried out iteratively between 2013 and 2020. A total of 3783 LE ratings of training programs and hospitals were assessed longitudinally using univariate linear regression. A Bonferroni corrected p-value of ≤.0045 was used to account for multiple comparisons. Positive professional behaviours were observed across time with some of the negative behaviors having improved. A negative signal was found, with attendings appearing to be treating patients unfairly because of their financial status, ethnic background, sexual or religious preferences. Applying LEP survey longitudinally across diverse training programs and institutions is feasible and may assist programs to identify areas requiring attention and acknowledging areas of exemplary professionalism. Continuous monitoring of LE to meet requirements of accrediting bodies can also be considered an important quality improvement metric.
{"title":"Professionalism in Residency Training: The Learning Environment for Professionalism Survey.","authors":"Anna Byszewski, Alexander Pearson, Heather Lochnan, Donna L Johnston, Sharon Whiting, Timothy J Wood","doi":"10.1177/01632787241286912","DOIUrl":"10.1177/01632787241286912","url":null,"abstract":"<p><p>Role modelling is important in developing professionalism with a need for reliable, evidence-based tools to assess professionalism in the learning environment (LE). The Learning Environment for Professionalism (LEP) survey is brief, anonymous and balanced assessing medical trainees' and attendings' positive and negative professionalism behaviours that can be tracked longitudinally and identify problem areas in the LE. Seven training programs agreed to facilitate administration of the LEP survey at four hospitals in Ottawa, Canada. The survey was carried out iteratively between 2013 and 2020. A total of 3783 LE ratings of training programs and hospitals were assessed longitudinally using univariate linear regression. A Bonferroni corrected <i>p</i>-value of ≤.0045 was used to account for multiple comparisons. Positive professional behaviours were observed across time with some of the negative behaviors having improved. A negative signal was found, with attendings appearing to be treating patients unfairly because of their financial status, ethnic background, sexual or religious preferences. Applying LEP survey longitudinally across diverse training programs and institutions is feasible and may assist programs to identify areas requiring attention and acknowledging areas of exemplary professionalism. Continuous monitoring of LE to meet requirements of accrediting bodies can also be considered an important quality improvement metric.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"451-457"},"PeriodicalIF":1.6,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12518883/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142344416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-13DOI: 10.1177/01632787251399197
Nerea Blanco-Martínez, Rebeca Montes-Montes, Carlos Ayán-Pérez, Alicia Beatriz Berlier-Cea, Laura Delgado-Lobete
The general population struggles to meet physical activity recommendations, risking mental and physical health. Validated, culturally adapted tools are essential for identifying barriers and implementing effective, context-specific strategies to promote exercise participation. Despite its wide use, the cross-cultural equivalence, and psychometric properties of the Barriers to Being Active Quiz (BBAQ) have not been confirmed. The purpose of this study was to validate the BBAQ cross-culturally into European Spanish (BBAQ-ES). Following international guidelines, the BBAQ underwent a systematic four-step process involving a multidisciplinary translation, synthesis, reconciliation, review, and a population-based comprehensibility test. Measurement properties-including structural and construct validity, and internal consistency, measurement error and test-retest reliability-were assessed following COSMIN guidelines on a sample of 589 Spanish University students. The IPAQ-SF was used as comparator instrument during hypothesis testing for construct validity (i.e. convergent, and discriminative validity). The BBAQ-ES demonstrates strong cross-cultural equivalence and good measurement properties (RMSEA = 0.0485, CFI = 0.946; Cronbach's alpha = 0.875; ICC = 0.724 -0.878; confirmed hypotheses testing >75%). The BBAQ-ES is a cross-culturally adapted, reliable and valid measure to assess multidimensional obstacles to physical activity. This study provides valuable new insights for international research and clinical practice.
{"title":"Assessment of Barriers to Physical Activity Practice: Spanish Cross-Cultural Adaptation, Reliability and Validity of the Barriers to Being Active Quiz.","authors":"Nerea Blanco-Martínez, Rebeca Montes-Montes, Carlos Ayán-Pérez, Alicia Beatriz Berlier-Cea, Laura Delgado-Lobete","doi":"10.1177/01632787251399197","DOIUrl":"https://doi.org/10.1177/01632787251399197","url":null,"abstract":"<p><p>The general population struggles to meet physical activity recommendations, risking mental and physical health. Validated, culturally adapted tools are essential for identifying barriers and implementing effective, context-specific strategies to promote exercise participation. Despite its wide use, the cross-cultural equivalence, and psychometric properties of the Barriers to Being Active Quiz (BBAQ) have not been confirmed. The purpose of this study was to validate the BBAQ cross-culturally into European Spanish (BBAQ-ES). Following international guidelines, the BBAQ underwent a systematic four-step process involving a multidisciplinary translation, synthesis, reconciliation, review, and a population-based comprehensibility test. Measurement properties-including structural and construct validity, and internal consistency, measurement error and test-retest reliability-were assessed following COSMIN guidelines on a sample of 589 Spanish University students. The IPAQ-SF was used as comparator instrument during hypothesis testing for construct validity (i.e. convergent, and discriminative validity). The BBAQ-ES demonstrates strong cross-cultural equivalence and good measurement properties (RMSEA = 0.0485, CFI = 0.946; Cronbach's alpha = 0.875; ICC = 0.724 -0.878; confirmed hypotheses testing >75%). The BBAQ-ES is a cross-culturally adapted, reliable and valid measure to assess multidimensional obstacles to physical activity. This study provides valuable new insights for international research and clinical practice.</p>","PeriodicalId":12315,"journal":{"name":"Evaluation & the Health Professions","volume":" ","pages":"1632787251399197"},"PeriodicalIF":1.6,"publicationDate":"2025-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145502872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}