Pub Date : 2024-11-03eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2421129
Esther de Groot, Jasperina Brouwer, Yvette Baggen, Nienke Moolenaar, Manon Kluijtmans, Roger Damoiseaux
Clinician-scientists, physicians who conduct research, may fulfil a bridging role in networks of health care researchers and practitioners. Within clinician-scientists' networks, knowledge sharing is thought to play a vital role in the continuing professional development of themselves and their colleagues. However, little is known about networks of clinician-scientists and how this impacts continuing professional development. Rooted in social capital theory, this study provides a mixed methods exploration of clinician-scientists' networks. Ego-level social network data were collected via semi-structured interviews on professional interactions about evidence-based practice with 15 clinician-scientists in the area of general practice and elderly care. Quantitative analysis revealed that professional networks of clinician-scientists varied in size, composition, and frequency of interactions depending on appointed research time and experience. Less experienced clinician-scientists interacted most frequently with other clinician-scientists while experienced clinician-scientist experienced more sporadically with clinicians. Clinician-scientists with more research time interacted more frequently with scientists and had a slightly larger professional network than those with less research time. The thematic qualitative analysis revealed different decision-making processes of clinician-scientists on mobilising their social capital and connecting to others in the network: (1) deliberate decision about initiating connections; (2) reactive behaviour without a decision; (3) ad-hoc decision. Clinician-scientists exchange knowledge to enhance their own continuing professional development mainly but also contribute to the professional development of clinicians, scientists, and other clinician-scientists.
{"title":"How Clinician-Scientists Access and Mobilise Social Capital and Thus Contribute to the Professional Development of Their Colleagues in Their Networks.","authors":"Esther de Groot, Jasperina Brouwer, Yvette Baggen, Nienke Moolenaar, Manon Kluijtmans, Roger Damoiseaux","doi":"10.1080/28338073.2024.2421129","DOIUrl":"10.1080/28338073.2024.2421129","url":null,"abstract":"<p><p>Clinician-scientists, physicians who conduct research, may fulfil a bridging role in networks of health care researchers and practitioners. Within clinician-scientists' networks, knowledge sharing is thought to play a vital role in the continuing professional development of themselves and their colleagues. However, little is known about networks of clinician-scientists and how this impacts continuing professional development. Rooted in social capital theory, this study provides a mixed methods exploration of clinician-scientists' networks. Ego-level social network data were collected via semi-structured interviews on professional interactions about evidence-based practice with 15 clinician-scientists in the area of general practice and elderly care. Quantitative analysis revealed that professional networks of clinician-scientists varied in size, composition, and frequency of interactions depending on appointed research time and experience. Less experienced clinician-scientists interacted most frequently with other clinician-scientists while experienced clinician-scientist experienced more sporadically with clinicians. Clinician-scientists with more research time interacted more frequently with scientists and had a slightly larger professional network than those with less research time. The thematic qualitative analysis revealed different decision-making processes of clinician-scientists on mobilising their social capital and connecting to others in the network: (1) deliberate decision about initiating connections; (2) reactive behaviour without a decision; (3) ad-hoc decision. Clinician-scientists exchange knowledge to enhance their own continuing professional development mainly but also contribute to the professional development of clinicians, scientists, and other clinician-scientists.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11536690/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142585189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-03eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2420475
Dalil Asmaou Bouba, Lucas Gomes Souza, Suélène Georgina Dofara, Sabrina Guay-Bélanger, Souleymane Gadio, Diogo Mochcovitch, Jean-Sébastien Paquette, Shigeko Seiko Izumi, Patrick Archambault, Annette M Totten, Louis-Paul Rivest, France Légaré
We aimed to measure the sustainability of health professionals' intention to have serious illness conversations with patients using the Serious Illness Conversation Guide (SICG) after individual-focused training versus team-based training. In a cluster randomised trial, we trained healthcare professionals in 40 primary care clinics and measured their intention to hold serious illness conversations immediately (T1), after 1 year (T2) and after 2 years (T3). Primary care clinics (n = 40) were randomly assigned to individual-focused training (comparator) or team-based training (intervention). Average age of the 373 participants was 35-44 years, 79% were women. On a scale of 1 to 7, at T1, the mean intention was 5.33 (SD 0.20) in the individual-focused group and 5.36 (SD 0.18) in the team-based group; at T2, these scores were 4.94 (SD 0.23) and 4.87 (SD 0.21) and at T3, 5.14 (SD 0.24) and 4.59 (SD 0.21), respectively. At T3, the difference in mean intention between study groups had a significant p-value of 0.01. Intention to have serious illness conversations was lower at T2 and T3 after team-based training than after individual-focused training, with a significant difference at 2 years in favour of individual-focused training. Health professionals reported not enough time during consultations for serious illness conversations as a major barrier.
Registration number: ClinicalTrials.gov (ID NCT03577002) for the parent clinical trial.
{"title":"Long-Term Effects of Individual-Focused and Team-Based Training on Health Professionals' Intention to Have Serious Illness Conversations: A Cluster Randomised Trial.","authors":"Dalil Asmaou Bouba, Lucas Gomes Souza, Suélène Georgina Dofara, Sabrina Guay-Bélanger, Souleymane Gadio, Diogo Mochcovitch, Jean-Sébastien Paquette, Shigeko Seiko Izumi, Patrick Archambault, Annette M Totten, Louis-Paul Rivest, France Légaré","doi":"10.1080/28338073.2024.2420475","DOIUrl":"10.1080/28338073.2024.2420475","url":null,"abstract":"<p><p>We aimed to measure the sustainability of health professionals' intention to have serious illness conversations with patients using the Serious Illness Conversation Guide (SICG) after individual-focused training versus team-based training. In a cluster randomised trial, we trained healthcare professionals in 40 primary care clinics and measured their intention to hold serious illness conversations immediately (T1), after 1 year (T2) and after 2 years (T3). Primary care clinics (<i>n</i> = 40) were randomly assigned to individual-focused training (comparator) or team-based training (intervention). Average age of the 373 participants was 35-44 years, 79% were women. On a scale of 1 to 7, at T1, the mean intention was 5.33 (SD 0.20) in the individual-focused group and 5.36 (SD 0.18) in the team-based group; at T2, these scores were 4.94 (SD 0.23) and 4.87 (SD 0.21) and at T3, 5.14 (SD 0.24) and 4.59 (SD 0.21), respectively. At T3, the difference in mean intention between study groups had a significant p-value of 0.01. Intention to have serious illness conversations was lower at T2 and T3 after team-based training than after individual-focused training, with a significant difference at 2 years in favour of individual-focused training. Health professionals reported not enough time during consultations for serious illness conversations as a major barrier.</p><p><strong>Registration number: </strong>ClinicalTrials.gov (ID NCT03577002) for the parent clinical trial.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11536683/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142585190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-30eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2420373
Katie Stringer Lucero, Donald E Moore
A considerable amount of continuing professional development (CPD) for health professionals is online and voluntary. There is evidence that some CPD activities impact clinical practice outcomes from self-reported and objective, administrative data. Some studies have shown that there is a potential mediating effect of knowledge/competency and/or self-efficacy between participation in CPD activities and the outcomes of that participation, specifically clinical practice. However, because clinical practice in those studies has been self-report, little is known about how this relationship impacts real world clinical practice. The purpose of the current study is to examine the relationship between knowledge/competency, self-efficacy, and real-world clinical practice so that we can begin to understand whether our focus on knowledge/competency and self-efficacy to change real-world clinical practice is empirically supported. We employed secondary data analysis from pre-participation questionnaire and medical and pharmacy claims data originally collected in three evaluations of online CPD interventions to examine if the relationship between knowledge/competency and self-efficacy contributed to physicians' real-world clinical practice. Results show an association between knowledge/competency scores and ratings of self-efficacy and suggest unique contributions of knowledge/competency and self-efficacy to clinical practice. Study results support the value of knowledge/competency scores and self-efficacy ratings as predictors of clinical practice. The effect size was larger for self-efficacy suggesting it may be a more practical indicator of clinical practice for CPD evaluators because its process of question development is simpler than the process for knowledge and case-based decision-making questions. However, it is important to conduct thorough need assessments which may include knowledge/competency assessments to identify topics to cover in CPD activities that are more likely to increase self-efficacy and ultimately, clinical practice.
{"title":"A Systematic Investigation of Assessment Scores, Self-Efficacy, and Clinical Practice: Are They Related?","authors":"Katie Stringer Lucero, Donald E Moore","doi":"10.1080/28338073.2024.2420373","DOIUrl":"10.1080/28338073.2024.2420373","url":null,"abstract":"<p><p>A considerable amount of continuing professional development (CPD) for health professionals is online and voluntary. There is evidence that some CPD activities impact clinical practice outcomes from self-reported and objective, administrative data. Some studies have shown that there is a potential mediating effect of knowledge/competency and/or self-efficacy between participation in CPD activities and the outcomes of that participation, specifically clinical practice. However, because clinical practice in those studies has been self-report, little is known about how this relationship impacts real world clinical practice. The purpose of the current study is to examine the relationship between knowledge/competency, self-efficacy, and real-world clinical practice so that we can begin to understand whether our focus on knowledge/competency and self-efficacy to change real-world clinical practice is empirically supported. We employed secondary data analysis from pre-participation questionnaire and medical and pharmacy claims data originally collected in three evaluations of online CPD interventions to examine if the relationship between knowledge/competency and self-efficacy contributed to physicians' real-world clinical practice. Results show an association between knowledge/competency scores and ratings of self-efficacy and suggest unique contributions of knowledge/competency and self-efficacy to clinical practice. Study results support the value of knowledge/competency scores and self-efficacy ratings as predictors of clinical practice. The effect size was larger for self-efficacy suggesting it may be a more practical indicator of clinical practice for CPD evaluators because its process of question development is simpler than the process for knowledge and case-based decision-making questions. However, it is important to conduct thorough need assessments which may include knowledge/competency assessments to identify topics to cover in CPD activities that are more likely to increase self-efficacy and ultimately, clinical practice.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11533230/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142577429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-26eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2421131
Kate Runacres, Jill Garner, Chanelle Goulet, Farah Wissanji, Rhonda St Croix, Kate Marsden, Lucie Filteau, Guylaine Lefebvre, Sofia Valanci-Aroesty
Continuous professional development (CPD) is crucial for physicians to maintain and enhance their skills. In response to the changing context of CPD and health care, this study applied a design thinking approach to transform and modernise the Royal College of Physicians and Surgeons of Canada's Maintenance of Certification (MOC) Program. A member-wide survey and co-design sessions with physicians, CPD leaders, and patient representatives were conducted, emphasising the importance of their insights and experiences. The data revealed key themes for the programme such as fostering meaningful learning, addressing barriers to CPD, supporting collaboration, and responding to the need for modern, flexible CPD delivery methods. Using "empathy", "define", "ideate", "prototype", and "test" phases, we continuously refined the MOC framework of CPD activities based on comprehensive user experiences and needs insights. The revised framework was iteratively prototyped and validated to ensure it was user-friendly and aligned with professional and regulatory requirements. The findings underscore the effectiveness of the design thinking approach in creating a dynamic, responsive MOC framework that supports CPD and meets the evolving needs of medical professionals. This approach not only demonstrates the effectiveness of design thinking but also the importance of engaging users in the development process, making them feel valued and integral to the transformation of the MOC Program.
持续专业发展(CPD)对医生保持和提高技能至关重要。为了应对持续专业发展和医疗保健不断变化的环境,本研究采用了设计思维方法,对加拿大皇家内外科医学院的认证维护(MOC)计划进行改造和现代化。研究人员开展了一项全员调查,并与医生、继续医学发展领导者和患者代表举行了共同设计会议,强调了他们的见解和经验的重要性。这些数据揭示了该计划的关键主题,如促进有意义的学习、解决继续医学教育的障碍、支持合作以及满足对现代、灵活的继续医学教育实施方法的需求。通过 "移情"、"定义"、"构思"、"原型 "和 "测试 "等阶段,我们根据全面的用户体验和需求洞察,不断完善了持续专业发展活动的 MOC 框架。修订后的框架经过反复的原型设计和验证,以确保其方便用户使用,并符合专业和监管要求。研究结果强调了设计思维方法在创建动态的、反应灵敏的 MOC 框架方面的有效性,该框架支持持续专业发展,并能满足医疗专业人员不断变化的需求。这种方法不仅证明了设计思维的有效性,还证明了让用户参与开发过程的重要性,使他们感到自己受到重视,并成为医学多媒体中心计划改革不可或缺的一部分。
{"title":"Evolving Maintenance of Certification in Canada: A Collaborative Journey.","authors":"Kate Runacres, Jill Garner, Chanelle Goulet, Farah Wissanji, Rhonda St Croix, Kate Marsden, Lucie Filteau, Guylaine Lefebvre, Sofia Valanci-Aroesty","doi":"10.1080/28338073.2024.2421131","DOIUrl":"10.1080/28338073.2024.2421131","url":null,"abstract":"<p><p>Continuous professional development (CPD) is crucial for physicians to maintain and enhance their skills. In response to the changing context of CPD and health care, this study applied a design thinking approach to transform and modernise the Royal College of Physicians and Surgeons of Canada's Maintenance of Certification (MOC) Program. A member-wide survey and co-design sessions with physicians, CPD leaders, and patient representatives were conducted, emphasising the importance of their insights and experiences. The data revealed key themes for the programme such as fostering meaningful learning, addressing barriers to CPD, supporting collaboration, and responding to the need for modern, flexible CPD delivery methods. Using \"empathy\", \"define\", \"ideate\", \"prototype\", and \"test\" phases, we continuously refined the MOC framework of CPD activities based on comprehensive user experiences and needs insights. The revised framework was iteratively prototyped and validated to ensure it was user-friendly and aligned with professional and regulatory requirements. The findings underscore the effectiveness of the design thinking approach in creating a dynamic, responsive MOC framework that supports CPD and meets the evolving needs of medical professionals. This approach not only demonstrates the effectiveness of design thinking but also the importance of engaging users in the development process, making them feel valued and integral to the transformation of the MOC Program.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11514386/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142523791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-06eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2396256
Lesley Simon, Alison Livingston, Khadijah Tiamiyu, Dean Beals, Anna Muehlenhaupt, Rachel Deerr, Stan Pogroszewski, Jean Anderson
In the United States, women account for one-fourth of people living with HIV. Most women living with HIV are Black or Hispanic and acquired HIV from heterosexual contact. Many face significant barriers to appropriate medical care, with lower retention in care and viral suppression than men who acquire HIV from male-to-male sexual contact. Many factors contribute to these disparities, including high rates of alcohol abuse, substance use, intimate partner violence, depression, and socioeconomic marginalisation. HIV, substance use, and violence each contribute independently to the collective health burden on women. The co-occurrence of these factors, termed the SAVA (substance abuse, violence, and HIV/AIDS) syndemic, is particularly hard to address, as the conditions act synergistically to negatively influence health outcomes. In addition, mental health conditions frequently coexist and further contribute to adverse outcomes. Unfortunately, clinician knowledge of this syndemic is low, and patients living with HIV and other elements of SAVA, including depression, are not recognised and referred for appropriate services. In this paper we describe our pilot educational and quality improvement program and the subsequent educational program we developed to increase knowledge of SAVA with the goal of improving health outcomes for women living with HIV.
在美国,妇女占艾滋病毒感染者的四分之一。大多数感染艾滋病毒的妇女是黑人或西班牙裔,通过异性性接触感染艾滋病毒。与通过男男性行为接触感染艾滋病毒的男性相比,许多女性在获得适当的医疗护理方面面临着巨大的障碍,在护理和病毒抑制方面的保持率较低。造成这些差异的因素很多,包括酗酒率高、使用药物、亲密伴侣暴力、抑郁和社会经济边缘化。艾滋病毒、药物使用和暴力各自独立地造成了妇女的集体健康负担。这些因素同时存在,被称为 SAVA(药物滥用、暴力和艾滋病毒/艾滋病)综合症,尤其难以解决,因为这些情况协同作用,对健康结果产生负面影响。此外,精神健康状况经常并存,进一步导致不良后果。遗憾的是,临床医生对这一综合症的了解甚少,艾滋病毒感染者和包括抑郁症在内的其他 SAVA 患者没有被认识到,也没有被转介到适当的服务机构。在本文中,我们介绍了我们的试点教育和质量改进计划,以及我们为增加对 SAVA 的了解而开发的后续教育计划,目的是改善女性艾滋病感染者的健康状况。
{"title":"<i>Finding the Invisible Patient</i> to Address Substance Use, Violence, and Depression in Women Living with HIV.","authors":"Lesley Simon, Alison Livingston, Khadijah Tiamiyu, Dean Beals, Anna Muehlenhaupt, Rachel Deerr, Stan Pogroszewski, Jean Anderson","doi":"10.1080/28338073.2024.2396256","DOIUrl":"https://doi.org/10.1080/28338073.2024.2396256","url":null,"abstract":"<p><p>In the United States, women account for one-fourth of people living with HIV. Most women living with HIV are Black or Hispanic and acquired HIV from heterosexual contact. Many face significant barriers to appropriate medical care, with lower retention in care and viral suppression than men who acquire HIV from male-to-male sexual contact. Many factors contribute to these disparities, including high rates of alcohol abuse, substance use, intimate partner violence, depression, and socioeconomic marginalisation. HIV, substance use, and violence each contribute independently to the collective health burden on women. The co-occurrence of these factors, termed the <i>SAVA</i> (substance abuse, violence, and HIV/AIDS) <i>syndemic</i>, is particularly hard to address, as the conditions act synergistically to negatively influence health outcomes. In addition, mental health conditions frequently coexist and further contribute to adverse outcomes. Unfortunately, clinician knowledge of this syndemic is low, and patients living with HIV and other elements of SAVA, including depression, are not recognised and referred for appropriate services. In this paper we describe our pilot educational and quality improvement program and the subsequent educational program we developed to increase knowledge of SAVA with the goal of improving health outcomes for women living with HIV.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11382687/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142302687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-12eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2390264
L Britt Wilson, Christine DiStefano, Huijuan Wang, Erika L Blanck
The purpose of this study was to compare student performance and question discrimination of multiple-choice questions (MCQs) that followed a standard format (SF) versus those that do not follow a SF, termed here as non-standard format (NSF). Medical physiology exam results of approximately 500 first-year medical students collected over a five-year period (2020-2024) were used. Classical test theory item analysis indices, e.g. discrimination (D), point-biserial correlation (rpbis), distractor analysis for non-functional distractors (NFDs), and difficulty (p) were determined and compared across MCQ format types. The results presented here are the mean ± standard error of the mean (SEM). The analysis showed that D (0.278 ± 0.008 vs 0.228 ± 0.006) and rpbis (0.291 ± .006 vs 0.273 ± .006) were significantly higher for NSF questions compared to SF questions, indicating NSF questions provided more discriminatory power. In addition, the percentage of NFDs was lower for the NSF items compared to the SF ones (58.3 ± 0.019% vs 70.2 ± 0.015%). Also, the NSF questions proved to be more difficult relative to the SF questions (p = 0.741 ± 0.007 for NSF; p = 0.809 ± 0.006 for SF). Thus, the NSF questions discriminated better, had fewer NFDs, and were more difficult than SF questions. These data suggest that using the selected non-standard item writing questions can enhance the ability to discriminate higher performers from lower performers on MCQs as well as provide more rigour for exams.
本研究的目的是比较遵循标准格式(SF)和不遵循标准格式(此处称为非标准格式(NSF))的多项选择题(MCQ)的学生成绩和问题辨别力。该研究使用了五年内(2020-2024 年)收集的约 500 名医科一年级学生的医学生理学考试成绩。我们确定了经典测试理论的项目分析指数,如区分度(D)、点-线性相关(rpbis)、非功能性干扰项(NFD)的干扰项分析和难度(p),并对不同 MCQ 格式进行了比较。本文给出的结果为平均值±平均值标准误差(SEM)。分析表明,与 SF 题型相比,NSF 题型的 D(0.278 ± 0.008 vs 0.228 ± 0.006)和 rpbis(0.291 ± .006 vs 0.273 ± .006)明显更高,这表明 NSF 题型的区分度更高。此外,与 SF 问题相比,NSF 问题的 NFD 百分比更低(58.3 ± 0.019% vs 70.2 ± 0.015%)。此外,事实证明,NSF题目比SF题目更难(NSF题目的p = 0.741 ± 0.007;SF题目的p = 0.809 ± 0.006)。因此,与 SF 问题相比,NSF 问题的区分度更高,NFD 更少,难度更大。这些数据表明,使用精选的非标准题目可以提高在 MCQ 考试中区分成绩优秀和成绩较差学生的能力,并使考试更加严格。
{"title":"Comparison of Multiple-Choice Question Formats in a First Year Medical Physiology Course.","authors":"L Britt Wilson, Christine DiStefano, Huijuan Wang, Erika L Blanck","doi":"10.1080/28338073.2024.2390264","DOIUrl":"10.1080/28338073.2024.2390264","url":null,"abstract":"<p><p>The purpose of this study was to compare student performance and question discrimination of multiple-choice questions (MCQs) that followed a standard format (SF) versus those that do not follow a SF, termed here as non-standard format (NSF). Medical physiology exam results of approximately 500 first-year medical students collected over a five-year period (2020-2024) were used. Classical test theory item analysis indices, e.g. discrimination (D), point-biserial correlation (r<sub>pbis</sub>), distractor analysis for non-functional distractors (NFDs), and difficulty (p) were determined and compared across MCQ format types. The results presented here are the mean ± standard error of the mean (SEM). The analysis showed that D (0.278 ± 0.008 vs 0.228 ± 0.006) and r<sub>pbis</sub> (0.291 ± .006 vs 0.273 ± .006) were significantly higher for NSF questions compared to SF questions, indicating NSF questions provided more discriminatory power. In addition, the percentage of NFDs was lower for the NSF items compared to the SF ones (58.3 ± 0.019% vs 70.2 ± 0.015%). Also, the NSF questions proved to be more difficult relative to the SF questions (<i>p</i> = 0.741 ± 0.007 for NSF; <i>p</i> = 0.809 ± 0.006 for SF). Thus, the NSF questions discriminated better, had fewer NFDs, and were more difficult than SF questions. These data suggest that using the selected non-standard item writing questions can enhance the ability to discriminate higher performers from lower performers on MCQs as well as provide more rigour for exams.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11328596/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142001508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-25eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2384546
Namita Bhardwaj, Wei-Chen Lee, Kendall M Campbell
The jigsaw method which utilises peer-teaching in small-group settings permits a facilitator to incorporate active learning strategies into their educational toolbox. In November 2022, we evaluated the impact of the jigsaw method with groups stratified by post-graduate year (PGY) level. We assessed pre and post learner confidence and medical knowledge during a facilitator-led workshop. Participants were stratified into three groups who presented on the following subtopics about osteoporosis in men: (1) history and physical examination (PGY1s), (2) lab work and imaging studies (PGY2s) and (3) management and interventions (PGY3s). We evaluated if stratifying by PGY level impacted learner medical knowledge and confidence in November 2022. We had an 80% response rate from 16 actual participants from a total of 20 possible participants. Authors found a statistically significant increases in residents' confidence and medical knowledge after the training for all questions, but broad application across a variety of learners is still needed. The jigsaw method showed improvement in learner confidence about osteoporosis in men and may be implemented in teams distributed by PGY levels. Distribution by PGY level allows each team to building on their current training level to educate their peers.
{"title":"Using the Jigsaw Method to Improve Resident Confidence and Medical Knowledge About Osteoporosis in Men.","authors":"Namita Bhardwaj, Wei-Chen Lee, Kendall M Campbell","doi":"10.1080/28338073.2024.2384546","DOIUrl":"10.1080/28338073.2024.2384546","url":null,"abstract":"<p><p>The jigsaw method which utilises peer-teaching in small-group settings permits a facilitator to incorporate active learning strategies into their educational toolbox. In November 2022, we evaluated the impact of the jigsaw method with groups stratified by post-graduate year (PGY) level. We assessed pre and post learner confidence and medical knowledge during a facilitator-led workshop. Participants were stratified into three groups who presented on the following subtopics about osteoporosis in men: (1) history and physical examination (PGY1s), (2) lab work and imaging studies (PGY2s) and (3) management and interventions (PGY3s). We evaluated if stratifying by PGY level impacted learner medical knowledge and confidence in November 2022. We had an 80% response rate from 16 actual participants from a total of 20 possible participants. Authors found a statistically significant increases in residents' confidence and medical knowledge after the training for all questions, but broad application across a variety of learners is still needed. The jigsaw method showed improvement in learner confidence about osteoporosis in men and may be implemented in teams distributed by PGY levels. Distribution by PGY level allows each team to building on their current training level to educate their peers.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11275627/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141790909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-14eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2378617
Graham T McMahon, Manal Alnasser, Haya Alzouman, Lama Aldakhil, Asma Ababtain
The Saudi Commission for Health Specialties (SCFHS), the regulatory agency for health professions in the Kingdom of Saudi Arabia (KSA), sought to evolve the continuing professional development (CPD) ecosystem for the country and to promote the concept of life-long learning for healthcare professionals. SCFHS audited its own CPD accreditation system, reviewed internationally recognised CPD accreditation criteria, adopted a new set of standards, and trained its staff and provider community in their adoption. SCFHS also deployed a range of programmes and grants to support healthcare educators and researchers engaged in CPD. SCFHS recruited and trained new staff and deployed an updated IT system to support system change. The adopted criteria and standards now align with best practices, as outlined by the Accreditation Council for Continuing Medical Education (ACCME) and the International Academy for CPD Accreditation. More than 170 educators have participated in programmes to learn effective CPD pedagogy. The adoption of new standards resulted in 396 providers seeking provider accreditation. The number of CPD accredited activities produced in the KSA and approved by the SCFHS has grown from 1,000 activities in 2002 to 10,500 in 2022. With leadership support, regulatory evolution to align with best practices supports healthcare educators and effectively expands of the diversity and quality of CPD.
{"title":"Transforming Continuing Professional Development for Healthcare Professionals to Meet National Goals in Saudi Arabia.","authors":"Graham T McMahon, Manal Alnasser, Haya Alzouman, Lama Aldakhil, Asma Ababtain","doi":"10.1080/28338073.2024.2378617","DOIUrl":"10.1080/28338073.2024.2378617","url":null,"abstract":"<p><p>The Saudi Commission for Health Specialties (SCFHS), the regulatory agency for health professions in the Kingdom of Saudi Arabia (KSA), sought to evolve the continuing professional development (CPD) ecosystem for the country and to promote the concept of life-long learning for healthcare professionals. SCFHS audited its own CPD accreditation system, reviewed internationally recognised CPD accreditation criteria, adopted a new set of standards, and trained its staff and provider community in their adoption. SCFHS also deployed a range of programmes and grants to support healthcare educators and researchers engaged in CPD. SCFHS recruited and trained new staff and deployed an updated IT system to support system change. The adopted criteria and standards now align with best practices, as outlined by the Accreditation Council for Continuing Medical Education (ACCME) and the International Academy for CPD Accreditation. More than 170 educators have participated in programmes to learn effective CPD pedagogy. The adoption of new standards resulted in 396 providers seeking provider accreditation. The number of CPD accredited activities produced in the KSA and approved by the SCFHS has grown from 1,000 activities in 2002 to 10,500 in 2022. With leadership support, regulatory evolution to align with best practices supports healthcare educators and effectively expands of the diversity and quality of CPD.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11249139/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141621877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-28eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2370746
Kate Regnier, Amy Smith, Jean-Philippe Natali, Siritio Berthe, Reinhard Griebenow, Robert Schaefer, Joerg Stein, Essam Elsayed, Michel Smith
The COVID-19 pandemic has had disruptive effects on all parts of the health-care system, including the continuing education (CE) landscape. This report documents, what has happened in six different CE accreditation systems to CE activities as well as learners. Complete lockdown periods in the first part of the COVID-19 pandemic have inevitably led to reductions in numbers of the then predominant format of education, i.e. onsite in-person meetings. However, with impressive speed CE providers have switched to online educational formats. With regard to learner interactions this has compensated, and in some systems even overcompensated, the loss of in-person educational opportunities. Thus, our data convincingly demonstrate the resilience of CPD in times of a global health crisis and offer important insights in how CPD might become more effective in the future.
{"title":"Effect of COVID-19 on Continuing Education Activities and Learner Interactions: Report from Six Accreditation Systems.","authors":"Kate Regnier, Amy Smith, Jean-Philippe Natali, Siritio Berthe, Reinhard Griebenow, Robert Schaefer, Joerg Stein, Essam Elsayed, Michel Smith","doi":"10.1080/28338073.2024.2370746","DOIUrl":"10.1080/28338073.2024.2370746","url":null,"abstract":"<p><p>The COVID-19 pandemic has had disruptive effects on all parts of the health-care system, including the continuing education (CE) landscape. This report documents, what has happened in six different CE accreditation systems to CE activities as well as learners. Complete lockdown periods in the first part of the COVID-19 pandemic have inevitably led to reductions in numbers of the then predominant format of education, i.e. onsite in-person meetings. However, with impressive speed CE providers have switched to online educational formats. With regard to learner interactions this has compensated, and in some systems even overcompensated, the loss of in-person educational opportunities. Thus, our data convincingly demonstrate the resilience of CPD in times of a global health crisis and offer important insights in how CPD might become more effective in the future.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11216726/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141478129","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-12eCollection Date: 2024-01-01DOI: 10.1080/28338073.2024.2363550
Gloria Ayivi-Vinz, Martin Tremblay, Souleymane Gadio, Suélène Georgina Dofara, Sam J Daniel, Denis Talbot, France Légaré
COVID-19 accelerated continuing professional development (CPD) delivered online. We aimed to compare the impact of in-person versus online CPD courses on medical specialists' behavioural intentions and subsequent behaviour. In this comparative before-and-after study, medical specialists attended in-person courses on nine clinical topics. A second group attended an adapted online version of these courses. Behavioural intention and its psychosocial determinants were measured before and immediately after the courses. Behaviour change was measured six months later. Generalised estimating equation (GEE) models were used to compare the impact of course formats. A total of 82/206 in-person registrants (mean age: 52±10 years; 50% men) and 318/506 on-line registrants (mean age: 49±12 years; men: 63%) participated. Mean intention before in-person courses was 5.99±1.31 and 6.43±0.80 afterwards (average intention gain 0.44, CI: 0.16-0.74; p=0.003); mean intention before online courses was 5.53±1.62 and 5.98±1.40 afterwards (average intention gain of 0.45, CI: 0.30-0.58; p<0.0001). Difference in intention gain between groups was not statistically significant. Behaviour reported six months later was not significantly associated with post-course intention in either group. However, the intention difference increased significantly among those who said they had adopted the targeted behaviour (paired wilcoxon test: n = 40 and p-value=0.002) while it did not increase significantly in the group of those who had not adopted a targeted behaviour (paired wilcoxon test: n = 16 and p-value=0.223). In conclusion, the increase in intention of specialists after CPD courses was similar whether the course was in-person or online. Also, an increase in intention in both groups signalled more likelihood of adoption.
{"title":"Impact of Educational Activity Formats, Online or In-Person, on the Intention of Medical Specialists to Adopt a Clinical Behaviour: A Comparative Study.","authors":"Gloria Ayivi-Vinz, Martin Tremblay, Souleymane Gadio, Suélène Georgina Dofara, Sam J Daniel, Denis Talbot, France Légaré","doi":"10.1080/28338073.2024.2363550","DOIUrl":"10.1080/28338073.2024.2363550","url":null,"abstract":"<p><p>COVID-19 accelerated continuing professional development (CPD) delivered online. We aimed to compare the impact of in-person versus online CPD courses on medical specialists' behavioural intentions and subsequent behaviour. In this comparative before-and-after study, medical specialists attended in-person courses on nine clinical topics. A second group attended an adapted online version of these courses. Behavioural intention and its psychosocial determinants were measured before and immediately after the courses. Behaviour change was measured six months later. Generalised estimating equation (GEE) models were used to compare the impact of course formats. A total of 82/206 in-person registrants (mean age: 52±10 years; 50% men) and 318/506 on-line registrants (mean age: 49±12 years; men: 63%) participated. Mean intention before in-person courses was 5.99±1.31 and 6.43±0.80 afterwards (average intention gain 0.44, CI: 0.16-0.74; <i>p</i>=0.003); mean intention before online courses was 5.53±1.62 and 5.98±1.40 afterwards (average intention gain of 0.45, CI: 0.30-0.58; <i>p</i><0.0001). Difference in intention gain between groups was not statistically significant. Behaviour reported six months later was not significantly associated with post-course intention in either group. However, the intention difference increased significantly among those who said they had adopted the targeted behaviour (paired wilcoxon test: <i>n</i> = 40 and <i>p</i>-value=0.002) while it did not increase significantly in the group of those who had not adopted a targeted behaviour (paired wilcoxon test: <i>n</i> = 16 and <i>p</i>-value=0.223). In conclusion, the increase in intention of specialists after CPD courses was similar whether the course was in-person or online. Also, an increase in intention in both groups signalled more likelihood of adoption.</p>","PeriodicalId":73675,"journal":{"name":"Journal of CME","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11172255/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141319170","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}