首页 > 最新文献

MedEdPublish (2016)最新文献

英文 中文
The impact of interviewer characteristics on residency candidate scores in Emergency Medicine: a brief report. 面试官特征对急诊医学专业住院医师候选人分数的影响:简要报告。
Pub Date : 2024-02-13 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19735.2
Ryan F Coughlin, Jessica Bod, D Brian Wood, Katja Goldflam, David Della-Giustina, Melissa Joseph, Dylan Devlin, Ambrose H Wong, Alina Tsyrulnik

Background: At the conclusion of residency candidate interview days, faculty interviewers commonly meet as a group to reach conclusions about candidate evaluations based on shared information. These conclusions ultimately translate into rank list position for The Residency Match. The primary objective is to determine if the post-interview discussion influences the final scores assigned by each interviewer, and to investigate whether interviewer characteristics are significantly associated with the likelihood of changing their score. Based on Foucault's 'theory of discourse' and Bourdieu's 'social capital theory,' we hypothesized that interviewer characteristics, and the discourse itself, would contribute to score changes after a post-interview discussion regarding emergency medicine residency candidates.

Methods: We conducted a cross-sectional observational study of candidate scores for all candidates to a four-year emergency medicine residency program affiliated with Yale University School of Medicine during a single application cycle. The magnitude and direction of score changes, if any, after group discussion were plotted and grouped by interviewer academic rank. We created a logistic regression model to determine the odds that candidate scores changed from pre- and post-discussion ratings related to specific interviewer factors.

Results: A total of 24 interviewers and 211 candidates created 471 unique interviewer-candidate scoring interactions, with 216 (45.8%) changing post-discussion. All interviewers ranked junior to professor were significantly more likely to change their score compared to professors. Interviewers who were women had significantly lower odds of changing their individual scores following group discussion (p=0.020; OR 0.49, 95% CI 0.26-0.89).

Conclusions: Interviewers with lower academic rank had higher odds of changing their post-discussion scores of residency candidates compared to professors. Future work is needed to further characterize the influencing factors and could help create more equitable decision processes during the residency candidate ranking process.

背景:在住院医师候选人面试日结束时,教员面试官通常会集体开会,根据共享信息对候选人的评价做出结论。这些结论最终会转化为住院医师匹配的排名表位置。本研究的主要目的是确定面试后的讨论是否会影响每位面试官给出的最终分数,并调查面试官的特征是否与改变分数的可能性有显著关联。根据福柯的 "话语理论 "和布迪厄的 "社会资本理论",我们假设面试官的特点和话语本身将有助于急诊科住院医师候选人面试后讨论后分数的变化:我们对耶鲁大学医学院附属四年制急诊医学住院医师项目的所有候选人在一个申请周期内的得分进行了横断面观察研究。我们绘制了小组讨论后分数变化的幅度和方向(如有),并按面试官的学术级别进行了分组。我们建立了一个逻辑回归模型,以确定候选人分数在讨论前后发生变化的几率与面试官的具体因素有关:共有 24 名面试官和 211 名应聘者参与了 471 次面试官与应聘者之间的评分互动,其中 216 次(45.8%)在讨论后发生了变化。与教授相比,所有从初级到教授级别的面试官都更有可能改变自己的评分。女性面试官在小组讨论后改变个人分数的几率明显较低(P=0.020;OR 0.49,95% CI 0.26-0.89):结论:与教授相比,学术级别较低的面试官在讨论后改变住院医师候选人分数的几率更高。未来的工作需要进一步确定影响因素的特征,这将有助于在住院医师候选人排名过程中建立更公平的决策程序。
{"title":"The impact of interviewer characteristics on residency candidate scores in Emergency Medicine: a brief report.","authors":"Ryan F Coughlin, Jessica Bod, D Brian Wood, Katja Goldflam, David Della-Giustina, Melissa Joseph, Dylan Devlin, Ambrose H Wong, Alina Tsyrulnik","doi":"10.12688/mep.19735.2","DOIUrl":"10.12688/mep.19735.2","url":null,"abstract":"<p><strong>Background: </strong>At the conclusion of residency candidate interview days, faculty interviewers commonly meet as a group to reach conclusions about candidate evaluations based on shared information. These conclusions ultimately translate into rank list position for The Residency Match. The primary objective is to determine if the post-interview discussion influences the final scores assigned by each interviewer, and to investigate whether interviewer characteristics are significantly associated with the likelihood of changing their score. Based on Foucault's 'theory of discourse' and Bourdieu's 'social capital theory,' we hypothesized that interviewer characteristics, and the discourse itself, would contribute to score changes after a post-interview discussion regarding emergency medicine residency candidates.</p><p><strong>Methods: </strong>We conducted a cross-sectional observational study of candidate scores for all candidates to a four-year emergency medicine residency program affiliated with Yale University School of Medicine during a single application cycle. The magnitude and direction of score changes, if any, after group discussion were plotted and grouped by interviewer academic rank. We created a logistic regression model to determine the odds that candidate scores changed from pre- and post-discussion ratings related to specific interviewer factors.</p><p><strong>Results: </strong>A total of 24 interviewers and 211 candidates created 471 unique interviewer-candidate scoring interactions, with 216 (45.8%) changing post-discussion. All interviewers ranked junior to professor were significantly more likely to change their score compared to professors. Interviewers who were women had significantly lower odds of changing their individual scores following group discussion (p=0.020; OR 0.49, 95% CI 0.26-0.89).</p><p><strong>Conclusions: </strong>Interviewers with lower academic rank had higher odds of changing their post-discussion scores of residency candidates compared to professors. Future work is needed to further characterize the influencing factors and could help create more equitable decision processes during the residency candidate ranking process.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"205"},"PeriodicalIF":0.0,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10933563/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140121536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Medical education in Bangladesh from Student and Teacher's Perspective: Impact and challenges of the COVID-19 pandemic. 从学生和教师的角度看孟加拉国的医学教育:COVID-19 大流行的影响和挑战。
Pub Date : 2024-02-05 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19761.2
M Wakilur Rahman, Md Mahfuzul Hasan, Md Salauddin Palash, Md Asaduzzaman

Background: In low- and middle-income countries like Bangladesh, where medical education faces a range of challenges-such as lack of infrastructure, well-trained educators, and advanced technologies, abrupt changes in methodologies without adequate preparation are more challenging than in higher-income countries. This was worsened during the COVID-19 pandemic and these challenges have resulted in a change in medical education methodology. This study assesses the medical education procedure, impacts and adaptation strategies and challenges of the COVID-19 pandemic in the medical education system of Bangladesh from learners' as well as educators' perspectives.

Methods: The study collected data from 22 Medical Colleges/Universities across 18 districts of eight divisions using quantitative and qualitative methods. A total of 408 samples were collected consisting of 316 from students and 92 from medical teachers. Descriptive analysis and probit model were performed for obtaining results.

Results: The efficacy of online learning was questionable, but results showed that it was more effective for theory classes (92.4%) followed by clinical classes (75.63%) and the efficacy rate was low for practical classes (54.11%). All types of classes (theory, practical and clinical) are currently using mixed methods to some extent in medical education in Bangladesh. Regarding impacts and adaptation strategy, approximately 75.3% of the students surveyed expressed their acceptance of online education. Over 80% of the participants acknowledged the advantages of online learning, highlighting the freedom to learn from home, cost and time savings, and avoiding physical closeness with other students as major benefits.

Conclusions: To address future challenges like the COVID-19 pandemic in medical education in Bangladesh, a comprehensive policy approach such as strengthening technological infrastructure, promoting blended learning approaches, enhancing faculty training and support, integrating telemedicine into the curriculum, and continuously evaluating and improving policies and interventions can enhance the resilience of its medical education system, and prepare for future challenges.

背景:在孟加拉国这样的中低收入国家,医学教育面临着一系列挑战--如缺乏基础设施、训练有素的教育工作者和先进技术,在没有充分准备的情况下突然改变教学方法比在高收入国家更具挑战性。在 COVID-19 大流行期间,这种情况更加严重,这些挑战导致了医学教育方法的改变。本研究从学习者和教育者的角度评估了孟加拉国医学教育系统中的医学教育程序、COVID-19 大流行的影响和适应策略及挑战:研究采用定量和定性方法,从 8 个省 18 个县的 22 所医学院/大学收集数据。共收集了 408 份样本,其中 316 份来自学生,92 份来自医学教师。研究采用描述性分析和 probit 模型得出结果:在线学习的效果值得商榷,但结果显示,在线学习对理论课(92.4%)更有效,其次是临床课(75.63%),而对实践课(54.11%)的有效率较低。目前,在孟加拉国的医学教育中,所有类型的课程(理论、实践和临床)都在一定程度上使用混合方法。关于影响和适应策略,约 75.3%的受访学生表示接受在线教育。超过 80% 的参与者承认在线学习的优势,强调在家学习的自由、节约成本和时间以及避免与其他学生的实际接触是其主要优势:为了应对未来的挑战,如 COVID-19 在孟加拉国医学教育中的流行,一个全面的政策方法,如加强技术基础设施、推广混合式学习方法、加强教师培训和支持、将远程医疗纳入课程以及不断评估和改进政策和干预措施,可以增强其医学教育系统的复原力,并为未来的挑战做好准备。
{"title":"Medical education in Bangladesh from Student and Teacher's Perspective: Impact and challenges of the COVID-19 pandemic.","authors":"M Wakilur Rahman, Md Mahfuzul Hasan, Md Salauddin Palash, Md Asaduzzaman","doi":"10.12688/mep.19761.2","DOIUrl":"10.12688/mep.19761.2","url":null,"abstract":"<p><strong>Background: </strong>In low- and middle-income countries like Bangladesh, where medical education faces a range of challenges-such as lack of infrastructure, well-trained educators, and advanced technologies, abrupt changes in methodologies without adequate preparation are more challenging than in higher-income countries. This was worsened during the COVID-19 pandemic and these challenges have resulted in a change in medical education methodology. This study assesses the medical education procedure, impacts and adaptation strategies and challenges of the COVID-19 pandemic in the medical education system of Bangladesh from learners' as well as educators' perspectives.</p><p><strong>Methods: </strong>The study collected data from 22 Medical Colleges/Universities across 18 districts of eight divisions using quantitative and qualitative methods. A total of 408 samples were collected consisting of 316 from students and 92 from medical teachers. Descriptive analysis and probit model were performed for obtaining results.</p><p><strong>Results: </strong>The efficacy of online learning was questionable, but results showed that it was more effective for theory classes (92.4%) followed by clinical classes (75.63%) and the efficacy rate was low for practical classes (54.11%). All types of classes (theory, practical and clinical) are currently using mixed methods to some extent in medical education in Bangladesh. Regarding impacts and adaptation strategy, approximately 75.3% of the students surveyed expressed their acceptance of online education. Over 80% of the participants acknowledged the advantages of online learning, highlighting the freedom to learn from home, cost and time savings, and avoiding physical closeness with other students as major benefits.</p><p><strong>Conclusions: </strong>To address future challenges like the COVID-19 pandemic in medical education in Bangladesh, a comprehensive policy approach such as strengthening technological infrastructure, promoting blended learning approaches, enhancing faculty training and support, integrating telemedicine into the curriculum, and continuously evaluating and improving policies and interventions can enhance the resilience of its medical education system, and prepare for future challenges.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"209"},"PeriodicalIF":0.0,"publicationDate":"2024-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11058450/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140860942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
E-learning modules to improve clinical reasoning and practice: a prospective comparative study. 改善临床推理和实践的电子学习模块:前瞻性比较研究。
Pub Date : 2024-01-05 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19449.2
Fabiola Stollar, Bernard Cerutti, Susanne Aujesky, Daniel Scherly, Mathieu Nendaz, Annick Galetto-Lacour

Background: Controversy remains about whether e-learning can improve clinical competences. Our study aimed to compare the effects of e-learning versus traditional education on medical students' reasoning and how they applied their knowledge to clinical competences, assess factors associated with e-learning that might influence exam scores, and evaluate medical students' satisfaction with these two learning methods.

Methods: Prospective study of 299 medical students in two fourth-year pediatric clerkship cohorts (2016-17 and 2017-18) in Switzerland.

Results: We found no evidence of a difference in students' reasoning or how they applied their knowledge to competences in clinical case resolution, whether they had followed e-learning modules or attended traditional lectures. The number of quizzes taken and being female were factors associated with better scores. Even though overall satisfaction with the two learning methods was similar, students claimed that they learned more in e-learning than in traditional lectures and that e-learning explained learning objectives better.

Conclusions: E-learning could be used as a supplement or alternative to traditional face-to-face medical teaching methods without compromising teaching quality. E-learning modules should be better integrated into medical students' curricula but avoid the risk of curriculum overload, especially in case of repeated COVID-like context.

背景:关于电子学习能否提高临床能力的争议依然存在。我们的研究旨在比较电子学习与传统教育对医学生推理能力的影响,以及他们如何将知识应用于临床能力,评估可能影响考试分数的电子学习相关因素,并评价医学生对这两种学习方法的满意度:对瑞士两届(2016-17 学年和 2017-18 学年)四年级儿科实习生中的 299 名医学生进行前瞻性研究:结果:我们没有发现任何证据表明,学生在推理或如何将知识应用于临床病例解决能力方面存在差异,无论他们是学习了电子学习模块还是参加了传统讲座。参加测验的次数和女性是获得较高分数的相关因素。尽管学生对两种学习方法的总体满意度相似,但他们认为电子学习比传统授课学到的东西更多,而且电子学习对学习目标的解释更好:结论:电子学习可作为传统面授医学教学方法的补充或替代方法,同时不会影响教学质量。电子学习模块应更好地融入医科学生的课程,但应避免课程负担过重的风险,尤其是在重复类似 COVID 的情况下。
{"title":"E-learning modules to improve clinical reasoning and practice: a prospective comparative study.","authors":"Fabiola Stollar, Bernard Cerutti, Susanne Aujesky, Daniel Scherly, Mathieu Nendaz, Annick Galetto-Lacour","doi":"10.12688/mep.19449.2","DOIUrl":"10.12688/mep.19449.2","url":null,"abstract":"<p><strong>Background: </strong>Controversy remains about whether e-learning can improve clinical competences. Our study aimed to compare the effects of e-learning versus traditional education on medical students' reasoning and how they applied their knowledge to clinical competences, assess factors associated with e-learning that might influence exam scores, and evaluate medical students' satisfaction with these two learning methods.</p><p><strong>Methods: </strong>Prospective study of 299 medical students in two fourth-year pediatric clerkship cohorts (2016-17 and 2017-18) in Switzerland.</p><p><strong>Results: </strong>We found no evidence of a difference in students' reasoning or how they applied their knowledge to competences in clinical case resolution, whether they had followed e-learning modules or attended traditional lectures. The number of quizzes taken and being female were factors associated with better scores. Even though overall satisfaction with the two learning methods was similar, students claimed that they learned more in e-learning than in traditional lectures and that e-learning explained learning objectives better.</p><p><strong>Conclusions: </strong>E-learning could be used as a supplement or alternative to traditional face-to-face medical teaching methods without compromising teaching quality. E-learning modules should be better integrated into medical students' curricula but avoid the risk of curriculum overload, especially in case of repeated COVID-like context.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"39"},"PeriodicalIF":0.0,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11134138/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141176765","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking medical students. 对英语非母语的医科学生进行医学英语技能同伴辅助教学的效果。
Pub Date : 2023-12-28 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19694.2
Ahmad Al Shihabi, Heba Mardini, Ahmad N Alkhaledi, Lana Jarad, Rama Jaber, Ramez Jaber, Sara Naoura, Mohammad Bashar Izzat

Background: Peer-assisted learning has been shown to be constructive in numerous aspects of undergraduate medical education. The purpose of this study was to evaluate the effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking students.

Methods: A medical English conversation course was conducted at Damascus University by a group of students. Targeted participants were intermediate level fellow students from the same program. A longitudinal study was carried out between 1 st to 31 st March 2019 to assess changes in self-assessment of English language skills among course participants. Pre- and post-course appraisal involved a review of previous experience with medical English language, a self-assessment of five English language skills, and an objective measurement of medical English knowledge. In addition, participants were requested to respond to a set of statements related to the importance and the usefulness of peer-assisted teaching of medical English skills. Paired-sample Student t-test was used to compare pre- and post-course appraisal results.

Results: 42 students attended the course and completed pre- and post-course appraisals in full. Data analyses showed a statistically significant increase in participants' confidence in speaking medical English in public ( p<0.001) and using English in various medical settings (presenting and discussing cases, writing clinical reports, interviewing patients and reading English medical texts). Objective measurements of medical English knowledge confirmed a significant increase in participants' knowledge of methods of administration of therapeutics, knowledge of human body parts in English and familiarity with English medical abbreviations. Most participants agreed that peer-education was effective in teaching medical English skills to non-native English-speaking students and in increasing their confidence when using English in real-life medical scenarios.

Conclusions: The present study highlights the effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking medical students. Further validation is required and should compare the effectiveness of traditional versus peer-assisted teaching approaches.

背景:在本科医学教育的许多方面,同伴辅助学习已被证明具有建设性。本研究的目的是评估对英语非母语学生进行医学英语技能同伴辅助教学的有效性:方法:一组学生在大马士革大学开设了医学英语会话课程。目标学员是来自同一专业的中级水平的同学。在 2019 年 3 月 1 日至 31 日期间开展了一项纵向研究,以评估课程参与者英语语言技能自我评估的变化。课前和课后评估包括对以往医学英语语言经验的回顾、对五项英语语言技能的自我评估以及对医学英语知识的客观测量。此外,还要求学员回答一组与医学英语技能同伴辅助教学的重要性和实用性相关的陈述。采用配对样本学生 t 检验比较课程前后的评估结果:结果:42 名学生参加了课程,并完整填写了课程前后的评价。数据分析显示,学员在公共场合说医学英语的自信心有了统计学意义上的显著提高(pConclusions):本研究强调了对母语非英语的医学生进行医学英语技能同伴辅助教学的有效性。还需要进一步验证,并比较传统教学法与同伴辅助教学法的效果。
{"title":"Effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking medical students.","authors":"Ahmad Al Shihabi, Heba Mardini, Ahmad N Alkhaledi, Lana Jarad, Rama Jaber, Ramez Jaber, Sara Naoura, Mohammad Bashar Izzat","doi":"10.12688/mep.19694.2","DOIUrl":"10.12688/mep.19694.2","url":null,"abstract":"<p><strong>Background: </strong>Peer-assisted learning has been shown to be constructive in numerous aspects of undergraduate medical education. The purpose of this study was to evaluate the effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking students.</p><p><strong>Methods: </strong>A medical English conversation course was conducted at Damascus University by a group of students. Targeted participants were intermediate level fellow students from the same program. A longitudinal study was carried out between 1 <sup>st</sup> to 31 <sup>st</sup> March 2019 to assess changes in self-assessment of English language skills among course participants. Pre- and post-course appraisal involved a review of previous experience with medical English language, a self-assessment of five English language skills, and an objective measurement of medical English knowledge. In addition, participants were requested to respond to a set of statements related to the importance and the usefulness of peer-assisted teaching of medical English skills. Paired-sample Student <i>t</i>-test was used to compare pre- and post-course appraisal results.</p><p><strong>Results: </strong>42 students attended the course and completed pre- and post-course appraisals in full. Data analyses showed a statistically significant increase in participants' confidence in speaking medical English in public ( <i>p</i><0.001) and using English in various medical settings (presenting and discussing cases, writing clinical reports, interviewing patients and reading English medical texts). Objective measurements of medical English knowledge confirmed a significant increase in participants' knowledge of methods of administration of therapeutics, knowledge of human body parts in English and familiarity with English medical abbreviations. Most participants agreed that peer-education was effective in teaching medical English skills to non-native English-speaking students and in increasing their confidence when using English in real-life medical scenarios.</p><p><strong>Conclusions: </strong>The present study highlights the effectiveness of peer-assisted teaching of medical English skills to non-native English-speaking medical students. Further validation is required and should compare the effectiveness of traditional versus peer-assisted teaching approaches.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"36"},"PeriodicalIF":0.0,"publicationDate":"2023-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10831228/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139673804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Student perceptions of handover diaries and reflective learning in an undergraduate MBChB anatomy course. 在本科解剖学硕士课程中,学生对交接日记和反思性学习的看法。
Pub Date : 2023-12-05 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19946.1
Seaneen McDougall

Background: The time spent on basic sciences, including clinical anatomy, is decreasing in many medical curricula. While dissection is often seen as a cornerstone of medical education, there is increasing pressure to ensure time spent undertaking dissection is an efficient use of student time. As part of an MBChB clinical anatomy course , 1 st year students were asked to complete 'dissection handover diaries', designed through evidence-based pedagogy on reflection and engagement, which encouraged them to reflect on the dissection session and consider clinical applications of the anatomy covered in the session. Student engagement with an activity is important for it to be beneficial to their educational experience. This engagement is often increased when students perceive the activity to be useful to their learning.

Methods: A survey was conducted, over two practical lab sessions on the final day of year one dissection in March 2023, using five Likert-type questions and one free-text question to evaluate student perceptions of the newly introduced dissection handover diaries. The survey was developed based on similar studies investigating student preference in dissection-based activities and questions were designed to elicit student perceptions on the usefulness of the diaries with respect to encouraging reflection, clinical application and student engagement in the sessions. Students were asked for constructive comments about the diaries in a free-text response question. Analysis was conducted using quantitative frequency distributions of survey responses as well as qualitative thematic analysis of the free text question.

Results: Of a total of 228 students, 64 participated in the survey, a response rate of 28%. The results were positive overall, with many respondents identifying the diaries as beneficial for reflection, consolidation, clinical application, and engagement.

Conclusions: Students perceived the dissection handover diaries to be useful to their anatomical learning, as well as encouraging reflection and application of knowledge.

背景:在许多医学课程中,用于基础科学(包括临床解剖学)的时间正在减少。虽然解剖通常被视为医学教育的基石,但要确保学生有效利用解剖时间的压力也越来越大。作为 MBChB 临床解剖学课程的一部分,一年级学生被要求完成 "解剖交接日记",该日记是根据反思和参与的循证教学法设计的,鼓励他们对解剖课程进行反思,并考虑课程中涉及的解剖学知识在临床上的应用。学生参与一项活动对他们的教育体验非常重要。当学生认为活动对他们的学习有用时,参与度往往会提高:在 2023 年 3 月一年级解剖学最后一天的两节实践实验课上进行了一项调查,使用五个李克特类型的问题和一个自由文本问题来评估学生对新引入的解剖交接日记的看法。该调查是在调查学生对解剖活动偏好的类似研究基础上开发的,问题旨在了解学生对日记在鼓励反思、临床应用和学生参与课程方面的作用的看法。在一个自由文本回答问题中,要求学生对日记提出建设性意见。通过对调查回答的频率分布进行定量分析,并对自由文本问题进行定性专题分析:在 228 名学生中,有 64 人参与了调查,回复率为 28%。调查结果总体上是积极的,许多受访者认为日记有利于反思、巩固、临床应用和参与:学生们认为解剖交接日记对他们的解剖学习很有帮助,同时还能鼓励反思和应用知识。
{"title":"Student perceptions of handover diaries and reflective learning in an undergraduate MBChB anatomy course.","authors":"Seaneen McDougall","doi":"10.12688/mep.19946.1","DOIUrl":"https://doi.org/10.12688/mep.19946.1","url":null,"abstract":"<p><strong>Background: </strong>The time spent on basic sciences, including clinical anatomy, is decreasing in many medical curricula. While dissection is often seen as a cornerstone of medical education, there is increasing pressure to ensure time spent undertaking dissection is an efficient use of student time. As part of an MBChB clinical anatomy course , 1 <sup>st</sup> year students were asked to complete 'dissection handover diaries', designed through evidence-based pedagogy on reflection and engagement, which encouraged them to reflect on the dissection session and consider clinical applications of the anatomy covered in the session. Student engagement with an activity is important for it to be beneficial to their educational experience. This engagement is often increased when students perceive the activity to be useful to their learning.</p><p><strong>Methods: </strong>A survey was conducted, over two practical lab sessions on the final day of year one dissection in March 2023, using five Likert-type questions and one free-text question to evaluate student perceptions of the newly introduced dissection handover diaries. The survey was developed based on similar studies investigating student preference in dissection-based activities and questions were designed to elicit student perceptions on the usefulness of the diaries with respect to encouraging reflection, clinical application and student engagement in the sessions. Students were asked for constructive comments about the diaries in a free-text response question. Analysis was conducted using quantitative frequency distributions of survey responses as well as qualitative thematic analysis of the free text question.</p><p><strong>Results: </strong>Of a total of 228 students, 64 participated in the survey, a response rate of 28%. The results were positive overall, with many respondents identifying the diaries as beneficial for reflection, consolidation, clinical application, and engagement.</p><p><strong>Conclusions: </strong>Students perceived the dissection handover diaries to be useful to their anatomical learning, as well as encouraging reflection and application of knowledge.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"305"},"PeriodicalIF":0.0,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11384193/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142302761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Formative assessments during COVID-19 pandemic: an observational study on performance and experiences of medical students. 新冠肺炎大流行期间的形成性评估:一项关于医学生表现和经历的观察性研究。
Pub Date : 2023-12-01 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19428.3
Vanessa Lavallard, Bernard Cerutti, Marie-Claude Audétat-Voirol, Barbara Broers, Julia Sader, Annick Galetto-Lacour, Stéphane Hausmann, Georges L Savoldelli, Mathieu Nendaz, Monica Escher

Background: Because of COVID-19, the 2020 written medical examinations were replaced by mandatory formative online assessments. This study aimed to determine students' performance, self-assessment of performance, and perception about the switch from a summative to a formative approach.

Methods: Medical students from year 2 to 5 (n=648) were included. They could repeat each test once or twice. They rated their performance after each attempt and were then given their score. Detailed feedback was given at the end of the session. An online survey determined medical students' perception about the reorganization of education. Two items concerned the switch from summative to formative assessments.

Results: Formative assessments involved 2385 examinees totaling 3197 attempts. Among examinees, 30.8% made at least 2 attempts. Scores increased significantly at the second attempt (median 9.4, IQR 10.8), and duration decreased (median -31.0, IQR 48.0). More than half of examinees (54.6%) underestimated their score, female students more often than male. Low performers overestimated, while high performers underestimated their scores. Students approved of the switch to formative assessments. Stress was lessened but motivation for learning decreased.

Conclusions: Medical students' better scores at a second attempt support a benefit of detailed feedback, learning time and re-test opportunity on performance. Decreased learning motivation and a minority of students repeating the formative assessments point to the positive influence of summative assessment on learning.

背景:由于新冠肺炎,2020年的书面体检被强制性的形成性在线评估所取代。本研究旨在确定学生的表现、对表现的自我评估,以及对从总结性方法转变为形成性方法的看法。方法:纳入2~5年级医学生(n=648)。他们可以将每个测试重复一到两次。他们在每次尝试后对自己的表现进行评分,然后给出分数。会议结束时提供了详细的反馈意见。一项在线调查确定了医学生对教育重组的看法。结果:形成性评估涉及2385名考生,共3197次尝试。在考生中,30.8%的考生至少进行了2次尝试。第二次尝试时成绩显著提高(中位数9.4,IQR 10.8),持续时间下降(中位数-31.0,IQR 48.0)。超过一半的考生(54.6%)低估了自己的成绩,女生比男生更容易低估自己的成绩。表现较差的人高估了自己的分数,而表现较好的人低估了自己的得分。学生们赞成改为形成性评估。压力减轻了,但学习动机降低了。结论:医学生在第二次尝试中的更好成绩有助于获得详细的反馈、学习时间和重新测试成绩的机会。学习动机的降低和少数学生重复形成性评估表明了终结性评估对学习的积极影响。
{"title":"Formative assessments during COVID-19 pandemic: an observational study on performance and experiences of medical students.","authors":"Vanessa Lavallard, Bernard Cerutti, Marie-Claude Audétat-Voirol, Barbara Broers, Julia Sader, Annick Galetto-Lacour, Stéphane Hausmann, Georges L Savoldelli, Mathieu Nendaz, Monica Escher","doi":"10.12688/mep.19428.3","DOIUrl":"10.12688/mep.19428.3","url":null,"abstract":"<p><strong>Background: </strong>Because of COVID-19, the 2020 written medical examinations were replaced by mandatory formative online assessments. This study aimed to determine students' performance, self-assessment of performance, and perception about the switch from a summative to a formative approach.</p><p><strong>Methods: </strong>Medical students from year 2 to 5 (n=648) were included. They could repeat each test once or twice. They rated their performance after each attempt and were then given their score. Detailed feedback was given at the end of the session. An online survey determined medical students' perception about the reorganization of education. Two items concerned the switch from summative to formative assessments.</p><p><strong>Results: </strong>Formative assessments involved 2385 examinees totaling 3197 attempts. Among examinees, 30.8% made at least 2 attempts. Scores increased significantly at the second attempt (median 9.4, IQR 10.8), and duration decreased (median -31.0, IQR 48.0). More than half of examinees (54.6%) underestimated their score, female students more often than male. Low performers overestimated, while high performers underestimated their scores. Students approved of the switch to formative assessments. Stress was lessened but motivation for learning decreased.</p><p><strong>Conclusions: </strong>Medical students' better scores at a second attempt support a benefit of detailed feedback, learning time and re-test opportunity on performance. Decreased learning motivation and a minority of students repeating the formative assessments point to the positive influence of summative assessment on learning.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"7"},"PeriodicalIF":0.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10628360/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71523756","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Masters in health professions education programs as they choose to represent themselves: A website review. 卫生专业教育硕士课程,因为他们选择代表自己:网站回顾。
Pub Date : 2023-11-30 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19498.2
Janse Schermerhorn, Shelby Wilcox, Steven Durning, Joseph Costello, Candace Norton, Holly Meyer

Introduction: In an age of increasingly face-to-face, blended, and online Health Professions Education, students have more choices of institutions at which to study their degree. For an applicant, oftentimes, the first step is to learn more about a program through its website. Websites allow programs to convey their unique voice and to share their mission and values with others such as applicants, researchers, and academics. Additionally, as the number of master in health professions education (MHPE), or equivalent, programs rapidly grows, websites can share the priorities of these programs.

Methods: In this study, we conducted a website review of 158 MHPE websites to explore their geographical distributions, missions, educational concentrations, and various programmatic components.

Results: We compiled this information and synthesized pertinent aspects, such as program similarities and differences, or highlighted the omission of critical data.

Conclusions: Given that websites are often the first point of contact for prospective applicants, curious collaborators, and potential faculty, the digital image of MHPE programs matters. We believe our findings demonstrate opportunities for growth within institutions and assist the field in identifying the priorities of MHPE programs. As programs begin to shape their websites with more intentionality, they can reflect their relative divergence/convergence compared to other programs as they see fit and, therefore, attract individuals to best match this identity. Periodic reviews of the breadth of programs, such as those undergone here, are necessary to capture diversifying goals, and serves to help advance the field of MHPE as a whole.

导言:在面授、混合式和在线卫生职业教育日益普及的时代,学生有了更多攻读学位的院校选择。对于申请者来说,第一步往往是通过网站了解一个专业。通过网站,各专业可以传达自己独特的声音,并与申请人、研究人员和学者等其他人分享自己的使命和价值观。此外,随着卫生专业教育硕士(MHPE)或同等学历项目数量的快速增长,网站可以分享这些项目的优先事项:在这项研究中,我们对 158 个 MHPE 网站进行了网站审查,以探索它们的地理分布、使命、教育重点以及各种项目内容:结果:我们汇编了这些信息,并归纳了相关方面,如项目的异同,或强调了关键数据的遗漏:鉴于网站通常是潜在申请者、好奇的合作者和潜在教师的第一接触点,因此 MHPE 项目的数字形象非常重要。我们相信,我们的研究结果表明了机构内部的发展机遇,并有助于该领域确定MHPE项目的优先事项。随着MHPE项目开始更有意识地塑造自己的网站,他们可以在自己认为合适的时候反映出自己与其他项目的相对差异/融合,从而吸引最符合这一身份的人才。对项目的广度进行定期审查是必要的,比如在这里进行的审查,以捕捉多样化的目标,并有助于推动整个MHPE领域的发展。
{"title":"Masters in health professions education programs as they choose to represent themselves: A website review.","authors":"Janse Schermerhorn, Shelby Wilcox, Steven Durning, Joseph Costello, Candace Norton, Holly Meyer","doi":"10.12688/mep.19498.2","DOIUrl":"10.12688/mep.19498.2","url":null,"abstract":"<p><strong>Introduction: </strong>In an age of increasingly face-to-face, blended, and online Health Professions Education, students have more choices of institutions at which to study their degree. For an applicant, oftentimes, the first step is to learn more about a program through its website. Websites allow programs to convey their unique voice and to share their mission and values with others such as applicants, researchers, and academics. Additionally, as the number of master in health professions education (MHPE), or equivalent, programs rapidly grows, websites can share the priorities of these programs.</p><p><strong>Methods: </strong>In this study, we conducted a website review of 158 MHPE websites to explore their geographical distributions, missions, educational concentrations, and various programmatic components.</p><p><strong>Results: </strong>We compiled this information and synthesized pertinent aspects, such as program similarities and differences, or highlighted the omission of critical data.</p><p><strong>Conclusions: </strong>Given that websites are often the first point of contact for prospective applicants, curious collaborators, and potential faculty, the digital image of MHPE programs matters. We believe our findings demonstrate opportunities for growth within institutions and assist the field in identifying the priorities of MHPE programs. As programs begin to shape their websites with more intentionality, they can reflect their relative divergence/convergence compared to other programs as they see fit and, therefore, attract individuals to best match this identity. Periodic reviews of the breadth of programs, such as those undergone here, are necessary to capture diversifying goals, and serves to help advance the field of MHPE as a whole.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"13"},"PeriodicalIF":0.0,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10714103/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138810410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Faculty development for strengthening online teaching capability: a mixed-methods study of what staff want, evaluated with Kirkpatrick's model of teaching effectiveness. 加强在线教学能力的师资队伍建设:根据柯克帕特里克教学效果模型评估教职员工需求的混合方法研究。
Pub Date : 2023-11-30 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19692.2
Rachelle Singleton, Daniela Ruiz Cosignani, Monica Kam, Megan Clune, Amanda Charlton, Tanisha Jowsey

Background: Globally, tertiary teachers are increasingly being pushed and pulled into online teaching. While most developments in online education have focused on the student perspective, few studies have reported faculty development (FD) initiatives for increasing online teaching capability and confidence from a staff perspective.

Methods: We designed and evaluated FD workshops, using five datasets, and the use of H5P software for interactive online teaching. We used educational theory to design our FD (Mayer multimedia principles, active learning) and evaluated our FD initiatives using the Best Evidence Medical Education (BEME) 2006 modified Kirkpatrick levels.

Results: Teaching staff reported that Communities of Practice were important for their learning and emotional support. Uptake and deployment of FD skills depended on the interactivity of FD sessions, their timeliness, and sufficient time allocated to attend and implement. Staff who applied FD learning to their online teaching created interactive learning resources. This content was associated with an increase in student grades, and the roll-out of an institutional site-wide H5P license.

Conclusion: This paper demonstrates an effective strategy for upskilling and upscaling faculty development. The use of H5P as a teaching tool enhances student learning. For successful FD, we make four recommendations. These are: provide just-in-time learning and allocate time for FD and staff to create online teaching material; foster supportive communities; offer personalized support; and design hands on active learning.

背景:在全球范围内,越来越多的高校教师被推向或拉入在线教学。虽然在线教育的大多数发展都集中在学生的角度,但很少有研究从教职员工的角度出发,报道提高在线教学能力和信心的教师发展(FD)举措:我们设计并评估了教师发展研讨会,使用了五个数据集,并使用 H5P 软件进行互动式在线教学。我们运用教育理论(梅耶尔多媒体原则、主动学习)来设计我们的FD,并使用2006年最佳医学教育(BEME)修订版柯克帕特里克等级来评估我们的FD计划:结果:教学人员表示,实践社区对他们的学习和情感支持非常重要。实践社群技能的吸收和运用取决于实践社群课程的互动性、及时性以及是否有足够的时间参加和实施。将 FD 学习应用于在线教学的工作人员创建了互动学习资源。这些内容与学生成绩的提高以及全校范围内 H5P 许可证的推出息息相关:本文展示了提升教师技能和扩大教师发展规模的有效策略。将 H5P 用作教学工具可以提高学生的学习效果。为取得成功,我们提出了四项建议。这些建议是:提供及时学习,为教师和员工分配时间创建在线教学材料;培养支持性社区;提供个性化支持;以及设计积极的动手学习。
{"title":"Faculty development for strengthening online teaching capability: a mixed-methods study of what staff want, evaluated with Kirkpatrick's model of teaching effectiveness.","authors":"Rachelle Singleton, Daniela Ruiz Cosignani, Monica Kam, Megan Clune, Amanda Charlton, Tanisha Jowsey","doi":"10.12688/mep.19692.2","DOIUrl":"10.12688/mep.19692.2","url":null,"abstract":"<p><strong>Background: </strong>Globally, tertiary teachers are increasingly being pushed and pulled into online teaching. While most developments in online education have focused on the student perspective, few studies have reported faculty development (FD) initiatives for increasing online teaching capability and confidence from a staff perspective.</p><p><strong>Methods: </strong>We designed and evaluated FD workshops, using five datasets, and the use of H5P software for interactive online teaching. We used educational theory to design our FD (Mayer multimedia principles, active learning) and evaluated our FD initiatives using the Best Evidence Medical Education (BEME) 2006 modified Kirkpatrick levels.</p><p><strong>Results: </strong>Teaching staff reported that Communities of Practice were important for their learning and emotional support. Uptake and deployment of FD skills depended on the interactivity of FD sessions, their timeliness, and sufficient time allocated to attend and implement. Staff who applied FD learning to their online teaching created interactive learning resources. This content was associated with an increase in student grades, and the roll-out of an institutional site-wide H5P license.</p><p><strong>Conclusion: </strong>This paper demonstrates an effective strategy for upskilling and upscaling faculty development. The use of H5P as a teaching tool enhances student learning. For successful FD, we make four recommendations. These are: provide just-in-time learning and allocate time for FD and staff to create online teaching material; foster supportive communities; offer personalized support; and design hands on active learning.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"127"},"PeriodicalIF":0.0,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10739185/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139032889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accelerating medical education with ChatGPT: an implementation guide. 利用 ChatGPT 加速医学教育:实施指南。
Pub Date : 2023-11-21 eCollection Date: 2023-01-01 DOI: 10.12688/mep.19732.2
Justin Peacock, Andrea Austin, Marina Shapiro, Alexis Battista, Anita Samuel

Chatbots powered by artificial intelligence have revolutionized many industries and fields of study, including medical education. Medical educators are increasingly asked to perform more administrative, written, and assessment functions with less time and resources. Safe use of chatbots, like ChatGPT, can help medical educators efficiently perform these functions. In this article, we provide medical educators with tips for the implementation of ChatGPT in medical education. Through creativity and careful construction of prompts, medical educators can use these and other implementations of chatbots, like ChatGPT, in their practice.

由人工智能驱动的聊天机器人已经彻底改变了许多行业和研究领域,包括医学教育。医学教育工作者越来越多地被要求以更少的时间和资源履行更多的行政、书面和评估职能。安全使用聊天机器人(如 ChatGPT)可以帮助医学教育工作者高效地履行这些职能。在本文中,我们将为医学教育者提供在医学教育中使用 ChatGPT 的技巧。通过创造力和精心设计提示,医学教育者可以在实践中使用聊天机器人(如 ChatGPT)的这些功能和其他功能。
{"title":"Accelerating medical education with ChatGPT: an implementation guide.","authors":"Justin Peacock, Andrea Austin, Marina Shapiro, Alexis Battista, Anita Samuel","doi":"10.12688/mep.19732.2","DOIUrl":"10.12688/mep.19732.2","url":null,"abstract":"<p><p>Chatbots powered by artificial intelligence have revolutionized many industries and fields of study, including medical education. Medical educators are increasingly asked to perform more administrative, written, and assessment functions with less time and resources. Safe use of chatbots, like ChatGPT, can help medical educators efficiently perform these functions. In this article, we provide medical educators with tips for the implementation of ChatGPT in medical education. Through creativity and careful construction of prompts, medical educators can use these and other implementations of chatbots, like ChatGPT, in their practice.</p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"13 ","pages":"64"},"PeriodicalIF":0.0,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10910173/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140029720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Associations between item characteristics and statistical performance for paediatric medical student multiple choice assessments 儿科医学生多项选择评估项目特征与统计表现之间的关系
Pub Date : 2023-11-08 DOI: 10.12688/mep.19764.1
Isabelle Bosi, Deborah O'Mara, Tyler Clark, Nounu Sarukkali Patabendige, Sean E. Kennedy, Hasantha Gunasekera
Background: Multiple choice questions (MCQs) are commonly used in medical student assessments but often prepared by clinicians without formal education qualifications. This study aimed to inform the question writing process by investigating the association between MCQ characteristics and commonly used statistical measures of individual item quality for a paediatric medical term. Methods: Item characteristics and statistics for five consecutive annual barrier paediatric medical student assessments (each n=60 items) were examined retrospectively. Items were characterised according to format (single best answer vs. extended matching); stem and option length; vignette presence and whether required to answer the question, inclusion of images/tables; clinical skill assessed; paediatric speciality; clinical relevance/applicability; Bloom’s taxonomy domain and item flaws. For each item, we recorded the facility (proportion of students answering correctly) and point biserial (discrimination). Results: Item characteristics significantly positively correlated (p<0.05) with facility were relevant vignette, diagnosis or application items, longer stem length and higher clinical relevance. Recall items (e.g., epidemiology items) were associated with lower facility. Characteristics significantly correlated with higher discrimination were extended matching question (EMQ) format, longer options, diagnostic and subspeciality items. Variation in item characteristics did not predict variation in the facility or point biserial (less than 10% variation explained). Conclusions: Our research supports the use of longer items, relevant vignettes, clinically-relevant content, EMQs and diagnostic items for optimising paediatric MCQ assessment quality. Variation in item characteristics explains a small amount of the observed variation in statistical measures of MCQ quality, highlighting the importance of clinical expertise in writing high quality assessments.
背景:多项选择题(mcq)通常用于医学生评估,但通常由没有正规教育资格的临床医生编写。本研究旨在通过调查MCQ特征与常用的儿科医学术语单项质量统计指标之间的关系,为问题写作过程提供信息。方法:回顾性分析连续5次年度障碍性儿科医学生评估(每次60项)的项目特征和统计数据。根据格式(单一最佳答案vs.扩展匹配)对项目进行表征;阀杆和选件长度;插图的存在和是否需要回答问题,包括图像/表格;临床技能评估;儿科专业;临床意义/适用性;Bloom的分类领域和项目缺陷。对于每个项目,我们记录了设施(正确回答的学生比例)和点双列(歧视)。结果:项目特征与设施显著正相关(p<0.05)的是相关的小插图、诊断或应用项目、较长的茎长和较高的临床相关性。召回项目(如流行病学项目)与较低的设施相关。与高歧视显著相关的特征是扩展匹配问题(EMQ)格式、较长的选项、诊断和亚专业项目。项目特征的变化不能预测设施或点双序列的变化(少于10%的变化被解释)。结论:我们的研究支持使用较长的项目、相关的小插曲、临床相关的内容、emq和诊断项目来优化儿科MCQ的评估质量。项目特征的变化解释了MCQ质量统计测量中观察到的少量变化,突出了临床专业知识在编写高质量评估中的重要性。
{"title":"Associations between item characteristics and statistical performance for paediatric medical student multiple choice assessments","authors":"Isabelle Bosi, Deborah O'Mara, Tyler Clark, Nounu Sarukkali Patabendige, Sean E. Kennedy, Hasantha Gunasekera","doi":"10.12688/mep.19764.1","DOIUrl":"https://doi.org/10.12688/mep.19764.1","url":null,"abstract":"<ns4:p><ns4:bold>Background:</ns4:bold> Multiple choice questions (MCQs) are commonly used in medical student assessments but often prepared by clinicians without formal education qualifications. This study aimed to inform the question writing process by investigating the association between MCQ characteristics and commonly used statistical measures of individual item quality for a paediatric medical term.</ns4:p><ns4:p> <ns4:bold>Methods:</ns4:bold> Item characteristics and statistics for five consecutive annual barrier paediatric medical student assessments (each n=60 items) were examined retrospectively. Items were characterised according to format (single best answer vs. extended matching); stem and option length; vignette presence and whether required to answer the question, inclusion of images/tables; clinical skill assessed; paediatric speciality; clinical relevance/applicability; Bloom’s taxonomy domain and item flaws. For each item, we recorded the facility (proportion of students answering correctly) and point biserial (discrimination).</ns4:p><ns4:p> <ns4:bold>Results:</ns4:bold> Item characteristics significantly positively correlated (p<0.05) with facility were relevant vignette, diagnosis or application items, longer stem length and higher clinical relevance. Recall items (e.g., epidemiology items) were associated with lower facility. Characteristics significantly correlated with higher discrimination were extended matching question (EMQ) format, longer options, diagnostic and subspeciality items. Variation in item characteristics did not predict variation in the facility or point biserial (less than 10% variation explained).</ns4:p><ns4:p> <ns4:bold>Conclusions:</ns4:bold> Our research supports the use of longer items, relevant vignettes, clinically-relevant content, EMQs and diagnostic items for optimising paediatric MCQ assessment quality. Variation in item characteristics explains a small amount of the observed variation in statistical measures of MCQ quality, highlighting the importance of clinical expertise in writing high quality assessments.</ns4:p>","PeriodicalId":74136,"journal":{"name":"MedEdPublish (2016)","volume":"71 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135342433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
MedEdPublish (2016)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1