Pub Date : 2025-05-31eCollection Date: 2025-10-01DOI: 10.1007/s40670-025-02433-5
Emily A Johnston, Leanne Coyne
Health professionals lack nutrition training. Food insecurity among trainees reduces performance. We aimed to support trainees in eating well on a budget and prepare them for patient encounters through "Shopping for Health," gamified grocery shopping, via Virtual Reality or website. Future work could integrate gamified nutrition education into existing training.
{"title":"Shopping for Health: An Interactive Health Professions Educational Intervention.","authors":"Emily A Johnston, Leanne Coyne","doi":"10.1007/s40670-025-02433-5","DOIUrl":"https://doi.org/10.1007/s40670-025-02433-5","url":null,"abstract":"<p><p>Health professionals lack nutrition training. Food insecurity among trainees reduces performance. We aimed to support trainees in eating well on a budget and prepare them for patient encounters through \"Shopping for Health,\" gamified grocery shopping, via Virtual Reality or website. Future work could integrate gamified nutrition education into existing training.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 5","pages":"2281-2282"},"PeriodicalIF":1.8,"publicationDate":"2025-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12812149/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146004327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-30eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02431-7
Caitlin A Hildebrand, Alice S Ammerman
Nutrition receives inadequate attention in medical training and primary care practice, and multiple barriers present challenges to adding nutrition to packed medical curricula and busy patient visits. To address the need to more adequately prepare medical students to practically address diet with patients while also considering these barriers, we implemented a required interprofessional and experiential nutrition curriculum. A prework personal dietary change assignment had positive impacts on students personally and professionally. Following the curriculum, students reported greater confidence discussing diet with patients, greater familiarity with registered dietitian (RD) services, and plans to change their own diet.
Supplementary information: The online version contains supplementary material available at 10.1007/s40670-025-02431-7.
{"title":"Teaching Medical Students Practical Nutrition Skills Through an Interprofessional and Experiential Nutrition Curriculum.","authors":"Caitlin A Hildebrand, Alice S Ammerman","doi":"10.1007/s40670-025-02431-7","DOIUrl":"https://doi.org/10.1007/s40670-025-02431-7","url":null,"abstract":"<p><p>Nutrition receives inadequate attention in medical training and primary care practice, and multiple barriers present challenges to adding nutrition to packed medical curricula and busy patient visits. To address the need to more adequately prepare medical students to practically address diet with patients while also considering these barriers, we implemented a required interprofessional and experiential nutrition curriculum. A prework personal dietary change assignment had positive impacts on students personally and professionally. Following the curriculum, students reported greater confidence discussing diet with patients, greater familiarity with registered dietitian (RD) services, and plans to change their own diet.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s40670-025-02431-7.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"1913-1919"},"PeriodicalIF":1.8,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532987/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145329960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-29eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02419-3
Emily Kwon, Rijul Asri, Jeremy Grachan, Christin Traba
Public speaking skills are essential for career advancement and success in medicine. This needs assessment evaluated the public speaking challenges faced by medical students and faculty, identifying areas where targeted training can enhance communication skills crucial for medical practice. Size and demographics (e.g., students versus attendings) of the audience population affect public speaking confidence, particularly for students. Both groups prefer practical, interactive learning methods, like workshops and peer practice. Medical schools can integrate training and practice opportunities into existing curricula, ensuring that students still receive essential communication skills development within their current programs.
Supplementary information: The online version contains supplementary material available at 10.1007/s40670-025-02419-3.
{"title":"The Voice of Physicians: The Essential Role of Public Speaking in Medical Training.","authors":"Emily Kwon, Rijul Asri, Jeremy Grachan, Christin Traba","doi":"10.1007/s40670-025-02419-3","DOIUrl":"10.1007/s40670-025-02419-3","url":null,"abstract":"<p><p>Public speaking skills are essential for career advancement and success in medicine. This needs assessment evaluated the public speaking challenges faced by medical students and faculty, identifying areas where targeted training can enhance communication skills crucial for medical practice. Size and demographics (e.g., students versus attendings) of the audience population affect public speaking confidence, particularly for students. Both groups prefer practical, interactive learning methods, like workshops and peer practice. Medical schools can integrate training and practice opportunities into existing curricula, ensuring that students still receive essential communication skills development within their current programs.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s40670-025-02419-3.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"1887-1892"},"PeriodicalIF":1.8,"publicationDate":"2025-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532966/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-29eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02421-9
Olave E Krigolson, Harvey Howse, Mathew R Hammerstrom, Alison Walzak, Bruce Wright, Kent G Hecker
Medical mistakes made while in a state of cognitive fatigue result in diagnostic errors, psychological distress, poor patient outcomes, and potentially, loss of life. To date, cognitive fatigue in health professionals is assessed via self-report; however, the reliability and validity of these measures are often challenged. Here we propose the use of mobile electroencephalography (mEEG) in a medical context as an objective cognitive fatigue assessment that is cost effective, reliable, and efficient. We had medical students complete a simulated night on call during which they diagnosed a series of simulated medical cases. Before and after their shift, we assessed cognitive fatigue using both behavioural and mEEG measures. Our results demonstrate a decrease in the amplitude of a neural response sensitive to cognitive fatigue from the start to the end of the simulated night on call - a finding associated with an increase in cognitive fatigue. Interestingly, we observed no reltionship between the neural response and subjective self-reported cognitive fatigue scores, supporting the need for objective as opposed to subjective measures when asasessing cognitive fatigue.
{"title":"Using EEG to Assess Cognitive Fatigue in Real Time: A Medical Simulation Study.","authors":"Olave E Krigolson, Harvey Howse, Mathew R Hammerstrom, Alison Walzak, Bruce Wright, Kent G Hecker","doi":"10.1007/s40670-025-02421-9","DOIUrl":"https://doi.org/10.1007/s40670-025-02421-9","url":null,"abstract":"<p><p>Medical mistakes made while in a state of cognitive fatigue result in diagnostic errors, psychological distress, poor patient outcomes, and potentially, loss of life. To date, cognitive fatigue in health professionals is assessed via self-report; however, the reliability and validity of these measures are often challenged. Here we propose the use of mobile electroencephalography (mEEG) in a medical context as an objective cognitive fatigue assessment that is cost effective, reliable, and efficient. We had medical students complete a simulated night on call during which they diagnosed a series of simulated medical cases. Before and after their shift, we assessed cognitive fatigue using both behavioural and mEEG measures. Our results demonstrate a decrease in the amplitude of a neural response sensitive to cognitive fatigue from the start to the end of the simulated night on call - a finding associated with an increase in cognitive fatigue. Interestingly, we observed no reltionship between the neural response and subjective self-reported cognitive fatigue scores, supporting the need for objective as opposed to subjective measures when asasessing cognitive fatigue.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"2099-2107"},"PeriodicalIF":1.8,"publicationDate":"2025-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-28eCollection Date: 2025-10-01DOI: 10.1007/s40670-025-02430-8
Michael Bordonaro
{"title":"Absolute Moral Certitude Is Not Consistent with Medical Science Education.","authors":"Michael Bordonaro","doi":"10.1007/s40670-025-02430-8","DOIUrl":"https://doi.org/10.1007/s40670-025-02430-8","url":null,"abstract":"","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 5","pages":"2287-2288"},"PeriodicalIF":1.8,"publicationDate":"2025-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12812127/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146004235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-28eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02425-5
Ilaisaane Foli Fakapulia, Yusuf Özgür Çakmak, Latika Samalia, Erik Wibowo
Anatomy education includes topics that are sensitive to some students due to their ethno-cultural background. Using a Tobii eye-tracker, we assessed the visual attention of New Zealand European (NZE) and Pasifika anatomy students to anatomical images. Pasifika students fixated less on surface anatomy images of the hand, male perineum, and gluteal regions than NZE students. Pasifika students fixated more on plastic model images of the gluteal, foot, and male perineum, as well as on images of the shoulder of human donors than NZE students. Ethnic background may influence the anatomy learning experience.
{"title":"Comparison of Visual Attention to Anatomical Images Between New Zealand European and Pasifika Anatomy Students.","authors":"Ilaisaane Foli Fakapulia, Yusuf Özgür Çakmak, Latika Samalia, Erik Wibowo","doi":"10.1007/s40670-025-02425-5","DOIUrl":"10.1007/s40670-025-02425-5","url":null,"abstract":"<p><p>Anatomy education includes topics that are sensitive to some students due to their ethno-cultural background. Using a Tobii eye-tracker, we assessed the visual attention of New Zealand European (NZE) and Pasifika anatomy students to anatomical images. Pasifika students fixated less on surface anatomy images of the hand, male perineum, and gluteal regions than NZE students. Pasifika students fixated more on plastic model images of the gluteal, foot, and male perineum, as well as on images of the shoulder of human donors than NZE students. Ethnic background may influence the anatomy learning experience.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"1901-1906"},"PeriodicalIF":1.8,"publicationDate":"2025-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532534/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-27eCollection Date: 2025-10-01DOI: 10.1007/s40670-025-02417-5
Tarik Tihan, Nazan Canbulat, Can Aktaş, Sibel Ölmez, Fahriye Oflaz, Hakan Abacıoğlu, Erol Gürpınar, Dilek Kitapçıoğlu, Mehmet Emin Aksoy, Gökhan Gönenli, Sevilay Çelik, Mehmet Kaya, Murat Sözer, Ferah Özer Aker, İskender Sayek
Health Professionals Education symposium, organized by the Koç Academy of Medical Education Research (KAMER), convened in October 2024 to discuss the evolving role of technology and social accountability in health professions education. The symposium adopted the concept of "healthcare professionals' education" as a unifying framework for synchronizing the training of medical and nursing students within a continuum of holistic healthcare education in low-and-middle income countries. The rationale for the symposium was to call on the dire need to improve healthcare professionals' education to reduce the increasing gap between the global north and global south. The discussion topics involved critical and current issues such as social accountability, health advocacy, and professionalism. Study groups explored aligning education with societal needs, addressing healthcare disparities, and integrating professional values into medical and nursing curricula. Presentations also focused on the integration of technology into healthcare education. Participants examined big data, artificial intelligence, simulation technologies, and digital learning platforms, identifying challenges and opportunities for their implementation. The symposium highlighted the transformative impact of interprofessional education, health advocacy, and technology in shaping socially accountable, patient-centered healthcare systems. Key recommendations included integrating community-oriented curricula, leveraging data-driven strategies for program enhancement, and expanding access to advanced educational technologies. This manuscript summarizes the symposium's conclusions and emphasizes the need to transform healthcare professionals' education in low-and-middle income countries to align with contemporary societal demands and to reduce the disparity gap.
{"title":"Critical Issues and the Impact of Technology in Healthcare Professional Education in Low-and-Middle Income Countries: A Call for Transformation: Report of the First Annual Symposium on Healthcare Academic Professionals Education (SHAPE) 2024.","authors":"Tarik Tihan, Nazan Canbulat, Can Aktaş, Sibel Ölmez, Fahriye Oflaz, Hakan Abacıoğlu, Erol Gürpınar, Dilek Kitapçıoğlu, Mehmet Emin Aksoy, Gökhan Gönenli, Sevilay Çelik, Mehmet Kaya, Murat Sözer, Ferah Özer Aker, İskender Sayek","doi":"10.1007/s40670-025-02417-5","DOIUrl":"https://doi.org/10.1007/s40670-025-02417-5","url":null,"abstract":"<p><p>Health Professionals Education symposium, organized by the Koç Academy of Medical Education Research (KAMER), convened in October 2024 to discuss the evolving role of technology and social accountability in health professions education. The symposium adopted the concept of \"healthcare professionals' education\" as a unifying framework for synchronizing the training of medical and nursing students within a continuum of holistic healthcare education in low-and-middle income countries. The rationale for the symposium was to call on the dire need to improve healthcare professionals' education to reduce the increasing gap between the global north and global south. The discussion topics involved critical and current issues such as social accountability, health advocacy, and professionalism. Study groups explored aligning education with societal needs, addressing healthcare disparities, and integrating professional values into medical and nursing curricula. Presentations also focused on the integration of technology into healthcare education. Participants examined big data, artificial intelligence, simulation technologies, and digital learning platforms, identifying challenges and opportunities for their implementation. The symposium highlighted the transformative impact of interprofessional education, health advocacy, and technology in shaping socially accountable, patient-centered healthcare systems. Key recommendations included integrating community-oriented curricula, leveraging data-driven strategies for program enhancement, and expanding access to advanced educational technologies. This manuscript summarizes the symposium's conclusions and emphasizes the need to transform healthcare professionals' education in low-and-middle income countries to align with contemporary societal demands and to reduce the disparity gap.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 5","pages":"2657-2665"},"PeriodicalIF":1.8,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12812145/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146004306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-26eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02415-7
Zara R Zaccariah, Janet Lefroy, Brianne Wenning
Background: Differential attainment is a phenomenon studied widely, but the reasons for its existence remain relatively unknown. Discriminatory behaviours have been well documented in the medical field, especially in the surgical environment, and have been shown to impact learning. This study explores experiences of students in the surgical environment which they attribute to their protected characteristics and the impact this had on their learning and attainment.
Methods: A mixed methods modified ethnographic approach involving diary study and semi-structured interviewing was used. Data was analysed using thematic analysis with an interpretive approach. An intersectional lens in analysis provided deeper insight into the individualised experiences of students.
Results: Students believed that others' reactions to their protected characteristics impacted how they were perceived and treated. They believed this differential treatment impacted their learning and influenced their future career prospects. Participants were not able to adequately compensate for the impact that discriminatory behaviours had on their learning. They were, however, able to suggest areas of improvement which they believed could improve the learning environment.
Conclusion: Our study demonstrated discrepancies in student experience based not only on their individual protected characteristics but also upon the way these intersect with one another. This resulted in suboptimal learning, suggesting that attitudes of surgical placement staff and student peers require review to improve student experience in the learning environment. The findings of this study have implications for the academic performance of students and also their postgraduate performance and patient safety.
{"title":"'Never Going to be a Cut Above [the Rest].' Medical Students' Perceptions of How Their Personal Protected Characteristics Impacted Surgical Learning.","authors":"Zara R Zaccariah, Janet Lefroy, Brianne Wenning","doi":"10.1007/s40670-025-02415-7","DOIUrl":"10.1007/s40670-025-02415-7","url":null,"abstract":"<p><strong>Background: </strong>Differential attainment is a phenomenon studied widely, but the reasons for its existence remain relatively unknown. Discriminatory behaviours have been well documented in the medical field, especially in the surgical environment, and have been shown to impact learning. This study explores experiences of students in the surgical environment which they attribute to their protected characteristics and the impact this had on their learning and attainment.</p><p><strong>Methods: </strong>A mixed methods modified ethnographic approach involving diary study and semi-structured interviewing was used. Data was analysed using thematic analysis with an interpretive approach. An intersectional lens in analysis provided deeper insight into the individualised experiences of students.</p><p><strong>Results: </strong>Students believed that others' reactions to their protected characteristics impacted how they were perceived and treated. They believed this differential treatment impacted their learning and influenced their future career prospects. Participants were not able to adequately compensate for the impact that discriminatory behaviours had on their learning. They were, however, able to suggest areas of improvement which they believed could improve the learning environment.</p><p><strong>Conclusion: </strong>Our study demonstrated discrepancies in student experience based not only on their individual protected characteristics but also upon the way these intersect with one another. This resulted in suboptimal learning, suggesting that attitudes of surgical placement staff and student peers require review to improve student experience in the learning environment. The findings of this study have implications for the academic performance of students and also their postgraduate performance and patient safety.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"2075-2088"},"PeriodicalIF":1.8,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532967/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-26eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02420-w
Marisa L Kometas, Ganesh Raman, Brian D Adkins, Siayareh Rambally, Sandra L Hofmann, William C Aird, Natalie Bavli
Background: Revisiting fundamental concepts during the post-clerkship phase of medical school promotes integration into clinical medicine. Our course uses evolutionarily derived hematologic adaptations to deepen students' understanding of pathophysiology.
Methods: This week-long curriculum incorporated interactive seminars, laboratory experiments, and off-site activities. Students' perceptions of course value, knowledge, and impact were evaluated using pre-course, immediate post-course, and follow-up Likert surveys. Paired t-tests were used to compare pre- and post-course scores.
Results and discussion: Our course increased students' confidence and sustained interest in hematology. These attitudes persisted into residency. This approach models the use of comparative and experiential methods to enhance hematology education.
{"title":"Form Follows Function: Introducing a Comparative Hematology Course into the Post-Clerkship Phase of Medical School.","authors":"Marisa L Kometas, Ganesh Raman, Brian D Adkins, Siayareh Rambally, Sandra L Hofmann, William C Aird, Natalie Bavli","doi":"10.1007/s40670-025-02420-w","DOIUrl":"https://doi.org/10.1007/s40670-025-02420-w","url":null,"abstract":"<p><strong>Background: </strong>Revisiting fundamental concepts during the post-clerkship phase of medical school promotes integration into clinical medicine. Our course uses evolutionarily derived hematologic adaptations to deepen students' understanding of pathophysiology.</p><p><strong>Methods: </strong>This week-long curriculum incorporated interactive seminars, laboratory experiments, and off-site activities. Students' perceptions of course value, knowledge, and impact were evaluated using pre-course, immediate post-course, and follow-up Likert surveys. Paired <i>t</i>-tests were used to compare pre- and post-course scores.</p><p><strong>Results and discussion: </strong>Our course increased students' confidence and sustained interest in hematology. These attitudes persisted into residency. This approach models the use of comparative and experiential methods to enhance hematology education.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"1893-1899"},"PeriodicalIF":1.8,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532976/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-26eCollection Date: 2025-08-01DOI: 10.1007/s40670-025-02426-4
Renato Ferretti, Joyce Santana Rizzi, Lorraine Silva Requena, Angelica Maria Bicudo, Pedro Tadao Hamamoto Filho
Artificial intelligence has been widely used to answer questions in the medical context. This study aimed to evaluate the performance, reliability, and precision of ChatGPT-4.0 in responding to multiple-choice questions (MCQs) previously administered to medical students. We conducted an observational and cross-sectional study to assess the performance of ChatGPT by analyzing its accuracy, examining associations with specific knowledge areas and Bloom's taxonomy levels, assessing the influence of the psychometric properties of the items, and investigating the effect of images on the results. From the eight examinations analyzed, chatbot performance varied from 46.7 to 90.0% on the first attempt, 47.5 to 90% on the second attempt, and 28.3 to 89.2% on the third attempt. The concordance rate varied from 56.2% to 62.0% with Cohen's kappa coefficients ranging from 0.071 to 0.217. On the second and third attempts, basic science had the highest scores (90.0 and 93.3%, respectively), whereas surgery (55.8%) and pediatrics (43.4%) had the lowest scores. In summary, the chatbot demonstrated poor performance that was inferior to its human counterparts in medical examinations and low reliability and precision in answering medical questions.
{"title":"Factors Associated with Lower Performance of Artificial Intelligence on Answering Undergraduate Medical Education Multiple-Choice Questions.","authors":"Renato Ferretti, Joyce Santana Rizzi, Lorraine Silva Requena, Angelica Maria Bicudo, Pedro Tadao Hamamoto Filho","doi":"10.1007/s40670-025-02426-4","DOIUrl":"https://doi.org/10.1007/s40670-025-02426-4","url":null,"abstract":"<p><p>Artificial intelligence has been widely used to answer questions in the medical context. This study aimed to evaluate the performance, reliability, and precision of ChatGPT-4.0 in responding to multiple-choice questions (MCQs) previously administered to medical students. We conducted an observational and cross-sectional study to assess the performance of ChatGPT by analyzing its accuracy, examining associations with specific knowledge areas and Bloom's taxonomy levels, assessing the influence of the psychometric properties of the items, and investigating the effect of images on the results. From the eight examinations analyzed, chatbot performance varied from 46.7 to 90.0% on the first attempt, 47.5 to 90% on the second attempt, and 28.3 to 89.2% on the third attempt. The concordance rate varied from 56.2% to 62.0% with Cohen's kappa coefficients ranging from 0.071 to 0.217. On the second and third attempts, basic science had the highest scores (90.0 and 93.3%, respectively), whereas surgery (55.8%) and pediatrics (43.4%) had the lowest scores. In summary, the chatbot demonstrated poor performance that was inferior to its human counterparts in medical examinations and low reliability and precision in answering medical questions.</p>","PeriodicalId":37113,"journal":{"name":"Medical Science Educator","volume":"35 4","pages":"2145-2152"},"PeriodicalIF":1.8,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532555/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330417","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}