首页 > 最新文献

JMIR Medical Education最新文献

英文 中文
Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study. 使用基于人工智能的虚拟模拟患者进行精神病理学访谈训练:横断面观察研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-23 DOI: 10.2196/78857
Daniel García-Torres, César Fernández, José Joaquín Mira, Alexandra Morales, María Asunción Vicente
<p><strong>Background: </strong>Virtual simulated patients (VSPs) powered by generative artificial intelligence (GAI) offer a promising tool for training clinical interviewing skills; yet, little is known about how different system- and user-level variables shape students' perceptions of these interactions.</p><p><strong>Objective: </strong>We aim to study psychology students' perceptions of GAI-driven VSPs and examine how demographic factors, system parameters, and interaction characteristics influence such perceptions.</p><p><strong>Methods: </strong>We conducted a total of 1832 recorded interactions involving 156 psychology students with 13 GAI-generated VSPs configured with varying temperature settings (0.1, 0.5, 0.9). For each student, we collected age and sex; for each interview, we recorded interview length (total number of question-answer turns), number of connectivity failures, the specific VSP consulted, and the model temperature. After every interview, students provided a 1-10 global rating and open-ended comments regarding strengths and areas for improvement. At the end of the training sequence, they also reported perceived improvement in diagnostic ability. Statistical analyses assessed the influence of different variables on global ratings: demographics, interaction-level data, and GAI temperature setting. Sentiment analysis was conducted to evaluate the VSPs' clinical realism.</p><p><strong>Results: </strong>Statistical analysis showed that female students rated the tool significantly higher (mean rating 9.25/10) than male students (mean rating 8.94/10; Kruskal-Wallis test, H=8.7; P=.003). On the other side, no significant correlation was found between global rating and age (r=0.02, 95% CI -0.03 to 0.06; P=.42), interview length (r=0.04, 95% CI -0.2 to 0.10; P=.18), or frequency of participation (Kruskal-Wallis test, H=4.62; P=.20). A moderate negative correlation emerged between connectivity failures and ratings (r=-0.26, 95% CI -0.41 to -0.10; P=.002). Temperature settings significantly influenced ratings (Kruskal-Wallis test, H=6.93; P=.03; η²=0.02), with higher scores at temperature 0.9 compared with 0.1 (Dunn's test, P=.04). Concerning learning outcomes, self-perceived improvement in diagnostic ability was reported by 94% (94/100) of students; however, final practical examination scores (mean 6.67, SD 1.42) did not differ significantly from those of the previous cohort without VSP training (mean 6.42, SD 1.56). Sentiment analysis indicated predominantly negative sentiment in GAI responses (median negativity 0.8903, IQR 0.306-0.961), consistent with clinical realism.</p><p><strong>Conclusions: </strong>GAI-driven VSPs were well-received by psychology students, with student gender and system-level variables (particularly temperature settings and connection stability) shaping user evaluations. Although participants perceived the training as beneficial for their diagnostic skills, objective examination performance did not signific
背景:由生成式人工智能(GAI)驱动的虚拟模拟患者(vsp)为临床访谈技能培训提供了一个很有前途的工具;然而,对于不同的系统和用户层面的变量如何影响学生对这些互动的看法,我们知之甚少。目的:研究心理学专业学生对人工智能驱动vsp的看法,并研究人口因素、系统参数和交互特征如何影响这种看法。方法:我们对156名心理学学生进行了1832次互动记录,他们使用了13个由ai生成的vsp,设置了不同的温度设置(0.1,0.5,0.9)。我们收集了每个学生的年龄和性别;对于每次访谈,我们记录了访谈长度(问答回合总数)、连接失败次数、咨询的特定VSP和模型温度。每次面试结束后,学生们提供1-10分的全球评分,并就自己的优势和需要改进的地方发表开放式评论。在训练结束时,他们也报告了诊断能力的改善。统计分析评估了不同变量对全球评级的影响:人口统计、互动水平数据和GAI温度设置。采用情绪分析评价vsp的临床现实性。结果:统计分析显示,女生对该工具的评分(平均评分9.25/10)显著高于男生(平均评分8.94/10);Kruskal-Wallis检验,H=8.7; P= 0.003)。另一方面,总体评分与年龄(r=0.02, 95% CI -0.03至0.06;P= 0.42)、访谈长度(r=0.04, 95% CI -0.2至0.10;P= 0.18)或参与频率(Kruskal-Wallis检验,H=4.62; P= 0.20)之间无显著相关性。连接失败和评分之间存在适度的负相关(r=-0.26, 95% CI -0.41至-0.10;P= 0.002)。温度设置显著影响评分(Kruskal-Wallis测试,H=6.93; P= 0.03; η²=0.02),温度为0.9的评分高于温度为0.1的评分(Dunn测试,P= 0.04)。在学习成果方面,94%(94/100)的学生自我感知诊断能力有所提高;然而,最后的实践考试成绩(平均6.67,SD 1.42)与未接受VSP训练的队列(平均6.42,SD 1.56)没有显著差异。情绪分析显示GAI反应以消极情绪为主(中位数负性0.8903,IQR为0.306-0.961),与临床现实相符。结论:ai驱动的vsp受到心理学学生的欢迎,学生的性别和系统级变量(特别是温度设置和连接稳定性)影响了用户的评价。尽管参与者认为培训对他们的诊断技能有益,但客观考试成绩与前一队列没有显着差异。然而,缺乏随机化限制了所得结果的泛化,需要进一步的实验。
{"title":"Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study.","authors":"Daniel García-Torres, César Fernández, José Joaquín Mira, Alexandra Morales, María Asunción Vicente","doi":"10.2196/78857","DOIUrl":"10.2196/78857","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Virtual simulated patients (VSPs) powered by generative artificial intelligence (GAI) offer a promising tool for training clinical interviewing skills; yet, little is known about how different system- and user-level variables shape students' perceptions of these interactions.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;We aim to study psychology students' perceptions of GAI-driven VSPs and examine how demographic factors, system parameters, and interaction characteristics influence such perceptions.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We conducted a total of 1832 recorded interactions involving 156 psychology students with 13 GAI-generated VSPs configured with varying temperature settings (0.1, 0.5, 0.9). For each student, we collected age and sex; for each interview, we recorded interview length (total number of question-answer turns), number of connectivity failures, the specific VSP consulted, and the model temperature. After every interview, students provided a 1-10 global rating and open-ended comments regarding strengths and areas for improvement. At the end of the training sequence, they also reported perceived improvement in diagnostic ability. Statistical analyses assessed the influence of different variables on global ratings: demographics, interaction-level data, and GAI temperature setting. Sentiment analysis was conducted to evaluate the VSPs' clinical realism.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Statistical analysis showed that female students rated the tool significantly higher (mean rating 9.25/10) than male students (mean rating 8.94/10; Kruskal-Wallis test, H=8.7; P=.003). On the other side, no significant correlation was found between global rating and age (r=0.02, 95% CI -0.03 to 0.06; P=.42), interview length (r=0.04, 95% CI -0.2 to 0.10; P=.18), or frequency of participation (Kruskal-Wallis test, H=4.62; P=.20). A moderate negative correlation emerged between connectivity failures and ratings (r=-0.26, 95% CI -0.41 to -0.10; P=.002). Temperature settings significantly influenced ratings (Kruskal-Wallis test, H=6.93; P=.03; η²=0.02), with higher scores at temperature 0.9 compared with 0.1 (Dunn's test, P=.04). Concerning learning outcomes, self-perceived improvement in diagnostic ability was reported by 94% (94/100) of students; however, final practical examination scores (mean 6.67, SD 1.42) did not differ significantly from those of the previous cohort without VSP training (mean 6.42, SD 1.56). Sentiment analysis indicated predominantly negative sentiment in GAI responses (median negativity 0.8903, IQR 0.306-0.961), consistent with clinical realism.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;GAI-driven VSPs were well-received by psychology students, with student gender and system-level variables (particularly temperature settings and connection stability) shaping user evaluations. Although participants perceived the training as beneficial for their diagnostic skills, objective examination performance did not signific","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e78857"},"PeriodicalIF":3.2,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12775747/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145811529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Trends in the Japanese National Medical Licensing Examination: Cross-Sectional Study. 日本全国医师执照考试趋势:横断面研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-23 DOI: 10.2196/78214
Yuki Morimoto, Kiyoshi Shikino, Yukihiro Nomura, Shoichi Ito
<p><strong>Background: </strong>The Japanese National Medical Licensing Examination (NMLE) is mandatory for all medical graduates seeking to become licensed physicians in Japan. Given the cultural emphasis on summative assessment, the NMLE has had a significant impact on Japanese medical education. Although the NMLE Content Guidelines have been revised approximately every five years over the last 2 decades, objective literature analyzing how the examination itself has evolved is absent.</p><p><strong>Objective: </strong>To provide a holistic view of the trends of the actual examination over time, this study used a combined rule-based and data-driven approach. We primarily focused on classifying the items according to the perspectives outlined in the NMLE Content Guidelines, complementing this approach with a natural language processing technique called topic modeling to identify latent topics.</p><p><strong>Methods: </strong>We collected publicly available NMLE data for 2001-2024. Six examination iterations (2880 items) were manually classified from 3 perspectives (level, content, and taxonomy) based on pre-established rules derived from the guidelines. Temporal trends within each classification were evaluated using the Cochran-Armitage test. Additionally, we conducted topic modeling for all 24 examination iterations (11,540 items) using the bidirectional encoder representations from transformers-based topic modeling framework. Temporal trends were traced using linear regression models of topic frequencies to identify topics growing in prominence.</p><p><strong>Results: </strong>In the level classification, the proportion of items addressing common or emergent diseases increased from 60% (115/193) to 76% (111/147; P<.001). In the content classification, the proportion of items assessing knowledge of pathophysiology decreased from 52% (237/459) to 33% (98/293; P<.001), whereas the proportion assessing practical knowledge of primary emergency care increased from 21% (95/459) to 29% (84/293; P<.001). In the taxonomy classification, the proportion of items that could be answered solely through simple recall of knowledge decreased from 51% (279/550) to 30% (118/400; P<.001), while the proportion assessing advanced analytical skills, such as interpreting and evaluating the meaning of each answer choice according to the given context, increased from 4% (21/550) to 19% (75/400; P<.001). Topic modeling identified 25 distinct topics, of which 10 exhibited an increasing trend. Non-organ-specific topics with notable increases included "comprehensive clinical items," "accountability in medical practice and patients' rights," "care, daily living support, and community health care," and "infection control and safety management in basic clinical procedures."</p><p><strong>Conclusions: </strong>This study identified significant shifts in the Japanese NMLE over the past 2 decades, suggesting that Japanese undergraduate medical education is evolving to place greate
背景:日本国家医疗执照考试(NMLE)是强制性的所有医学毕业生寻求成为日本执业医师。鉴于文化上对总结性评估的重视,NMLE对日本医学教育产生了重大影响。虽然NMLE内容指南在过去20年中大约每五年修订一次,但缺乏客观的文献分析考试本身是如何演变的。目的:为了全面了解实际检查的趋势,本研究采用了基于规则和数据驱动的结合方法。我们主要关注根据NMLE内容指南中概述的观点对条目进行分类,并使用称为主题建模的自然语言处理技术对该方法进行补充,以识别潜在主题。方法:我们收集了2001-2024年公开的NMLE数据。基于源自指南的预先建立的规则,从3个角度(级别、内容和分类法)手动对6个检查迭代(2880个项目)进行分类。使用Cochran-Armitage检验评估每个分类的时间趋势。此外,我们使用来自基于转换器的主题建模框架的双向编码器表示对所有24个检查迭代(11,540个项目)进行了主题建模。使用主题频率的线性回归模型追踪时间趋势,以确定日益突出的主题。结果:在水平分类中,常见病和突发疾病的项目比例从60%(115/193)增加到76%(111/147);结论:本研究发现日本NMLE在过去20年中发生了显著变化,表明日本本科医学教育正在向更重视实际问题解决能力而不是死记硬背的方向发展。这项研究还发现了潜在的话题,显示出越来越突出,可能反映了潜在的社会条件。
{"title":"Trends in the Japanese National Medical Licensing Examination: Cross-Sectional Study.","authors":"Yuki Morimoto, Kiyoshi Shikino, Yukihiro Nomura, Shoichi Ito","doi":"10.2196/78214","DOIUrl":"10.2196/78214","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;The Japanese National Medical Licensing Examination (NMLE) is mandatory for all medical graduates seeking to become licensed physicians in Japan. Given the cultural emphasis on summative assessment, the NMLE has had a significant impact on Japanese medical education. Although the NMLE Content Guidelines have been revised approximately every five years over the last 2 decades, objective literature analyzing how the examination itself has evolved is absent.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;To provide a holistic view of the trends of the actual examination over time, this study used a combined rule-based and data-driven approach. We primarily focused on classifying the items according to the perspectives outlined in the NMLE Content Guidelines, complementing this approach with a natural language processing technique called topic modeling to identify latent topics.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We collected publicly available NMLE data for 2001-2024. Six examination iterations (2880 items) were manually classified from 3 perspectives (level, content, and taxonomy) based on pre-established rules derived from the guidelines. Temporal trends within each classification were evaluated using the Cochran-Armitage test. Additionally, we conducted topic modeling for all 24 examination iterations (11,540 items) using the bidirectional encoder representations from transformers-based topic modeling framework. Temporal trends were traced using linear regression models of topic frequencies to identify topics growing in prominence.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;In the level classification, the proportion of items addressing common or emergent diseases increased from 60% (115/193) to 76% (111/147; P&lt;.001). In the content classification, the proportion of items assessing knowledge of pathophysiology decreased from 52% (237/459) to 33% (98/293; P&lt;.001), whereas the proportion assessing practical knowledge of primary emergency care increased from 21% (95/459) to 29% (84/293; P&lt;.001). In the taxonomy classification, the proportion of items that could be answered solely through simple recall of knowledge decreased from 51% (279/550) to 30% (118/400; P&lt;.001), while the proportion assessing advanced analytical skills, such as interpreting and evaluating the meaning of each answer choice according to the given context, increased from 4% (21/550) to 19% (75/400; P&lt;.001). Topic modeling identified 25 distinct topics, of which 10 exhibited an increasing trend. Non-organ-specific topics with notable increases included \"comprehensive clinical items,\" \"accountability in medical practice and patients' rights,\" \"care, daily living support, and community health care,\" and \"infection control and safety management in basic clinical procedures.\"&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;This study identified significant shifts in the Japanese NMLE over the past 2 decades, suggesting that Japanese undergraduate medical education is evolving to place greate","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e78214"},"PeriodicalIF":3.2,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12775762/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145821367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction: Comparing the Perceived Realism and Adequacy of Venipuncture Training on an in-House Developed 3D-Printed Arm With a Commercially Available Arm: Randomized, Single-Blind, Cross-Over Study. 更正:比较内部开发的3d打印手臂与市售手臂上静脉穿刺训练的感知真实性和充分性:随机,单盲,交叉研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-22 DOI: 10.2196/89670
Susan Gijsbertje Brouwer de Koning, Amy Hofman, Sonja Gerber, Vera Lagerburg, Michelle van den Boorn
{"title":"Correction: Comparing the Perceived Realism and Adequacy of Venipuncture Training on an in-House Developed 3D-Printed Arm With a Commercially Available Arm: Randomized, Single-Blind, Cross-Over Study.","authors":"Susan Gijsbertje Brouwer de Koning, Amy Hofman, Sonja Gerber, Vera Lagerburg, Michelle van den Boorn","doi":"10.2196/89670","DOIUrl":"10.2196/89670","url":null,"abstract":"","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e89670"},"PeriodicalIF":3.2,"publicationDate":"2025-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12721218/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145805599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Need for Health Care Innovation Training in Medical Education. 医学教育中卫生创新训练的必要性
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-19 DOI: 10.2196/79489
Lily Zhu, Jeffrey Khong, Oren Wei, Katherine C Chretien, Youseph Yazdi

Unlabelled: The rapid transformation of the health care landscape requires physicians to not only be skilled clinically but also navigate and lead a highly dynamic, innovation-driven environment. This also provides an avenue for physicians to significantly enhance their ability to help their patients, through participation in health innovation projects. Despite this growing need and opportunity, few medical schools provide formal training in innovation and entrepreneurship (I&E). In this perspective, we examine the need for I&E education in medical curricula by exploring student interest, effective program models, and implementation strategies. To better understand medical student interest in innovation and willingness to participate in I&E programs during medical school, we surveyed 480 medical students at our institution, the Johns Hopkins University School of Medicine, and received 90 responses with a 19% response rate. We observed a strong interest in health care I&E, with 97% (87/90) of respondents valuing knowledge or experience in I&E and 63% (56/90) expressing intent to incorporate I&E into their careers. To assess the real-world impact of I&E education on medical professionals, we surveyed 12 alumni of the Johns Hopkins Center for Bioengineering Innovation and Design (CBID) Master's program who had also completed medical school. Graduates reported that their experiences cultivated transferable skills-design thinking, interdisciplinary collaboration, and leadership-that shaped their professional trajectories. We propose three models for incorporating I&E education into existing medical curricula-short-term workshops, one-year gap programs, and longitudinal tracks-and discuss their advantages and trade-offs. Early and structured exposure to I&E education in medical school empowers students to identify unmet clinical needs, collaborate across disciplines, and develop real-world solutions. As the pace of innovation continues to accelerate, integration of I&E education into medical curricula offers a timely opportunity for medical schools to cultivate physician leaders in this space.

未标记:医疗保健领域的快速转型要求医生不仅要熟练临床,而且要导航和领导一个高度动态的,创新驱动的环境。这也为医生提供了一个途径,通过参与卫生创新项目,大大提高他们帮助病人的能力。尽管这种需求和机会不断增长,但很少有医学院提供创新和创业(I&E)方面的正式培训。从这个角度来看,我们通过探索学生的兴趣、有效的课程模式和实施策略来研究医学课程中对科学与教育教育的需求。为了更好地了解医学院学生对创新的兴趣和参与创新与创新项目的意愿,我们调查了我们所在机构约翰霍普金斯大学医学院的480名医学生,收到了90份回复,回复率为19%。我们观察到人们对医疗保健的I&E有浓厚的兴趣,97%(87/90)的受访者重视I&E方面的知识或经验,63%(56/90)的受访者表示有意将I&E纳入自己的职业生涯。为了评估I&E教育对医学专业人员的现实影响,我们调查了约翰霍普金斯大学生物工程创新与设计中心(CBID)硕士课程的12名校友,他们也完成了医学院的学业。毕业生报告说,他们的经历培养了可转移的技能——设计思维、跨学科合作和领导能力——这些技能塑造了他们的职业轨迹。我们提出了将科学与教育教育纳入现有医学课程的三种模式——短期工作坊、一年间隔计划和纵向跟踪——并讨论了它们的优点和缺点。在医学院的早期和结构化的I&E教育使学生能够识别未满足的临床需求,跨学科合作,并开发现实世界的解决方案。随着创新步伐的不断加快,将I&E教育整合到医学课程中,为医学院培养这一领域的医生领导者提供了及时的机会。
{"title":"The Need for Health Care Innovation Training in Medical Education.","authors":"Lily Zhu, Jeffrey Khong, Oren Wei, Katherine C Chretien, Youseph Yazdi","doi":"10.2196/79489","DOIUrl":"10.2196/79489","url":null,"abstract":"<p><strong>Unlabelled: </strong>The rapid transformation of the health care landscape requires physicians to not only be skilled clinically but also navigate and lead a highly dynamic, innovation-driven environment. This also provides an avenue for physicians to significantly enhance their ability to help their patients, through participation in health innovation projects. Despite this growing need and opportunity, few medical schools provide formal training in innovation and entrepreneurship (I&E). In this perspective, we examine the need for I&E education in medical curricula by exploring student interest, effective program models, and implementation strategies. To better understand medical student interest in innovation and willingness to participate in I&E programs during medical school, we surveyed 480 medical students at our institution, the Johns Hopkins University School of Medicine, and received 90 responses with a 19% response rate. We observed a strong interest in health care I&E, with 97% (87/90) of respondents valuing knowledge or experience in I&E and 63% (56/90) expressing intent to incorporate I&E into their careers. To assess the real-world impact of I&E education on medical professionals, we surveyed 12 alumni of the Johns Hopkins Center for Bioengineering Innovation and Design (CBID) Master's program who had also completed medical school. Graduates reported that their experiences cultivated transferable skills-design thinking, interdisciplinary collaboration, and leadership-that shaped their professional trajectories. We propose three models for incorporating I&E education into existing medical curricula-short-term workshops, one-year gap programs, and longitudinal tracks-and discuss their advantages and trade-offs. Early and structured exposure to I&E education in medical school empowers students to identify unmet clinical needs, collaborate across disciplines, and develop real-world solutions. As the pace of innovation continues to accelerate, integration of I&E education into medical curricula offers a timely opportunity for medical schools to cultivate physician leaders in this space.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e79489"},"PeriodicalIF":3.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12716411/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145795037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Student Satisfaction in Social Media-Based Learning Environments: Development, Validation, and Psychometric Evaluation of the CuSAERS (Questionnaire of Satisfaction With Educational Activities Performed on Social Media). 基于社交媒体的学习环境中的学生满意度:CuSAERS(社交媒体教育活动满意度问卷)的编制、验证和心理测量评估
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-19 DOI: 10.2196/73805
Roy La Touche, Álvaro Reina-Varona, Mónica Grande-Alonso, José Vicente León-Hernández, Joaquín Pardo-Montero, Néstor Requejo-Salinas, Raúl Ferrer-Peña, Alba Paris-Alemany

Background: Social media platforms are increasingly integrated into higher education, enabling collaborative, student-centered learning. Yet, few instruments specifically measure students' satisfaction with these activities across platforms. A brief, valid tool is needed to evaluate perceived quality and guide instructional design in social media-based learning environments.

Objective: This study investigated the use of social media as educational tools in the university environment, with the aim of designing and validating the CuSAERS (Questionnaire of Satisfaction With Educational Activities Performed on Social Media).

Methods: Using a mixed and sequential methodology, we explored the perceptions of bachelor's and master's degree students in physiotherapy who participated in teaching activities through X (formerly Twitter) and Instagram. The first phase of the project identified key dimensions of satisfaction from the literature, expert interviews, and cognitive interviews. The second phase assessed the psychometric properties of the CuSAERS in a sample of 150 students, addressing construct validity, internal reliability, concurrent validity, and discriminant validity.

Results: Exploratory factor analysis supported a 3-factor structure-perception of learning, task satisfaction/environment, and self-realization-explaining 61.9% of the variance, with acceptable overall reliability. Concurrent validity was supported by moderate correlations with the Academic Satisfaction Scale. Master's students reported higher scores than bachelor's students.

Conclusions: CuSAERS provides preliminary evidence as a promising measure of student satisfaction with social media-based learning activities; its use should remain formative and cautious until confirmatory and invariance analyses are completed.

Trial registration: No applicable.

背景:社交媒体平台越来越多地融入高等教育,实现了以学生为中心的协作学习。然而,很少有工具专门衡量学生对这些跨平台活动的满意度。在基于社交媒体的学习环境中,需要一个简单有效的工具来评估感知质量并指导教学设计。目的:本研究旨在调查社交媒体作为教育工具在大学环境中的使用情况,旨在设计和验证CuSAERS(对在社交媒体上进行的教育活动的满意度问卷)。方法:采用混合序贯方法,对通过X(原Twitter)和Instagram参与教学活动的物理治疗专业本科和硕士学生的认知进行调查。项目的第一阶段从文献、专家访谈和认知访谈中确定了满意度的关键维度。第二阶段以150名学生为样本,评估了CuSAERS的心理测量特性,包括构念效度、内部信度、并发效度和区别效度。结果:探索性因子分析支持学习感知、任务满意度/环境和自我实现的三因素结构,解释了61.9%的方差,总体信度可接受。同时效度与学业满意度量表有中度相关。硕士生报告的分数高于本科生。结论:CuSAERS提供了初步的证据,作为一个有希望的衡量学生对基于社交媒体的学习活动的满意度;在完成验证性和不变性分析之前,它的使用应保持形成性和谨慎性。试验注册:不适用。
{"title":"Student Satisfaction in Social Media-Based Learning Environments: Development, Validation, and Psychometric Evaluation of the CuSAERS (Questionnaire of Satisfaction With Educational Activities Performed on Social Media).","authors":"Roy La Touche, Álvaro Reina-Varona, Mónica Grande-Alonso, José Vicente León-Hernández, Joaquín Pardo-Montero, Néstor Requejo-Salinas, Raúl Ferrer-Peña, Alba Paris-Alemany","doi":"10.2196/73805","DOIUrl":"10.2196/73805","url":null,"abstract":"<p><strong>Background: </strong>Social media platforms are increasingly integrated into higher education, enabling collaborative, student-centered learning. Yet, few instruments specifically measure students' satisfaction with these activities across platforms. A brief, valid tool is needed to evaluate perceived quality and guide instructional design in social media-based learning environments.</p><p><strong>Objective: </strong>This study investigated the use of social media as educational tools in the university environment, with the aim of designing and validating the CuSAERS (Questionnaire of Satisfaction With Educational Activities Performed on Social Media).</p><p><strong>Methods: </strong>Using a mixed and sequential methodology, we explored the perceptions of bachelor's and master's degree students in physiotherapy who participated in teaching activities through X (formerly Twitter) and Instagram. The first phase of the project identified key dimensions of satisfaction from the literature, expert interviews, and cognitive interviews. The second phase assessed the psychometric properties of the CuSAERS in a sample of 150 students, addressing construct validity, internal reliability, concurrent validity, and discriminant validity.</p><p><strong>Results: </strong>Exploratory factor analysis supported a 3-factor structure-perception of learning, task satisfaction/environment, and self-realization-explaining 61.9% of the variance, with acceptable overall reliability. Concurrent validity was supported by moderate correlations with the Academic Satisfaction Scale. Master's students reported higher scores than bachelor's students.</p><p><strong>Conclusions: </strong>CuSAERS provides preliminary evidence as a promising measure of student satisfaction with social media-based learning activities; its use should remain formative and cautious until confirmatory and invariance analyses are completed.</p><p><strong>Trial registration: </strong>No applicable.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e73805"},"PeriodicalIF":3.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12759299/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145795012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Electronic Health Data to Deliver an Adaptive Online Learning Solution to Emergency Trainees: Mixed Methods Pilot Study. 使用电子健康数据为急救学员提供自适应在线学习解决方案:混合方法试点研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-17 DOI: 10.2196/65287
Anna Janssen, Andrew Coggins, James Tadros, Deleana Quinn, Amith Shetty, Tim Shaw

Background: Electronic medical records (EMRs) are a potentially rich source of information on an individual's health care providers' clinical activities. These data provide an opportunity to tailor web-based learning for health care providers to align closely with their practice. There is increasing interest in the use of EMR data to understand performance and support continuous and targeted education for health care providers.

Objective: This study aims to understand the feasibility and acceptability of harnessing EMR data to adaptively deliver a web-based learning program to early-career physicians.

Methods: The intervention consisted of a microlearning program where content was adaptively delivered using an algorithm input with EMR data. The microlearning program content consisted of a library of questions covering topics related to best practice management of common emergency department presentations. Study participants were early-career physicians undergoing training in emergency care. The study design involved 3 design cycles, which iteratively changed aspects of the adaptive algorithm based on an end-of-cycle evaluation to optimize the intervention. At the end of each cycle, an online survey and analysis of learning platform metrics were used to evaluate the feasibility and acceptability of the program. Within each cycle, participants were recruited and enrolled in the adaptive program for 6 weeks, with new cohorts of participants in each cycle.

Results: Across each cycle, all 75 participants triggered at least 1 question from their EMR data, with the majority triggering 1 question per week. The majority of participants in the study indicated that the online program was engaging and the content felt aligned with clinical practice.

Conclusions: The use of EMR data to deliver an adaptive online learning program for emergency trainees is both feasible and acceptable. However, further research is required on the optimal design of such adaptive solutions to ensure training is closely aligned with clinical practice.

背景:电子病历(emr)是关于个人医疗保健提供者临床活动的潜在丰富信息来源。这些数据为卫生保健提供者量身定制基于网络的学习提供了机会,使其与实践紧密结合。人们越来越关注使用电子病历数据来了解绩效并支持对卫生保健提供者进行持续和有针对性的教育。目的:本研究旨在了解利用电子病历数据自适应地向早期职业医生提供基于网络的学习计划的可行性和可接受性。方法:干预包括一个微学习程序,其中内容使用EMR数据的算法输入自适应地传递。微学习方案的内容包括一个问题库,涵盖与普通急诊科演示的最佳实践管理有关的主题。研究参与者是正在接受急诊护理培训的早期职业医生。研究设计涉及3个设计周期,迭代地改变基于周期结束评估的自适应算法的各个方面,以优化干预措施。在每个周期结束时,使用在线调查和学习平台指标分析来评估该计划的可行性和可接受性。在每个周期内,参与者被招募并参加了为期6周的适应性项目,每个周期都有新的参与者。结果:在每个周期中,所有75名参与者从他们的EMR数据中触发至少一个问题,大多数人每周触发一个问题。该研究的大多数参与者表示,在线课程引人入胜,内容与临床实践一致。结论:利用电子病历数据为急诊学员提供自适应在线学习计划是可行且可接受的。然而,需要进一步研究这种适应性解决方案的最佳设计,以确保培训与临床实践紧密结合。
{"title":"Using Electronic Health Data to Deliver an Adaptive Online Learning Solution to Emergency Trainees: Mixed Methods Pilot Study.","authors":"Anna Janssen, Andrew Coggins, James Tadros, Deleana Quinn, Amith Shetty, Tim Shaw","doi":"10.2196/65287","DOIUrl":"10.2196/65287","url":null,"abstract":"<p><strong>Background: </strong>Electronic medical records (EMRs) are a potentially rich source of information on an individual's health care providers' clinical activities. These data provide an opportunity to tailor web-based learning for health care providers to align closely with their practice. There is increasing interest in the use of EMR data to understand performance and support continuous and targeted education for health care providers.</p><p><strong>Objective: </strong>This study aims to understand the feasibility and acceptability of harnessing EMR data to adaptively deliver a web-based learning program to early-career physicians.</p><p><strong>Methods: </strong>The intervention consisted of a microlearning program where content was adaptively delivered using an algorithm input with EMR data. The microlearning program content consisted of a library of questions covering topics related to best practice management of common emergency department presentations. Study participants were early-career physicians undergoing training in emergency care. The study design involved 3 design cycles, which iteratively changed aspects of the adaptive algorithm based on an end-of-cycle evaluation to optimize the intervention. At the end of each cycle, an online survey and analysis of learning platform metrics were used to evaluate the feasibility and acceptability of the program. Within each cycle, participants were recruited and enrolled in the adaptive program for 6 weeks, with new cohorts of participants in each cycle.</p><p><strong>Results: </strong>Across each cycle, all 75 participants triggered at least 1 question from their EMR data, with the majority triggering 1 question per week. The majority of participants in the study indicated that the online program was engaging and the content felt aligned with clinical practice.</p><p><strong>Conclusions: </strong>The use of EMR data to deliver an adaptive online learning program for emergency trainees is both feasible and acceptable. However, further research is required on the optimal design of such adaptive solutions to ensure training is closely aligned with clinical practice.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e65287"},"PeriodicalIF":3.2,"publicationDate":"2025-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12711133/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145776069","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pharmacists' Attitudes, Perceptions, and Preferences Regarding Continuing Education: Cross-Sectional Study in Vietnam. 药师对继续教育的态度、认知和偏好:越南的横断面研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-16 DOI: 10.2196/77013
Trung Quang Vo, Phuoc Duy Le, Hien Thi Bich Tran, Hieu Thi Thanh Nguyen, Thoai Dang Nguyen, Trang Nguyen Khanh Huynh, Bay Van Vo

Background: The evolution of the health care landscape necessitates expanding the roles of pharmacists in patient-centered care to encompass direct patient management, collaborative practice, and preventive service. These responsibilities can be fulfilled by pharmacists through ongoing professional development, in which continuing education (CE) is instrumental to career advancement and improved patient care.

Objective: This cross-sectional study aimed to assess Vietnamese pharmacists' attitudes, perceptions, and preferences regarding CE.

Methods: Participants were recruited via convenience and snowball sampling, after which a validated 42-item questionnaire was administered to them through online and offline channels from December 2024 to February 2025. The data were examined via descriptive statistical analysis using SPSS (version 26.0; IBM Corp). The associations between participant characteristics and attitudinal or perception scores (P<.05) were assessed using 1-way ANOVA with 1000 bootstrap samples.

Results: This study involved 508 pharmacists, most of whom were aged 25 to 30 years (n=197, 38.8%), and the majority held university degrees (n=360, 70.9%). Their mean attitudinal score was 44.4 (SD 5.5), reflecting generally positive attitudes toward CE. However, significant differences in mean attitudinal scores were found across groups categorized by education level, job position, and frequency of overtime (P<.05). More than half of the participants derived good scores on their perceptions of CE, with their preferred CE formats including computer- and internet-based learning, as well as the use of medical search engines. Finally, the pharmacists expressed a strong preference for CE topics focusing on skill development.

Conclusions: The Vietnamese pharmacists exhibited positive attitudes toward CE, favoring flexible learning formats and practical topics. These insights can inform the efforts of policymakers and educators to enhance CE accessibility, improve pharmacists' competencies, and, ultimately, advance patient care.

背景:卫生保健领域的发展需要扩大药剂师在以患者为中心的护理中的作用,包括直接患者管理,合作实践和预防服务。药剂师可以通过持续的专业发展来履行这些责任,其中继续教育(CE)有助于职业发展和改善患者护理。目的:本横断面研究旨在评估越南药剂师对CE的态度、看法和偏好。方法:采用便利抽样和滚雪球抽样的方法,于2024年12月至2025年2月通过线上和线下渠道对参与者进行问卷调查,问卷共42项。使用SPSS(26.0版本;IBM Corp)对数据进行描述性统计分析。结果:本研究共涉及508名药师,其中年龄以25 ~ 30岁为主(n=197, 38.8%),以大学学历为主(n=360, 70.9%)。他们的平均态度得分为44.4 (SD 5.5),反映了他们对CE的普遍积极态度。然而,不同教育水平、工作职位和加班频率的分组在平均态度得分上存在显著差异(p结论:越南药剂师对学习学习表现出积极的态度,倾向于灵活的学习形式和实用的主题。这些见解可以为政策制定者和教育工作者提供信息,以提高CE的可及性,提高药剂师的能力,并最终提高患者护理水平。
{"title":"Pharmacists' Attitudes, Perceptions, and Preferences Regarding Continuing Education: Cross-Sectional Study in Vietnam.","authors":"Trung Quang Vo, Phuoc Duy Le, Hien Thi Bich Tran, Hieu Thi Thanh Nguyen, Thoai Dang Nguyen, Trang Nguyen Khanh Huynh, Bay Van Vo","doi":"10.2196/77013","DOIUrl":"10.2196/77013","url":null,"abstract":"<p><strong>Background: </strong>The evolution of the health care landscape necessitates expanding the roles of pharmacists in patient-centered care to encompass direct patient management, collaborative practice, and preventive service. These responsibilities can be fulfilled by pharmacists through ongoing professional development, in which continuing education (CE) is instrumental to career advancement and improved patient care.</p><p><strong>Objective: </strong>This cross-sectional study aimed to assess Vietnamese pharmacists' attitudes, perceptions, and preferences regarding CE.</p><p><strong>Methods: </strong>Participants were recruited via convenience and snowball sampling, after which a validated 42-item questionnaire was administered to them through online and offline channels from December 2024 to February 2025. The data were examined via descriptive statistical analysis using SPSS (version 26.0; IBM Corp). The associations between participant characteristics and attitudinal or perception scores (P<.05) were assessed using 1-way ANOVA with 1000 bootstrap samples.</p><p><strong>Results: </strong>This study involved 508 pharmacists, most of whom were aged 25 to 30 years (n=197, 38.8%), and the majority held university degrees (n=360, 70.9%). Their mean attitudinal score was 44.4 (SD 5.5), reflecting generally positive attitudes toward CE. However, significant differences in mean attitudinal scores were found across groups categorized by education level, job position, and frequency of overtime (P<.05). More than half of the participants derived good scores on their perceptions of CE, with their preferred CE formats including computer- and internet-based learning, as well as the use of medical search engines. Finally, the pharmacists expressed a strong preference for CE topics focusing on skill development.</p><p><strong>Conclusions: </strong>The Vietnamese pharmacists exhibited positive attitudes toward CE, favoring flexible learning formats and practical topics. These insights can inform the efforts of policymakers and educators to enhance CE accessibility, improve pharmacists' competencies, and, ultimately, advance patient care.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e77013"},"PeriodicalIF":3.2,"publicationDate":"2025-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12707692/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145769371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of AIGC in medical education: a systematic review of the impact on critical thinking abilities of medical students. AIGC在医学教育中的应用:对医学生批判性思维能力影响的系统回顾。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-14 DOI: 10.2196/79939
Jinlei Li, Fen Ai, Juan Huang, Jueyan Wang, Bingxin Cheng, Yu Li, Zhen Chen
<p><strong>Background: </strong>With the rapid development of artificial intelligence technology, generative artificial intelligence content (AIGC) is increasingly widely applied in the field of medical education. Large language models (LLMs), such as ChatGPT, are a prominent type of AIGC technology. Critical thinking is a core ability in medical education, but the impact of AIGC technology on the critical thinking ability of medical students remains unclear. Medical students are at a crucial stage in cultivating critical thinking, and the intervention of AIGC technology may have a profound impact on this process.</p><p><strong>Objective: </strong>This study aims to systematically review the impact of AIGC technology on the complex mechanisms affecting medical students' critical thinking abilities and to build a corresponding strategic framework. The findings are intended to provide theoretical support and practical guidance for applying AIGC in medical education.</p><p><strong>Methods: </strong>This study followed 2020 PRISMA guidelines, retrieval scope limited to November 2022 to June 2025 published in the English literature. Through the PubMed database, combined with the search methods of subject terms and free words, relevant studies involving the impact of AIGC on the critical thinking of medical students were screened out around keywords such as "AIGC", "medical students", and "critical thinking". Two independent reviewers screened and evaluated the literature, and ultimately conducted qualitative analysis based on the common themes extracted from the literature.</p><p><strong>Results: </strong>AIGC technology in medical education is two-fold. On the one hand, AIGC's powerful information capabilities provide abundant learning resources and efficient tools. This accelerates knowledge acquisition and broadens learning scope. On the other hand, over-reliance on AIGC may lead to mental inertia, weaken critical thinking skills, and cause academic integrity issues among students.Research has found that strategies such as customized AIGC tools, virtual standardized patients, new models of resource integration, and proactive assessment of AI limitations can effectively make up for the deficiencies of AIGC in cultivating high-level critical thinking, helping medical students maintain and enhance their critical thinking and problem-solving abilities.</p><p><strong>Conclusions: </strong>AIGC technology application in the medical education needs to carefully weigh the pros and cons. By optimizing the design and usage of AIGC tools and combining them with the guidance and supervision of educators, they can be transformed into powerful tools for promoting the development of critical thinking among medical students. Future research should further expand the scope of study, optimize research methods, pay attention to individual differences, track long-term effects, and deeply explore the influence of ethical and cultural factors to more comprehensively ass
背景:随着人工智能技术的快速发展,生成式人工智能内容(AIGC)在医学教育领域的应用越来越广泛。大型语言模型(llm),如ChatGPT,是AIGC技术的一种突出类型。批判性思维是医学教育的核心能力,但AIGC技术对医学生批判性思维能力的影响尚不清楚。医学生正处于批判性思维培养的关键阶段,AIGC技术的介入可能会对这一过程产生深远的影响。目的:本研究旨在系统回顾AIGC技术对医学生批判性思维能力复杂机制的影响,并构建相应的策略框架。研究结果旨在为AIGC在医学教育中的应用提供理论支持和实践指导。方法:本研究遵循2020年PRISMA指南,检索范围限于2022年11月至2025年6月发表的英文文献。通过PubMed数据库,结合主题词和自由词的搜索方法,围绕“AIGC”、“医学生”、“批判性思维”等关键词,筛选出涉及AIGC对医学生批判性思维影响的相关研究。两位独立的审稿人对文献进行筛选和评估,并最终根据从文献中提取的共同主题进行定性分析。结果:AIGC技术在医学教育中具有双重作用。一方面,AIGC强大的信息能力提供了丰富的学习资源和高效的学习工具。这加快了知识获取,拓宽了学习范围。另一方面,过度依赖AIGC可能会导致心理惰性,削弱批判性思维能力,并导致学生的学术诚信问题。研究发现,定制化AIGC工具、虚拟标准化患者、资源整合新模式、主动评估AI局限性等策略可以有效弥补AIGC在培养高水平批判性思维方面的不足,帮助医学生保持和增强批判性思维和解决问题的能力。结论:AIGC技术在医学教育中的应用需要慎重权衡利弊,通过优化AIGC工具的设计和使用,并结合教育者的指导和监督,使其成为促进医学生批判性思维发展的有力工具。未来的研究应进一步扩大研究范围,优化研究方法,关注个体差异,跟踪长期效果,深入探讨伦理和文化因素的影响,更全面地评估AIGC技术在医学教育中的应用潜力和挑战。
{"title":"Application of AIGC in medical education: a systematic review of the impact on critical thinking abilities of medical students.","authors":"Jinlei Li, Fen Ai, Juan Huang, Jueyan Wang, Bingxin Cheng, Yu Li, Zhen Chen","doi":"10.2196/79939","DOIUrl":"https://doi.org/10.2196/79939","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;With the rapid development of artificial intelligence technology, generative artificial intelligence content (AIGC) is increasingly widely applied in the field of medical education. Large language models (LLMs), such as ChatGPT, are a prominent type of AIGC technology. Critical thinking is a core ability in medical education, but the impact of AIGC technology on the critical thinking ability of medical students remains unclear. Medical students are at a crucial stage in cultivating critical thinking, and the intervention of AIGC technology may have a profound impact on this process.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This study aims to systematically review the impact of AIGC technology on the complex mechanisms affecting medical students' critical thinking abilities and to build a corresponding strategic framework. The findings are intended to provide theoretical support and practical guidance for applying AIGC in medical education.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;This study followed 2020 PRISMA guidelines, retrieval scope limited to November 2022 to June 2025 published in the English literature. Through the PubMed database, combined with the search methods of subject terms and free words, relevant studies involving the impact of AIGC on the critical thinking of medical students were screened out around keywords such as \"AIGC\", \"medical students\", and \"critical thinking\". Two independent reviewers screened and evaluated the literature, and ultimately conducted qualitative analysis based on the common themes extracted from the literature.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;AIGC technology in medical education is two-fold. On the one hand, AIGC's powerful information capabilities provide abundant learning resources and efficient tools. This accelerates knowledge acquisition and broadens learning scope. On the other hand, over-reliance on AIGC may lead to mental inertia, weaken critical thinking skills, and cause academic integrity issues among students.Research has found that strategies such as customized AIGC tools, virtual standardized patients, new models of resource integration, and proactive assessment of AI limitations can effectively make up for the deficiencies of AIGC in cultivating high-level critical thinking, helping medical students maintain and enhance their critical thinking and problem-solving abilities.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;AIGC technology application in the medical education needs to carefully weigh the pros and cons. By optimizing the design and usage of AIGC tools and combining them with the guidance and supervision of educators, they can be transformed into powerful tools for promoting the development of critical thinking among medical students. Future research should further expand the scope of study, optimize research methods, pay attention to individual differences, track long-term effects, and deeply explore the influence of ethical and cultural factors to more comprehensively ass","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":" ","pages":""},"PeriodicalIF":3.2,"publicationDate":"2025-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145811519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large Language Model-Based Patient Simulation to Foster Communication Skills in Health Care Professionals: User-Centered Development and Usability Study. 基于大语言模型的病人模拟以培养卫生保健专业人员的沟通技巧:以用户为中心的开发和可用性研究。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-12 DOI: 10.2196/81271
Ahmed Elhilali, Andy Suy-Huor Ngo, Daniel Reichenpfader, Kerstin Denecke
<p><strong>Background: </strong>Case-based learning using standardized patients is a key method for teaching communication skills in medicine. Besides logistical and financial hurdles, standardized patients portrayed by actors cannot cover the complete diversity of sociodemographic factors of patients. Large language models (LLMs) show promise for creating scalable patient simulations and could probably cover a broader diversity of factors. They could also be integrated into the continuous training of future health care professionals' communication and interaction skills.</p><p><strong>Objective: </strong>This study aimed to introduce the system architecture of a digital tool that leverages LLMs to simulate patient conversations for medical education, focusing specifically on medical history taking. Through an explorative analysis, we aimed to assess the tool's usability and examine differences between LLMs in simulating patient encounters.</p><p><strong>Methods: </strong>We followed a user-centered design process, gathering initial requirements from 2 medical students. We then developed a fully functional web prototype using a Python Flask backend and a PostgreSQL database, integrating 5 LLMs from OpenAI, Anthropic, and xAI. The system includes an artificial intelligence-assisted case vignette generator and a dynamic patient simulator. For the explorative analysis of the prototype, we conducted a task-based usability test with 5 medical students, measuring their experience using the System Usability Scale (SUS) questionnaire and qualitative questions. We then conducted an explorative analysis in which 4 practicing physicians evaluated the simulation quality of 3 models (Grok 3, GPT-4, and Claude 3 Opus) across 7 criteria on a 5-point Likert scale.</p><p><strong>Results: </strong>Usability testing yielded a mean SUS score of 91.5 (SD 8.40), indicating high perceived usability in a small formative sample. Students praised the system's simplicity and intuitive design but noted the absence of a formal conclusion and performance feedback, expressing a desire for a "didactic loop" to maximize learning. The models showed limitations in simulating uncertainties and memory lapses, responding to follow-up questions, and producing natural conversational flow. They perform well in simulating a coherent symptom profile, in using patient-like language, and in describing a realistic timeline and symptom progression. The differences among the models were not statistically significant. Ratings showed limited discriminative reliability (Kendall W=0-0.19, ie, very low) and a ceiling effect, with most scores clustered at 4-5, constraining interpretation; all group differences should therefore be viewed as exploratory.</p><p><strong>Conclusions: </strong>We successfully developed a highly usable patient simulation tool that serves as a foundation for further development. Our results show that while the tool could be effective for communication training, its full pot
背景:基于案例的标准化患者学习是医学沟通技巧教学的重要方法。除了后勤和财政方面的障碍外,演员所描绘的标准化患者并不能完全涵盖患者社会人口因素的多样性。大型语言模型(llm)有望创建可扩展的患者模拟,并可能涵盖更广泛的因素。它们也可以被纳入未来卫生保健专业人员沟通和互动技能的持续培训中。目的:本研究旨在介绍一种数字工具的系统架构,该工具利用法学硕士来模拟医学教育中的患者对话,特别关注病史获取。通过探索性分析,我们旨在评估该工具的可用性,并检查法学硕士在模拟患者遭遇方面的差异。方法:我们遵循以用户为中心的设计过程,收集2名医学生的初始需求。然后,我们使用Python Flask后端和PostgreSQL数据库开发了一个功能齐全的web原型,集成了OpenAI、Anthropic和xAI的5个llm。该系统包括一个人工智能辅助的病例图像生成器和一个动态患者模拟器。为了对原型进行探索性分析,我们对5名医学生进行了基于任务的可用性测试,使用系统可用性量表(SUS)问卷和定性问题来衡量他们的体验。然后,我们进行了一项探索性分析,其中4名执业医生评估了3个模型(Grok 3, GPT-4和Claude 3 Opus)在5点李克特量表上的7个标准的模拟质量。结果:可用性测试产生的平均SUS得分为91.5 (SD 8.40),表明在一个小的形成性样本中具有较高的感知可用性。学生们称赞该系统的简单和直观的设计,但指出缺乏正式的结论和性能反馈,表达了对“教学循环”的渴望,以最大限度地提高学习效果。这些模型在模拟不确定性和记忆缺失、回答后续问题和产生自然会话流方面存在局限性。他们在模拟连贯的症状概况、使用类似病人的语言以及描述现实的时间线和症状进展方面表现良好。模型间差异无统计学意义。评分显示有限的判别信度(Kendall W=0-0.19,即非常低)和天花板效应,大多数分数聚集在4-5,限制了解释;因此,所有的群体差异都应被视为探索性的。结论:我们成功开发了一种高度可用的患者模拟工具,为进一步开发奠定了基础。我们的结果表明,虽然该工具可以有效地进行沟通培训,但它的全部潜力只能通过集成自动反馈机制来实现,以创建一个完整的教学循环,正如测试用户所要求的那样。未来的工作应该更深入地评估模型在模拟患者心理社会特征方面的差异。
{"title":"Large Language Model-Based Patient Simulation to Foster Communication Skills in Health Care Professionals: User-Centered Development and Usability Study.","authors":"Ahmed Elhilali, Andy Suy-Huor Ngo, Daniel Reichenpfader, Kerstin Denecke","doi":"10.2196/81271","DOIUrl":"10.2196/81271","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Case-based learning using standardized patients is a key method for teaching communication skills in medicine. Besides logistical and financial hurdles, standardized patients portrayed by actors cannot cover the complete diversity of sociodemographic factors of patients. Large language models (LLMs) show promise for creating scalable patient simulations and could probably cover a broader diversity of factors. They could also be integrated into the continuous training of future health care professionals' communication and interaction skills.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This study aimed to introduce the system architecture of a digital tool that leverages LLMs to simulate patient conversations for medical education, focusing specifically on medical history taking. Through an explorative analysis, we aimed to assess the tool's usability and examine differences between LLMs in simulating patient encounters.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We followed a user-centered design process, gathering initial requirements from 2 medical students. We then developed a fully functional web prototype using a Python Flask backend and a PostgreSQL database, integrating 5 LLMs from OpenAI, Anthropic, and xAI. The system includes an artificial intelligence-assisted case vignette generator and a dynamic patient simulator. For the explorative analysis of the prototype, we conducted a task-based usability test with 5 medical students, measuring their experience using the System Usability Scale (SUS) questionnaire and qualitative questions. We then conducted an explorative analysis in which 4 practicing physicians evaluated the simulation quality of 3 models (Grok 3, GPT-4, and Claude 3 Opus) across 7 criteria on a 5-point Likert scale.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Usability testing yielded a mean SUS score of 91.5 (SD 8.40), indicating high perceived usability in a small formative sample. Students praised the system's simplicity and intuitive design but noted the absence of a formal conclusion and performance feedback, expressing a desire for a \"didactic loop\" to maximize learning. The models showed limitations in simulating uncertainties and memory lapses, responding to follow-up questions, and producing natural conversational flow. They perform well in simulating a coherent symptom profile, in using patient-like language, and in describing a realistic timeline and symptom progression. The differences among the models were not statistically significant. Ratings showed limited discriminative reliability (Kendall W=0-0.19, ie, very low) and a ceiling effect, with most scores clustered at 4-5, constraining interpretation; all group differences should therefore be viewed as exploratory.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;We successfully developed a highly usable patient simulation tool that serves as a foundation for further development. Our results show that while the tool could be effective for communication training, its full pot","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":"11 ","pages":"e81271"},"PeriodicalIF":3.2,"publicationDate":"2025-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12743234/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145744879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Twelve Practical Tips for Integrating AI Into Medical Education: Tutorial to Support Educators Across Teaching, Research, Administration, and Ethical Domains. 将人工智能(AI)融入医学教育的12个实用技巧。
IF 3.2 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Pub Date : 2025-12-12 DOI: 10.2196/81297
Alireza Jalali, Kadidja Harbi Houssein, Salomon Fotsing

Artificial intelligence (AI) is rapidly reshaping medical education, offering new opportunities to personalize learning, enhance research, and streamline administration. The aim of this study is to provide 12 practical, evidence-informed tips by drawing on current literature and real-world examples to guide the integration of AI into medical education, supporting educators across teaching, research, administration, and ethical domains. Key strategies include using adaptive learning platforms to tailor educational content, using AI tools to provide timely feedback, and incorporating AI-generated clinical scenarios in case-based learning. The importance of fostering AI literacy among students is emphasized, as well as utilizing AI-powered tools for efficient literature reviews, data analysis, and manuscript preparation. Administrative applications such as automating routine tasks, supporting strategic planning through data analysis, and enhancing faculty development with AI-driven platforms are also discussed. Ethical considerations are highlighted, with a focus on ensuring transparency, fairness, and accountability in all AI applications. By following these 12 tips, medical educators can leverage the benefits of AI to improve educational outcomes, increase efficiency, and prepare future clinicians for a technology-driven health care environment.

非结构化:人工智能(AI)正在迅速重塑医学教育,为个性化学习、加强研究和简化管理提供了新的机会。本文的目的是提供12个实用的、基于证据的提示,以指导将人工智能融入医学教育,为教学、研究、管理和伦理领域的教育工作者提供支持。本文介绍了将人工智能融入医学教育的12个实用技巧,借鉴了当前的文献和现实世界的例子。关键策略包括使用自适应学习平台定制教育内容,使用人工智能工具提供及时反馈,以及将人工智能生成的临床场景纳入基于案例的学习。强调了培养学生人工智能素养的重要性,以及利用人工智能工具进行有效的文献综述、数据分析和手稿准备的重要性。管理应用,如自动化日常任务,通过数据分析支持战略规划,以及通过人工智能驱动的平台加强教师发展,也进行了讨论。强调道德考虑,重点是确保所有人工智能应用的透明度、公平性和问责制。通过遵循这12条建议,医学教育工作者可以利用人工智能的好处来改善教育成果,提高效率,并为未来的临床医生做好准备,以适应技术驱动的医疗环境。
{"title":"Twelve Practical Tips for Integrating AI Into Medical Education: Tutorial to Support Educators Across Teaching, Research, Administration, and Ethical Domains.","authors":"Alireza Jalali, Kadidja Harbi Houssein, Salomon Fotsing","doi":"10.2196/81297","DOIUrl":"10.2196/81297","url":null,"abstract":"<p><p>Artificial intelligence (AI) is rapidly reshaping medical education, offering new opportunities to personalize learning, enhance research, and streamline administration. The aim of this study is to provide 12 practical, evidence-informed tips by drawing on current literature and real-world examples to guide the integration of AI into medical education, supporting educators across teaching, research, administration, and ethical domains. Key strategies include using adaptive learning platforms to tailor educational content, using AI tools to provide timely feedback, and incorporating AI-generated clinical scenarios in case-based learning. The importance of fostering AI literacy among students is emphasized, as well as utilizing AI-powered tools for efficient literature reviews, data analysis, and manuscript preparation. Administrative applications such as automating routine tasks, supporting strategic planning through data analysis, and enhancing faculty development with AI-driven platforms are also discussed. Ethical considerations are highlighted, with a focus on ensuring transparency, fairness, and accountability in all AI applications. By following these 12 tips, medical educators can leverage the benefits of AI to improve educational outcomes, increase efficiency, and prepare future clinicians for a technology-driven health care environment.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":" ","pages":"e81297"},"PeriodicalIF":3.2,"publicationDate":"2025-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12743235/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145640704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
JMIR Medical Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1