Teaching opportunities for anamnesis interviews through AI based teaching role plays: a survey with online learning students from health study programs.
Katharina Rädel-Ablass, Klaus Schliz, Cornelia Schlick, Benjamin Meindl, Sandra Pahr-Hosbach, Hanna Schwendemann, Stephanie Rupp, Marion Roddewig, Claudia Miersch
{"title":"Teaching opportunities for anamnesis interviews through AI based teaching role plays: a survey with online learning students from health study programs.","authors":"Katharina Rädel-Ablass, Klaus Schliz, Cornelia Schlick, Benjamin Meindl, Sandra Pahr-Hosbach, Hanna Schwendemann, Stephanie Rupp, Marion Roddewig, Claudia Miersch","doi":"10.1186/s12909-025-06756-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>This study presents a novel approach to educational role-playing through an AI-based bot, leveraging GPT-4 to simulate anamnesis interviews in various learning scenarios. Developed collaboratively by an interdisciplinary team of university lecturers and AI experts, the bot provides a platform for students of different health study programs to engage in complex patient-health professional conversations, offering an alternative to traditional role plays with actors or real patients.</p><p><strong>Methods: </strong>This study utilized a GPT-4 based digital teaching assistant, implemented through a proprietary chatbot design platform, to train anamnesis interviews in virtual settings with students from different online health care study programs. Students' satisfaction, virtual patient's accuracy, its realism, and quality were evaluated with a quantitative survey.</p><p><strong>Results: </strong>The evaluation of the bot focused on student feedback, highlighting a preference for the AI-driven method due to its immersive and interactive nature. Preliminary results show that students consistently rate the language ability of the AI model positively. More than 80% of students rated the professional and content-related precision of the virtual patient as good to excellent. Even as a text-based chatbot, the vast majority of students see a fairly close to very close relationship to a real anamnesis interview. The results further indicate that students even prefer this training approach to traditional in-person role-plays.</p><p><strong>Conclusions: </strong>The study underscores the bot's potential as a versatile tool for enriching learning experiences across multiple health disciplines, signaling a meaningful shift in educational practices towards the integration of AI technologies.</p>","PeriodicalId":51234,"journal":{"name":"BMC Medical Education","volume":"25 1","pages":"259"},"PeriodicalIF":2.7000,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11834289/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Education","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12909-025-06756-0","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Background: This study presents a novel approach to educational role-playing through an AI-based bot, leveraging GPT-4 to simulate anamnesis interviews in various learning scenarios. Developed collaboratively by an interdisciplinary team of university lecturers and AI experts, the bot provides a platform for students of different health study programs to engage in complex patient-health professional conversations, offering an alternative to traditional role plays with actors or real patients.
Methods: This study utilized a GPT-4 based digital teaching assistant, implemented through a proprietary chatbot design platform, to train anamnesis interviews in virtual settings with students from different online health care study programs. Students' satisfaction, virtual patient's accuracy, its realism, and quality were evaluated with a quantitative survey.
Results: The evaluation of the bot focused on student feedback, highlighting a preference for the AI-driven method due to its immersive and interactive nature. Preliminary results show that students consistently rate the language ability of the AI model positively. More than 80% of students rated the professional and content-related precision of the virtual patient as good to excellent. Even as a text-based chatbot, the vast majority of students see a fairly close to very close relationship to a real anamnesis interview. The results further indicate that students even prefer this training approach to traditional in-person role-plays.
Conclusions: The study underscores the bot's potential as a versatile tool for enriching learning experiences across multiple health disciplines, signaling a meaningful shift in educational practices towards the integration of AI technologies.
期刊介绍:
BMC Medical Education is an open access journal publishing original peer-reviewed research articles in relation to the training of healthcare professionals, including undergraduate, postgraduate, and continuing education. The journal has a special focus on curriculum development, evaluations of performance, assessment of training needs and evidence-based medicine.