Background: The relationship between educational outcomes and the use of web-based clinical knowledge support systems in teaching hospitals remains unknown in Japan. A previous study on this topic could have been affected by recall bias because of the use of a self-reported questionnaire.
Objective: We aimed to explore the relationship between the use of the Wolters Kluwer UpToDate clinical knowledge support system in teaching hospitals and residents' General Medicine In-Training Examination (GM-ITE) scores. In this study, we objectively evaluated the relationship between the total number of UpToDate hospital use logs and the GM-ITE scores.
Methods: This nationwide cross-sectional study included postgraduate year-1 and -2 residents who had taken the examination in the 2020 academic year. Hospital-level information was obtained from published web pages, and UpToDate hospital use logs were provided by Wolters Kluwer. We evaluated the relationship between the total number of UpToDate hospital use logs and residents' GM-ITE scores. We analyzed 215 teaching hospitals with at least 5 GM-ITE examinees and hospital use logs from 2017 to 2019.
Results: The study population consisted of 3013 residents from 215 teaching hospitals with at least 5 GM-ITE examinees and web-based resource use log data from 2017 to 2019. High-use hospital residents had significantly higher GM-ITE scores than low-use hospital residents (mean 26.9, SD 2.0 vs mean 26.2, SD 2.3; P=.009; Cohen d=0.35, 95% CI 0.08-0.62). The GM-ITE scores were significantly correlated with the total number of hospital use logs (Pearson r=0.28; P<.001). The multilevel analysis revealed a positive association between the total number of logs divided by the number of hospital physicians and the GM-ITE scores (estimated coefficient=0.36, 95% CI 0.14-0.59; P=.001).
Conclusions: The findings suggest that the development of residents' clinical reasoning abilities through UpToDate is associated with high GM-ITE scores. Thus, higher use of UpToDate may lead physicians and residents in high-use hospitals to increase the implementation of evidence-based medicine, leading to high educational outcomes.
{"title":"Hospital Use of a Web-Based Clinical Knowledge Support System and In-Training Examination Performance Among Postgraduate Resident Physicians in Japan: Nationwide Observational Study.","authors":"Koshi Kataoka, Yuji Nishizaki, Taro Shimizu, Yu Yamamoto, Kiyoshi Shikino, Masanori Nojima, Kazuya Nagasaki, Sho Fukui, Sho Nishiguchi, Kohta Katayama, Masaru Kurihara, Rieko Ueda, Hiroyuki Kobayashi, Yasuharu Tokuda","doi":"10.2196/52207","DOIUrl":"10.2196/52207","url":null,"abstract":"<p><strong>Background: </strong>The relationship between educational outcomes and the use of web-based clinical knowledge support systems in teaching hospitals remains unknown in Japan. A previous study on this topic could have been affected by recall bias because of the use of a self-reported questionnaire.</p><p><strong>Objective: </strong>We aimed to explore the relationship between the use of the Wolters Kluwer UpToDate clinical knowledge support system in teaching hospitals and residents' General Medicine In-Training Examination (GM-ITE) scores. In this study, we objectively evaluated the relationship between the total number of UpToDate hospital use logs and the GM-ITE scores.</p><p><strong>Methods: </strong>This nationwide cross-sectional study included postgraduate year-1 and -2 residents who had taken the examination in the 2020 academic year. Hospital-level information was obtained from published web pages, and UpToDate hospital use logs were provided by Wolters Kluwer. We evaluated the relationship between the total number of UpToDate hospital use logs and residents' GM-ITE scores. We analyzed 215 teaching hospitals with at least 5 GM-ITE examinees and hospital use logs from 2017 to 2019.</p><p><strong>Results: </strong>The study population consisted of 3013 residents from 215 teaching hospitals with at least 5 GM-ITE examinees and web-based resource use log data from 2017 to 2019. High-use hospital residents had significantly higher GM-ITE scores than low-use hospital residents (mean 26.9, SD 2.0 vs mean 26.2, SD 2.3; P=.009; Cohen d=0.35, 95% CI 0.08-0.62). The GM-ITE scores were significantly correlated with the total number of hospital use logs (Pearson r=0.28; P<.001). The multilevel analysis revealed a positive association between the total number of logs divided by the number of hospital physicians and the GM-ITE scores (estimated coefficient=0.36, 95% CI 0.14-0.59; P=.001).</p><p><strong>Conclusions: </strong>The findings suggest that the development of residents' clinical reasoning abilities through UpToDate is associated with high GM-ITE scores. Thus, higher use of UpToDate may lead physicians and residents in high-use hospitals to increase the implementation of evidence-based medicine, leading to high educational outcomes.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11154652/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141200505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Juan Pablo Arango-Ibanez, Jose Alejandro Posso-Nuñez, Juan Pablo Díaz-Solórzano, Gustavo Cruz-Suárez
Unlabelled: Large language models (LLMs), like ChatGPT, are transforming the landscape of medical education. They offer a vast range of applications, such as tutoring (personalized learning), patient simulation, generation of examination questions, and streamlined access to information. The rapid advancement of medical knowledge and the need for personalized learning underscore the relevance and timeliness of exploring innovative strategies for integrating artificial intelligence (AI) into medical education. In this paper, we propose coupling evidence-based learning strategies, such as active recall and memory cues, with AI to optimize learning. These strategies include the generation of tests, mnemonics, and visual cues.
{"title":"Evidence-Based Learning Strategies in Medicine Using AI.","authors":"Juan Pablo Arango-Ibanez, Jose Alejandro Posso-Nuñez, Juan Pablo Díaz-Solórzano, Gustavo Cruz-Suárez","doi":"10.2196/54507","DOIUrl":"10.2196/54507","url":null,"abstract":"<p><strong>Unlabelled: </strong>Large language models (LLMs), like ChatGPT, are transforming the landscape of medical education. They offer a vast range of applications, such as tutoring (personalized learning), patient simulation, generation of examination questions, and streamlined access to information. The rapid advancement of medical knowledge and the need for personalized learning underscore the relevance and timeliness of exploring innovative strategies for integrating artificial intelligence (AI) into medical education. In this paper, we propose coupling evidence-based learning strategies, such as active recall and memory cues, with AI to optimize learning. These strategies include the generation of tests, mnemonics, and visual cues.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11144835/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141158524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Unlabelled: For more than 50 years, digital technologies have been employed for the creation and distribution of knowledge in health services. In the last decade, digital social media have been developed for applications in clinical decision support and population health monitoring. Recently, these technologies have also been used for knowledge translation, such as in the process where research findings created in academic settings are established as evidence and distributed for use in clinical practice, policy making, and health self-management. To date, it has been common for medical and public health institutions to have social media accounts for the dissemination of novel research findings and to facilitate conversations about these findings. However, recent events such as the transformation of the microblog Twitter to platform X have brought to light the need for the social media industry to exploit user data to generate revenue. In this viewpoint, it is argued that a redirection of social media use is required in the translation of knowledge to action in the fields of medicine and public health. A new kind of social internet is currently forming, known as the "fediverse," which denotes an ensemble of open social media that can communicate with each other while remaining independent platforms. In several countries, government institutions, universities, and newspapers use open social media to distribute information and enable discussions. These organizations control their own channels while being able to communicate with other platforms through open standards. Examples of medical knowledge translation via such open social media platforms, where users are less exposed to disinformation than in general platforms, are also beginning to appear. The current status of the social media industry calls for a broad discussion about the use of social technologies by health institutions involving researchers and health service practitioners, academic leaders, scientific publishers, social technology providers, policy makers, and the public. This debate should not primarily take place on social media platforms but rather at universities, in scientific journals, at public seminars, and other venues, allowing for the transparent and undisturbed communication and formation of opinions.
无标签:50 多年来,数字技术一直被用于医疗服务知识的创造和传播。在过去十年中,数字社交媒体被开发应用于临床决策支持和人口健康监测。最近,这些技术还被用于知识转化,例如在学术环境中创造的研究成果被确立为证据,并传播到临床实践、政策制定和健康自我管理中。迄今为止,医疗和公共卫生机构普遍拥有社交媒体账户来传播新的研究成果,并促进有关这些成果的对话。然而,最近发生的一些事件,如微博 Twitter 向 X 平台的转型,让人们看到了社交媒体行业利用用户数据创收的必要性。本文认为,在医学和公共卫生领域将知识转化为行动的过程中,需要对社交媒体的使用进行重新定位。目前,一种新型的社交互联网正在形成,被称为 "联邦宇宙",指的是既能相互交流又能保持独立平台的开放式社交媒体的集合体。在一些国家,政府机构、大学和报纸利用开放式社交媒体来发布信息和开展讨论。这些机构既能控制自己的渠道,又能通过开放标准与其他平台进行交流。通过此类开放式社交媒体平台进行医学知识翻译的例子也开始出现,与一般平台相比,用户在这些平台上接触到的虚假信息更少。社交媒体行业的现状要求对医疗机构使用社交技术的问题进行广泛讨论,参与者包括研究人员和医疗服务从业人员、学术带头人、科学出版商、社交技术提供商、政策制定者和公众。这种讨论不应主要在社交媒体平台上进行,而应在大学、科学杂志、公开研讨会和其他场所进行,以便在透明、不受干扰的情况下交流和形成意见。
{"title":"Time for Medicine and Public Health to Leave Platform X.","authors":"Toomas Timpka","doi":"10.2196/53810","DOIUrl":"10.2196/53810","url":null,"abstract":"<p><strong>Unlabelled: </strong>For more than 50 years, digital technologies have been employed for the creation and distribution of knowledge in health services. In the last decade, digital social media have been developed for applications in clinical decision support and population health monitoring. Recently, these technologies have also been used for knowledge translation, such as in the process where research findings created in academic settings are established as evidence and distributed for use in clinical practice, policy making, and health self-management. To date, it has been common for medical and public health institutions to have social media accounts for the dissemination of novel research findings and to facilitate conversations about these findings. However, recent events such as the transformation of the microblog Twitter to platform X have brought to light the need for the social media industry to exploit user data to generate revenue. In this viewpoint, it is argued that a redirection of social media use is required in the translation of knowledge to action in the fields of medicine and public health. A new kind of social internet is currently forming, known as the \"fediverse,\" which denotes an ensemble of open social media that can communicate with each other while remaining independent platforms. In several countries, government institutions, universities, and newspapers use open social media to distribute information and enable discussions. These organizations control their own channels while being able to communicate with other platforms through open standards. Examples of medical knowledge translation via such open social media platforms, where users are less exposed to disinformation than in general platforms, are also beginning to appear. The current status of the social media industry calls for a broad discussion about the use of social technologies by health institutions involving researchers and health service practitioners, academic leaders, scientific publishers, social technology providers, policy makers, and the public. This debate should not primarily take place on social media platforms but rather at universities, in scientific journals, at public seminars, and other venues, allowing for the transparent and undisturbed communication and formation of opinions.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11144836/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141158563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Performance of ChatGPT-4V in Interpreting Images and Tables in the Japanese Medical Licensing Exam.","authors":"Soshi Takagi, Masahide Koda, Takashi Watari","doi":"10.2196/54283","DOIUrl":"10.2196/54283","url":null,"abstract":"","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11148840/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141088100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alireza Jalali, Jacline Nyman, Ouida Loeffelholz, Chantelle Courtney
Unstructured: Higher education institutions, including medical schools, increasingly rely on fundraising to bridge funding gaps and support their missions. This manuscript presents a viewpoint on data-driven strategies in fundraising, outlining a four-step approach for effective planning while considering ethical implications. It outlines a four-step approach to creating an effective, end-to-end, data-driven fundraising plan, emphasizing the crucial stages of data collection, data analysis, goal establishment, and targeted strategy formulation. By leveraging internal and external data, schools can create tailored outreach initiatives that resonate with potential donors. However, the fundraising process must be grounded in ethical considerations. Ethical challenges, particularly when fundraising from grateful medical patients , necessitate transparent and honest practices prioritizing donors' and beneficiaries' rights and safeguarding public trust. This manuscript presents a viewpoint on the critical role of data-driven strategies in fundraising for medical education. It emphasizes integrating comprehensive data analysis with ethical considerations to enhance fundraising efforts in medical schools. By integrating data analytics with fundraising best practices and ensuring ethical practice, medical institutions can ensure financial support and foster enduring, trust-based relationships with their donor communities.
{"title":"Data-Driven Fundraising: A Strategic Plan for Medical Education.","authors":"Alireza Jalali, Jacline Nyman, Ouida Loeffelholz, Chantelle Courtney","doi":"10.2196/53624","DOIUrl":"10.2196/53624","url":null,"abstract":"<p><strong>Unstructured: </strong>Higher education institutions, including medical schools, increasingly rely on fundraising to bridge funding gaps and support their missions. This manuscript presents a viewpoint on data-driven strategies in fundraising, outlining a four-step approach for effective planning while considering ethical implications. It outlines a four-step approach to creating an effective, end-to-end, data-driven fundraising plan, emphasizing the crucial stages of data collection, data analysis, goal establishment, and targeted strategy formulation. By leveraging internal and external data, schools can create tailored outreach initiatives that resonate with potential donors. However, the fundraising process must be grounded in ethical considerations. Ethical challenges, particularly when fundraising from grateful medical patients , necessitate transparent and honest practices prioritizing donors' and beneficiaries' rights and safeguarding public trust. This manuscript presents a viewpoint on the critical role of data-driven strategies in fundraising for medical education. It emphasizes integrating comprehensive data analysis with ethical considerations to enhance fundraising efforts in medical schools. By integrating data analytics with fundraising best practices and ensuring ethical practice, medical institutions can ensure financial support and foster enduring, trust-based relationships with their donor communities.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141076916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Unstructured: The continued demand for digital health requires that providers adapt thought processes to enable sound clinical decision making in digital settings. Providers report that lack of training is a barrier to providing digital healthcare. Physical exam techniques and hands-on interventions must be adjusted in safe, reliable and feasible ways to digital care and decision making may be impacted by modifications made to these techniques. We have proposed a framework for determining if a procedure can be modified to obtain a comparable result in a digital environment or if a referral to in-person care is required. The decision making framework developed using program outcomes of a digital physical therapy platform, and aims to alleviate provider barriers to providing digital care. This paper describes the unique considerations a provider must make when collecting background information, selecting procedures, executing procedures, assessing results, and determining if they can proceed with clinical care in digital settings.
{"title":"A Proposed Decision Making Framework for the Translation of In-Person Clinical Care to Digital Care: A Tutorial.","authors":"Anna DeLaRosby, Julie Mulcahy, Todd Norwood","doi":"10.2196/52993","DOIUrl":"10.2196/52993","url":null,"abstract":"<p><strong>Unstructured: </strong>The continued demand for digital health requires that providers adapt thought processes to enable sound clinical decision making in digital settings. Providers report that lack of training is a barrier to providing digital healthcare. Physical exam techniques and hands-on interventions must be adjusted in safe, reliable and feasible ways to digital care and decision making may be impacted by modifications made to these techniques. We have proposed a framework for determining if a procedure can be modified to obtain a comparable result in a digital environment or if a referral to in-person care is required. The decision making framework developed using program outcomes of a digital physical therapy platform, and aims to alleviate provider barriers to providing digital care. This paper describes the unique considerations a provider must make when collecting background information, selecting procedures, executing procedures, assessing results, and determining if they can proceed with clinical care in digital settings.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11256212/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140904822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shishir Shetty, Supriya Bhat, Saad Al Bayatti, Sausan Al Kawas, Wael Talaat, Mohamed El-Kishawi, Natheer Al Rawi, Sangeetha Narasimhan, Hiba Al-Daghestani, Medhini Madi, Raghavendra Shetty
Background: In recent years, virtual reality (VR) has gained significant importance in medical education. Radiology education also has seen the induction of VR technology. However, there is no comprehensive review in this specific area. This review aims to fill this knowledge gap.
Objective: This systematic literature review aims to explore the scope of VR use in radiology education.
Methods: A literature search was carried out using PubMed, Scopus, ScienceDirect, and Google Scholar for articles relating to the use of VR in radiology education, published from database inception to September 1, 2023. The identified articles were then subjected to a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)-defined study selection process.
Results: The database search identified 2503 nonduplicate articles. After PRISMA screening, 17 were included in the review for analysis, of which 3 (18%) were randomized controlled trials, 7 (41%) were randomized experimental trials, and 7 (41%) were cross-sectional studies. Of the 10 randomized trials, 3 (30%) had a low risk of bias, 5 (50%) showed some concerns, and 2 (20%) had a high risk of bias. Among the 7 cross-sectional studies, 2 (29%) scored "good" in the overall quality and the remaining 5 (71%) scored "fair." VR was found to be significantly more effective than traditional methods of teaching in improving the radiographic and radiologic skills of students. The use of VR systems was found to improve the students' skills in overall proficiency, patient positioning, equipment knowledge, equipment handling, and radiographic techniques. Student feedback was also reported in the included studies. The students generally provided positive feedback about the utility, ease of use, and satisfaction of VR systems, as well as their perceived positive impact on skill and knowledge acquisition.
Conclusions: The evidence from this review shows that the use of VR had significant benefit for students in various aspects of radiology education. However, the variable nature of the studies included in the review reduces the scope for a comprehensive recommendation of VR use in radiology education.
{"title":"The Scope of Virtual Reality Simulators in Radiology Education: Systematic Literature Review.","authors":"Shishir Shetty, Supriya Bhat, Saad Al Bayatti, Sausan Al Kawas, Wael Talaat, Mohamed El-Kishawi, Natheer Al Rawi, Sangeetha Narasimhan, Hiba Al-Daghestani, Medhini Madi, Raghavendra Shetty","doi":"10.2196/52953","DOIUrl":"10.2196/52953","url":null,"abstract":"<p><strong>Background: </strong>In recent years, virtual reality (VR) has gained significant importance in medical education. Radiology education also has seen the induction of VR technology. However, there is no comprehensive review in this specific area. This review aims to fill this knowledge gap.</p><p><strong>Objective: </strong>This systematic literature review aims to explore the scope of VR use in radiology education.</p><p><strong>Methods: </strong>A literature search was carried out using PubMed, Scopus, ScienceDirect, and Google Scholar for articles relating to the use of VR in radiology education, published from database inception to September 1, 2023. The identified articles were then subjected to a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)-defined study selection process.</p><p><strong>Results: </strong>The database search identified 2503 nonduplicate articles. After PRISMA screening, 17 were included in the review for analysis, of which 3 (18%) were randomized controlled trials, 7 (41%) were randomized experimental trials, and 7 (41%) were cross-sectional studies. Of the 10 randomized trials, 3 (30%) had a low risk of bias, 5 (50%) showed some concerns, and 2 (20%) had a high risk of bias. Among the 7 cross-sectional studies, 2 (29%) scored \"good\" in the overall quality and the remaining 5 (71%) scored \"fair.\" VR was found to be significantly more effective than traditional methods of teaching in improving the radiographic and radiologic skills of students. The use of VR systems was found to improve the students' skills in overall proficiency, patient positioning, equipment knowledge, equipment handling, and radiographic techniques. Student feedback was also reported in the included studies. The students generally provided positive feedback about the utility, ease of use, and satisfaction of VR systems, as well as their perceived positive impact on skill and knowledge acquisition.</p><p><strong>Conclusions: </strong>The evidence from this review shows that the use of VR had significant benefit for students in various aspects of radiology education. However, the variable nature of the studies included in the review reduces the scope for a comprehensive recommendation of VR use in radiology education.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11094427/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140899857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lena Rössler, Manfred Herrmann, Annette Wiegand, Philipp Kanzow
Background: Multiple-choice examinations are frequently employed among German dental schools. However, details regarding the used item types and applied scoring methods are lacking.
Objective: We aimed to gain an insight into the current usage of multiple-choice items (ie, questions) in summative examinations in German undergraduate dental training programmes.
Methods: A paper-based 10-item questionnaire regarding the employed assessment methods, multiple-choice item types, and applied scoring methods was designed. The pilot-tested questionnaire was mailed to the Deans of Studies and to the Heads of Department of Operative/Restorative Dentistry at all 30 dental schools in Germany in February 2023. Statistical analysis was performed using Fisher's exact test (P<.05).
Results: The response rate amounted to 90.0% (27/30 dental schools). All respondent dental schools employed multiple-choice examinations for summative assessments. Examinations were delivered electronically by 70.4% (19/27) of the dental schools. Almost all dental schools used single-choice Type A items (88.9%) which accounted for the largest number of items in about half of the dental schools. Further item types (eg, conventional multiple-select items, Multiple-True-False, Pick-N) were only used by fewer dental schools (≤66.7%, up to 18 out of 27 dental schools). For the multiple-select item types, the applied scoring methods varied considerably (ie, awarding [intermediate] partial credit, requirements for partial credit). Dental schools with the possibility of electronic examinations used multiple-select items slightly more often (73.7%, 14/19 vs. 50.0%, 4/8). However, this difference was statistically not significant (P=.375). Dental schools used items either individually or as key feature problems consisting of a clinical case scenario followed by a number of items focusing on critical treatment steps (55.6%, 15/27). Not a single school employed alternative testing methods (eg, answer-until-correct). A formal item review process was established at about half of the dental schools (55.6%, 15/27).
Conclusions: Summative assessment methods among German dental schools vary widely. Especially, a large variability regarding the use and scoring of multiple-select multiple-choice items was found.
{"title":"Usage of Multiple-Choice Items in Summative Examinations: Questionnaire Survey Among German Undergraduate Dental Training Programmes.","authors":"Lena Rössler, Manfred Herrmann, Annette Wiegand, Philipp Kanzow","doi":"10.2196/58126","DOIUrl":"10.2196/58126","url":null,"abstract":"<p><strong>Background: </strong>Multiple-choice examinations are frequently employed among German dental schools. However, details regarding the used item types and applied scoring methods are lacking.</p><p><strong>Objective: </strong>We aimed to gain an insight into the current usage of multiple-choice items (ie, questions) in summative examinations in German undergraduate dental training programmes.</p><p><strong>Methods: </strong>A paper-based 10-item questionnaire regarding the employed assessment methods, multiple-choice item types, and applied scoring methods was designed. The pilot-tested questionnaire was mailed to the Deans of Studies and to the Heads of Department of Operative/Restorative Dentistry at all 30 dental schools in Germany in February 2023. Statistical analysis was performed using Fisher's exact test (<i>P</i><.05).</p><p><strong>Results: </strong>The response rate amounted to 90.0% (27/30 dental schools). All respondent dental schools employed multiple-choice examinations for summative assessments. Examinations were delivered electronically by 70.4% (19/27) of the dental schools. Almost all dental schools used single-choice Type A items (88.9%) which accounted for the largest number of items in about half of the dental schools. Further item types (eg, conventional multiple-select items, Multiple-True-False, Pick-N) were only used by fewer dental schools (≤66.7%, up to 18 out of 27 dental schools). For the multiple-select item types, the applied scoring methods varied considerably (ie, awarding [intermediate] partial credit, requirements for partial credit). Dental schools with the possibility of electronic examinations used multiple-select items slightly more often (73.7%, 14/19 vs. 50.0%, 4/8). However, this difference was statistically not significant (<i>P</i>=.375). Dental schools used items either individually or as key feature problems consisting of a clinical case scenario followed by a number of items focusing on critical treatment steps (55.6%, 15/27). Not a single school employed alternative testing methods (eg, answer-until-correct). A formal item review process was established at about half of the dental schools (55.6%, 15/27).</p><p><strong>Conclusions: </strong>Summative assessment methods among German dental schools vary widely. Especially, a large variability regarding the use and scoring of multiple-select multiple-choice items was found.</p><p><strong>Clinicaltrial: </strong></p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140856088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Digital Skills to Improve Levels of Care and Renew Health Care Professions.","authors":"Massimo De Martinis, Lia Ginaldi","doi":"10.2196/58743","DOIUrl":"10.2196/58743","url":null,"abstract":"","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11085040/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140877479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julien Grosjean, Frank Dufour, Arriel Benis, Jean-Marie Januel, Pascal Staccini, Stéfan Jacques Darmoni
SaNuRN is a five-year project by the University of Rouen Normandy (URN) and the Côte d’Azur University (CAU) consortium to optimize digital health education for medical and paramedical students, professionals, and administrators. The project includes a skills framework, training modules, and teaching resources. In 2027, SaNuRN is expected to train a significant portion of the 400,000 health and paramedical professions students at the French national level. Our purpose is to give a synopsis of the SaNuRN initiative, emphasizing its novel educational methods and how they will enhance the delivery of digital health education. Our goals include showcasing SaNuRN as a comprehensive program consisting of a proficiency framework, instructional modules, and educational materials and explaining how SaNuRN is implemented in the participating academic institutions. SaNuRN is a project aimed at educating and training health-related and paramedics students in digital health. The project results from a cooperative effort between URN and CAU, covering four French departments. The project is based on the French National Referential on Digital Health (FNRDH), which defines the skills and competencies to be acquired and validated by every student in the health, paramedical, and social professions curricula. The SaNuRN team is currently adapting the existing URN and CAU syllabi to FNRDH and developing short-duration video capsules of 20 to 30 minutes to teach all the relevant material. The project aims to ensure that the largest student population earns the necessary skills, and it has developed a two-tier system involving facilitators who will enable the efficient expansion of the project’s educational outreach and support the students in learning the needed material efficiently. With a focus on real-world scenarios and innovative teaching activities integrating telemedicine devices and virtual professionals, SaNuRN is committed to enabling continuous learning for healthcare professionals in clinical practice. The SaNuRN team introduced new ways of evaluating healthcare professionals by shifting from a knowledge-based to a competencies-based evaluation, aligning with the Miller teaching pyramid and using the Objective Structured Clinical Examination and Script Concordance Test in digital health education. Drawing on the expertise of URN, CAU, and their public health and digital research laboratories and partners, the SaNuRN project represents a platform for continuous innovation, including telemedicine training and living labs with virtual and interactive professional activities. The SaNuRN project provides a comprehensive, personalized 30-hour training package for health and paramedical students, addressing all 70 FNRDH competencies. The program is enhanced using AI and NLP to create virtual patients and professionals for digital healthcare simulation. SaNuRN teaching materials are open-access. The project collaborates with academic institutions worldwide t
{"title":"Digital Health Education for the Future: The SaNuRN (Santé Numérique Rouen-Nice) Consortium's Journey.","authors":"Julien Grosjean, Frank Dufour, Arriel Benis, Jean-Marie Januel, Pascal Staccini, Stéfan Jacques Darmoni","doi":"10.2196/53997","DOIUrl":"10.2196/53997","url":null,"abstract":"<p><p>SaNuRN is a five-year project by the University of Rouen Normandy (URN) and the Côte d’Azur University (CAU) consortium to optimize digital health education for medical and paramedical students, professionals, and administrators. The project includes a skills framework, training modules, and teaching resources. In 2027, SaNuRN is expected to train a significant portion of the 400,000 health and paramedical professions students at the French national level. Our purpose is to give a synopsis of the SaNuRN initiative, emphasizing its novel educational methods and how they will enhance the delivery of digital health education. Our goals include showcasing SaNuRN as a comprehensive program consisting of a proficiency framework, instructional modules, and educational materials and explaining how SaNuRN is implemented in the participating academic institutions. SaNuRN is a project aimed at educating and training health-related and paramedics students in digital health. The project results from a cooperative effort between URN and CAU, covering four French departments. The project is based on the French National Referential on Digital Health (FNRDH), which defines the skills and competencies to be acquired and validated by every student in the health, paramedical, and social professions curricula. The SaNuRN team is currently adapting the existing URN and CAU syllabi to FNRDH and developing short-duration video capsules of 20 to 30 minutes to teach all the relevant material. The project aims to ensure that the largest student population earns the necessary skills, and it has developed a two-tier system involving facilitators who will enable the efficient expansion of the project’s educational outreach and support the students in learning the needed material efficiently. With a focus on real-world scenarios and innovative teaching activities integrating telemedicine devices and virtual professionals, SaNuRN is committed to enabling continuous learning for healthcare professionals in clinical practice. The SaNuRN team introduced new ways of evaluating healthcare professionals by shifting from a knowledge-based to a competencies-based evaluation, aligning with the Miller teaching pyramid and using the Objective Structured Clinical Examination and Script Concordance Test in digital health education. Drawing on the expertise of URN, CAU, and their public health and digital research laboratories and partners, the SaNuRN project represents a platform for continuous innovation, including telemedicine training and living labs with virtual and interactive professional activities. The SaNuRN project provides a comprehensive, personalized 30-hour training package for health and paramedical students, addressing all 70 FNRDH competencies. The program is enhanced using AI and NLP to create virtual patients and professionals for digital healthcare simulation. SaNuRN teaching materials are open-access. The project collaborates with academic institutions worldwide t","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11082434/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140872504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}