JMIR Medical Education最新文献

Background: Critical evaluation of naloxone coprescription academic detailing programs has been positive, but little research has focused on how participant thinking changes during academic detailing.

Objective: The dual purposes of this study were to (1) present a metacognitive evaluation of a naloxone coprescription academic detailing intervention and (2) describe the application of a metacognitive evaluation for future medical education interventions.

Methods: Data were obtained from a pre-post knowledge assessment of a web-based, self-paced intervention designed to increase knowledge of clinical and organizational best practices for the coprescription of naloxone. To assess metacognition, items were designed with confidence-weighted true-false scoring. Multiple metacognitive scores were calculated: 3 content knowledge scores and 5 confidence-weighted true-false scores. Statistical analysis examined whether there were significant differences in scores before and after intervention. Analysis of overall content knowledge showed significant improvement at posttest.

Results: There was a significant positive increase in absolute accuracy of participant confidence judgments, confidence in correct probability, and confidence in incorrect probability (all P values were <.05). Overall, results suggest an improvement in content knowledge scores after intervention and, metacognitively, suggest that individuals were more confident in their answer choices, regardless of correctness.

Conclusions: Implications include the potential application of metacognitive evaluations to assess nuances in learner performance during academic detailing interventions and as a feedback mechanism to reinforce learning and guide curricular design.

Background: Social media (SoMe) have taken a major place in the medical field, and younger generations are increasingly using them as their primary source to find information.

Objective: This study aimed to describe the use of SoMe for medical education among French medical students and assess the prevalence of smartphone addiction in this population.

Methods: A cross-sectional web-based survey was conducted among French medical students (second to sixth year of study). The questionnaire collected information on SoMe use for medical education and professional behavior. Smartphone addiction was assessed using the Smartphone Addiction Scale Short-Version (SAS-SV) score.

Results: A total of 762 medical students responded to the survey. Of these, 762 (100%) were SoMe users, spending a median of 120 (IQR 60-150) minutes per day on SoMe; 656 (86.1%) used SoMe for medical education, with YouTube, Instagram, and Facebook being the most popular platforms. The misuse of SoMe in a professional context was also identified; 27.2% (207/762) of students posted hospital internship content, and 10.8% (82/762) searched for a patient's name on SoMe. Smartphone addiction was prevalent among 29.1% (222/762) of respondents, with a significant correlation between increased SoMe use and SAS-SV score (r=0.39, 95% CI 0.33-0.45; P<.001). Smartphone-addicted students reported a higher impact on study time (211/222, 95% vs 344/540, 63.6%; P<.001) and a greater tendency to share hospital internship content on social networks (78/222, 35.1% vs 129/540, 23.8%; P=.002).

Conclusions: Our findings reveal the extensive use of SoMe for medical education among French medical students, alongside a notable prevalence of smartphone addiction. These results highlight the need for medical schools and educators to address the responsible use of SoMe and develop strategies to mitigate the risks associated with excessive use and addiction.

Background: Although digital health is essential for improving health care, its adoption remains slow due to the lack of literacy in this area. Therefore, it is crucial for health professionals to acquire digital skills and for a digital competence assessment and accreditation model to be implemented to make advances in this field.

Objective: This study had two objectives: (1) to create a specific map of digital competences for health professionals and (2) to define and test a digital competence assessment and accreditation model for health professionals.

Methods: We took an iterative mixed methods approach, which included a review of the gray literature and consultation with local experts. We used the arithmetic mean and SD in descriptive statistics, P values in hypothesis testing and subgroup comparisons, the greatest lower bound in test diagnosis, and the discrimination index in study instrument analysis.

Results: The assessment model designed in accordance with the competence content defined in the map of digital competences and based on scenarios had excellent internal consistency overall (greatest lower bound=0.91). Although most study participants (110/122, 90.2%) reported an intermediate self-perceived digital competence level, we found that the vast majority would not attain a level-2 Accreditation of Competence in Information and Communication Technologies.

Conclusions: Knowing the digital competence level of health professionals based on a defined competence framework should enable such professionals to be trained and updated to meet real needs in their specific professional contexts and, consequently, take full advantage of the potential of digital technologies. These results have informed the Health Plan for Catalonia 2021-2025, thus laying the foundations for creating and offering specific training to assess and certify the digital competence of such professionals.

Background: Incremental advancements in artificial intelligence (AI) technology have facilitated its integration into various disciplines. In particular, the infusion of AI into medical education has emerged as a significant trend, with noteworthy research findings. Consequently, a comprehensive review and analysis of the current research landscape of AI in medical education is warranted.

Objective: This study aims to conduct a bibliometric analysis of pertinent papers, spanning the years 2013-2022, using CiteSpace and VOSviewer. The study visually represents the existing research status and trends of AI in medical education.

Methods: Articles related to AI and medical education, published between 2013 and 2022, were systematically searched in the Web of Science core database. Two reviewers scrutinized the initially retrieved papers, based on their titles and abstracts, to eliminate papers unrelated to the topic. The selected papers were then analyzed and visualized for country, institution, author, reference, and keywords using CiteSpace and VOSviewer.

Results: A total of 195 papers pertaining to AI in medical education were identified from 2013 to 2022. The annual publications demonstrated an increasing trend over time. The United States emerged as the most active country in this research arena, and Harvard Medical School and the University of Toronto were the most active institutions. Prolific authors in this field included Vincent Bissonnette, Charlotte Blacketer, Rolando F Del Maestro, Nicole Ledows, Nykan Mirchi, Alexander Winkler-Schwartz, and Recai Yilamaz. The paper with the highest citation was "Medical Students' Attitude Towards Artificial Intelligence: A Multicentre Survey." Keyword analysis revealed that "radiology," "medical physics," "ehealth," "surgery," and "specialty" were the primary focus, whereas "big data" and "management" emerged as research frontiers.

Conclusions: The study underscores the promising potential of AI in medical education research. Current research directions encompass radiology, medical information management, and other aspects. Technological progress is expected to broaden these directions further. There is an urgent need to bolster interregional collaboration and enhance research quality. These findings offer valuable insights for researchers to identify perspectives and guide future research directions.

Background: The 2024 Nephrology fellowship match data show the declining interest in nephrology in the United States, with an 11% drop in candidates and a mere 66% (321/488) of positions filled.

Objective: The study aims to discern the factors influencing this trend using ChatGPT, a leading chatbot model, for insights into the comparative appeal of nephrology versus other internal medicine specialties.

Methods: Using the GPT-4 model, the study compared nephrology with 13 other internal medicine specialties, evaluating each on 7 criteria including intellectual complexity, work-life balance, procedural involvement, research opportunities, patient relationships, career demand, and financial compensation. Each criterion was assigned scores from 1 to 10, with the cumulative score determining the ranking. The approach included counteracting potential bias by instructing GPT-4 to favor other specialties over nephrology in reverse scenarios.

Results: GPT-4 ranked nephrology only above sleep medicine. While nephrology scored higher than hospice and palliative medicine, it fell short in key criteria such as work-life balance, patient relationships, and career demand. When examining the percentage of filled positions in the 2024 appointment year match, nephrology's filled rate was 66%, only higher than the 45% (155/348) filled rate of geriatric medicine. Nephrology's score decreased by 4%-14% in 5 criteria including intellectual challenge and complexity, procedural involvement, career opportunity and demand, research and academic opportunities, and financial compensation.

Conclusions: ChatGPT does not favor nephrology over most internal medicine specialties, highlighting its diminishing appeal as a career choice. This trend raises significant concerns, especially considering the overall physician shortage, and prompts a reevaluation of factors affecting specialty choice among medical residents.

Background: Current challenges in patient care have increased research on technology use in nursing and health care. Digital assistive technologies (DATs) are one option that can be incorporated into care processes. However, how the application of DATs should be introduced to nurses and care professionals must be clarified. No structured and effective education concepts for the patient-oriented integration of DATs in the nursing sector are currently available.

Objective: This study aims to examine how a structured and guided integration and education concept, herein termed the sensitization, evaluative introduction, qualification, and implementation (SEQI) education concept, can support the integration of DATs into nursing practices.

Methods: This study used an explanatory, sequential study design with a mixed methods approach. The SEQI intervention was run in 26 long-term care facilities oriented toward older adults in Germany after a 5-day training course in each. The participating care professionals were asked to test 1 of 6 DATs in real-world practice over 3 days. Surveys (n=112) were then administered that recorded the intention to use DATs at 3 measurement points, and guided qualitative interviews with care professionals (n=12) were conducted to evaluate the learning concepts and effects of the intervention.

Results: As this was a pilot study, no sample size calculation was carried out, and P values were not reported. The participating care professionals were generally willing to integrate DATs-as an additional resource-into nursing processes even before the 4-stage SEQI intervention was presented. However, the intervention provided additional background knowledge and sensitized care professionals to the digital transformation, enabling them to evaluate how DATs fit in the health care sector, what qualifies these technologies for correct application, and what promotes their use. The care professionals expressed specific ideas and requirements for both technology-related education concepts and nursing DATs.

Conclusions: Actively matching technical support, physical limitations, and patients' needs is crucial when selecting DATs and integrating them into nursing processes. To this end, using a structured process such as SEQI that strengthens care professionals' ability to integrate DATs can help improve the benefits of such technology in the health care setting. Practical, application-oriented learning can promote the long-term implementation of DATs.

Background: The integration of gender and sexuality awareness in health care is increasingly recognized as vital for patient outcomes. Despite this, there is a notable lack of comprehensive data on the current state of physicians' training and perceptions in these areas, leading to a gap in targeted educational interventions and optimal health care delivery.

Objective: The study's aim was to explore the experiences and perceptions of attending and resident physicians regarding the inclusion of gender and sexuality content in medical school curricula and professional practice in Israel.

Methods: This cross-sectional survey targeted a diverse group of physicians across various specializations and experience levels. Distributed through Israeli Medical Associations and professional networks, it included sections on experiences with gender and sexuality content, perceptions of knowledge, the impact of medical school curricula on professional capabilities, and views on integrating gender medicine in medical education. Descriptive and correlational analyses, along with gender-based and medical status-based comparisons, were used, complemented, and enhanced by qualitative analysis of participants' replies.

Results: The survey, encompassing 189 respondents, revealed low-to-moderate exposure to gender and sexuality content in medical school curricula, with a similar perception of preparedness. A need for more comprehensive training was widely recognized. The majority valued training in these areas for enhancing professional capabilities, identifying 10 essential gender-related knowledge areas. The preference for integrating gender medicine throughout medical education was significant. Gender-based analysis indicated variations in exposure and perceptions.

Conclusions: The study highlights a crucial need for the inclusion of gender and sexuality awareness in medical education and practice. It suggests the necessity for curriculum development, targeted training programs, policy advocacy, mentorship initiatives, and research to evaluate the effectiveness of these interventions. The findings serve as a foundation for future directions in medical education, aiming for a more inclusive, aware, and prepared medical workforce.

Background: This research explores the capabilities of ChatGPT-4 in passing the American Board of Family Medicine (ABFM) Certification Examination. Addressing a gap in existing literature, where earlier artificial intelligence (AI) models showed limitations in medical board examinations, this study evaluates the enhanced features and potential of ChatGPT-4, especially in document analysis and information synthesis.

Objective: The primary goal is to assess whether ChatGPT-4, when provided with extensive preparation resources and when using sophisticated data analysis, can achieve a score equal to or above the passing threshold for the Family Medicine Board Examinations.

Methods: In this study, ChatGPT-4 was embedded in a specialized subenvironment, "AI Family Medicine Board Exam Taker," designed to closely mimic the conditions of the ABFM Certification Examination. This subenvironment enabled the AI to access and analyze a range of relevant study materials, including a primary medical textbook and supplementary web-based resources. The AI was presented with a series of ABFM-type examination questions, reflecting the breadth and complexity typical of the examination. Emphasis was placed on assessing the AI's ability to interpret and respond to these questions accurately, leveraging its advanced data processing and analysis capabilities within this controlled subenvironment.

Results: In our study, ChatGPT-4's performance was quantitatively assessed on 300 practice ABFM examination questions. The AI achieved a correct response rate of 88.67% (95% CI 85.08%-92.25%) for the Custom Robot version and 87.33% (95% CI 83.57%-91.10%) for the Regular version. Statistical analysis, including the McNemar test (P=.45), indicated no significant difference in accuracy between the 2 versions. In addition, the chi-square test for error-type distribution (P=.32) revealed no significant variation in the pattern of errors across versions. These results highlight ChatGPT-4's capacity for high-level performance and consistency in responding to complex medical examination questions under controlled conditions.

Conclusions: The study demonstrates that ChatGPT-4, particularly when equipped with specialized preparation and when operating in a tailored subenvironment, shows promising potential in handling the intricacies of medical board examinations. While its performance is comparable with the expected standards for passing the ABFM Certification Examination, further enhancements in AI technology and tailored training methods could push these capabilities to new heights. This exploration opens avenues for integrating AI tools such as ChatGPT-4 in medical education and assessment, emphasizing the importance of continuous advancement and specialized training in medical applications of AI.