首页 > 最新文献

Family Medicine最新文献

英文 中文
Inappropriate Survey Design Misstates Findings on Use of Preference Signaling. 不恰当的调查设计误导了关于偏好信号使用情况的调查结果。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-09-10 DOI: 10.22454/FamMed.2024.994096
Bailey Slone White
{"title":"Inappropriate Survey Design Misstates Findings on Use of Preference Signaling.","authors":"Bailey Slone White","doi":"10.22454/FamMed.2024.994096","DOIUrl":"10.22454/FamMed.2024.994096","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":"56 9","pages":"605"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493116/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142479697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning Networks: How Family Medicine Departments Are Meeting the Requirement. 学习网络:全科医学科如何满足要求。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-08-12 DOI: 10.22454/FamMed.2024.556157
Dean A Seehusen, Isabella Brout, Stephen A Wilson

Background and objectives: In 2023, the Accreditation Council for Graduate Medical Education added participation within a "learning collaborative" or "learning network" (LN) as a requirement for family medicine residencies. The structure and scope of what makes an acceptable LN was only vaguely defined. The purpose of this study was to learn how many family medicine residencies associated with departments already belong to LNs, the purpose and funding of these existing LNs, and barriers to entering LNs.

Methods: An online survey was sent to family medicine department chairs through a Council of Academic Family Medicine Educational Research Alliance omnibus study from August to September 2023. Survey questions explored the purpose, structure, and funding of LNs that associated residency programs already belonged to as well as the chairs' beliefs and knowledge about LNs.

Results: Of the 227 chairs, 119 completed the survey (50.2%). About 53% reported that their department was part of an LN, with more than one-third belonging for 5 years or less; 47% had a low understanding of what an LN is; and 71% had little to no concern that collaborating in an LN would negatively affect residency recruitment. The purpose of most LNs was a mix of research, education, and clinical activities. Faculty's lack of knowledge about LNs and lack of time were the top barriers identified to joining an LN. Funding was varied, and departmental funding was positively associated with administrative control of the LN.

Conclusions: About half of the residency programs associated with family medicine departments already belong to LNs. Wide variation among existing LNs may lead to significantly disparate outcomes for residents and residencies as they navigate this new requirement.

背景和目标:2023 年,毕业后医学教育认证委员会将参与 "学习合作 "或 "学习网络"(LN)作为家庭医学住院医师培训的一项要求。但对可接受的学习网络的结构和范围仅有模糊的定义。本研究旨在了解有多少与科室相关的家庭医学住院医师已经加入了 LN,这些现有 LN 的目的和资金来源,以及加入 LN 的障碍:2023 年 8 月至 9 月,通过全科医学教育研究联盟理事会的一项综合研究,向全科医学系主任发送了一份在线调查。调查问题涉及相关住院医师培训项目已加入的LNs的目的、结构和资金来源,以及系主任对LNs的看法和了解:在 227 位系主任中,119 位完成了调查(50.2%)。约53%的人称他们所在的科室是LN的一部分,其中超过三分之一的人加入LN的时间为5年或更短;47%的人对LN的含义了解不多;71%的人几乎不担心与LN合作会对住院医师招募产生负面影响。大多数 LN 的目的是混合研究、教育和临床活动。教员对 LN 缺乏了解和缺乏时间是加入 LN 的最大障碍。资金来源各不相同,系部资金与 LN 的行政控制呈正相关:结论:与全科医学系相关的住院医师培训项目中,约有一半已经加入了LN。结论:与全科医学系相关的住院医师培训项目中,约有一半已经加入了LNs。现有LNs之间的巨大差异可能会导致住院医师和住院医师培训项目在应对这一新要求时出现明显的结果差异。
{"title":"Learning Networks: How Family Medicine Departments Are Meeting the Requirement.","authors":"Dean A Seehusen, Isabella Brout, Stephen A Wilson","doi":"10.22454/FamMed.2024.556157","DOIUrl":"10.22454/FamMed.2024.556157","url":null,"abstract":"<p><strong>Background and objectives: </strong>In 2023, the Accreditation Council for Graduate Medical Education added participation within a \"learning collaborative\" or \"learning network\" (LN) as a requirement for family medicine residencies. The structure and scope of what makes an acceptable LN was only vaguely defined. The purpose of this study was to learn how many family medicine residencies associated with departments already belong to LNs, the purpose and funding of these existing LNs, and barriers to entering LNs.</p><p><strong>Methods: </strong>An online survey was sent to family medicine department chairs through a Council of Academic Family Medicine Educational Research Alliance omnibus study from August to September 2023. Survey questions explored the purpose, structure, and funding of LNs that associated residency programs already belonged to as well as the chairs' beliefs and knowledge about LNs.</p><p><strong>Results: </strong>Of the 227 chairs, 119 completed the survey (50.2%). About 53% reported that their department was part of an LN, with more than one-third belonging for 5 years or less; 47% had a low understanding of what an LN is; and 71% had little to no concern that collaborating in an LN would negatively affect residency recruitment. The purpose of most LNs was a mix of research, education, and clinical activities. Faculty's lack of knowledge about LNs and lack of time were the top barriers identified to joining an LN. Funding was varied, and departmental funding was positively associated with administrative control of the LN.</p><p><strong>Conclusions: </strong>About half of the residency programs associated with family medicine departments already belong to LNs. Wide variation among existing LNs may lead to significantly disparate outcomes for residents and residencies as they navigate this new requirement.</p>","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":" ","pages":"561-566"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493123/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Survey Design for Family Medicine Residents and Faculty. 针对全科住院医师和教师的调查设计。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-08-26 DOI: 10.22454/FamMed.2024.785866
Katherine M Wright, John L Gatta, Deborah S Clements
{"title":"Survey Design for Family Medicine Residents and Faculty.","authors":"Katherine M Wright, John L Gatta, Deborah S Clements","doi":"10.22454/FamMed.2024.785866","DOIUrl":"10.22454/FamMed.2024.785866","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":" ","pages":"611"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
We Had Bodies. 我们有身体
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-09-09 DOI: 10.22454/FamMed.2024.636507
Sophie L Schott
{"title":"We Had Bodies.","authors":"Sophie L Schott","doi":"10.22454/FamMed.2024.636507","DOIUrl":"10.22454/FamMed.2024.636507","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":"56 9","pages":"591-592"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493115/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142479701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond the Mirage: Confronting Historic Inequities in Maternal Care Deserts. 超越海市蜃楼:面对孕产妇护理荒漠中历史性的不平等。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-09-09 DOI: 10.22454/FamMed.2024.850422
Chynna Smith
{"title":"Beyond the Mirage: Confronting Historic Inequities in Maternal Care Deserts.","authors":"Chynna Smith","doi":"10.22454/FamMed.2024.850422","DOIUrl":"10.22454/FamMed.2024.850422","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":"56 9","pages":"606-607"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493125/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142479696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Missing Tools, Missing Out. 缺失工具,错失机会。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 DOI: 10.22454/FamMed.2024.757299
Joseph W Gravel
{"title":"Missing Tools, Missing Out.","authors":"Joseph W Gravel","doi":"10.22454/FamMed.2024.757299","DOIUrl":"10.22454/FamMed.2024.757299","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":"56 9","pages":"612-614"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493126/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142479698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
When Interruption Becomes Innovation: How Integrated Behavioral Health in Primary Care Adapted During COVID-19. 当中断成为创新:初级保健中的综合行为健康如何在 COVID-19 期间进行调整。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-07-15 DOI: 10.22454/FamMed.2024.168465
Brianna M Lombardi, Lisa de Saxe Zerden, Danya K Krueger, Sundania J W Wonnum, Erica L Richman

Background and objectives: Integrated behavioral health (IBH) delivered in primary care is critical to addressing the growing behavioral health crisis in the United States. COVID-19 prompted changes to the core components of IBH, causing the model to shift. The specifics of how IBH teams adapted and what these adaptations mean for the future of IBH teams in primary care are uncertain.

Methods: We conducted individual interviews with IBH team members using a semistructured interview guide. A purposive convenience sample consisted of primary care clinicians (N=20) from nine states. We used qualitative thematic analysis to code and generate themes.

Results: Four themes emerged: (a) permanent changes to the physical structure of the team; (b) increased reliance on technology for team communication; (c) shift in team collaboration, often occurring asynchronously; and (d) telehealth embraced for IBH.

Conclusions: COVID-19 interrupted the originally designed IBH model of team-based care. Changes to the physical proximity of team members disrupted all other components of IBH, requiring adapted workflows, communication via digital channels, virtual team building, asynchronous care coordination, and remote service delivery. Long-term evaluation of these innovations is needed to examine whether shifts in core components impact model efficacy. Training family medicine, primary care, and behavioral health clinicians for these adapted models of IBH will be needed.

背景和目标:在初级保健中提供综合行为健康(IBH)对于解决美国日益严重的行为健康危机至关重要。COVID-19 促使 IBH 的核心组成部分发生变化,导致模式发生转变。IBH 团队如何进行调整以及这些调整对初级医疗中 IBH 团队的未来意味着什么,这些问题的具体细节尚不确定:我们使用半结构化访谈指南对 IBH 团队成员进行了个别访谈。有目的性的方便样本包括来自九个州的初级保健临床医生(N=20)。我们采用定性主题分析法进行编码并生成主题:出现了四个主题:(a) 团队物理结构的永久性改变;(b) 团队沟通对技术的依赖性增加;(c) 团队协作的转变,通常为异步协作;(d) IBH 采用远程医疗:结论:COVID-19 干扰了最初设计的以团队为基础的 IBH 医疗模式。团队成员物理距离的改变扰乱了 IBH 的所有其他组成部分,需要调整工作流程、通过数字渠道进行沟通、建立虚拟团队、异步护理协调和远程提供服务。需要对这些创新进行长期评估,以研究核心组成部分的转变是否会影响模式的有效性。需要对家庭医学、初级保健和行为健康临床医生进行培训,使其掌握这些经过调整的 IBH 模式。
{"title":"When Interruption Becomes Innovation: How Integrated Behavioral Health in Primary Care Adapted During COVID-19.","authors":"Brianna M Lombardi, Lisa de Saxe Zerden, Danya K Krueger, Sundania J W Wonnum, Erica L Richman","doi":"10.22454/FamMed.2024.168465","DOIUrl":"10.22454/FamMed.2024.168465","url":null,"abstract":"<p><strong>Background and objectives: </strong>Integrated behavioral health (IBH) delivered in primary care is critical to addressing the growing behavioral health crisis in the United States. COVID-19 prompted changes to the core components of IBH, causing the model to shift. The specifics of how IBH teams adapted and what these adaptations mean for the future of IBH teams in primary care are uncertain.</p><p><strong>Methods: </strong>We conducted individual interviews with IBH team members using a semistructured interview guide. A purposive convenience sample consisted of primary care clinicians (N=20) from nine states. We used qualitative thematic analysis to code and generate themes.</p><p><strong>Results: </strong>Four themes emerged: (a) permanent changes to the physical structure of the team; (b) increased reliance on technology for team communication; (c) shift in team collaboration, often occurring asynchronously; and (d) telehealth embraced for IBH.</p><p><strong>Conclusions: </strong>COVID-19 interrupted the originally designed IBH model of team-based care. Changes to the physical proximity of team members disrupted all other components of IBH, requiring adapted workflows, communication via digital channels, virtual team building, asynchronous care coordination, and remote service delivery. Long-term evaluation of these innovations is needed to examine whether shifts in core components impact model efficacy. Training family medicine, primary care, and behavioral health clinicians for these adapted models of IBH will be needed.</p>","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":" ","pages":"548-554"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493129/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141621690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PROMOTE: An Innovative Curriculum to Enhance the Maternity Care Workforce. PROMOTE:加强孕产妇护理队伍的创新课程。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-08-19 DOI: 10.22454/FamMed.2024.146382
Jennifer D Cohn, Matthew D Kearney, Melissa L Donze, Caroline S O'Brien, Mario P DeMarco

Background and objectives: Maternal morbidity and mortality disproportionally affect marginalized populations in both rural and urban settings. While the workforce of family physicians (FPs) who provide maternity care is declining, an enhanced obstetrics (OB) curriculum during residency training can help prepare future FPs to provide competent pregnancy care, particularly in marginalized communities.

Methods: We developed an innovative OB curriculum-PROMOTE: Primary care obstetrics and maternal outcomes training enhancement-in an urban underserved residency program in Pennsylvania that directly addressed barriers previously known to impact maternity care practice. We created a clinical competency assessment aligned with Accreditation Council for Graduate Medical Education requirements, and we reviewed resident feedback and logs throughout and upon completion of the track.

Results: After 3 years of implementation, 23 of 48 (48%) total residents entered and/or completed PROMOTE, compared to 17 of 45 (38%) total residents who chose the OB track in the 5 years prior to implementation. Postimplementation, 29.6% of total graduates practice inpatient obstetrics, compared to 26.6% prior to implementation. Twice annual competency evaluations were completed for all residents on the track. Our review of resident submitted feedback, logs, and competency assessments suggests that the curriculum has positively impacted their knowledge, skills, and clinical care provision.

Conclusions: PROMOTE's curricular innovation enhances obstetrical training by addressing known facilitators and barriers to practicing family medicine obstetrics. PROMOTE was implemented in an existing family medicine residency with an obstetrics track and could be adapted by other residency programs to enhance the future maternity care workforce.

背景和目标:在农村和城市环境中,孕产妇发病率和死亡率对边缘化人群的影响尤为严重。虽然提供孕产妇保健的家庭医生(FPs)队伍正在减少,但在住院医师培训期间加强产科(OB)课程有助于培养未来的家庭医生提供合格的孕期保健,尤其是在边缘化社区:方法:我们在宾夕法尼亚州一个服务不足的城市住院医师培训项目中开发了一个创新的产科课程--PROMOTE:初级产科护理和孕产妇结局培训强化课程,直接解决了之前已知的影响孕产妇护理实践的障碍。我们创建了一个符合美国医学教育认证委员会(Accreditation Council for Graduate Medical Education)要求的临床能力评估,并在整个培训过程中和培训结束后对住院医师的反馈和日志进行了审查:实施 3 年后,48 名住院医师中有 23 名(48%)进入和/或完成了 PROMOTE,而在实施前 5 年,45 名住院医师中有 17 名(38%)选择了产科方向。实施后,29.6% 的毕业生在住院产科实习,而实施前这一比例为 26.6%。该方向的所有住院医师都完成了每年两次的能力评估。我们对住院医师提交的反馈意见、日志和能力评估进行了审查,结果表明该课程对他们的知识、技能和临床护理工作产生了积极影响:结论:PROMOTE 的课程创新通过解决家庭医学产科实践中已知的促进因素和障碍,加强了产科培训。PROMOTE 在一个现有的全科医学住院医师培训项目中实施,并设有产科方向,其他住院医师培训项目也可对其进行调整,以增强未来的孕产妇护理队伍。
{"title":"PROMOTE: An Innovative Curriculum to Enhance the Maternity Care Workforce.","authors":"Jennifer D Cohn, Matthew D Kearney, Melissa L Donze, Caroline S O'Brien, Mario P DeMarco","doi":"10.22454/FamMed.2024.146382","DOIUrl":"10.22454/FamMed.2024.146382","url":null,"abstract":"<p><strong>Background and objectives: </strong>Maternal morbidity and mortality disproportionally affect marginalized populations in both rural and urban settings. While the workforce of family physicians (FPs) who provide maternity care is declining, an enhanced obstetrics (OB) curriculum during residency training can help prepare future FPs to provide competent pregnancy care, particularly in marginalized communities.</p><p><strong>Methods: </strong>We developed an innovative OB curriculum-PROMOTE: Primary care obstetrics and maternal outcomes training enhancement-in an urban underserved residency program in Pennsylvania that directly addressed barriers previously known to impact maternity care practice. We created a clinical competency assessment aligned with Accreditation Council for Graduate Medical Education requirements, and we reviewed resident feedback and logs throughout and upon completion of the track.</p><p><strong>Results: </strong>After 3 years of implementation, 23 of 48 (48%) total residents entered and/or completed PROMOTE, compared to 17 of 45 (38%) total residents who chose the OB track in the 5 years prior to implementation. Postimplementation, 29.6% of total graduates practice inpatient obstetrics, compared to 26.6% prior to implementation. Twice annual competency evaluations were completed for all residents on the track. Our review of resident submitted feedback, logs, and competency assessments suggests that the curriculum has positively impacted their knowledge, skills, and clinical care provision.</p><p><strong>Conclusions: </strong>PROMOTE's curricular innovation enhances obstetrical training by addressing known facilitators and barriers to practicing family medicine obstetrics. PROMOTE was implemented in an existing family medicine residency with an obstetrics track and could be adapted by other residency programs to enhance the future maternity care workforce.</p>","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":" ","pages":"567-571"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493113/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Publishing on Diversity, Equity, and Inclusion Can Advance the Work. 出版关于多样性、公平和包容性的书籍可以推动工作。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 DOI: 10.22454/FamMed.2024.366445
José E Rodríguez, Judy C Washington, Amy Fulton
{"title":"Publishing on Diversity, Equity, and Inclusion Can Advance the Work.","authors":"José E Rodríguez, Judy C Washington, Amy Fulton","doi":"10.22454/FamMed.2024.366445","DOIUrl":"10.22454/FamMed.2024.366445","url":null,"abstract":"","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":"56 9","pages":"609-610"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493130/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142479699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance of Language Models on the Family Medicine In-Training Exam. 语言模型在全科医学实习考试中的表现。
IF 1.8 4区 医学 Q2 MEDICINE, GENERAL & INTERNAL Pub Date : 2024-10-01 Epub Date: 2024-08-12 DOI: 10.22454/FamMed.2024.233738
Rana E Hanna, Logan R Smith, Rahul Mhaskar, Karim Hanna

Background and objectives: Artificial intelligence (AI), such as ChatGPT and Bard, has gained popularity as a tool in medical education. The use of AI in family medicine has not yet been assessed. The objective of this study is to compare the performance of three large language models (LLMs; ChatGPT 3.5, ChatGPT 4.0, and Google Bard) on the family medicine in-training exam (ITE).

Methods: The 193 multiple-choice questions of the 2022 ITE, written by the American Board of Family Medicine, were inputted in ChatGPT 3.5, ChatGPT 4.0, and Bard. The LLMs' performance was then scored and scaled.

Results: ChatGPT 4.0 scored 167/193 (86.5%) with a scaled score of 730 out of 800. According to the Bayesian score predictor, ChatGPT 4.0 has a 100% chance of passing the family medicine board exam. ChatGPT 3.5 scored 66.3%, translating to a scaled score of 400 and an 88% chance of passing the family medicine board exam. Bard scored 64.2%, with a scaled score of 380 and an 85% chance of passing the boards. Compared to the national average of postgraduate year 3 residents, only ChatGPT 4.0 surpassed the residents' mean of 68.4%.

Conclusions: ChatGPT 4.0 was the only LLM that outperformed the family medicine postgraduate year 3 residents' national averages on the 2022 ITE, providing robust explanations and demonstrating its potential use in delivering background information on common medical concepts that appear on board exams.

背景和目的:人工智能(AI),如 ChatGPT 和 Bard,作为医学教育中的一种工具已越来越受欢迎。人工智能在全科医学中的应用尚未得到评估。本研究旨在比较三种大型语言模型(LLMs;ChatGPT 3.5、ChatGPT 4.0 和 Google Bard)在全科医学内训考试(ITE)中的表现:在 ChatGPT 3.5、ChatGPT 4.0 和 Bard 中输入由美国全科医学委员会编写的 2022 年 ITE 的 193 道选择题。然后对法学硕士的成绩进行评分和标度:ChatGPT 4.0 得分为 167/193 (86.5%),满分 800 分,得分 730 分。根据贝叶斯分数预测法,ChatGPT 4.0 通过家庭医学委员会考试的几率为 100%。ChatGPT 3.5 的得分率为 66.3%,换算成比例分数为 400 分,通过全科医学执业医师考试的几率为 88%。Bard 的得分率为 64.2%,比例分数为 380 分,通过委员会考试的几率为 85%。与全国研究生三年级住院医师的平均水平相比,只有 ChatGPT 4.0 超过了住院医师的平均水平 68.4%:ChatGPT 4.0 是唯一一个在 2022 年 ITE 考试中成绩超过全科医学研究生三年级住院医师全国平均水平的 LLM,它提供了可靠的解释,并证明了其在提供董事会考试中出现的常见医学概念背景信息方面的潜在用途。
{"title":"Performance of Language Models on the Family Medicine In-Training Exam.","authors":"Rana E Hanna, Logan R Smith, Rahul Mhaskar, Karim Hanna","doi":"10.22454/FamMed.2024.233738","DOIUrl":"10.22454/FamMed.2024.233738","url":null,"abstract":"<p><strong>Background and objectives: </strong>Artificial intelligence (AI), such as ChatGPT and Bard, has gained popularity as a tool in medical education. The use of AI in family medicine has not yet been assessed. The objective of this study is to compare the performance of three large language models (LLMs; ChatGPT 3.5, ChatGPT 4.0, and Google Bard) on the family medicine in-training exam (ITE).</p><p><strong>Methods: </strong>The 193 multiple-choice questions of the 2022 ITE, written by the American Board of Family Medicine, were inputted in ChatGPT 3.5, ChatGPT 4.0, and Bard. The LLMs' performance was then scored and scaled.</p><p><strong>Results: </strong>ChatGPT 4.0 scored 167/193 (86.5%) with a scaled score of 730 out of 800. According to the Bayesian score predictor, ChatGPT 4.0 has a 100% chance of passing the family medicine board exam. ChatGPT 3.5 scored 66.3%, translating to a scaled score of 400 and an 88% chance of passing the family medicine board exam. Bard scored 64.2%, with a scaled score of 380 and an 85% chance of passing the boards. Compared to the national average of postgraduate year 3 residents, only ChatGPT 4.0 surpassed the residents' mean of 68.4%.</p><p><strong>Conclusions: </strong>ChatGPT 4.0 was the only LLM that outperformed the family medicine postgraduate year 3 residents' national averages on the 2022 ITE, providing robust explanations and demonstrating its potential use in delivering background information on common medical concepts that appear on board exams.</p>","PeriodicalId":50456,"journal":{"name":"Family Medicine","volume":" ","pages":"555-560"},"PeriodicalIF":1.8,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493131/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142114368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Family Medicine
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1