首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
Toward Alleviating Clinician Documentation Burden: A Scoping Review of Burden Reduction Efforts. 减轻临床医生的文档负担:减轻负担工作的范围审查。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-06-05 DOI: 10.1055/s-0044-1787007
Elizabeth A Sloss, Shawna Abdul, Mayfair A Aboagyewah, Alicia Beebe, Kathleen Kendle, Kyle Marshall, S Trent Rosenbloom, Sarah Rossetti, Aaron Grigg, Kevin D Smith, Rebecca G Mishuris

Background:  Studies have shown that documentation burden experienced by clinicians may lead to less direct patient care, increased errors, and job dissatisfaction. Implementing effective strategies within health care systems to mitigate documentation burden can result in improved clinician satisfaction and more time spent with patients. However, there is a gap in the literature regarding evidence-based interventions to reduce documentation burden.

Objectives:  The objective of this review was to identify and comprehensively summarize the state of the science related to documentation burden reduction efforts.

Methods:  Following Joanna Briggs Institute Manual for Evidence Synthesis and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines, we conducted a comprehensive search of multiple databases, including PubMed, Medline, Embase, CINAHL Complete, Scopus, and Web of Science. Additionally, we searched gray literature and used Google Scholar to ensure a thorough review. Two reviewers independently screened titles and abstracts, followed by full-text review, with a third reviewer resolving any discrepancies. Data extraction was performed and a table of evidence was created.

Results:  A total of 34 articles were included in the review, published between 2016 and 2022, with a majority focusing on the United States. The efforts described can be categorized into medical scribes, workflow improvements, educational interventions, user-driven approaches, technology-based solutions, combination approaches, and other strategies. The outcomes of these efforts often resulted in improvements in documentation time, workflow efficiency, provider satisfaction, and patient interactions.

Conclusion:  This scoping review provides a comprehensive summary of health system documentation burden reduction efforts. The positive outcomes reported in the literature emphasize the potential effectiveness of these efforts. However, more research is needed to identify universally applicable best practices, and considerations should be given to the transfer of burden among members of the health care team, quality of education, clinician involvement, and evaluation methods.

背景:研究表明,临床医生所承受的文档记录负担可能会导致对患者的直接护理减少、错误增加以及对工作的不满。在医疗保健系统中实施有效的策略来减轻文档记录负担,可以提高临床医生的满意度,让他们有更多的时间与患者在一起。然而,关于减轻文档负担的循证干预措施的文献还存在空白:本综述旨在确定并全面总结与减轻文档负担工作相关的科学现状:按照乔安娜-布里格斯研究所的《证据综述手册》和《系统综述和元分析首选报告项目扩展范围综述》(PRISMA-ScR)指南,我们对多个数据库进行了全面检索,包括 PubMed、Medline、Embase、CINAHL Complete、Scopus 和 Web of Science。此外,我们还搜索了灰色文献,并使用谷歌学术(Google Scholar)来确保审查的全面性。两名审稿人独立筛选标题和摘要,然后进行全文审阅,由第三名审稿人解决任何不一致之处。进行数据提取并创建证据表:共有 34 篇文章被纳入审查范围,这些文章发表于 2016 年至 2022 年之间,其中大部分集中在美国。所述工作可分为医疗抄写员、工作流程改进、教育干预、用户驱动方法、基于技术的解决方案、组合方法和其他策略。这些工作的成果通常能够改善记录时间、工作流程效率、医疗服务提供者满意度以及与患者的互动:本范围综述全面总结了医疗系统在减少文档负担方面所做的努力。文献中报道的积极成果强调了这些努力的潜在有效性。然而,还需要更多的研究来确定普遍适用的最佳实践,并应考虑医疗团队成员之间的负担转移、教育质量、临床医生的参与以及评估方法。
{"title":"Toward Alleviating Clinician Documentation Burden: A Scoping Review of Burden Reduction Efforts.","authors":"Elizabeth A Sloss, Shawna Abdul, Mayfair A Aboagyewah, Alicia Beebe, Kathleen Kendle, Kyle Marshall, S Trent Rosenbloom, Sarah Rossetti, Aaron Grigg, Kevin D Smith, Rebecca G Mishuris","doi":"10.1055/s-0044-1787007","DOIUrl":"10.1055/s-0044-1787007","url":null,"abstract":"<p><strong>Background: </strong> Studies have shown that documentation burden experienced by clinicians may lead to less direct patient care, increased errors, and job dissatisfaction. Implementing effective strategies within health care systems to mitigate documentation burden can result in improved clinician satisfaction and more time spent with patients. However, there is a gap in the literature regarding evidence-based interventions to reduce documentation burden.</p><p><strong>Objectives: </strong> The objective of this review was to identify and comprehensively summarize the state of the science related to documentation burden reduction efforts.</p><p><strong>Methods: </strong> Following Joanna Briggs Institute Manual for Evidence Synthesis and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines, we conducted a comprehensive search of multiple databases, including PubMed, Medline, Embase, CINAHL Complete, Scopus, and Web of Science. Additionally, we searched gray literature and used Google Scholar to ensure a thorough review. Two reviewers independently screened titles and abstracts, followed by full-text review, with a third reviewer resolving any discrepancies. Data extraction was performed and a table of evidence was created.</p><p><strong>Results: </strong> A total of 34 articles were included in the review, published between 2016 and 2022, with a majority focusing on the United States. The efforts described can be categorized into medical scribes, workflow improvements, educational interventions, user-driven approaches, technology-based solutions, combination approaches, and other strategies. The outcomes of these efforts often resulted in improvements in documentation time, workflow efficiency, provider satisfaction, and patient interactions.</p><p><strong>Conclusion: </strong> This scoping review provides a comprehensive summary of health system documentation burden reduction efforts. The positive outcomes reported in the literature emphasize the potential effectiveness of these efforts. However, more research is needed to identify universally applicable best practices, and considerations should be given to the transfer of burden among members of the health care team, quality of education, clinician involvement, and evaluation methods.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"446-455"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11152769/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141263122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sprint-inspired One-on-One Post-Go-Live Training Session (Mini-Sprint) Improves Provider Electronic Health Record Efficiency and Satisfaction 受 Sprint 启发的一对一上线后培训课程(Mini-Sprint)提高了医疗服务提供者的电子健康记录效率和满意度
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-04-24 DOI: 10.1055/s-0044-1786368
July Chen, Wei Ning Chi, Urmila Ravichandran, Anthony Solomonides, Jeffrey Trimark, Shilpan Patel, Bruce McNulty, Nirav S. Shah, Stacy Brown

Background Inefficient electronic health record (EHR) usage increases the documentation burden on physicians and other providers, which increases cognitive load and contributes to provider burnout. Studies show that EHR efficiency sessions, optimization sprints, reduce burnout using a resource-intense five-person team. We implemented sprint-inspired one-on-one post-go-live efficiency training sessions (mini-sprints) as a more economical training option directed at providers.

Objectives We evaluated a post-go-live mini-sprint intervention to assess provider satisfaction and efficiency.

Methods NorthShore University HealthSystem implemented one-on-one provider-to-provider mini-sprint sessions to optimize provider workflow within the EHR platform. The physician informaticist completed a 9-point checklist of efficiency tips with physician trainees covering schedule organization, chart review, speed buttons, billing, note personalization/optimization, preference lists, quick actions, and quick tips. We collected postsession survey data assessing for net promoter score (NPS) and open-ended feedback. We conducted financial analysis of pre- and post-mini-sprint efficiency levels and financial data.

Results Seventy-six sessions were conducted with 32 primary care physicians, 28 specialty physicians, and 16 nonphysician providers within primary care and other areas. Thirty-seven physicians completed the postsession survey. The average NPS for the completed mini-sprint sessions was 97. The proficiency score had a median of 6.12 (Interquartile range (IQR): 4.71–7.64) before training, and a median of 7.10 (IQR: 6.25–8.49) after training. Financial data analysis indicates that higher level billing codes were used at a greater frequency post-mini-sprint. The revenue increase 12 months post-mini-sprint was $213,234, leading to a return of $75,559.50 for 40 providers, or $1,888.98 per provider in a 12-month period.

Conclusion Our data show that mini-sprint sessions were effective in optimizing efficiency within the EHR platform. Financial analysis demonstrates that this type of training program is sustainable and pays for itself. There was high satisfaction with the mini-sprint training modality, and feedback indicated an interest in further mini-sprint training sessions for physicians and nonphysician staff.

背景 电子病历(EHR)的低效使用加重了医生和其他医疗服务提供者的文档记录负担,从而增加了认知负荷并导致医疗服务提供者的职业倦怠。研究表明,电子病历效率课程、优化冲刺可以通过使用资源密集型五人团队来减少职业倦怠。我们实施了由冲刺启发的一对一上线后效率培训课程(迷你冲刺),作为针对医疗服务提供者的更经济的培训方案。目标 我们对直播后迷你冲刺干预进行了评估,以评估医疗服务提供者的满意度和效率。方法 NorthShore University HealthSystem 实施了一对一的医疗服务提供者迷你打印课程,以优化 EHR 平台内的医疗服务提供者工作流程。医生信息学家与受训医生一起完成了一份 9 点效率提示清单,内容包括日程安排、病历审查、快速按钮、账单、笔记个性化/优化、偏好列表、快速操作和快速提示。我们收集了会后调查数据,评估净促进者得分(NPS)和开放式反馈。我们对迷你打印前后的效率水平和财务数据进行了财务分析。结果 对 32 名初级保健医生、28 名专科医生和 16 名初级保健和其他领域的非医生提供者进行了 76 次培训。37 名医生完成了会后调查。完成迷你冲印课程的平均 NPS 为 97。培训前的熟练程度得分中位数为 6.12(四分位数间距 (IQR):4.71-7.64),培训后的熟练程度得分中位数为 7.10(四分位数间距 (IQR):6.25-8.49)。财务数据分析显示,迷你培训后使用高级计费代码的频率更高。迷你培训后 12 个月的收入增长为 213 234 美元,40 名医疗服务提供者的回报为 75 559.50 美元,即每位医疗服务提供者在 12 个月内的回报为 1 888.98 美元。结论 我们的数据显示,迷你打印课程能有效优化电子病历平台的效率。财务分析表明,这种培训计划是可持续的,并能收回成本。对迷你打印培训模式的满意度很高,反馈意见表明,医生和非医生工作人员对进一步开展迷你打印培训课程很感兴趣。
{"title":"Sprint-inspired One-on-One Post-Go-Live Training Session (Mini-Sprint) Improves Provider Electronic Health Record Efficiency and Satisfaction","authors":"July Chen, Wei Ning Chi, Urmila Ravichandran, Anthony Solomonides, Jeffrey Trimark, Shilpan Patel, Bruce McNulty, Nirav S. Shah, Stacy Brown","doi":"10.1055/s-0044-1786368","DOIUrl":"https://doi.org/10.1055/s-0044-1786368","url":null,"abstract":"<p>\u0000<b>Background</b> Inefficient electronic health record (EHR) usage increases the documentation burden on physicians and other providers, which increases cognitive load and contributes to provider burnout. Studies show that EHR efficiency sessions, optimization sprints, reduce burnout using a resource-intense five-person team. We implemented sprint-inspired one-on-one post-go-live efficiency training sessions (mini-sprints) as a more economical training option directed at providers.</p> <p>\u0000<b>Objectives</b> We evaluated a post-go-live mini-sprint intervention to assess provider satisfaction and efficiency.</p> <p>\u0000<b>Methods</b> NorthShore University HealthSystem implemented one-on-one provider-to-provider mini-sprint sessions to optimize provider workflow within the EHR platform. The physician informaticist completed a 9-point checklist of efficiency tips with physician trainees covering schedule organization, chart review, speed buttons, billing, note personalization/optimization, preference lists, quick actions, and quick tips. We collected postsession survey data assessing for net promoter score (NPS) and open-ended feedback. We conducted financial analysis of pre- and post-mini-sprint efficiency levels and financial data.</p> <p>\u0000<b>Results</b> Seventy-six sessions were conducted with 32 primary care physicians, 28 specialty physicians, and 16 nonphysician providers within primary care and other areas. Thirty-seven physicians completed the postsession survey. The average NPS for the completed mini-sprint sessions was 97. The proficiency score had a median of 6.12 (Interquartile range (IQR): 4.71–7.64) before training, and a median of 7.10 (IQR: 6.25–8.49) after training. Financial data analysis indicates that higher level billing codes were used at a greater frequency post-mini-sprint. The revenue increase 12 months post-mini-sprint was $213,234, leading to a return of $75,559.50 for 40 providers, or $1,888.98 per provider in a 12-month period.</p> <p>\u0000<b>Conclusion</b> Our data show that mini-sprint sessions were effective in optimizing efficiency within the EHR platform. Financial analysis demonstrates that this type of training program is sustainable and pays for itself. There was high satisfaction with the mini-sprint training modality, and feedback indicated an interest in further mini-sprint training sessions for physicians and nonphysician staff.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"59 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140805268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifying Barriers to The Implementation of Communicating Narrative Concerns Entered by Registered Nurses, An Early Warning System SmartApp 识别实施 "交流注册护士输入的关切叙事"(一种预警系统智能应用程序)的障碍
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-04-17 DOI: 10.1055/s-0044-1785688
Mollie Hobensack, Jennifer Withall, Brian Douthit, Kenrick Cato, Patricia Dykes, Sandy Cho, Graham Lowenthal, Catherine Ivory, Po-Yin Yen, Sarah Rossetti

Background Nurses are at the frontline of detecting patient deterioration. We developed Communicating Narrative Concerns Entered by Registered Nurses (CONCERN), an early warning system for clinical deterioration that generates a risk prediction score utilizing nursing data. CONCERN was implemented as a randomized clinical trial at two health systems in the Northeastern United States. Following the implementation of CONCERN, our team sought to develop the CONCERN Implementation Toolkit to enable other hospital systems to adopt CONCERN.

Objective The aim of this study was to identify the optimal resources needed to implement CONCERN and package these resources into the CONCERN Implementation Toolkit to enable the spread of CONCERN to other hospital sites.

Methods To accomplish this aim, we conducted qualitative interviews with nurses, prescribing providers, and information technology experts in two health systems. We recruited participants from July 2022 to January 2023. We conducted thematic analysis guided by the Donabedian model. Based on the results of the thematic analysis, we updated the α version of the CONCERN Implementation Toolkit.

Results There was a total of 32 participants included in our study. In total, 12 themes were identified, with four themes mapping to each domain in Donabedian's model (i.e., structure, process, and outcome). Eight new resources were added to the CONCERN Implementation Toolkit.

Conclusions This study validated the α version of the CONCERN Implementation Toolkit. Future studies will focus on returning the results of the Toolkit to the hospital sites to validate the β version of the CONCERN Implementation Toolkit. As the development of early warning systems continues to increase and clinician workflows evolve, the results of this study will provide considerations for research teams interested in implementing early warning systems in the acute care setting.

背景 护士处于发现病人病情恶化的第一线。我们开发了由注册护士输入的 "沟通叙事关注点"(CONCERN),这是一种临床病情恶化预警系统,可利用护理数据生成风险预测评分。CONCERN 作为一项随机临床试验在美国东北部的两个医疗系统中实施。CONCERN 实施后,我们的团队试图开发 CONCERN 实施工具包,以便其他医院系统也能采用 CONCERN。目标 本研究旨在确定实施 CONCERN 所需的最佳资源,并将这些资源打包到 CONCERN 实施工具包中,以便将 CONCERN 推广到其他医院。方法 为了实现这一目标,我们对两个医疗系统的护士、处方提供者和信息技术专家进行了定性访谈。我们在 2022 年 7 月至 2023 年 1 月期间招募了参与者。我们在多纳比德模型的指导下进行了主题分析。根据主题分析的结果,我们更新了 CONCERN 实施工具包的 α 版本。结果 共有 32 名参与者参与了我们的研究。总共确定了 12 个主题,其中 4 个主题与 Donabedian 模型中的每个领域(即结构、过程和结果)相对应。CONCERN 实施工具包中新增了八项资源。结论 本研究验证了 CONCERN 实施工具包的 α 版本。今后的研究将侧重于将工具包的结果返回到医院现场,以验证 β 版本的 CONCERN 实施工具包。随着早期预警系统的不断发展和临床医生工作流程的演变,本研究的结果将为有兴趣在急症护理环境中实施早期预警系统的研究团队提供参考。
{"title":"Identifying Barriers to The Implementation of Communicating Narrative Concerns Entered by Registered Nurses, An Early Warning System SmartApp","authors":"Mollie Hobensack, Jennifer Withall, Brian Douthit, Kenrick Cato, Patricia Dykes, Sandy Cho, Graham Lowenthal, Catherine Ivory, Po-Yin Yen, Sarah Rossetti","doi":"10.1055/s-0044-1785688","DOIUrl":"https://doi.org/10.1055/s-0044-1785688","url":null,"abstract":"<p>\u0000<b>Background</b> Nurses are at the frontline of detecting patient deterioration. We developed Communicating Narrative Concerns Entered by Registered Nurses (CONCERN), an early warning system for clinical deterioration that generates a risk prediction score utilizing nursing data. CONCERN was implemented as a randomized clinical trial at two health systems in the Northeastern United States. Following the implementation of CONCERN, our team sought to develop the CONCERN Implementation Toolkit to enable other hospital systems to adopt CONCERN.</p> <p>\u0000<b>Objective</b> The aim of this study was to identify the optimal resources needed to implement CONCERN and package these resources into the CONCERN Implementation Toolkit to enable the spread of CONCERN to other hospital sites.</p> <p>\u0000<b>Methods</b> To accomplish this aim, we conducted qualitative interviews with nurses, prescribing providers, and information technology experts in two health systems. We recruited participants from July 2022 to January 2023. We conducted thematic analysis guided by the Donabedian model. Based on the results of the thematic analysis, we updated the α version of the CONCERN Implementation Toolkit.</p> <p>\u0000<b>Results</b> There was a total of 32 participants included in our study. In total, 12 themes were identified, with four themes mapping to each domain in Donabedian's model (i.e., structure, process, and outcome). Eight new resources were added to the CONCERN Implementation Toolkit.</p> <p>\u0000<b>Conclusions</b> This study validated the α version of the CONCERN Implementation Toolkit. Future studies will focus on returning the results of the Toolkit to the hospital sites to validate the β version of the CONCERN Implementation Toolkit. As the development of early warning systems continues to increase and clinician workflows evolve, the results of this study will provide considerations for research teams interested in implementing early warning systems in the acute care setting.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"181 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140614231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Provider Perceptions of an Electronic Health Record Prostate Cancer Screening Tool 医疗服务提供者对电子健康记录前列腺癌筛查工具的看法
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-04-10 DOI: 10.1055/s-0044-1782619
Sigrid V. Carlsson, Mark Preston, Andrew Vickers, Deepak Malhotra, Behfar Ehdaie, Michael Healey, Adam S. Kibel

Objectives We conducted a focus group to assess the attitudes of primary care physicians (PCPs) toward prostate-specific antigen (PSA)-screening algorithms, perceptions of using decision support tools, and features that would make such tools feasible to implement.

Methods A multidisciplinary team (primary care, urology, behavioral sciences, bioinformatics) developed the decision support tool that was presented to a focus group of 10 PCPs who also filled out a survey. Notes and audio-recorded transcripts were analyzed using Thematic Content Analysis.

Results The survey showed that PCPs followed different guidelines. In total, 7/10 PCPs agreed that engaging in shared decision-making about PSA screening was burdensome. The majority (9/10) had never used a decision aid for PSA screening. Although 70% of PCPs felt confident about their ability to discuss PSA screening, 90% still felt a need for a provider-facing platform to assist in these discussions. Three major themes emerged: (1) confirmatory reactions regarding the importance, innovation, and unmet need for a decision support tool embedded in the electronic health record; (2) issues around implementation and application of the tool in clinic workflow and PCPs' own clinical bias; and (3) attitudes/reflections regarding discrepant recommendations from various guideline groups that cause confusion.

Conclusion There was overwhelmingly positive support for the need for a provider-facing decision support tool to assist with PSA-screening decisions in the primary care setting. PCPs appreciated that the tool would allow flexibility for clinical judgment and documentation of shared decision-making. Incorporation of suggestions from this focus group into a second version of the tool will be used in subsequent pilot testing.

目的 我们开展了一个焦点小组,以评估初级保健医生 (PCP) 对前列腺特异性抗原 (PSA) 筛查算法的态度、对使用决策支持工具的看法以及使此类工具可行的特点。方法 一个多学科团队(初级保健、泌尿科、行为科学、生物信息学)开发了决策支持工具,并向由 10 名初级保健医生组成的焦点小组展示了该工具,这些医生也填写了一份调查问卷。采用主题内容分析法对笔记和录音誊本进行了分析。结果 调查显示,初级保健医生遵循不同的指导原则。共有 7/10 名初级保健医生认为,参与 PSA 筛查的共同决策是一种负担。大多数人(9/10)从未使用过 PSA 筛查决策辅助工具。尽管 70% 的初级保健医生对自己讨论 PSA 筛查的能力充满信心,但仍有 90% 的人认为需要一个面向医疗服务提供者的平台来协助这些讨论。研究中出现了三大主题:(1) 对嵌入电子健康记录的决策支持工具的重要性、创新性和未满足的需求的肯定性反应;(2) 诊所工作流程中工具的实施和应用问题以及初级保健医生自身的临床偏见;(3) 对不同指南小组提出的导致混乱的不同建议的态度/反思。结论 绝大多数人都支持在初级医疗机构中需要一种面向医疗服务提供者的决策支持工具来协助做出 PSA 筛查决策。初级保健医生对该工具能够灵活地进行临床判断并记录共同决策表示赞赏。将该焦点小组的建议纳入第二版工具将用于后续的试点测试。
{"title":"Provider Perceptions of an Electronic Health Record Prostate Cancer Screening Tool","authors":"Sigrid V. Carlsson, Mark Preston, Andrew Vickers, Deepak Malhotra, Behfar Ehdaie, Michael Healey, Adam S. Kibel","doi":"10.1055/s-0044-1782619","DOIUrl":"https://doi.org/10.1055/s-0044-1782619","url":null,"abstract":"<p>\u0000<b>Objectives</b> We conducted a focus group to assess the attitudes of primary care physicians (PCPs) toward prostate-specific antigen (PSA)-screening algorithms, perceptions of using decision support tools, and features that would make such tools feasible to implement.</p> <p>\u0000<b>Methods</b> A multidisciplinary team (primary care, urology, behavioral sciences, bioinformatics) developed the decision support tool that was presented to a focus group of 10 PCPs who also filled out a survey. Notes and audio-recorded transcripts were analyzed using Thematic Content Analysis.</p> <p>\u0000<b>Results</b> The survey showed that PCPs followed different guidelines. In total, 7/10 PCPs agreed that engaging in shared decision-making about PSA screening was burdensome. The majority (9/10) had never used a decision aid for PSA screening. Although 70% of PCPs felt confident about their ability to discuss PSA screening, 90% still felt a need for a provider-facing platform to assist in these discussions. Three major themes emerged: (1) confirmatory reactions regarding the importance, innovation, and unmet need for a decision support tool embedded in the electronic health record; (2) issues around implementation and application of the tool in clinic workflow and PCPs' own clinical bias; and (3) attitudes/reflections regarding discrepant recommendations from various guideline groups that cause confusion.</p> <p>\u0000<b>Conclusion</b> There was overwhelmingly positive support for the need for a provider-facing decision support tool to assist with PSA-screening decisions in the primary care setting. PCPs appreciated that the tool would allow flexibility for clinical judgment and documentation of shared decision-making. Incorporation of suggestions from this focus group into a second version of the tool will be used in subsequent pilot testing.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"187 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140563568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Provider-Facing Decision Support Tool for Prostate Cancer Screening in Primary Care: A Pilot Study 面向医疗服务提供者的基层医疗机构前列腺癌筛查决策支持工具:试点研究
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-04-10 DOI: 10.1055/s-0044-1780511
Sigrid V. Carlsson, Mark A. Preston, Andrew Vickers, Deepak Malhotra, Behfar Ehdaie, Michael J. Healey, Adam S. Kibel

Objectives Our objective was to pilot test an electronic health record-embedded decision support tool to facilitate prostate-specific antigen (PSA) screening discussions in the primary care setting.

Methods We pilot-tested a novel decision support tool that was used by 10 primary care physicians (PCPs) for 6 months, followed by a survey. The tool comprised (1) a risk-stratified algorithm, (2) a tool for facilitating shared decision-making (Simple Schema), (3) three best practice advisories (BPAs: <45, 45–75, and >75 years), and (4) a health maintenance module for scheduling automated reminders about PSA rescreening.

Results All PCPs found the tool feasible, acceptable, and clear to use. Eight out of ten PCPs reported that the tool made PSA screening conversations somewhat or much easier. Before using the tool, 70% of PCPs felt confident in their ability to discuss PSA screening with their patient, and this improved to 100% after the tool was used by PCPs for 6 months. PCPs found the BPAs for eligible (45–75 years) and older men (>75 years) more useful than the BPA for younger men (<45 years). Among the 10 PCPs, 60% found the Simple Schema to be very useful, and 50% found the health maintenance module to be extremely or very useful. Most PCPs reported the components of the tool to be at least somewhat useful, with 10% finding them to be very burdensome.

Conclusion We demonstrated the feasibility and acceptability of the tool, which is notable given the marked low acceptance of existing tools. All PCPs reported that they would consider continuing to use the tool in their clinic and were likely or very likely to recommend the tool to a colleague.

目的 我们的目标是对一种嵌入电子健康记录的决策支持工具进行试点测试,以促进初级保健环境中的前列腺特异性抗原 (PSA) 筛查讨论。方法 我们对一种新型决策支持工具进行了为期 6 个月的试点测试,10 名初级保健医生(PCP)使用了该工具,随后进行了调查。该工具包括:(1)风险分级算法;(2)促进共同决策的工具(Simple Schema);(3)三个最佳实践建议(BPA:75 岁);(4)用于安排 PSA 再筛查自动提醒的健康维护模块。结果 所有初级保健医生都认为该工具可行、可接受且清晰易用。十位初级保健医生中有八位表示,该工具使 PSA 筛查对话变得更容易一些或容易得多。在使用该工具前,70% 的初级保健医生对自己与患者讨论 PSA 筛查的能力充满信心,而在初级保健医生使用该工具 6 个月后,这一比例提高到 100%。初级保健医生认为符合条件的男性(45-75 岁)和老年男性(75 岁以上)的 BPA 比年轻男性的 BPA 更有用(结论 我们证明了该工具的可行性和可接受性,鉴于现有工具的接受度明显较低,这一点值得注意。所有初级保健医生都表示,他们会考虑在自己的诊所继续使用该工具,并有可能或非常有可能向同事推荐该工具。
{"title":"A Provider-Facing Decision Support Tool for Prostate Cancer Screening in Primary Care: A Pilot Study","authors":"Sigrid V. Carlsson, Mark A. Preston, Andrew Vickers, Deepak Malhotra, Behfar Ehdaie, Michael J. Healey, Adam S. Kibel","doi":"10.1055/s-0044-1780511","DOIUrl":"https://doi.org/10.1055/s-0044-1780511","url":null,"abstract":"<p>\u0000<b>Objectives</b> Our objective was to pilot test an electronic health record-embedded decision support tool to facilitate prostate-specific antigen (PSA) screening discussions in the primary care setting.</p> <p>\u0000<b>Methods</b> We pilot-tested a novel decision support tool that was used by 10 primary care physicians (PCPs) for 6 months, followed by a survey. The tool comprised (1) a risk-stratified algorithm, (2) a tool for facilitating shared decision-making (Simple Schema), (3) three best practice advisories (BPAs: <45, 45–75, and >75 years), and (4) a health maintenance module for scheduling automated reminders about PSA rescreening.</p> <p>\u0000<b>Results</b> All PCPs found the tool feasible, acceptable, and clear to use. Eight out of ten PCPs reported that the tool made PSA screening conversations somewhat or much easier. Before using the tool, 70% of PCPs felt confident in their ability to discuss PSA screening with their patient, and this improved to 100% after the tool was used by PCPs for 6 months. PCPs found the BPAs for eligible (45–75 years) and older men (>75 years) more useful than the BPA for younger men (<45 years). Among the 10 PCPs, 60% found the Simple Schema to be very useful, and 50% found the health maintenance module to be extremely or very useful. Most PCPs reported the components of the tool to be at least somewhat useful, with 10% finding them to be very burdensome.</p> <p>\u0000<b>Conclusion</b> We demonstrated the feasibility and acceptability of the tool, which is notable given the marked low acceptance of existing tools. All PCPs reported that they would consider continuing to use the tool in their clinic and were likely or very likely to recommend the tool to a colleague.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"9 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140563566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Suicide Risk Screening for Head and Neck Cancer Patients: An Implementation Study. 头颈部癌症患者自杀风险筛查:实施研究。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-03-01 Epub Date: 2024-05-22 DOI: 10.1055/s-0044-1787006
Bhargav Kansara, Ameer Basta, Marian Mikhael, Randa Perkins, Phillip Reisman, Julie Hallanger-Johnson, Dana E Rollison, Oliver T Nguyen, Sean Powell, Scott M Gilbert, Kea Turner

Objectives:  There is limited research on suicide risk screening (SRS) among head and neck cancer (HNC) patients, a population at increased risk for suicide. To address this gap, this single-site mixed methods study assessed oncology professionals' perspectives about the feasibility, acceptability, and appropriateness of an electronic SRS program that was implemented as a part of routine care for HNC patients.

Methods: Staff who assisted with SRS implementation completed (e.g., nurses, medical assistants, advanced practice providers, physicians, social workers) a one-time survey (N = 29) and interview (N = 25). Quantitative outcomes were assessed using previously validated feasibility, acceptability, and appropriateness measures. Additional qualitative data were collected to provide context for interpreting the scores.

Results:  Nurses and medical assistants, who were directly responsible for implementing SRS, reported low feasibility, acceptability, and appropriateness, compared with other team members (e.g., physicians, social workers, advanced practice providers). Team members identified potential improvements needed to optimize SRS, such as hiring additional staff, improving staff training, providing different modalities for screening completion among individuals with disabilities, and revising the patient-reported outcomes to improve suicide risk prediction.

Conclusion:  Staff perspectives about implementing SRS as a part of routine cancer care for HNC patients varied widely. Before screening can be implemented on a larger scale for HNC and other cancer patients, additional implementation strategies may be needed that optimize workflow and reduce staff burden, such as staff training, multiple modalities for completion, and refined tools for identifying which patients are at greatest risk for suicide.

目的:头颈癌(HNC)患者是自杀风险较高的人群,目前有关头颈癌患者自杀风险筛查(SRS)的研究十分有限。为了填补这一空白,本研究采用单点混合方法评估了肿瘤专业人员对电子 SRS 程序的可行性、可接受性和适当性的看法,该程序已作为 HNC 患者常规护理的一部分实施:协助实施 SRS 的工作人员(如护士、医疗助理、高级医疗服务提供者、医生、社会工作者)完成了一次性调查(29 人)和访谈(25 人)。定量结果采用之前验证过的可行性、可接受性和适当性测量方法进行评估。此外,还收集了其他定性数据,为解释评分提供背景资料:结果:与其他团队成员(如医生、社会工作者、高级医疗服务提供者)相比,直接负责实施 SRS 的护士和医疗助理报告的可行性、可接受性和适宜性较低。团队成员指出了优化 SRS 所需的潜在改进措施,如增聘员工、加强员工培训、为残障人士完成筛查提供不同方式,以及修改患者报告结果以改进自杀风险预测:员工对将 SRS 作为 HNC 患者常规癌症护理的一部分的看法大相径庭。在对 HNC 和其他癌症患者大规模实施筛查之前,可能需要采取更多的实施策略,以优化工作流程并减轻员工负担,例如员工培训、多种完成方式以及用于识别哪些患者自杀风险最高的改进工具。
{"title":"Suicide Risk Screening for Head and Neck Cancer Patients: An Implementation Study.","authors":"Bhargav Kansara, Ameer Basta, Marian Mikhael, Randa Perkins, Phillip Reisman, Julie Hallanger-Johnson, Dana E Rollison, Oliver T Nguyen, Sean Powell, Scott M Gilbert, Kea Turner","doi":"10.1055/s-0044-1787006","DOIUrl":"10.1055/s-0044-1787006","url":null,"abstract":"<p><strong>Objectives: </strong> There is limited research on suicide risk screening (SRS) among head and neck cancer (HNC) patients, a population at increased risk for suicide. To address this gap, this single-site mixed methods study assessed oncology professionals' perspectives about the feasibility, acceptability, and appropriateness of an electronic SRS program that was implemented as a part of routine care for HNC patients.</p><p><strong>Methods: </strong>Staff who assisted with SRS implementation completed (e.g., nurses, medical assistants, advanced practice providers, physicians, social workers) a one-time survey (<i>N</i> = 29) and interview (<i>N</i> = 25). Quantitative outcomes were assessed using previously validated feasibility, acceptability, and appropriateness measures. Additional qualitative data were collected to provide context for interpreting the scores.</p><p><strong>Results: </strong> Nurses and medical assistants, who were directly responsible for implementing SRS, reported low feasibility, acceptability, and appropriateness, compared with other team members (e.g., physicians, social workers, advanced practice providers). Team members identified potential improvements needed to optimize SRS, such as hiring additional staff, improving staff training, providing different modalities for screening completion among individuals with disabilities, and revising the patient-reported outcomes to improve suicide risk prediction.</p><p><strong>Conclusion: </strong> Staff perspectives about implementing SRS as a part of routine cancer care for HNC patients varied widely. Before screening can be implemented on a larger scale for HNC and other cancer patients, additional implementation strategies may be needed that optimize workflow and reduce staff burden, such as staff training, multiple modalities for completion, and refined tools for identifying which patients are at greatest risk for suicide.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 2","pages":"404-413"},"PeriodicalIF":2.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11111312/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141082535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Randomized Comparison of Electronic Health Record Alert Types in Eliciting Responses about Prognosis in Gynecologic Oncology Patients. 随机比较电子健康记录警报类型在激发妇科肿瘤患者对预后的反应方面的作用。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-03-01 Epub Date: 2024-01-17 DOI: 10.1055/a-2247-9355
Robert Clayton Musser, Rashaud Senior, Laura J Havrilesky, Jordan Buuck, David J Casarett, Salam Ibrahim, Brittany A Davidson

Objectives:  To compare the ability of different electronic health record alert types to elicit responses from users caring for cancer patients benefiting from goals of care (GOC) conversations.

Methods:  A validated question asking if the user would be surprised by the patient's 6-month mortality was built as an Epic BestPractice Advisory (BPA) alert in three versions-(1) Required on Open chart (pop-up BPA), (2) Required on Close chart (navigator BPA), and (3) Optional Persistent (Storyboard BPA)-randomized using patient medical record number. Meaningful responses were defined as "Yes" or "No," rather than deferral. Data were extracted over 6 months.

Results:  Alerts appeared for 685 patients during 1,786 outpatient encounters. Measuring encounters where a meaningful response was elicited, rates were highest for Required on Open (94.8% of encounters), compared with Required on Close (90.1%) and Optional Persistent (19.7%) (p < 0.001). Measuring individual alerts to which responses were given, they were most likely meaningful with Optional Persistent (98.3% of responses) and least likely with Required on Open (68.0%) (p < 0.001). Responses of "No," suggesting poor prognosis and prompting GOC, were more likely with Optional Persistent (13.6%) and Required on Open (10.3%) than with Required on Close (7.0%) (p = 0.028).

Conclusion:  Required alerts had response rates almost five times higher than optional alerts. Timing of alerts affects rates of meaningful responses and possibly the response itself. The alert with the most meaningful responses was also associated with the most interruptions and deferral responses. Considering tradeoffs in these metrics is important in designing clinical decision support to maximize success.

目的比较不同类型的电子健康记录警报在诱导癌症患者护理用户从护理目标(GOC)对话中受益的能力:一个经过验证的问题询问用户是否会对患者 6 个月的死亡率感到惊讶,该问题作为 Epic 最佳实践建议(BPA)提示,有三个版本:1)打开病历时必须回答(弹出式 BPA);2)关闭病历时必须回答(导航式 BPA);3)可选的持续回答(故事板 BPA)--使用患者病历号随机排列。有意义的回复被定义为 "是 "或 "否",而不是推迟。数据提取历时 6 个月:结果:在 1,786 次门诊就诊中,有 685 名患者收到了警报。在有意义的应答中,开放时要求应答的应答率最高(占应答的 94.8%),相比之下,关闭时要求应答的应答率为 90.1%,可选持续应答的应答率为 19.7%(p 结论:在有意义的应答中,开放时要求应答的应答率最高(占应答的 94.8%),相比之下,关闭时要求应答的应答率为 90.1%,可选持续应答的应答率为 19.7%:必要警报的响应率几乎是可选警报的五倍。警报的时间会影响有意义回复的比率,也可能会影响回复本身。有意义响应最多的警报也与中断和延迟响应最多有关。考虑这些指标的权衡对于设计临床决策支持以取得最大成功非常重要。
{"title":"Randomized Comparison of Electronic Health Record Alert Types in Eliciting Responses about Prognosis in Gynecologic Oncology Patients.","authors":"Robert Clayton Musser, Rashaud Senior, Laura J Havrilesky, Jordan Buuck, David J Casarett, Salam Ibrahim, Brittany A Davidson","doi":"10.1055/a-2247-9355","DOIUrl":"10.1055/a-2247-9355","url":null,"abstract":"<p><strong>Objectives: </strong> To compare the ability of different electronic health record alert types to elicit responses from users caring for cancer patients benefiting from goals of care (GOC) conversations.</p><p><strong>Methods: </strong> A validated question asking if the user would be surprised by the patient's 6-month mortality was built as an Epic BestPractice Advisory (BPA) alert in three versions-(1) Required on Open chart (pop-up BPA), (2) Required on Close chart (navigator BPA), and (3) Optional Persistent (Storyboard BPA)-randomized using patient medical record number. Meaningful responses were defined as \"Yes\" or \"No,\" rather than deferral. Data were extracted over 6 months.</p><p><strong>Results: </strong> Alerts appeared for 685 patients during 1,786 outpatient encounters. Measuring encounters where a meaningful response was elicited, rates were highest for Required on Open (94.8% of encounters), compared with Required on Close (90.1%) and Optional Persistent (19.7%) (<i>p</i> < 0.001). Measuring individual alerts to which responses were given, they were most likely meaningful with Optional Persistent (98.3% of responses) and least likely with Required on Open (68.0%) (<i>p</i> < 0.001). Responses of \"No,\" suggesting poor prognosis and prompting GOC, were more likely with Optional Persistent (13.6%) and Required on Open (10.3%) than with Required on Close (7.0%) (<i>p</i> = 0.028).</p><p><strong>Conclusion: </strong> Required alerts had response rates almost five times higher than optional alerts. Timing of alerts affects rates of meaningful responses and possibly the response itself. The alert with the most meaningful responses was also associated with the most interruptions and deferral responses. Considering tradeoffs in these metrics is important in designing clinical decision support to maximize success.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"204-211"},"PeriodicalIF":2.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10937092/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139486567","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit. 重症监护室情境感知临床决策支持的可用性测试。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-03-01 Epub Date: 2024-02-20 DOI: 10.1055/a-2272-6184
Matthew J Molloy, Matthew Zackoff, Annika Gifford, Philip Hagedorn, Ken Tegtmeyer, Maria T Britto, Maya Dewan

Objective:  Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.

Methods:  We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.

Results:  Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80-95), with over 96% rating the tool's usability as "good" or "excellent." Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.

Conclusion:  The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.

目的我们的目的是评估之前在儿科重症监护室(PICU)实施的自动化临床决策支持(CDS)工具的可用性,该工具旨在促进医疗团队的共同情况意识,以防止儿童医院发生严重安全事件:我们采用混合方法对中西部一家大型城市四级独立儿童医院 PICU 的 CDS 工具进行了可用性评估。定量评估采用系统可用性量表,而定性评估则包括畅想可用性测试。系统可用性量表根据调查指南进行评分。对于思考-朗读测试,按角色分层计算了任务时间,并确定了平均值和标准偏差。对参与者的定性反馈和主持人的观察结果进行了总结:51 名 PICU 工作人员(包括医生、高级医疗服务提供者、护士和呼吸治疗师)完成了系统可用性量表,10 名参与者进行了高声思考可用性测试。总体可用性得分中位数为 87.5(IQR:80-95),96% 以上的人将工具的可用性评为 "良好 "或 "优秀"。任务完成时间从 2 秒到 92 秒不等,其中审核高风险标准的完成时间最快,添加高风险标准的完成时间最慢。通过观察和参与者的回答,我们从 "思考-大声说 "测试中发现了一些积极的方面,如易学性、复杂信息的清晰显示、易获取性,以及将工具整合到临床工作流程中的改进机会。
{"title":"Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit.","authors":"Matthew J Molloy, Matthew Zackoff, Annika Gifford, Philip Hagedorn, Ken Tegtmeyer, Maria T Britto, Maya Dewan","doi":"10.1055/a-2272-6184","DOIUrl":"10.1055/a-2272-6184","url":null,"abstract":"<p><strong>Objective: </strong> Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.</p><p><strong>Methods: </strong> We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.</p><p><strong>Results: </strong> Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80-95), with over 96% rating the tool's usability as \"good\" or \"excellent.\" Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.</p><p><strong>Conclusion: </strong> The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"327-334"},"PeriodicalIF":2.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11062760/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139913854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Survey of Clinicians' Views of the Utility of Large Language Models. 临床医生对大型语言模型实用性的看法调查。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-03-01 Epub Date: 2024-03-05 DOI: 10.1055/a-2281-7092
Matthew Spotnitz, Betina Idnay, Emily R Gordon, Rebecca Shyu, Gongbo Zhang, Cong Liu, James J Cimino, Chunhua Weng

Objectives:  Large language models (LLMs) like Generative pre-trained transformer (ChatGPT) are powerful algorithms that have been shown to produce human-like text from input data. Several potential clinical applications of this technology have been proposed and evaluated by biomedical informatics experts. However, few have surveyed health care providers for their opinions about whether the technology is fit for use.

Methods:  We distributed a validated mixed-methods survey to gauge practicing clinicians' comfort with LLMs for a breadth of tasks in clinical practice, research, and education, which were selected from the literature.

Results:  A total of 30 clinicians fully completed the survey. Of the 23 tasks, 16 were rated positively by more than 50% of the respondents. Based on our qualitative analysis, health care providers considered LLMs to have excellent synthesis skills and efficiency. However, our respondents had concerns that LLMs could generate false information and propagate training data bias.Our survey respondents were most comfortable with scenarios that allow LLMs to function in an assistive role, like a physician extender or trainee.

Conclusion:  In a mixed-methods survey of clinicians about LLM use, health care providers were encouraging of having LLMs in health care for many tasks, and especially in assistive roles. There is a need for continued human-centered development of both LLMs and artificial intelligence in general.

目的:像 ChatGPT 这样的大型语言模型(LLM)是一种功能强大的算法,已被证明能从输入数据中生成类人文本。生物医学信息学专家已经提出并评估了该技术的许多潜在临床应用。然而,很少有人调查过医疗服务提供者对该技术是否适合使用的看法:我们分发了一份经过验证的混合方法调查表,以评估临床医生在临床实践、研究和教育中使用 LLM 的舒适度,这些任务都是从文献中挑选出来的:共有 30 名临床医生完成了调查。在 23 项任务中,有 16 项任务得到了 50% 以上受访者的好评。根据我们的定性分析,医疗服务提供者认为法学硕士具有出色的综合技能和效率。但是,我们的受访者担心 LLM 可能会产生错误信息并传播训练数据偏差:讨论:我们的调查对象对允许 LLMs 以辅助角色(如医生临时工或实习生)发挥作用的情景最为满意:在对临床医生进行的关于使用 LLM 的独特、严格和全面的混合方法调查中,医疗服务提供者对在医疗服务中使用 LLM 执行多项任务,尤其是辅助性任务表示鼓励。有必要继续以人为本,开发 LLM 和人工智能(AI)。
{"title":"A Survey of Clinicians' Views of the Utility of Large Language Models.","authors":"Matthew Spotnitz, Betina Idnay, Emily R Gordon, Rebecca Shyu, Gongbo Zhang, Cong Liu, James J Cimino, Chunhua Weng","doi":"10.1055/a-2281-7092","DOIUrl":"10.1055/a-2281-7092","url":null,"abstract":"<p><strong>Objectives: </strong> Large language models (LLMs) like Generative pre-trained transformer (ChatGPT) are powerful algorithms that have been shown to produce human-like text from input data. Several potential clinical applications of this technology have been proposed and evaluated by biomedical informatics experts. However, few have surveyed health care providers for their opinions about whether the technology is fit for use.</p><p><strong>Methods: </strong> We distributed a validated mixed-methods survey to gauge practicing clinicians' comfort with LLMs for a breadth of tasks in clinical practice, research, and education, which were selected from the literature.</p><p><strong>Results: </strong> A total of 30 clinicians fully completed the survey. Of the 23 tasks, 16 were rated positively by more than 50% of the respondents. Based on our qualitative analysis, health care providers considered LLMs to have excellent synthesis skills and efficiency. However, our respondents had concerns that LLMs could generate false information and propagate training data bias.Our survey respondents were most comfortable with scenarios that allow LLMs to function in an assistive role, like a physician extender or trainee.</p><p><strong>Conclusion: </strong> In a mixed-methods survey of clinicians about LLM use, health care providers were encouraging of having LLMs in health care for many tasks, and especially in assistive roles. There is a need for continued human-centered development of both LLMs and artificial intelligence in general.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"306-312"},"PeriodicalIF":2.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11023712/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140040685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Clinician Needs for Electronic Health Record Pediatric and Adolescent Weight Management Tools: A Mixed-Methods Study. 临床医生对电子病历儿科和青少年体重管理工具的需求:混合方法研究。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-03-01 Epub Date: 2024-03-08 DOI: 10.1055/a-2283-9036
Amy S Braddock, K Taylor Bosworth, Parijat Ghosh, Rachel Proffitt, Lauren Flowers, Emma Montgomery, Gwendolyn Wilson, Aneesh K Tosh, Richelle J Koopman

Background:  Clinicians play an important role in addressing pediatric and adolescent obesity, but their effectiveness is restricted by time constraints, competing clinical demands, and the lack of effective electronic health record (EHR) tools. EHR tools are rarely developed with provider input.

Objectives:  We conducted a mixed method study of clinicians who provide weight management care to children and adolescents to determine current barriers for effective care and explore the role of EHR weight management tools to overcome these barriers.

Methods:  In this mixed-methods study, we conducted three 1-hour long virtual focus groups at one medium-sized academic health center in Missouri and analyzed the focus group scripts using thematic analysis. We sequentially conducted a descriptive statistical analysis of a survey emailed to pediatric and family medicine primary care clinicians (n = 52) at two private and two academic health centers in Missouri.

Results:  Surveyed clinicians reported that they effectively provided health behavior lifestyle counseling at well-child visits (mean of 60 on a scale of 1-100) and child obesity visits (63); however, most felt the current health care system (27) and EHR tools (41) do not adequately support pediatric weight management. Major themes from the clinician focus groups were that EHR weight management tools should display data in a way that (1) improves clinical efficiency, (2) supports patient-centered communication, (3) improves patient continuity between visits, and (4) reduces documentation burdens. An additional theme was (5) clinicians trust patient data entered in real time over patient recalled data.

Conclusion:  Study participants report that the health care system status quo and currently available EHR tools do not sufficiently support clinicians working to manage pediatric or adolescent obesity and provide health behavior counseling. Clinician input in the development and testing of EHR weight management tools provides opportunities to address barriers, inform content, and improve efficiencies of EHR use.

背景:临床医生在解决儿童和青少年肥胖问题方面发挥着重要作用,但由于时间有限、临床需求相互竞争以及缺乏有效的电子健康记录(EHR)工具,他们的工作效率受到限制。电子健康记录工具的开发很少考虑到提供者的意见:我们对为儿童和青少年提供体重管理护理的临床医生进行了一项混合方法研究,以确定目前有效护理的障碍,并探讨电子健康记录体重管理工具在克服这些障碍方面的作用:在这项混合方法研究中,我们在密苏里州的一家中型学术健康中心开展了三次长达 1 小时的虚拟焦点小组讨论,并使用主题分析法对焦点小组讨论脚本进行了分析。我们通过电子邮件向密苏里州两家私立医疗中心和两家学术医疗中心的儿科和家庭医学初级保健临床医生(人数=52)发送了一份调查问卷,并依次进行了描述性统计分析:接受调查的临床医生表示,他们在儿童健康访视(1-100 分,平均 60 分)和儿童肥胖访视(63 分)中有效地提供了健康行为生活方式咨询;但是,大多数人认为目前的医疗保健系统(27 人)和电子病历工具(41 人)不能充分支持儿科体重管理。临床医生焦点小组讨论的主要议题是,电子病历体重管理工具显示数据的方式应:(1)提高临床效率;(2)支持以患者为中心的沟通;(3)提高患者就诊的连续性;(4)减轻记录负担。另外一个主题是:(5) 临床医生信任实时输入的病人数据,而不是病人回忆的数据:研究参与者表示,医疗保健系统的现状和目前可用的电子病历工具不足以支持临床医生管理儿科或青少年肥胖症并提供健康行为咨询。临床医生参与电子病历体重管理工具的开发和测试,为消除障碍、充实内容和提高电子病历使用效率提供了机会。
{"title":"Clinician Needs for Electronic Health Record Pediatric and Adolescent Weight Management Tools: A Mixed-Methods Study.","authors":"Amy S Braddock, K Taylor Bosworth, Parijat Ghosh, Rachel Proffitt, Lauren Flowers, Emma Montgomery, Gwendolyn Wilson, Aneesh K Tosh, Richelle J Koopman","doi":"10.1055/a-2283-9036","DOIUrl":"10.1055/a-2283-9036","url":null,"abstract":"<p><strong>Background: </strong> Clinicians play an important role in addressing pediatric and adolescent obesity, but their effectiveness is restricted by time constraints, competing clinical demands, and the lack of effective electronic health record (EHR) tools. EHR tools are rarely developed with provider input.</p><p><strong>Objectives: </strong> We conducted a mixed method study of clinicians who provide weight management care to children and adolescents to determine current barriers for effective care and explore the role of EHR weight management tools to overcome these barriers.</p><p><strong>Methods: </strong> In this mixed-methods study, we conducted three 1-hour long virtual focus groups at one medium-sized academic health center in Missouri and analyzed the focus group scripts using thematic analysis. We sequentially conducted a descriptive statistical analysis of a survey emailed to pediatric and family medicine primary care clinicians (<i>n</i> = 52) at two private and two academic health centers in Missouri.</p><p><strong>Results: </strong> Surveyed clinicians reported that they effectively provided health behavior lifestyle counseling at well-child visits (mean of 60 on a scale of 1-100) and child obesity visits (63); however, most felt the current health care system (27) and EHR tools (41) do not adequately support pediatric weight management. Major themes from the clinician focus groups were that EHR weight management tools should display data in a way that (1) improves clinical efficiency, (2) supports patient-centered communication, (3) improves patient continuity between visits, and (4) reduces documentation burdens. An additional theme was (5) clinicians trust patient data entered in real time over patient recalled data.</p><p><strong>Conclusion: </strong> Study participants report that the health care system status quo and currently available EHR tools do not sufficiently support clinicians working to manage pediatric or adolescent obesity and provide health behavior counseling. Clinician input in the development and testing of EHR weight management tools provides opportunities to address barriers, inform content, and improve efficiencies of EHR use.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"368-377"},"PeriodicalIF":2.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11078569/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140066094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1