Pub Date : 2025-10-01Epub Date: 2025-05-26DOI: 10.1055/a-2620-3147
Francois Bastardot, Vanessa Kraege, Julien Castioni, Alain Petter, David W Bates, Antoine Garnier
Electronic health records (EHRs) are widely implemented and consume nearly half of physicians' work time. Despite the importance of efficient data entry, physicians' typing skills-potential contributors to documentation burden-remain poorly studied.This study aims to evaluate the typing skills of physicians and their associations with demographic characteristics and professional roles.This cross-sectional pilot study included a convenience sample of physicians (residents, chief residents, and attending physicians) from the internal medicine division of an academic hospital. Participants completed a 1-minute typing test under supervised conditions. The primary outcome was raw typing speed, measured in words per minute (WPM). The secondary outcome was a performance score calculated by subtracting 50 points for each error from the total number of characters typed per minute.Participation rate was 100% (82/82 physicians). The mean age was 33.7 ± 7.3 years; 7.2 ± 7.1 years since graduation; and 45.1% female. The mean typing speed was 53.4 WPM (range: 31-91 WPM), with 57.3% (47/82) of participants exceeding 50 WPM, a threshold commonly considered professional. Bivariate analysis showed a significant negative association with age (Spearman's ρ = -0.281, p = 0.011), which was not sustained in the multivariable analysis. No significant association was observed with sex, country of diploma, or role. Upon multivariable analysis, performance score showed a significant negative association with age (β = -17.724, p = 0.009) but a positive association with years since graduation (β = 16.850, p = 0.021), suggesting a generation- and experience-related interaction.Nearly half of physicians exhibited professional-level typing skills, yet overall performance varied widely and was influenced by both generational factors and clinical experience. Given that documentation burden affects clinicians across all skill levels, both individual and systemic strategies-such as improved EHR design and alternative input methods-should be explored.
背景:电子病历(Electronic health records, EHR)被广泛应用,占用了医生近一半的工作时间。尽管有效的数据输入很重要,但医生的打字技能——可能造成文档负担的因素——仍然缺乏研究。目的:评价医师的打字技能及其与人口学特征和职业角色的关系。方法:本横断面试点研究纳入了一所学术医院内科医师(住院医师、住院总医师和主治医师)的方便样本。参与者在监督的条件下完成了一分钟的打字测试。主要结果是原始打字速度,以每分钟字数(WPM)衡量。次要结果是通过从每分钟输入的字符总数中减去每个错误的50分计算出的性能分数。结果:参照率为100%(82/82)。平均年龄33.7±7.3岁;毕业后7.2±7.1年;45.1%的女性。平均打字速度为53.4 WPM(范围:31-91 WPM),其中57.3%(47/82)的参与者超过50 WPM,这是一个通常被认为是专业的阈值。双变量分析显示与年龄呈显著负相关(Spearman's ρ = -0.281, p = 0.011),多变量分析未证实这一点。未观察到与性别、学历国家或角色有显著关联。多变量分析结果显示,大学生绩效得分与年龄呈显著负相关(β = -17.724, p = 0.009),与毕业年限呈正相关(β = 16.850, p = 0.021),表明大学生绩效得分与年龄和经历存在交互作用。结论:近一半的医生表现出专业水平的分型技能,但总体表现差异很大,受代际因素和临床经验的影响。鉴于文件负担影响到所有技能水平的临床医生,应该探索个人和系统策略,例如改进电子病历设计和替代输入方法。
{"title":"Typing Proficiency among Physicians in Internal Medicine: A Pilot Study of Speed and Performance.","authors":"Francois Bastardot, Vanessa Kraege, Julien Castioni, Alain Petter, David W Bates, Antoine Garnier","doi":"10.1055/a-2620-3147","DOIUrl":"10.1055/a-2620-3147","url":null,"abstract":"<p><p>Electronic health records (EHRs) are widely implemented and consume nearly half of physicians' work time. Despite the importance of efficient data entry, physicians' typing skills-potential contributors to documentation burden-remain poorly studied.This study aims to evaluate the typing skills of physicians and their associations with demographic characteristics and professional roles.This cross-sectional pilot study included a convenience sample of physicians (residents, chief residents, and attending physicians) from the internal medicine division of an academic hospital. Participants completed a 1-minute typing test under supervised conditions. The primary outcome was raw typing speed, measured in words per minute (WPM). The secondary outcome was a performance score calculated by subtracting 50 points for each error from the total number of characters typed per minute.Participation rate was 100% (82/82 physicians). The mean age was 33.7 ± 7.3 years; 7.2 ± 7.1 years since graduation; and 45.1% female. The mean typing speed was 53.4 WPM (range: 31-91 WPM), with 57.3% (47/82) of participants exceeding 50 WPM, a threshold commonly considered professional. Bivariate analysis showed a significant negative association with age (Spearman's ρ = -0.281, <i>p</i> = 0.011), which was not sustained in the multivariable analysis. No significant association was observed with sex, country of diploma, or role. Upon multivariable analysis, performance score showed a significant negative association with age (β = -17.724, <i>p</i> = 0.009) but a positive association with years since graduation (β = 16.850, <i>p</i> = 0.021), suggesting a generation- and experience-related interaction.Nearly half of physicians exhibited professional-level typing skills, yet overall performance varied widely and was influenced by both generational factors and clinical experience. Given that documentation burden affects clinicians across all skill levels, both individual and systemic strategies-such as improved EHR design and alternative input methods-should be explored.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1393-1400"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534124/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144152528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-12-18DOI: 10.1055/a-2765-6842
Lan Jiang, Yu-Li Huang, Jungwei Fan, Christy L Hunt, Jason S Eldrige, Lezli Kuster, Maribeth A Jensen, Sahil Gupta
Pain medicine triage plays a crucial role in ensuring patients receive timely and appropriate care by scheduling them to the most suitable treatment path. However, the absence of standardized triage protocols in pain medicine often leads to inefficiencies, including delay of care and wastage of healthcare resources.This study aims to develop a rule-based automated referral triage system leveraging information from patients' medical notes for scheduling patients to specific procedures in the pain medicine department.The proposed triage system, grounded in the knowledge and expertise of clinical providers, processed referral order comments and referring provider notes by iteratively refining the Natural Language Processing (NLP) rules and post-processing rules through intensively reviewing 76 patients. A post-processing regression model was incorporated to further enhance the accuracy. To ensure alignment with real-world practices, the system was integrated into an electronic health record (EHR) platform for real-time application, streamlining scheduling workflows and enhancing usability in daily clinical settings.After three iterations, the proposed NLP and post-processing rules improved accuracy from 76.3 to 80.3% compared to machine learning (ML) approaches in the preliminary study. The post-processing model further increased accuracy to 84.2%. The implementation accuracy of 200 cases for the first 3 months was consistent with our prediction at 83.5%, which concluded that the improvement over ML models (p-value = 0.018) was statistically significant at 95% significance level.This study demonstrates the feasibility and benefits of a knowledge-driven approach to referral triage in specialized medical fields. It lays a foundation for others in building similar triaging solutions to other specialties.
{"title":"A Rule-Based Automated Triage Model Using Natural Language Processing for Pain Medicine-Development and Implementation.","authors":"Lan Jiang, Yu-Li Huang, Jungwei Fan, Christy L Hunt, Jason S Eldrige, Lezli Kuster, Maribeth A Jensen, Sahil Gupta","doi":"10.1055/a-2765-6842","DOIUrl":"10.1055/a-2765-6842","url":null,"abstract":"<p><p>Pain medicine triage plays a crucial role in ensuring patients receive timely and appropriate care by scheduling them to the most suitable treatment path. However, the absence of standardized triage protocols in pain medicine often leads to inefficiencies, including delay of care and wastage of healthcare resources.This study aims to develop a rule-based automated referral triage system leveraging information from patients' medical notes for scheduling patients to specific procedures in the pain medicine department.The proposed triage system, grounded in the knowledge and expertise of clinical providers, processed referral order comments and referring provider notes by iteratively refining the Natural Language Processing (NLP) rules and post-processing rules through intensively reviewing 76 patients. A post-processing regression model was incorporated to further enhance the accuracy. To ensure alignment with real-world practices, the system was integrated into an electronic health record (EHR) platform for real-time application, streamlining scheduling workflows and enhancing usability in daily clinical settings.After three iterations, the proposed NLP and post-processing rules improved accuracy from 76.3 to 80.3% compared to machine learning (ML) approaches in the preliminary study. The post-processing model further increased accuracy to 84.2%. The implementation accuracy of 200 cases for the first 3 months was consistent with our prediction at 83.5%, which concluded that the improvement over ML models (<i>p</i>-value = 0.018) was statistically significant at 95% significance level.This study demonstrates the feasibility and benefits of a knowledge-driven approach to referral triage in specialized medical fields. It lays a foundation for others in building similar triaging solutions to other specialties.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1850-1861"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714436/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-12-18DOI: 10.1055/a-2765-6969
Joseph E Capito, Brian Z Dilcher, Zulkifl I Jafary
Anticoagulation decisions in atrial fibrillation (AF) depend on balancing stroke and bleeding risk, often guided by CHA2DS2-VASc (a validated clinical score used to estimate stroke risk in patients with atrial fibrillation) and HAS-BLED (a validated clinical score used to estimate bleeding risk in patients treated with anticoagulation) scores. Manual calculation of these scores can be time-consuming and inconsistently performed.This study evaluated whether implementing real-time, electronic health record (EHR)-integrated alerts in a rural academic primary care clinic would influence physician and non-physician provider (NPP) behavior around anticoagulation management.A single-arm observational study was conducted from March 2024 to September 2025 at a West Virginia University (WVU) Family Medicine Clinic. A rules-based engine in Epic calculated risk scores using 1 year of structured data and displayed them within a non-interruptive "Our Practice Advisory" alert. Physician or NPP interaction-defined as initiation of anticoagulation, documentation of rationale, or adding exclusion diagnosis to problem list-was analyzed using chi-square testing.Among 313 patients triggering the alert, 53 (16.9%) were newly started on anticoagulation, 112 (35.8%) had a documented rationale for not initiating therapy, and 2 had the exclusion diagnosis added to their chart. In total, 50.5% of patients had a clinically meaningful interaction with the tool (χ2 = 9.82, p = 0.0017). Across 2,447 encounters, the overall alert success rate was 19.8%, reflecting encounter-level engagement. Common acknowledgment reasons included corrective measures completed, high bleeding risk, recent procedures, and patient refusal. Physician and NPP comments informed iterative refinement, leading to expanded acknowledgment options.Real-time alerts displaying stroke and bleeding risk scores were associated with meaningful physician and NPP engagement, particularly for initiating anticoagulation in high-risk patients. While most interactions reflected review rather than treatment change, the tool appeared to support point-of-care decision-making. These findings support further investigation of EHR-based advisories to improve anticoagulation management in AF.
房颤(AF)的抗凝决策取决于卒中和出血风险的平衡,通常以CHA2DS2-VASc(用于估计房颤患者卒中风险的有效临床评分)和HAS-BLED(用于估计抗凝治疗患者出血风险的有效临床评分)评分为指导。手动计算这些分数既耗时又不一致。本研究评估了在农村学术初级保健诊所实施实时、电子健康记录(EHR)集成警报是否会影响医生和非医生提供者(NPP)在抗凝管理方面的行为。一项单臂观察性研究于2024年3月至2025年9月在西弗吉尼亚大学(WVU)家庭医学诊所进行。Epic中的基于规则的引擎使用1年的结构化数据计算风险分数,并在不间断的“我们的实践咨询”警报中显示它们。医师或NPP的相互作用——定义为抗凝的开始、基本原理的记录或将排除诊断添加到问题列表中——使用卡方检验进行分析。在触发警报的313例患者中,53例(16.9%)是新开始抗凝治疗的,112例(35.8%)有未开始治疗的记录,2例在其图表中添加了排除诊断。总共有50.5%的患者与该工具有临床意义的相互作用(χ2 = 9.82, p = 0.0017)。在2447次遭遇中,总体警报成功率为19.8%,反映了遭遇级别的参与。常见的承认原因包括纠正措施完成、出血风险高、近期手术和患者拒绝。医生和NPP的意见为反复改进提供了信息,从而扩大了确认选项。显示中风和出血风险评分的实时警报与有意义的医生和NPP参与相关,特别是在高危患者开始抗凝治疗时。虽然大多数互动反映的是回顾而不是治疗变化,但该工具似乎支持即时护理决策。这些发现支持进一步研究基于ehr的建议,以改善房颤的抗凝管理。
{"title":"Effect of Clinical Decision Support Alerts on Anticoagulation Management in Atrial Fibrillation.","authors":"Joseph E Capito, Brian Z Dilcher, Zulkifl I Jafary","doi":"10.1055/a-2765-6969","DOIUrl":"10.1055/a-2765-6969","url":null,"abstract":"<p><p>Anticoagulation decisions in atrial fibrillation (AF) depend on balancing stroke and bleeding risk, often guided by CHA<sub>2</sub>DS<sub>2</sub>-VASc (a validated clinical score used to estimate stroke risk in patients with atrial fibrillation) and HAS-BLED (a validated clinical score used to estimate bleeding risk in patients treated with anticoagulation) scores. Manual calculation of these scores can be time-consuming and inconsistently performed.This study evaluated whether implementing real-time, electronic health record (EHR)-integrated alerts in a rural academic primary care clinic would influence physician and non-physician provider (NPP) behavior around anticoagulation management.A single-arm observational study was conducted from March 2024 to September 2025 at a West Virginia University (WVU) Family Medicine Clinic. A rules-based engine in Epic calculated risk scores using 1 year of structured data and displayed them within a non-interruptive \"Our Practice Advisory\" alert. Physician or NPP interaction-defined as initiation of anticoagulation, documentation of rationale, or adding exclusion diagnosis to problem list-was analyzed using chi-square testing.Among 313 patients triggering the alert, 53 (16.9%) were newly started on anticoagulation, 112 (35.8%) had a documented rationale for not initiating therapy, and 2 had the exclusion diagnosis added to their chart. In total, 50.5% of patients had a clinically meaningful interaction with the tool (χ<sup>2 </sup>= 9.82, <i>p</i> = 0.0017). Across 2,447 encounters, the overall alert success rate was 19.8%, reflecting encounter-level engagement. Common acknowledgment reasons included corrective measures completed, high bleeding risk, recent procedures, and patient refusal. Physician and NPP comments informed iterative refinement, leading to expanded acknowledgment options.Real-time alerts displaying stroke and bleeding risk scores were associated with meaningful physician and NPP engagement, particularly for initiating anticoagulation in high-risk patients. While most interactions reflected review rather than treatment change, the tool appeared to support point-of-care decision-making. These findings support further investigation of EHR-based advisories to improve anticoagulation management in AF.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1892-1899"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714456/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-11-14DOI: 10.1055/a-2639-4974
Olena Mazurenko, Nate C Apathy, Lindsey M Sanner, Emma McCord, Meredith C B Adams, Robert W Hurley, Randall W Grout, Burke Mamlin, Saura Fortin, Justin Blackburn, Nir Menachemi, Joshua R Vest, Matthew Gurka, Christopher A Harle
This study aimed to assess the effect of a passive, opt-in electronic health record (EHR)-based clinical decision support (CDS), the Chronic Pain OneSheet, on guideline-recommended chronic pain management in primary care.A pragmatic randomized controlled trial with a parallel group design was conducted between October 2020 and May 2022. Participants were 137 primary care clinicians (PCCs) treating qualifying patients with chronic pain at 25 primary care clinics within two academic health systems in the United States. PCCs were randomized in the EHR to have access to OneSheet or usual care. OneSheet aggregates guideline-relevant information in a single view and provides shortcuts to guideline-recommended actions (e.g., ordering urine drug screening [UDS] for patients prescribed opioids). We constructed five visit-level binary outcomes: (1) documenting pain-related goals; (2) documenting pain and function via Pain, Enjoyment of Life and General Activity (PEG) scale; (3) reviewing prescription drug monitoring programs (PDMPs); (4) ordering UDS; and (5) ordering naloxone. Analysis used generalized linear mixed models for each outcome.OneSheet access minimally increased rates of pain-related goal documentation (0.2 percentage point increase, p = 0.013), PEG scale documentation (0.7 percentage point increase, p < 0.001), and UDS orders (2.2 percentage point increase, p = 0.006). OneSheet access decreased the rate of ordering naloxone (0.5 percentage point decrease, p < 0.001). OneSheet access did not affect PDMP review rates (0.5 percentage point decrease, p = 0.382).OneSheet access did not result in clinically significant improvements in guideline-recommended management of chronic pain in primary care despite a robust user-centered design incorporating clinician input and EHR integration. Several factors likely limited OneSheet effectiveness, including limited ability to target certain patient visits, workflow limits on data collection and ordering, and evolving COVID-19 and opioid epidemic-related policies and procedures. These findings highlight specific limitations of OneSheet and the broader challenges of implementing effective EHR-based CDS in complex health care environments.
本研究旨在评估被动的、可选择的基于电子健康记录(EHR)的临床决策支持(CDS),即慢性疼痛单,对初级保健中指南推荐的慢性疼痛管理的影响。本研究于2020年10月至2022年5月进行了一项具有平行组设计的实用随机对照试验。参与者是137名初级保健临床医生(PCCs),他们在美国两个学术卫生系统的25个初级保健诊所治疗符合条件的慢性疼痛患者。在电子病历中随机分配PCCs,使其能够获得电子病历或常规护理。OneSheet在单一视图中汇总了指南相关信息,并提供了指南推荐行动的快捷方式(例如,为处方阿片类药物的患者订购尿液药物筛查[UDS])。我们构建了五个访问级二元结果:(1)记录疼痛相关目标;(2)通过疼痛、生活享受和一般活动(PEG)量表记录疼痛和功能;(3)审查处方药监测方案;(4)订购UDS;(5)订购纳洛酮。对每个结果使用广义线性混合模型进行分析。单张表的访问最低限度地增加了疼痛相关目标文档的比率(增加0.2个百分点,p = 0.013), PEG量表文档(增加0.7个百分点,p = 0.006)。单页访问降低了纳洛酮订购率(降低0.5个百分点,p p = 0.382)。尽管采用了强有力的以用户为中心的设计,包括临床医生输入和电子病历整合,但在指南推荐的初级保健慢性疼痛管理方面,OneSheet访问并没有带来临床显著的改善。有几个因素可能限制了OneSheet的有效性,包括针对某些患者就诊的能力有限,数据收集和排序的工作流程限制,以及不断发展的COVID-19和阿片类药物流行相关政策和程序。这些发现突出了OneSheet的特定局限性,以及在复杂的卫生保健环境中实施有效的基于ehr的CDS所面临的更广泛挑战。
{"title":"Learning from Misses: Evaluating a Clinical Decision Support for Chronic Pain Management in Primary Care.","authors":"Olena Mazurenko, Nate C Apathy, Lindsey M Sanner, Emma McCord, Meredith C B Adams, Robert W Hurley, Randall W Grout, Burke Mamlin, Saura Fortin, Justin Blackburn, Nir Menachemi, Joshua R Vest, Matthew Gurka, Christopher A Harle","doi":"10.1055/a-2639-4974","DOIUrl":"10.1055/a-2639-4974","url":null,"abstract":"<p><p>This study aimed to assess the effect of a passive, opt-in electronic health record (EHR)-based clinical decision support (CDS), the Chronic Pain OneSheet, on guideline-recommended chronic pain management in primary care.A pragmatic randomized controlled trial with a parallel group design was conducted between October 2020 and May 2022. Participants were 137 primary care clinicians (PCCs) treating qualifying patients with chronic pain at 25 primary care clinics within two academic health systems in the United States. PCCs were randomized in the EHR to have access to OneSheet or usual care. OneSheet aggregates guideline-relevant information in a single view and provides shortcuts to guideline-recommended actions (e.g., ordering urine drug screening [UDS] for patients prescribed opioids). We constructed five visit-level binary outcomes: (1) documenting pain-related goals; (2) documenting pain and function via Pain, Enjoyment of Life and General Activity (PEG) scale; (3) reviewing prescription drug monitoring programs (PDMPs); (4) ordering UDS; and (5) ordering naloxone. Analysis used generalized linear mixed models for each outcome.OneSheet access minimally increased rates of pain-related goal documentation (0.2 percentage point increase, <i>p</i> = 0.013), PEG scale documentation (0.7 percentage point increase, <i>p</i> < 0.001), and UDS orders (2.2 percentage point increase, <i>p</i> = 0.006). OneSheet access decreased the rate of ordering naloxone (0.5 percentage point decrease, <i>p</i> < 0.001). OneSheet access did not affect PDMP review rates (0.5 percentage point decrease, <i>p</i> = 0.382).OneSheet access did not result in clinically significant improvements in guideline-recommended management of chronic pain in primary care despite a robust user-centered design incorporating clinician input and EHR integration. Several factors likely limited OneSheet effectiveness, including limited ability to target certain patient visits, workflow limits on data collection and ordering, and evolving COVID-19 and opioid epidemic-related policies and procedures. These findings highlight specific limitations of OneSheet and the broader challenges of implementing effective EHR-based CDS in complex health care environments.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1683-1694"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12618150/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145524281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-02DOI: 10.1055/a-2625-0750
Naveed Rabbani, Mondira Ray, Eleanor Verhagen, Jonathan Hatoun, Laura Burckett Patane, Louis Vernacchio
Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.
{"title":"Ambient Artificial Intelligence Scribes in Pediatric Primary Care: A Mixed Methods Study.","authors":"Naveed Rabbani, Mondira Ray, Eleanor Verhagen, Jonathan Hatoun, Laura Burckett Patane, Louis Vernacchio","doi":"10.1055/a-2625-0750","DOIUrl":"10.1055/a-2625-0750","url":null,"abstract":"<p><p>Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1578-1587"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12578578/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-23DOI: 10.1055/a-2725-6117
Dominique V C de Jel, J Willemijn van Koevorden, Melanie Singer, Vincent van der Noort, Ludi E Smeele, Richard Dirven
The digital availability of health data not only improves processes in primary care, but it also facilitates the evaluation of healthcare delivery. Nevertheless, the preprocessing of data for secondary use is still time-consuming and expensive, particularly in head and neck cancer (HNC), where patients undergo complex multidisciplinary treatment trajectories. Therefore, we have looked further into the effects on data quantity and quality following the implementation of structured care pathways. Leveraging data extracted from these care pathways, we assessed the potential of real-time quality-of-care evaluation through dashboards, incorporating indicators such as a proposed "textbook process" model.Our mixed methods study assessed the value of a newly implemented structured HNC pathway and its effect on data quantity and quality through three processes: (1) A qualitative assessment of current barriers, data registration processes, and data-interpretation discrepancies with in-house data managers. (2) A prospective pilot (n = 41) in which patient data is registered both manually and semi-automatically. (3) An evaluation of the patient journey through dashboards with real-time indicators 1 year after go-live.During the iterative implementation phase of the structured care pathway, data completeness and correctness averaged 84.8 and 88.4%, respectively. The new method reduced registration time by 3.7 minutes per patient. A majority of 87.8% followed all four defined time points of the structured care pathway. One year after implementation and in-house validation, time-to-treatment intervals could be tracked, and processes could be adapted accordingly.A structured care pathway, followed by early implementation guided by a multidisciplinary team, forms the foundation for sustainable data capturing for multiple purposes, including quality registries. In-house dashboards further enhance data quality and process improvement.
{"title":"Implementing a Structured Head and Neck Cancer Care Pathway in an Electronic Health Record: Iterative Process and Effects on Data Quality.","authors":"Dominique V C de Jel, J Willemijn van Koevorden, Melanie Singer, Vincent van der Noort, Ludi E Smeele, Richard Dirven","doi":"10.1055/a-2725-6117","DOIUrl":"10.1055/a-2725-6117","url":null,"abstract":"<p><p>The digital availability of health data not only improves processes in primary care, but it also facilitates the evaluation of healthcare delivery. Nevertheless, the preprocessing of data for secondary use is still time-consuming and expensive, particularly in head and neck cancer (HNC), where patients undergo complex multidisciplinary treatment trajectories. Therefore, we have looked further into the effects on data quantity and quality following the implementation of structured care pathways. Leveraging data extracted from these care pathways, we assessed the potential of real-time quality-of-care evaluation through dashboards, incorporating indicators such as a proposed \"textbook process\" model.Our mixed methods study assessed the value of a newly implemented structured HNC pathway and its effect on data quantity and quality through three processes: (1) A qualitative assessment of current barriers, data registration processes, and data-interpretation discrepancies with in-house data managers. (2) A prospective pilot (<i>n</i> = 41) in which patient data is registered both manually and semi-automatically. (3) An evaluation of the patient journey through dashboards with real-time indicators 1 year after go-live.During the iterative implementation phase of the structured care pathway, data completeness and correctness averaged 84.8 and 88.4%, respectively. The new method reduced registration time by 3.7 minutes per patient. A majority of 87.8% followed all four defined time points of the structured care pathway. One year after implementation and in-house validation, time-to-treatment intervals could be tracked, and processes could be adapted accordingly.A structured care pathway, followed by early implementation guided by a multidisciplinary team, forms the foundation for sustainable data capturing for multiple purposes, including quality registries. In-house dashboards further enhance data quality and process improvement.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1606-1614"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594565/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145356555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-11-28DOI: 10.1055/a-2740-1587
Oluwatoba Moninuola, John M Grisham, Naveed Farrukh, Leanne Murray, Aarti Chandawarkar, Laura Rust, Alysha J Taxter, Juan D Chaparro, Jeffrey Hoffman, Jennifer A Lee
This study aimed to evaluate the effect of optimizing the ambulatory medication preference list on provider efficiency in medication ordering.Using electronic health record (EHR) vendor data, a multidisciplinary informatics team optimized the general ambulatory medication preference list to better align with providers' ordering patterns. We conducted a pre-postintervention analysis assessing time-in-orders per encounter and number of manual changes per order.Postintervention, average manual changes per order decreased from 4.12 to 3.00 (p < 0.01), and median time spent in the orders activity per encounter decreased from 3.1 to 2.3 minutes (p < 0.01).Optimizing the ambulatory medication preference list reduced time spent and clicks needed by providers when ordering medications. This is relevant to ongoing efforts to address EHR-related burden.
{"title":"A Prescription for Efficiency: The Effect of an Ambulatory Medication Preference List Optimization.","authors":"Oluwatoba Moninuola, John M Grisham, Naveed Farrukh, Leanne Murray, Aarti Chandawarkar, Laura Rust, Alysha J Taxter, Juan D Chaparro, Jeffrey Hoffman, Jennifer A Lee","doi":"10.1055/a-2740-1587","DOIUrl":"10.1055/a-2740-1587","url":null,"abstract":"<p><p>This study aimed to evaluate the effect of optimizing the ambulatory medication preference list on provider efficiency in medication ordering.Using electronic health record (EHR) vendor data, a multidisciplinary informatics team optimized the general ambulatory medication preference list to better align with providers' ordering patterns. We conducted a pre-postintervention analysis assessing time-in-orders per encounter and number of manual changes per order.Postintervention, average manual changes per order decreased from 4.12 to 3.00 (<i>p</i> < 0.01), and median time spent in the orders activity per encounter decreased from 3.1 to 2.3 minutes (<i>p</i> < 0.01).Optimizing the ambulatory medication preference list reduced time spent and clicks needed by providers when ordering medications. This is relevant to ongoing efforts to address EHR-related burden.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1794-1798"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12662729/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145641700","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-17DOI: 10.1055/a-2701-4543
Courtney J Diamond, Jonathan E Elias, Rachel Y Lee, Haomiao Jia, Erika L Abramson, Jessica S Ancker, Susan Bostwick, Kenrick D Cato, Richard Trepp, Rachel A Lewis, Timothy J Crimmins, Sarah C Rossetti
The adoption of electronic health records (EHRs) into clinical practice has changed clinical workflows and, in some cases, increased documentation burden and clinician burnout. Identifying factors associated with perceived EHR usability after the implementation of a new EHR may guide efforts to reduce burden and burnout.This study measured: (1) group-level perceptions of EHR usability pre- and postimplementation of a new EHR; (2) adaptation to the new EHR; and (3) the effects of clinical role, setting, and specialty on these measures.Pre- and postimplementation surveys were sent to clinical staff at two academic medical centers (AMC A and AMC B), each part of the same Northeast health system where one instance of a new EHR was implemented starting in 2020. The surveys measured constructs from the Health Information Technology Usability Evaluation Scale (Health-ITUES) and Health Information Technology Adaptation survey. Unpaired t-tests assessed changes in group-level scores from pre- to postimplementation, and multiway analyses of variance with post hoc pairwise t-tests with Bonferroni's correction were used to assess differences in scores by clinical role, setting, and specialty.Average Perceived Usefulness (PU) and adaptation scores were higher at AMC B than at AMC A, but similar pre- to postimplementation trends were observed at both sites. Perceptions of Quality of Work Life (QWL), PU, and User Control (UC) improved across both sites postimplementation, whereas Perceived Ease of Use and Cognitive Support and Situational Awareness declined. Ordering Providers, Registered Nurses, clinicians practicing in the Emergency Department setting, and Emergency Medicine, and Critical/Intensive Care specialists had statistically different scores across various constructs.After implementation of a new EHR system at two AMCs, clinical staff perceptions of quality of work life (QWL), perceived usefulness (PU), and user control (UC) generally improved, although perceptions of perceived ease of use and cognitive support declined.
{"title":"Evaluating Clinical Staff Perceptions of EHR Usability, Satisfaction, and Adaptation to a New EHR: A Multisite, Pre-Post Implementation Study.","authors":"Courtney J Diamond, Jonathan E Elias, Rachel Y Lee, Haomiao Jia, Erika L Abramson, Jessica S Ancker, Susan Bostwick, Kenrick D Cato, Richard Trepp, Rachel A Lewis, Timothy J Crimmins, Sarah C Rossetti","doi":"10.1055/a-2701-4543","DOIUrl":"10.1055/a-2701-4543","url":null,"abstract":"<p><p>The adoption of electronic health records (EHRs) into clinical practice has changed clinical workflows and, in some cases, increased documentation burden and clinician burnout. Identifying factors associated with perceived EHR usability after the implementation of a new EHR may guide efforts to reduce burden and burnout.This study measured: (1) group-level perceptions of EHR usability pre- and postimplementation of a new EHR; (2) adaptation to the new EHR; and (3) the effects of clinical role, setting, and specialty on these measures.Pre- and postimplementation surveys were sent to clinical staff at two academic medical centers (AMC A and AMC B), each part of the same Northeast health system where one instance of a new EHR was implemented starting in 2020. The surveys measured constructs from the Health Information Technology Usability Evaluation Scale (Health-ITUES) and Health Information Technology Adaptation survey. Unpaired <i>t</i>-tests assessed changes in group-level scores from pre- to postimplementation, and multiway analyses of variance with post hoc pairwise <i>t</i>-tests with Bonferroni's correction were used to assess differences in scores by clinical role, setting, and specialty.Average Perceived Usefulness (PU) and adaptation scores were higher at AMC B than at AMC A, but similar pre- to postimplementation trends were observed at both sites. Perceptions of Quality of Work Life (QWL), PU, and User Control (UC) improved across both sites postimplementation, whereas Perceived Ease of Use and Cognitive Support and Situational Awareness declined. Ordering Providers, Registered Nurses, clinicians practicing in the Emergency Department setting, and Emergency Medicine, and Critical/Intensive Care specialists had statistically different scores across various constructs.After implementation of a new EHR system at two AMCs, clinical staff perceptions of quality of work life (QWL), perceived usefulness (PU), and user control (UC) generally improved, although perceptions of perceived ease of use and cognitive support declined.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1368-1380"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534127/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145313912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-09-26DOI: 10.1055/a-2710-4226
Theresa Burkard, Montse Camprubi, Daniel Prieto-Alhambra, Peter Rijnbeek, Marta Pineda-Moncusi
Federated network studies allow data to remain locally while the research is conducted through the sharing of analytical code and aggregated results across different health care settings and countries. A large number of databases have been mapped to the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM), boosting the use of analytical pipelines for standardized observational research within this open science framework. Transparency, reproducibility, and robustness of results have positioned federated analyses using the OMOP CDM within the European Health Data and Evidence Network (EHDEN) as an essential tool for generating large-scale evidence.We conducted large-scale federated analyses involving 52 databases from 19 countries using the OMOP CDM. In this State-of-the-Art/Best Practice article, we aimed to share key lessons and strategies for conducting such complex, large multidatabase analyses.Meticulous planning, establishing a strong community of collaborators, efficient communication channels, standardized analytics, and strategic division of responsibilities are essential. We highlight the benefits of network engagement, cross-fertilization of ideas, and shared learning. Further key elements contributing to the study's success included an inclusive, incremental implementation of the analytical code, timely engagement of data partners, and community webinars to discuss and interpret study findings.We received predominantly positive feedback from data custodians about their participation, and included input for further improvements for future large-scale federated network studies from this shared learning experience.
{"title":"Best Practices to Design, Plan, and Execute Large-Scale Federated Analyses-Key Learnings and Suggestions from a Study Comprising 52 Databases.","authors":"Theresa Burkard, Montse Camprubi, Daniel Prieto-Alhambra, Peter Rijnbeek, Marta Pineda-Moncusi","doi":"10.1055/a-2710-4226","DOIUrl":"10.1055/a-2710-4226","url":null,"abstract":"<p><p>Federated network studies allow data to remain locally while the research is conducted through the sharing of analytical code and aggregated results across different health care settings and countries. A large number of databases have been mapped to the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM), boosting the use of analytical pipelines for standardized observational research within this open science framework. Transparency, reproducibility, and robustness of results have positioned federated analyses using the OMOP CDM within the European Health Data and Evidence Network (EHDEN) as an essential tool for generating large-scale evidence.We conducted large-scale federated analyses involving 52 databases from 19 countries using the OMOP CDM. In this <i>State-of-the-Art/Best Practice</i> article, we aimed to share key lessons and strategies for conducting such complex, large multidatabase analyses.Meticulous planning, establishing a strong community of collaborators, efficient communication channels, standardized analytics, and strategic division of responsibilities are essential. We highlight the benefits of network engagement, cross-fertilization of ideas, and shared learning. Further key elements contributing to the study's success included an inclusive, incremental implementation of the analytical code, timely engagement of data partners, and community webinars to discuss and interpret study findings.We received predominantly positive feedback from data custodians about their participation, and included input for further improvements for future large-scale federated network studies from this shared learning experience.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1507-1517"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12575070/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145179787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-11-07DOI: 10.1055/a-2720-5448
Andrew J King, Christopher M Horvat, David Schlessinger, Harry Hochheiser, Kevin V Bui, Jason N Kennedy, Emily B Brant, James Shalaby, Derek C Angus, Vincent X Liu, Christopher W Seymour
Sepsis is a heterogeneous syndrome with high morbidity and mortality. Despite extensive clinical trials, therapeutic progress remains limited, in part due to the absence of actionable sepsis subtypes.This study aimed to evaluate the feasibility of using HL7 Fast Healthcare Interoperability Resources (FHIR) for prerandomization sepsis subtyping to support clinical trial enrichment across multiple health systems.Data from 765 encounters at two academic medical centers were analyzed. FHIR-based resources were extracted from both research data warehouses (RDWs) and electronic health records (EHRs). A Python implementation of the Sepsis Endotyping in Emergency Care (SENECA) sepsis subtyping algorithm was developed to query and assemble FHIR resources for subtype classification.Open-source Python code for the SENECA algorithm is provided on GitHub. Experiments demonstrated: (1) successful sepsis subtyping across both health systems; (2) concordance between the original R implementation and the new Python implementation; and (3) discrepancies when comparing RDW-derived versus EHR-integrated FHIR APIs, primarily due to query and filtering limitations. Missing data were common and influenced by both clinical practice and FHIR API constraints. We provide five recommendations to address these challenges.FHIR can support multi-institutional sepsis subtyping and trial enrichment, though technical and governance challenges remain.
{"title":"A FHIR-Powered Python Implementation of the SENECA Algorithm for Sepsis Subtyping.","authors":"Andrew J King, Christopher M Horvat, David Schlessinger, Harry Hochheiser, Kevin V Bui, Jason N Kennedy, Emily B Brant, James Shalaby, Derek C Angus, Vincent X Liu, Christopher W Seymour","doi":"10.1055/a-2720-5448","DOIUrl":"10.1055/a-2720-5448","url":null,"abstract":"<p><p>Sepsis is a heterogeneous syndrome with high morbidity and mortality. Despite extensive clinical trials, therapeutic progress remains limited, in part due to the absence of actionable sepsis subtypes.This study aimed to evaluate the feasibility of using HL7 Fast Healthcare Interoperability Resources (FHIR) for prerandomization sepsis subtyping to support clinical trial enrichment across multiple health systems.Data from 765 encounters at two academic medical centers were analyzed. FHIR-based resources were extracted from both research data warehouses (RDWs) and electronic health records (EHRs). A Python implementation of the Sepsis Endotyping in Emergency Care (SENECA) sepsis subtyping algorithm was developed to query and assemble FHIR resources for subtype classification.Open-source Python code for the SENECA algorithm is provided on GitHub. Experiments demonstrated: (1) successful sepsis subtyping across both health systems; (2) concordance between the original R implementation and the new Python implementation; and (3) discrepancies when comparing RDW-derived versus EHR-integrated FHIR APIs, primarily due to query and filtering limitations. Missing data were common and influenced by both clinical practice and FHIR API constraints. We provide five recommendations to address these challenges.FHIR can support multi-institutional sepsis subtyping and trial enrichment, though technical and governance challenges remain.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1588-1594"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594559/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145472394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}