Pub Date : 2025-10-01Epub Date: 2025-05-26DOI: 10.1055/a-2620-3244
Brian G Bell, Adam Khimji, Basharat Hussain, Anthony J Avery
In recent years, there has been an expansion in the literature on the effects of computerized alerts on prescribing and patient outcomes. The aim of our study was to examine the impact of these systems on clinician prescribing and patient outcomes.We searched three databases (Medline, Embase, and PsychINFO) for studies that had been conducted since 2009 and included studies that examined the effects of alerts at the point of prescribing. We extracted data from 69 studies.Most studies reported a beneficial effect on prescribing of computerized alerts (n = 58, 84.1%), including all studies (n = 4) that used passive alerts. Seven of the 10 studies that reported on patient outcomes showed a beneficial effect. Both randomized controlled trials (RCTs) and non-RCTS showed beneficial effects on prescribing across a range of different types of alerts. In 43 studies, it was possible to ascertain the effects of different types of alerts; the interventions that were most frequently associated with improvements in prescribing were drug-laboratory alerts (9/11; 81.8%); dose range checking (6/7; 85.7%); formulary alerts (8/9; 88.9%), and drug-allergy alerts (4/4; 100%). However, most of the studies did not satisfy the quality criteria.Most of the studies found a beneficial effect of computerized alerts on prescribing. We have also shown that these benefits are apparent for a range of different types of alerts. These findings support the continued development, implementation, and evaluation of computerized alerts for prescribing.
{"title":"The Effect of Computerized Alerts on Prescribing and Patient Outcomes: A Systematic Review.","authors":"Brian G Bell, Adam Khimji, Basharat Hussain, Anthony J Avery","doi":"10.1055/a-2620-3244","DOIUrl":"10.1055/a-2620-3244","url":null,"abstract":"<p><p>In recent years, there has been an expansion in the literature on the effects of computerized alerts on prescribing and patient outcomes. The aim of our study was to examine the impact of these systems on clinician prescribing and patient outcomes.We searched three databases (Medline, Embase, and PsychINFO) for studies that had been conducted since 2009 and included studies that examined the effects of alerts at the point of prescribing. We extracted data from 69 studies.Most studies reported a beneficial effect on prescribing of computerized alerts (<i>n</i> = 58, 84.1%), including all studies (<i>n</i> = 4) that used passive alerts. Seven of the 10 studies that reported on patient outcomes showed a beneficial effect. Both randomized controlled trials (RCTs) and non-RCTS showed beneficial effects on prescribing across a range of different types of alerts. In 43 studies, it was possible to ascertain the effects of different types of alerts; the interventions that were most frequently associated with improvements in prescribing were drug-laboratory alerts (9/11; 81.8%); dose range checking (6/7; 85.7%); formulary alerts (8/9; 88.9%), and drug-allergy alerts (4/4; 100%). However, most of the studies did not satisfy the quality criteria.Most of the studies found a beneficial effect of computerized alerts on prescribing. We have also shown that these benefits are apparent for a range of different types of alerts. These findings support the continued development, implementation, and evaluation of computerized alerts for prescribing.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1381-1392"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534129/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144152614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-05-30DOI: 10.1055/a-2621-7717
Swaminathan Kandaswamy, Sarah Thompson, Edwin Ray, Tracy Ruska, Evan Orenstein
The timely administration of postoperative antibiotics is crucial for preventing surgical site infections. Despite surgical ordering workflows designed to facilitate care across settings, delays in antibiotic administration posttransfer to the pediatric intensive care unit (PICU) were identified. We aimed to develop a clinical decision support (CDS) system to enhance timely order activation in a large pediatric health system. We hypothesized that the time to release signed and held orders by PICU nurses would decrease after implementation of an electronic health record alert, ultimately reducing time to antibiotic administration.This study aimed to describe the CDS design for the timely release of postoperative orders, evaluate its effectiveness, and share lessons learned from its implementation.Stakeholder interviews and a staged implementation approach were employed to develop and implement the CDS in one of the two PICUs. An interruptive alert was designed to prompt nurses to release specific signed and held orders. The study period spanned from January 2019 to August 2024, with pre- and postintervention comparisons of the mean time to release medication orders.The alert was used from May to December 2021, but was associated with increased time to release orders. Postintervention usability testing revealed confusion among nurses, leading to the alert's discontinuation. A post hoc analysis suggested that the observed delays might align with seasonal trends rather than the CDS intervention.The CDS implementation had unintended adverse effects on order release times, emphasizing the importance of monitoring and evaluating such systems postimplementation. Usability testing highlighted the complexity of the alert messaging and the importance of including end-users in the design phase. Extended evaluation periods are recommended to discern CDS impact accurately. The study also underscores the necessity of assessing whether a technological or workflow/process change is needed in response to safety reports.
{"title":"Unintended Delays in Pediatric Postoperative Antibiotic Administration from Overly Complex CDS Instructions.","authors":"Swaminathan Kandaswamy, Sarah Thompson, Edwin Ray, Tracy Ruska, Evan Orenstein","doi":"10.1055/a-2621-7717","DOIUrl":"10.1055/a-2621-7717","url":null,"abstract":"<p><p>The timely administration of postoperative antibiotics is crucial for preventing surgical site infections. Despite surgical ordering workflows designed to facilitate care across settings, delays in antibiotic administration posttransfer to the pediatric intensive care unit (PICU) were identified. We aimed to develop a clinical decision support (CDS) system to enhance timely order activation in a large pediatric health system. We hypothesized that the time to release signed and held orders by PICU nurses would decrease after implementation of an electronic health record alert, ultimately reducing time to antibiotic administration.This study aimed to describe the CDS design for the timely release of postoperative orders, evaluate its effectiveness, and share lessons learned from its implementation.Stakeholder interviews and a staged implementation approach were employed to develop and implement the CDS in one of the two PICUs. An interruptive alert was designed to prompt nurses to release specific signed and held orders. The study period spanned from January 2019 to August 2024, with pre- and postintervention comparisons of the mean time to release medication orders.The alert was used from May to December 2021, but was associated with increased time to release orders. Postintervention usability testing revealed confusion among nurses, leading to the alert's discontinuation. A post hoc analysis suggested that the observed delays might align with seasonal trends rather than the CDS intervention.The CDS implementation had unintended adverse effects on order release times, emphasizing the importance of monitoring and evaluating such systems postimplementation. Usability testing highlighted the complexity of the alert messaging and the importance of including end-users in the design phase. Extended evaluation periods are recommended to discern CDS impact accurately. The study also underscores the necessity of assessing whether a technological or workflow/process change is needed in response to safety reports.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1413-1418"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534123/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144974990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-12-18DOI: 10.1055/a-2765-6792
Alejandro García-Rudolph, Alicia Romero Marquez, Mónica López Andurell, Laura Jimenez Pérez, Susana Guillén Gazapo, Marc Navarro Berenguel, Eloy Opisso, Elena Hernandez-Pena
Sleep quality critically influences recovery in neurological patients, yet its longitudinal monitoring during hospitalization remains limited. Nursing narrative notes offer an underutilized resource to track sleep trajectories objectively across time.To propose and apply a formal pipeline that integrates structured clinical data and unstructured nursing annotations to monitor sleep trajectories during post-acute inpatient neurorehabilitation, relying exclusively on free-to-use software tools and without increasing nursing workload.A total of 17,039 nighttime nursing annotations were extracted and categorized into four sleep quality states. Two expert raters manually labeled a training set of 2,000 annotations (κ = 0.84). A random forest classifier achieved 0.93 sensitivity and 0.94 specificity and was used to classify the remaining notes. Sleep sequences were constructed and clustered using sequence analysis (TraMineR) and hierarchical clustering (AGNES, Ward's method). The obtained clusters (silhouette = 0.40) were compared using non-parametric statistics across clinical, functional, and social variables in a cohort of 303 post-acute consecutive neurorehabilitation inpatients.Four distinct sleep trajectory clusters were identified, each characterized by unique functional and socio-environmental profiles. The first group (n = 102; 33.7%) combined high functional independence, strong social support, stable economy, short hospitalization, and favorable sleep quality. The second group (n = 76; 25.1%) presented moderate functional independence, precarious economic conditions, and the highest proportion of poor sleep quality. The third group (n = 76; 25.1%) exhibited severe functional impairment, long hospitalization, poor housing conditions, but paradoxically the highest proportion of good sleep quality. The fourth group (n = 49; 16.2%) showed profound disability, relatively favorable socio-economic conditions, and predominance of intermediate sleep quality, likely influenced by medication. Distinctive sets of social and functional keywords emerged for each cluster.This pipeline identified clinically meaningful sleep profiles from nursing notes, highlighting functional and social determinants' role in shaping neurorehabilitation sleep trajectories.
{"title":"A Sequence Clustering Approach to Mining Sleep Trajectories from Nursing Narratives and Structured Clinical Data.","authors":"Alejandro García-Rudolph, Alicia Romero Marquez, Mónica López Andurell, Laura Jimenez Pérez, Susana Guillén Gazapo, Marc Navarro Berenguel, Eloy Opisso, Elena Hernandez-Pena","doi":"10.1055/a-2765-6792","DOIUrl":"10.1055/a-2765-6792","url":null,"abstract":"<p><p>Sleep quality critically influences recovery in neurological patients, yet its longitudinal monitoring during hospitalization remains limited. Nursing narrative notes offer an underutilized resource to track sleep trajectories objectively across time.To propose and apply a formal pipeline that integrates structured clinical data and unstructured nursing annotations to monitor sleep trajectories during post-acute inpatient neurorehabilitation, relying exclusively on free-to-use software tools and without increasing nursing workload.A total of 17,039 nighttime nursing annotations were extracted and categorized into four sleep quality states. Two expert raters manually labeled a training set of 2,000 annotations (κ = 0.84). A random forest classifier achieved 0.93 sensitivity and 0.94 specificity and was used to classify the remaining notes. Sleep sequences were constructed and clustered using sequence analysis (TraMineR) and hierarchical clustering (AGNES, Ward's method). The obtained clusters (silhouette = 0.40) were compared using non-parametric statistics across clinical, functional, and social variables in a cohort of 303 post-acute consecutive neurorehabilitation inpatients.Four distinct sleep trajectory clusters were identified, each characterized by unique functional and socio-environmental profiles. The first group (<i>n</i> = 102; 33.7%) combined high functional independence, strong social support, stable economy, short hospitalization, and favorable sleep quality. The second group (<i>n</i> = 76; 25.1%) presented moderate functional independence, precarious economic conditions, and the highest proportion of poor sleep quality. The third group (<i>n</i> = 76; 25.1%) exhibited severe functional impairment, long hospitalization, poor housing conditions, but paradoxically the highest proportion of good sleep quality. The fourth group (<i>n</i> = 49; 16.2%) showed profound disability, relatively favorable socio-economic conditions, and predominance of intermediate sleep quality, likely influenced by medication. Distinctive sets of social and functional keywords emerged for each cluster.This pipeline identified clinically meaningful sleep profiles from nursing notes, highlighting functional and social determinants' role in shaping neurorehabilitation sleep trajectories.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1837-1849"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714454/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783383","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-31DOI: 10.1055/a-2624-1875
Sue S Feldman, Ben Martin, Josette Jones, Kim M Unertl, Madison Fritts, Paul Nagy, RaeLynn Gochnauer
Health informatics continues to be a continuously evolving discipline. As a result, faculty in health informatics training programs cover a broad range of topics and work in highly diverse academic contexts. This is a strength of the field, and also introduces challenges in understanding faculty salary ranges and assessing potential salary disparities across contexts. Although limited studies have been done on salary ranges in specific academic contexts, prior to this, no comprehensive salary survey had been performed on faculty in health informatics.The goal of this study was to obtain a preliminary understanding of the salary ranges for academic health informatics faculty and contextual factors that affect salary ranges in this field.A team of researchers affiliated with the American Medical Informatics Association (AMIA) Academic Forum collaboratively developed a survey focused on salary and factors that affect salary for health informatics faculty. The survey was distributed through official AMIA communication channels, including communications at the 2023 AMIA Symposium. Descriptive statistics were calculated, and an ordinal regression analysis was performed.Of 314 responses, 153 individuals employed by academic organizations reported their base salary information. A majority (61%) of these respondents reported working in a school of medicine, with PhD (59%) and MD (37%) degrees reported as the highest educational level for the majority of the sample. When adjusted for cost of living, there were statistically significant associations between salary and type of school/department, position/title, and highest degree. We also found that while salaries at the assistant professor level were between $120,000 and 159,999, those of associate and full professors were at or above $200,000.The survey provided preliminary baseline data on salary ranges in academic health informatics programs and factors leading to salary differences. More data are needed on focused topics to extend the impact of this type of survey.
{"title":"Salary Structures in Health Informatics Academia: A Preliminary Survey Analysis.","authors":"Sue S Feldman, Ben Martin, Josette Jones, Kim M Unertl, Madison Fritts, Paul Nagy, RaeLynn Gochnauer","doi":"10.1055/a-2624-1875","DOIUrl":"10.1055/a-2624-1875","url":null,"abstract":"<p><p>Health informatics continues to be a continuously evolving discipline. As a result, faculty in health informatics training programs cover a broad range of topics and work in highly diverse academic contexts. This is a strength of the field, and also introduces challenges in understanding faculty salary ranges and assessing potential salary disparities across contexts. Although limited studies have been done on salary ranges in specific academic contexts, prior to this, no comprehensive salary survey had been performed on faculty in health informatics.The goal of this study was to obtain a preliminary understanding of the salary ranges for academic health informatics faculty and contextual factors that affect salary ranges in this field.A team of researchers affiliated with the American Medical Informatics Association (AMIA) Academic Forum collaboratively developed a survey focused on salary and factors that affect salary for health informatics faculty. The survey was distributed through official AMIA communication channels, including communications at the 2023 AMIA Symposium. Descriptive statistics were calculated, and an ordinal regression analysis was performed.Of 314 responses, 153 individuals employed by academic organizations reported their base salary information. A majority (61%) of these respondents reported working in a school of medicine, with PhD (59%) and MD (37%) degrees reported as the highest educational level for the majority of the sample. When adjusted for cost of living, there were statistically significant associations between salary and type of school/department, position/title, and highest degree. We also found that while salaries at the assistant professor level were between $120,000 and 159,999, those of associate and full professors were at or above $200,000.The survey provided preliminary baseline data on salary ranges in academic health informatics programs and factors leading to salary differences. More data are needed on focused topics to extend the impact of this type of survey.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1560-1567"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12578576/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145423129","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-30DOI: 10.1055/a-2713-5725
George A Gellert, Daniel Borgasano, Robert Palermo, Gabriel L Gellert, Sean P Kelly
Gather insights regarding the state of third-party access cybersecurity in healthcare delivery organizations (HDOs).An online multinational survey was deployed to eligible respondents to assess HDO third-party access, cybersecurity, and challenges.Of 209 respondents, only 51.1% reported having a comprehensive inventory of all third parties accessing their network. Sixty percent stated third-party access to sensitive/confidential information was not routinely monitored, despite 19% having more than 40, and 31% having 21 to 40 third parties with network access. Reasons included lack of resources (48%) and centralized control over third-party relationships (36%), complexity (28%), and frequent third-party turnover (22%). Confidence in third-party ability to secure information and their reputations was cited. More than half (56%) reported a breach involving a third party in the last 12 months, and two-thirds anticipate breaches increasing in the next 12 to 24 months. Most agreed breaches are a cybersecurity priority, a resource drain, and their weakest attack surface. Slight majorities indicated high perceived effectiveness in mitigating, detecting, preventing, and controlling third-party access risks and security/privacy regulatory compliance. Regarding existing solutions, roughly half (55%) ranked the effectiveness of vendor privileged access management (VPAM) and privileged access management (PAM; 49%) at ≤ 6 on a 10-point scale, respectively. Barriers to reducing access risks include lack of oversight/governance (53%) and insufficient resources (45%). Of those monitoring third-party access, 53% do so manually. Breach consequences include loss/theft of sensitive information (60%), regulatory fines (49%), severed relationships with third parties (47%), and loss of revenue (42%) and business partners (38%).HDOs recognize the increasing threat of third-party cyber breaches but are struggling to effectively address them. Lack of budget, expert resources, complexity, and third-party turnover are among the reasons why. Need exists for automated, cost-effective solutions to address the significant risks of third-party access with a consistent strategy that minimizes breach risk by securing remote access to privileged assets, accounts, and data.
{"title":"Third-Party Access Cybersecurity Threats and Precautions: A Survey of Healthcare Delivery Organizations.","authors":"George A Gellert, Daniel Borgasano, Robert Palermo, Gabriel L Gellert, Sean P Kelly","doi":"10.1055/a-2713-5725","DOIUrl":"10.1055/a-2713-5725","url":null,"abstract":"<p><p>Gather insights regarding the state of third-party access cybersecurity in healthcare delivery organizations (HDOs).An online multinational survey was deployed to eligible respondents to assess HDO third-party access, cybersecurity, and challenges.Of 209 respondents, only 51.1% reported having a comprehensive inventory of all third parties accessing their network. Sixty percent stated third-party access to sensitive/confidential information was not routinely monitored, despite 19% having more than 40, and 31% having 21 to 40 third parties with network access. Reasons included lack of resources (48%) and centralized control over third-party relationships (36%), complexity (28%), and frequent third-party turnover (22%). Confidence in third-party ability to secure information and their reputations was cited. More than half (56%) reported a breach involving a third party in the last 12 months, and two-thirds anticipate breaches increasing in the next 12 to 24 months. Most agreed breaches are a cybersecurity priority, a resource drain, and their weakest attack surface. Slight majorities indicated high perceived effectiveness in mitigating, detecting, preventing, and controlling third-party access risks and security/privacy regulatory compliance. Regarding existing solutions, roughly half (55%) ranked the effectiveness of vendor privileged access management (VPAM) and privileged access management (PAM; 49%) at ≤ 6 on a 10-point scale, respectively. Barriers to reducing access risks include lack of oversight/governance (53%) and insufficient resources (45%). Of those monitoring third-party access, 53% do so manually. Breach consequences include loss/theft of sensitive information (60%), regulatory fines (49%), severed relationships with third parties (47%), and loss of revenue (42%) and business partners (38%).HDOs recognize the increasing threat of third-party cyber breaches but are struggling to effectively address them. Lack of budget, expert resources, complexity, and third-party turnover are among the reasons why. Need exists for automated, cost-effective solutions to address the significant risks of third-party access with a consistent strategy that minimizes breach risk by securing remote access to privileged assets, accounts, and data.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1518-1530"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12575072/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145410628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-12-18DOI: 10.1055/a-2765-6969
Joseph E Capito, Brian Z Dilcher, Zulkifl I Jafary
Anticoagulation decisions in atrial fibrillation (AF) depend on balancing stroke and bleeding risk, often guided by CHA2DS2-VASc (a validated clinical score used to estimate stroke risk in patients with atrial fibrillation) and HAS-BLED (a validated clinical score used to estimate bleeding risk in patients treated with anticoagulation) scores. Manual calculation of these scores can be time-consuming and inconsistently performed.This study evaluated whether implementing real-time, electronic health record (EHR)-integrated alerts in a rural academic primary care clinic would influence physician and non-physician provider (NPP) behavior around anticoagulation management.A single-arm observational study was conducted from March 2024 to September 2025 at a West Virginia University (WVU) Family Medicine Clinic. A rules-based engine in Epic calculated risk scores using 1 year of structured data and displayed them within a non-interruptive "Our Practice Advisory" alert. Physician or NPP interaction-defined as initiation of anticoagulation, documentation of rationale, or adding exclusion diagnosis to problem list-was analyzed using chi-square testing.Among 313 patients triggering the alert, 53 (16.9%) were newly started on anticoagulation, 112 (35.8%) had a documented rationale for not initiating therapy, and 2 had the exclusion diagnosis added to their chart. In total, 50.5% of patients had a clinically meaningful interaction with the tool (χ2 = 9.82, p = 0.0017). Across 2,447 encounters, the overall alert success rate was 19.8%, reflecting encounter-level engagement. Common acknowledgment reasons included corrective measures completed, high bleeding risk, recent procedures, and patient refusal. Physician and NPP comments informed iterative refinement, leading to expanded acknowledgment options.Real-time alerts displaying stroke and bleeding risk scores were associated with meaningful physician and NPP engagement, particularly for initiating anticoagulation in high-risk patients. While most interactions reflected review rather than treatment change, the tool appeared to support point-of-care decision-making. These findings support further investigation of EHR-based advisories to improve anticoagulation management in AF.
房颤(AF)的抗凝决策取决于卒中和出血风险的平衡,通常以CHA2DS2-VASc(用于估计房颤患者卒中风险的有效临床评分)和HAS-BLED(用于估计抗凝治疗患者出血风险的有效临床评分)评分为指导。手动计算这些分数既耗时又不一致。本研究评估了在农村学术初级保健诊所实施实时、电子健康记录(EHR)集成警报是否会影响医生和非医生提供者(NPP)在抗凝管理方面的行为。一项单臂观察性研究于2024年3月至2025年9月在西弗吉尼亚大学(WVU)家庭医学诊所进行。Epic中的基于规则的引擎使用1年的结构化数据计算风险分数,并在不间断的“我们的实践咨询”警报中显示它们。医师或NPP的相互作用——定义为抗凝的开始、基本原理的记录或将排除诊断添加到问题列表中——使用卡方检验进行分析。在触发警报的313例患者中,53例(16.9%)是新开始抗凝治疗的,112例(35.8%)有未开始治疗的记录,2例在其图表中添加了排除诊断。总共有50.5%的患者与该工具有临床意义的相互作用(χ2 = 9.82, p = 0.0017)。在2447次遭遇中,总体警报成功率为19.8%,反映了遭遇级别的参与。常见的承认原因包括纠正措施完成、出血风险高、近期手术和患者拒绝。医生和NPP的意见为反复改进提供了信息,从而扩大了确认选项。显示中风和出血风险评分的实时警报与有意义的医生和NPP参与相关,特别是在高危患者开始抗凝治疗时。虽然大多数互动反映的是回顾而不是治疗变化,但该工具似乎支持即时护理决策。这些发现支持进一步研究基于ehr的建议,以改善房颤的抗凝管理。
{"title":"Effect of Clinical Decision Support Alerts on Anticoagulation Management in Atrial Fibrillation.","authors":"Joseph E Capito, Brian Z Dilcher, Zulkifl I Jafary","doi":"10.1055/a-2765-6969","DOIUrl":"10.1055/a-2765-6969","url":null,"abstract":"<p><p>Anticoagulation decisions in atrial fibrillation (AF) depend on balancing stroke and bleeding risk, often guided by CHA<sub>2</sub>DS<sub>2</sub>-VASc (a validated clinical score used to estimate stroke risk in patients with atrial fibrillation) and HAS-BLED (a validated clinical score used to estimate bleeding risk in patients treated with anticoagulation) scores. Manual calculation of these scores can be time-consuming and inconsistently performed.This study evaluated whether implementing real-time, electronic health record (EHR)-integrated alerts in a rural academic primary care clinic would influence physician and non-physician provider (NPP) behavior around anticoagulation management.A single-arm observational study was conducted from March 2024 to September 2025 at a West Virginia University (WVU) Family Medicine Clinic. A rules-based engine in Epic calculated risk scores using 1 year of structured data and displayed them within a non-interruptive \"Our Practice Advisory\" alert. Physician or NPP interaction-defined as initiation of anticoagulation, documentation of rationale, or adding exclusion diagnosis to problem list-was analyzed using chi-square testing.Among 313 patients triggering the alert, 53 (16.9%) were newly started on anticoagulation, 112 (35.8%) had a documented rationale for not initiating therapy, and 2 had the exclusion diagnosis added to their chart. In total, 50.5% of patients had a clinically meaningful interaction with the tool (χ<sup>2 </sup>= 9.82, <i>p</i> = 0.0017). Across 2,447 encounters, the overall alert success rate was 19.8%, reflecting encounter-level engagement. Common acknowledgment reasons included corrective measures completed, high bleeding risk, recent procedures, and patient refusal. Physician and NPP comments informed iterative refinement, leading to expanded acknowledgment options.Real-time alerts displaying stroke and bleeding risk scores were associated with meaningful physician and NPP engagement, particularly for initiating anticoagulation in high-risk patients. While most interactions reflected review rather than treatment change, the tool appeared to support point-of-care decision-making. These findings support further investigation of EHR-based advisories to improve anticoagulation management in AF.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1892-1899"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714456/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-12-18DOI: 10.1055/a-2765-6842
Lan Jiang, Yu-Li Huang, Jungwei Fan, Christy L Hunt, Jason S Eldrige, Lezli Kuster, Maribeth A Jensen, Sahil Gupta
Pain medicine triage plays a crucial role in ensuring patients receive timely and appropriate care by scheduling them to the most suitable treatment path. However, the absence of standardized triage protocols in pain medicine often leads to inefficiencies, including delay of care and wastage of healthcare resources.This study aims to develop a rule-based automated referral triage system leveraging information from patients' medical notes for scheduling patients to specific procedures in the pain medicine department.The proposed triage system, grounded in the knowledge and expertise of clinical providers, processed referral order comments and referring provider notes by iteratively refining the Natural Language Processing (NLP) rules and post-processing rules through intensively reviewing 76 patients. A post-processing regression model was incorporated to further enhance the accuracy. To ensure alignment with real-world practices, the system was integrated into an electronic health record (EHR) platform for real-time application, streamlining scheduling workflows and enhancing usability in daily clinical settings.After three iterations, the proposed NLP and post-processing rules improved accuracy from 76.3 to 80.3% compared to machine learning (ML) approaches in the preliminary study. The post-processing model further increased accuracy to 84.2%. The implementation accuracy of 200 cases for the first 3 months was consistent with our prediction at 83.5%, which concluded that the improvement over ML models (p-value = 0.018) was statistically significant at 95% significance level.This study demonstrates the feasibility and benefits of a knowledge-driven approach to referral triage in specialized medical fields. It lays a foundation for others in building similar triaging solutions to other specialties.
{"title":"A Rule-Based Automated Triage Model Using Natural Language Processing for Pain Medicine-Development and Implementation.","authors":"Lan Jiang, Yu-Li Huang, Jungwei Fan, Christy L Hunt, Jason S Eldrige, Lezli Kuster, Maribeth A Jensen, Sahil Gupta","doi":"10.1055/a-2765-6842","DOIUrl":"10.1055/a-2765-6842","url":null,"abstract":"<p><p>Pain medicine triage plays a crucial role in ensuring patients receive timely and appropriate care by scheduling them to the most suitable treatment path. However, the absence of standardized triage protocols in pain medicine often leads to inefficiencies, including delay of care and wastage of healthcare resources.This study aims to develop a rule-based automated referral triage system leveraging information from patients' medical notes for scheduling patients to specific procedures in the pain medicine department.The proposed triage system, grounded in the knowledge and expertise of clinical providers, processed referral order comments and referring provider notes by iteratively refining the Natural Language Processing (NLP) rules and post-processing rules through intensively reviewing 76 patients. A post-processing regression model was incorporated to further enhance the accuracy. To ensure alignment with real-world practices, the system was integrated into an electronic health record (EHR) platform for real-time application, streamlining scheduling workflows and enhancing usability in daily clinical settings.After three iterations, the proposed NLP and post-processing rules improved accuracy from 76.3 to 80.3% compared to machine learning (ML) approaches in the preliminary study. The post-processing model further increased accuracy to 84.2%. The implementation accuracy of 200 cases for the first 3 months was consistent with our prediction at 83.5%, which concluded that the improvement over ML models (<i>p</i>-value = 0.018) was statistically significant at 95% significance level.This study demonstrates the feasibility and benefits of a knowledge-driven approach to referral triage in specialized medical fields. It lays a foundation for others in building similar triaging solutions to other specialties.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1850-1861"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714436/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-05-26DOI: 10.1055/a-2620-3147
Francois Bastardot, Vanessa Kraege, Julien Castioni, Alain Petter, David W Bates, Antoine Garnier
Electronic health records (EHRs) are widely implemented and consume nearly half of physicians' work time. Despite the importance of efficient data entry, physicians' typing skills-potential contributors to documentation burden-remain poorly studied.This study aims to evaluate the typing skills of physicians and their associations with demographic characteristics and professional roles.This cross-sectional pilot study included a convenience sample of physicians (residents, chief residents, and attending physicians) from the internal medicine division of an academic hospital. Participants completed a 1-minute typing test under supervised conditions. The primary outcome was raw typing speed, measured in words per minute (WPM). The secondary outcome was a performance score calculated by subtracting 50 points for each error from the total number of characters typed per minute.Participation rate was 100% (82/82 physicians). The mean age was 33.7 ± 7.3 years; 7.2 ± 7.1 years since graduation; and 45.1% female. The mean typing speed was 53.4 WPM (range: 31-91 WPM), with 57.3% (47/82) of participants exceeding 50 WPM, a threshold commonly considered professional. Bivariate analysis showed a significant negative association with age (Spearman's ρ = -0.281, p = 0.011), which was not sustained in the multivariable analysis. No significant association was observed with sex, country of diploma, or role. Upon multivariable analysis, performance score showed a significant negative association with age (β = -17.724, p = 0.009) but a positive association with years since graduation (β = 16.850, p = 0.021), suggesting a generation- and experience-related interaction.Nearly half of physicians exhibited professional-level typing skills, yet overall performance varied widely and was influenced by both generational factors and clinical experience. Given that documentation burden affects clinicians across all skill levels, both individual and systemic strategies-such as improved EHR design and alternative input methods-should be explored.
背景:电子病历(Electronic health records, EHR)被广泛应用,占用了医生近一半的工作时间。尽管有效的数据输入很重要,但医生的打字技能——可能造成文档负担的因素——仍然缺乏研究。目的:评价医师的打字技能及其与人口学特征和职业角色的关系。方法:本横断面试点研究纳入了一所学术医院内科医师(住院医师、住院总医师和主治医师)的方便样本。参与者在监督的条件下完成了一分钟的打字测试。主要结果是原始打字速度,以每分钟字数(WPM)衡量。次要结果是通过从每分钟输入的字符总数中减去每个错误的50分计算出的性能分数。结果:参照率为100%(82/82)。平均年龄33.7±7.3岁;毕业后7.2±7.1年;45.1%的女性。平均打字速度为53.4 WPM(范围:31-91 WPM),其中57.3%(47/82)的参与者超过50 WPM,这是一个通常被认为是专业的阈值。双变量分析显示与年龄呈显著负相关(Spearman's ρ = -0.281, p = 0.011),多变量分析未证实这一点。未观察到与性别、学历国家或角色有显著关联。多变量分析结果显示,大学生绩效得分与年龄呈显著负相关(β = -17.724, p = 0.009),与毕业年限呈正相关(β = 16.850, p = 0.021),表明大学生绩效得分与年龄和经历存在交互作用。结论:近一半的医生表现出专业水平的分型技能,但总体表现差异很大,受代际因素和临床经验的影响。鉴于文件负担影响到所有技能水平的临床医生,应该探索个人和系统策略,例如改进电子病历设计和替代输入方法。
{"title":"Typing Proficiency among Physicians in Internal Medicine: A Pilot Study of Speed and Performance.","authors":"Francois Bastardot, Vanessa Kraege, Julien Castioni, Alain Petter, David W Bates, Antoine Garnier","doi":"10.1055/a-2620-3147","DOIUrl":"10.1055/a-2620-3147","url":null,"abstract":"<p><p>Electronic health records (EHRs) are widely implemented and consume nearly half of physicians' work time. Despite the importance of efficient data entry, physicians' typing skills-potential contributors to documentation burden-remain poorly studied.This study aims to evaluate the typing skills of physicians and their associations with demographic characteristics and professional roles.This cross-sectional pilot study included a convenience sample of physicians (residents, chief residents, and attending physicians) from the internal medicine division of an academic hospital. Participants completed a 1-minute typing test under supervised conditions. The primary outcome was raw typing speed, measured in words per minute (WPM). The secondary outcome was a performance score calculated by subtracting 50 points for each error from the total number of characters typed per minute.Participation rate was 100% (82/82 physicians). The mean age was 33.7 ± 7.3 years; 7.2 ± 7.1 years since graduation; and 45.1% female. The mean typing speed was 53.4 WPM (range: 31-91 WPM), with 57.3% (47/82) of participants exceeding 50 WPM, a threshold commonly considered professional. Bivariate analysis showed a significant negative association with age (Spearman's ρ = -0.281, <i>p</i> = 0.011), which was not sustained in the multivariable analysis. No significant association was observed with sex, country of diploma, or role. Upon multivariable analysis, performance score showed a significant negative association with age (β = -17.724, <i>p</i> = 0.009) but a positive association with years since graduation (β = 16.850, <i>p</i> = 0.021), suggesting a generation- and experience-related interaction.Nearly half of physicians exhibited professional-level typing skills, yet overall performance varied widely and was influenced by both generational factors and clinical experience. Given that documentation burden affects clinicians across all skill levels, both individual and systemic strategies-such as improved EHR design and alternative input methods-should be explored.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1393-1400"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534124/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144152528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-02DOI: 10.1055/a-2625-0750
Naveed Rabbani, Mondira Ray, Eleanor Verhagen, Jonathan Hatoun, Laura Burckett Patane, Louis Vernacchio
Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.
{"title":"Ambient Artificial Intelligence Scribes in Pediatric Primary Care: A Mixed Methods Study.","authors":"Naveed Rabbani, Mondira Ray, Eleanor Verhagen, Jonathan Hatoun, Laura Burckett Patane, Louis Vernacchio","doi":"10.1055/a-2625-0750","DOIUrl":"10.1055/a-2625-0750","url":null,"abstract":"<p><p>Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1578-1587"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12578578/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-23DOI: 10.1055/a-2725-6117
Dominique V C de Jel, J Willemijn van Koevorden, Melanie Singer, Vincent van der Noort, Ludi E Smeele, Richard Dirven
The digital availability of health data not only improves processes in primary care, but it also facilitates the evaluation of healthcare delivery. Nevertheless, the preprocessing of data for secondary use is still time-consuming and expensive, particularly in head and neck cancer (HNC), where patients undergo complex multidisciplinary treatment trajectories. Therefore, we have looked further into the effects on data quantity and quality following the implementation of structured care pathways. Leveraging data extracted from these care pathways, we assessed the potential of real-time quality-of-care evaluation through dashboards, incorporating indicators such as a proposed "textbook process" model.Our mixed methods study assessed the value of a newly implemented structured HNC pathway and its effect on data quantity and quality through three processes: (1) A qualitative assessment of current barriers, data registration processes, and data-interpretation discrepancies with in-house data managers. (2) A prospective pilot (n = 41) in which patient data is registered both manually and semi-automatically. (3) An evaluation of the patient journey through dashboards with real-time indicators 1 year after go-live.During the iterative implementation phase of the structured care pathway, data completeness and correctness averaged 84.8 and 88.4%, respectively. The new method reduced registration time by 3.7 minutes per patient. A majority of 87.8% followed all four defined time points of the structured care pathway. One year after implementation and in-house validation, time-to-treatment intervals could be tracked, and processes could be adapted accordingly.A structured care pathway, followed by early implementation guided by a multidisciplinary team, forms the foundation for sustainable data capturing for multiple purposes, including quality registries. In-house dashboards further enhance data quality and process improvement.
{"title":"Implementing a Structured Head and Neck Cancer Care Pathway in an Electronic Health Record: Iterative Process and Effects on Data Quality.","authors":"Dominique V C de Jel, J Willemijn van Koevorden, Melanie Singer, Vincent van der Noort, Ludi E Smeele, Richard Dirven","doi":"10.1055/a-2725-6117","DOIUrl":"10.1055/a-2725-6117","url":null,"abstract":"<p><p>The digital availability of health data not only improves processes in primary care, but it also facilitates the evaluation of healthcare delivery. Nevertheless, the preprocessing of data for secondary use is still time-consuming and expensive, particularly in head and neck cancer (HNC), where patients undergo complex multidisciplinary treatment trajectories. Therefore, we have looked further into the effects on data quantity and quality following the implementation of structured care pathways. Leveraging data extracted from these care pathways, we assessed the potential of real-time quality-of-care evaluation through dashboards, incorporating indicators such as a proposed \"textbook process\" model.Our mixed methods study assessed the value of a newly implemented structured HNC pathway and its effect on data quantity and quality through three processes: (1) A qualitative assessment of current barriers, data registration processes, and data-interpretation discrepancies with in-house data managers. (2) A prospective pilot (<i>n</i> = 41) in which patient data is registered both manually and semi-automatically. (3) An evaluation of the patient journey through dashboards with real-time indicators 1 year after go-live.During the iterative implementation phase of the structured care pathway, data completeness and correctness averaged 84.8 and 88.4%, respectively. The new method reduced registration time by 3.7 minutes per patient. A majority of 87.8% followed all four defined time points of the structured care pathway. One year after implementation and in-house validation, time-to-treatment intervals could be tracked, and processes could be adapted accordingly.A structured care pathway, followed by early implementation guided by a multidisciplinary team, forms the foundation for sustainable data capturing for multiple purposes, including quality registries. In-house dashboards further enhance data quality and process improvement.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1606-1614"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594565/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145356555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}