Pub Date : 2025-08-01Epub Date: 2025-05-21DOI: 10.1055/a-2616-9858
Farhana Pethani, Alec Chapman, Mike Conway, Xiang Dai, Demiana Bishay, Victor Choh, Alexander He, Su-Elle Lim, Huey Ying Ng, Tanya Mahony, Albert Yaacoub, Sarvnaz Karimi, Heiko Spallek, Adam G Dunn
In dentistry, social determinants of health (SDoH) are potentially recorded in the clinical notes of electronic dental records. The objective of this study was to examine the availability of SDoH data in dental clinical notes and evaluate natural language processing methods to extract SDoH from dental clinical notes.A set of 1,000 dental clinical notes was sampled from a dataset of 105,311 patient visits to a dental clinic and manually annotated for information pertaining to sugar, tobacco, alcohol, methamphetamine, housing, and employment. Annotations included temporality, dose, type, duration, and frequency where appropriate. Experiments were to compare extraction using fine-tuned pretrained language models (PLMs) with a rule-based approach. Performance was measured by F1-score.For identifying SDoH, the best-performing PLM method produced F1-scores of 0.75 (sugar), 0.69 (tobacco), 0.67 (alcohol), 0.42 (housing), and 0 (employment). The rule-based method produced F1-scores of 0.70 (sugar), 0.69 (tobacco), 0.53 (alcohol), 0.44 (housing), and 0 (employment). The overall difference between PLMs and rule-based methods was F1-score of 0.04 (95% confidence interval -0.01, 0.09). SDoH were relatively rare in dental clinical notes, from sugar (9.1%), tobacco (3.9%), alcohol (1.2%), housing (1.2%), employment (0.2%), and methamphetamine use (0%).The main challenge of extracting SDoH information from dental clinical notes was the frequency with which they are recorded, and the brevity and inconsistency where they are recorded. Improved surveillance likely needs new ways to standardize how SDoHs are reported in dental clinical notes.
{"title":"Extracting Social Determinants of Health from Dental Clinical Notes.","authors":"Farhana Pethani, Alec Chapman, Mike Conway, Xiang Dai, Demiana Bishay, Victor Choh, Alexander He, Su-Elle Lim, Huey Ying Ng, Tanya Mahony, Albert Yaacoub, Sarvnaz Karimi, Heiko Spallek, Adam G Dunn","doi":"10.1055/a-2616-9858","DOIUrl":"10.1055/a-2616-9858","url":null,"abstract":"<p><p>In dentistry, social determinants of health (SDoH) are potentially recorded in the clinical notes of electronic dental records. The objective of this study was to examine the availability of SDoH data in dental clinical notes and evaluate natural language processing methods to extract SDoH from dental clinical notes.A set of 1,000 dental clinical notes was sampled from a dataset of 105,311 patient visits to a dental clinic and manually annotated for information pertaining to sugar, tobacco, alcohol, methamphetamine, housing, and employment. Annotations included temporality, dose, type, duration, and frequency where appropriate. Experiments were to compare extraction using fine-tuned pretrained language models (PLMs) with a rule-based approach. Performance was measured by F1-score.For identifying SDoH, the best-performing PLM method produced F1-scores of 0.75 (sugar), 0.69 (tobacco), 0.67 (alcohol), 0.42 (housing), and 0 (employment). The rule-based method produced F1-scores of 0.70 (sugar), 0.69 (tobacco), 0.53 (alcohol), 0.44 (housing), and 0 (employment). The overall difference between PLMs and rule-based methods was F1-score of 0.04 (95% confidence interval -0.01, 0.09). SDoH were relatively rare in dental clinical notes, from sugar (9.1%), tobacco (3.9%), alcohol (1.2%), housing (1.2%), employment (0.2%), and methamphetamine use (0%).The main challenge of extracting SDoH information from dental clinical notes was the frequency with which they are recorded, and the brevity and inconsistency where they are recorded. Improved surveillance likely needs new ways to standardize how SDoHs are reported in dental clinical notes.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1281-1291"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12494450/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144121216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-04-21DOI: 10.1055/a-2591-3930
Thamer A Almohaya, James Batchelor, Edilson Arruda
The purpose of this systematic literature review is to critically evaluate the use of mathematical and simulation models within emergency departments (EDs) and assess their potential to improve the quality of care. This review emphasizes the critical need for quality enhancement in health care systems, with a specific focus on EDs.This review incorporates studies that have investigated the quality of care provided in ED settings, employing assorted mathematical and simulation models for adult populations. Based on the selected studies, a narrative approach was used to synthesize the findings, focusing on outcome classification, simulation, and modelling. There are six outcome dimensions: safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity.This review analyzed 112 studies, uncovering a distinct focus on a set of key performance measures within ED operations, accounting for 222 instances across these studies. Measures assessing timeliness were most frequent, occurring 111 times, indicative of a strong emphasis on operational efficiency aspects such as waiting times and patient flow. A total of 75 examinations were conducted on efficiency-related measures, with a specific focus on identifying and addressing operational bottlenecks and optimizing resource utilization. On the other hand, safety, patient-centeredness, and effectiveness were not as commonly represented, with only 3, 4, and 29 instances, respectively.This review highlights the considerable potential of mathematical and simulation models to enhance ED operations, particularly regarding timeliness and efficiency. However, aspects such as patient safety, effectiveness, and patient-centeredness were underrepresented, while equity was absent across the studies, indicating a clear need for further research. These findings emphasize the importance of adopting a more thorough approach to evaluating and improving the quality of emergency care. Future research should also concentrate on refining data management practices, incorporating observational studies, and exploring various simulation tools to develop a more balanced and inclusive understanding of these models' applications.
{"title":"Effectiveness of Mathematical and Simulation Models for Improving Quality of Care in Emergency Departments: A Systematic Literature Review.","authors":"Thamer A Almohaya, James Batchelor, Edilson Arruda","doi":"10.1055/a-2591-3930","DOIUrl":"10.1055/a-2591-3930","url":null,"abstract":"<p><p>The purpose of this systematic literature review is to critically evaluate the use of mathematical and simulation models within emergency departments (EDs) and assess their potential to improve the quality of care. This review emphasizes the critical need for quality enhancement in health care systems, with a specific focus on EDs.This review incorporates studies that have investigated the quality of care provided in ED settings, employing assorted mathematical and simulation models for adult populations. Based on the selected studies, a narrative approach was used to synthesize the findings, focusing on outcome classification, simulation, and modelling. There are six outcome dimensions: safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity.This review analyzed 112 studies, uncovering a distinct focus on a set of key performance measures within ED operations, accounting for 222 instances across these studies. Measures assessing timeliness were most frequent, occurring 111 times, indicative of a strong emphasis on operational efficiency aspects such as waiting times and patient flow. A total of 75 examinations were conducted on efficiency-related measures, with a specific focus on identifying and addressing operational bottlenecks and optimizing resource utilization. On the other hand, safety, patient-centeredness, and effectiveness were not as commonly represented, with only 3, 4, and 29 instances, respectively.This review highlights the considerable potential of mathematical and simulation models to enhance ED operations, particularly regarding timeliness and efficiency. However, aspects such as patient safety, effectiveness, and patient-centeredness were underrepresented, while equity was absent across the studies, indicating a clear need for further research. These findings emphasize the importance of adopting a more thorough approach to evaluating and improving the quality of emergency care. Future research should also concentrate on refining data management practices, incorporating observational studies, and exploring various simulation tools to develop a more balanced and inclusive understanding of these models' applications.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"825-837"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12373464/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144026549","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-08-12DOI: 10.1055/a-2681-5008
Nicholas Genes, Gregory Simon, Christian Koziatek, Jung G Kim, Kar-Mun Woo, Cassidy Dahn, Leland Chan, Batia Wiesenfeld
Emergency department (ED) handoff to inpatient teams is a potential source of error. Generative artificial intelligence (AI) has shown promise in succinctly summarizing large quantities of clinical data and may help improve ED handoff.Our objectives were to: (1) evaluate the accuracy, clinical utility, and safety of AI-generated ED-to-inpatient handoff summaries; (2) identify patient and visit characteristics influencing summary effectiveness; and (3) characterize potential error patterns to inform implementation strategies.This exploratory study evaluated AI-generated handoff summaries at an urban academic ED (February-April 2024). A Health Insurance Portability and Accountability Act-compliant GPT-4 model generated summaries aligned with the IPASS framework; ED providers assessed summary accuracy, usefulness, and safety through on-shift surveys.Among 50 cases, median quality and usefulness scores were 4/5 (standard error = 0.13). Safety concerns arose in 6% of cases, with issues including data omissions and mischaracterizations. Consultation status significantly affected usefulness scores (p < 0.05). Omissions of relevant medications, laboratory results, and other essential details were noted (n = 6), and emergency medicine clinicians disagreed with some AI characterizations of patient stability, vitals, and workup (n = 8). The most common response was positive impressions of the technology incorporated into the handoff process (n = 11).This exploratory provider-in-the-loop model demonstrated clinical acceptability and highlighted areas for refinement. Future studies should incorporate recipient perspectives and examine clinical outcomes to scale and optimize AI implementation.
{"title":"Generative Artificial Intelligence Summaries to Facilitate Emergency Department Handoff.","authors":"Nicholas Genes, Gregory Simon, Christian Koziatek, Jung G Kim, Kar-Mun Woo, Cassidy Dahn, Leland Chan, Batia Wiesenfeld","doi":"10.1055/a-2681-5008","DOIUrl":"10.1055/a-2681-5008","url":null,"abstract":"<p><p>Emergency department (ED) handoff to inpatient teams is a potential source of error. Generative artificial intelligence (AI) has shown promise in succinctly summarizing large quantities of clinical data and may help improve ED handoff.Our objectives were to: (1) evaluate the accuracy, clinical utility, and safety of AI-generated ED-to-inpatient handoff summaries; (2) identify patient and visit characteristics influencing summary effectiveness; and (3) characterize potential error patterns to inform implementation strategies.This exploratory study evaluated AI-generated handoff summaries at an urban academic ED (February-April 2024). A Health Insurance Portability and Accountability Act-compliant GPT-4 model generated summaries aligned with the IPASS framework; ED providers assessed summary accuracy, usefulness, and safety through on-shift surveys.Among 50 cases, median quality and usefulness scores were 4/5 (standard error = 0.13). Safety concerns arose in 6% of cases, with issues including data omissions and mischaracterizations. Consultation status significantly affected usefulness scores (<i>p</i> < 0.05). Omissions of relevant medications, laboratory results, and other essential details were noted (<i>n</i> = 6), and emergency medicine clinicians disagreed with some AI characterizations of patient stability, vitals, and workup (<i>n</i> = 8). The most common response was positive impressions of the technology incorporated into the handoff process (<i>n</i> = 11).This exploratory provider-in-the-loop model demonstrated clinical acceptability and highlighted areas for refinement. Future studies should incorporate recipient perspectives and examine clinical outcomes to scale and optimize AI implementation.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1185-1191"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473522/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144838317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-05-22DOI: 10.1055/a-2618-4580
Julianne Scholes, Lauren Schiff, Alicia Jacobs, Michelle Cangiano, Marie Sandoval
Electronic health record (EHR) patient portal messaging has become an essential tool for patient-clinician communication by improving accessibility to primary care. While messaging is beneficial for patients, it can increase clinicians' workloads. Female clinicians receive a greater number of EHR messaging, resulting in an increased workload.This evaluation explores the factors in clinician gender disparity in EHR messaging burden.The first phase of the evaluation included a retrospective analysis of the messages to 267 primary care clinicians in the University of Vermont Health Network (UVMHN). The second phase analyzed patient demographics and panel complexity. Statistical analysis was performed across all categories of patient care-generated messages to primary care clinicians and subsequently on all messages across the UVMHN.Female clinicians received significantly more patient-initiated medical advice request messages than their male counterparts (68.28 vs. 49.22 messages/month, p = 0.005) and spent more time managing messages (1.85 vs. 1.35 minute/day, p = 0.006). Despite this increased workload, response times remained similar between genders. Female clinicians have a higher proportion of female patients, and analysis of all messages sent across the organization demonstrated that female patient care produces more messages than male patient care (59 vs. 52 messages/female vs. male, p = 0.001). Panels size and complexity were similar for both male and female providers.These findings highlight an unequal messaging burden for female clinicians in primary care specialties of internal and family medicine, largely due to patient demographics. Patient panel complexity as defined by UVMHN and clinician full-time equivalent were similar between genders. Disparities in message volumes appear to be driven primarily by patient communication behavior differences between genders rather than differences in workload allocation. These findings likely contribute to increased burnout risk among female clinicians. Addressing this imbalance through workflow optimization and artificial intelligence-driven message triage systems may help to mitigate the burden on female clinicians and promote greater equity in primary care.
{"title":"The Digital Workload Divide: Investigating Gender Differences in Electronic Health Record Messaging among Primary Care Clinicians.","authors":"Julianne Scholes, Lauren Schiff, Alicia Jacobs, Michelle Cangiano, Marie Sandoval","doi":"10.1055/a-2618-4580","DOIUrl":"10.1055/a-2618-4580","url":null,"abstract":"<p><p>Electronic health record (EHR) patient portal messaging has become an essential tool for patient-clinician communication by improving accessibility to primary care. While messaging is beneficial for patients, it can increase clinicians' workloads. Female clinicians receive a greater number of EHR messaging, resulting in an increased workload.This evaluation explores the factors in clinician gender disparity in EHR messaging burden.The first phase of the evaluation included a retrospective analysis of the messages to 267 primary care clinicians in the University of Vermont Health Network (UVMHN). The second phase analyzed patient demographics and panel complexity. Statistical analysis was performed across all categories of patient care-generated messages to primary care clinicians and subsequently on all messages across the UVMHN.Female clinicians received significantly more patient-initiated medical advice request messages than their male counterparts (68.28 vs. 49.22 messages/month, <i>p</i> = 0.005) and spent more time managing messages (1.85 vs. 1.35 minute/day, <i>p</i> = 0.006). Despite this increased workload, response times remained similar between genders. Female clinicians have a higher proportion of female patients, and analysis of all messages sent across the organization demonstrated that female patient care produces more messages than male patient care (59 vs. 52 messages/female vs. male, <i>p</i> = 0.001). Panels size and complexity were similar for both male and female providers.These findings highlight an unequal messaging burden for female clinicians in primary care specialties of internal and family medicine, largely due to patient demographics. Patient panel complexity as defined by UVMHN and clinician full-time equivalent were similar between genders. Disparities in message volumes appear to be driven primarily by patient communication behavior differences between genders rather than differences in workload allocation. These findings likely contribute to increased burnout risk among female clinicians. Addressing this imbalance through workflow optimization and artificial intelligence-driven message triage systems may help to mitigate the burden on female clinicians and promote greater equity in primary care.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1341-1349"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12513775/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144128079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-10-03DOI: 10.1055/a-2616-9992
Erica Patterson, Adam Paul Yan, Shawna Silver, Bren Cardiff
Ensuring clinician safety in health care settings is critical, particularly regarding exposure to hazardous drugs and bodily fluids, which can be carcinogenic, teratogenic, genotoxic, or cause organ toxicity at low doses. At SickKids a safety issue arose when a clinician was unknowingly exposed to hazardous bodily fluids due to inadequate communication of a patient's hazardous medication status.This clinical decision support (CDS) redesign aimed to reduce alert fatigue while ensuring timely team awareness to minimize hazardous bodily fluid exposure risk. This case study aims to explore how redesigning a CDS system addressed the dual challenge of maintaining safety communication while minimizing alert fatigue and improving workflow integration.In 2018, a biohazardous bodily fluids alert was introduced within the hospital's electronic patient record (EPR) to raise awareness. However, its frequent and disruptive nature resulted in a 0% alert action rate and 89 unactionable clinician hours over a 90-day period. Feedback collected over 42 months revealed clinician frustration and desensitization due to the alert's timing and frequency. Using a human-centered design approach, the alert was redesigned from an interruptive pop-up to a passive notification embedded within the patient's storyboard.The redesigned alert allowed clinicians to review hazardous status information without immediate interruptions, reducing workflow disruption while maintaining its critical safety function. This approach effectively balanced safety communication with clinicians' need for efficient workflows, addressing the root cause of alert fatigue.This case study highlights the importance of ongoing CDS evaluation and redesign to enhance clinician safety, minimize alert fatigue, and improve workflow integration. Future evaluations will assess the redesign's effect on personal protective equipment compliance and clinician burnout.
{"title":"Rethinking the Biohazardous Bodily Fluids Alert for Improved Workflow and Safety.","authors":"Erica Patterson, Adam Paul Yan, Shawna Silver, Bren Cardiff","doi":"10.1055/a-2616-9992","DOIUrl":"10.1055/a-2616-9992","url":null,"abstract":"<p><p>Ensuring clinician safety in health care settings is critical, particularly regarding exposure to hazardous drugs and bodily fluids, which can be carcinogenic, teratogenic, genotoxic, or cause organ toxicity at low doses. At SickKids a safety issue arose when a clinician was unknowingly exposed to hazardous bodily fluids due to inadequate communication of a patient's hazardous medication status.This clinical decision support (CDS) redesign aimed to reduce alert fatigue while ensuring timely team awareness to minimize hazardous bodily fluid exposure risk. This case study aims to explore how redesigning a CDS system addressed the dual challenge of maintaining safety communication while minimizing alert fatigue and improving workflow integration.In 2018, a biohazardous bodily fluids alert was introduced within the hospital's electronic patient record (EPR) to raise awareness. However, its frequent and disruptive nature resulted in a 0% alert action rate and 89 unactionable clinician hours over a 90-day period. Feedback collected over 42 months revealed clinician frustration and desensitization due to the alert's timing and frequency. Using a human-centered design approach, the alert was redesigned from an interruptive pop-up to a passive notification embedded within the patient's storyboard.The redesigned alert allowed clinicians to review hazardous status information without immediate interruptions, reducing workflow disruption while maintaining its critical safety function. This approach effectively balanced safety communication with clinicians' need for efficient workflows, addressing the root cause of alert fatigue.This case study highlights the importance of ongoing CDS evaluation and redesign to enhance clinician safety, minimize alert fatigue, and improve workflow integration. Future evaluations will assess the redesign's effect on personal protective equipment compliance and clinician burnout.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1282-1287"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12494444/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145226068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-09-26DOI: 10.1055/a-2606-9326
Shannon M Canfield, Abigail J Rolbiecki, Parijat Ghosh, William Martinez, Victoria A Shaffer, Emma E Montgomery, David A Dorr, Richelle J Koopman
Hypertension is a significant contributor to cardiovascular disease, yet evidence-based blood pressure (BP) control practices are inconsistently applied. The Collaboration Oriented Approach to Controlling High Blood Pressure (COACH) is a digital clinical decision support tool designed to improve BP self-management and support clinician workflows. While the patient perspective on COACH has been evaluated in a separate study, this study evaluates organizational readiness for COACH implementation across three health systems using the Consolidated Framework for Implementation Research (CFIR).This study aimed to assess preimplementation facilitators and barriers for COACH, focusing on organizational readiness and modifiable factors influencing scalability.Qualitative interviews were conducted with 72 care team members from nine primary care clinics across three health systems using Epic or Oracle electronic health records. Data were analyzed using CFIR domains: innovation, inner setting, outer setting, individuals, and implementation process. Subdomains were rated from -2 (barrier) to +2 (facilitator).Overall, 79% of CFIR domain scores were positive, suggesting strong readiness for COACH implementation. The innovation domain scored 80% positive, highlighting COACH's user-friendly design, robust evidence base, and perceived advantages over current workflows. The inner setting domain showed 85% positive scores, driven by strong leadership, established infrastructures for patient-centered care, and high motivation for quality improvement. The outer setting domain scored 70% positive, reflecting barriers such as reimbursement policies, resource limitations, and staffing shortages. Participants noted the importance of continued leadership engagement, team-based support, and addressing workload challenges for sustainable implementation.The study demonstrates high organizational readiness for COACH, with critical barriers in reimbursement and resources that must be addressed for successful adoption. Findings underscore COACH's potential to enhance clinical decision-making and patient engagement. Future research should explore long-term impacts on care delivery and outcomes, informing broader adoption of digital health interventions in clinical practice.
{"title":"\"Everyone Has a Role in This\": Evaluating Organizational Readiness for a Digital Solution to Support Hypertension Care Teams and Patients.","authors":"Shannon M Canfield, Abigail J Rolbiecki, Parijat Ghosh, William Martinez, Victoria A Shaffer, Emma E Montgomery, David A Dorr, Richelle J Koopman","doi":"10.1055/a-2606-9326","DOIUrl":"10.1055/a-2606-9326","url":null,"abstract":"<p><p>Hypertension is a significant contributor to cardiovascular disease, yet evidence-based blood pressure (BP) control practices are inconsistently applied. The Collaboration Oriented Approach to Controlling High Blood Pressure (COACH) is a digital clinical decision support tool designed to improve BP self-management and support clinician workflows. While the patient perspective on COACH has been evaluated in a separate study, this study evaluates organizational readiness for COACH implementation across three health systems using the Consolidated Framework for Implementation Research (CFIR).This study aimed to assess preimplementation facilitators and barriers for COACH, focusing on organizational readiness and modifiable factors influencing scalability.Qualitative interviews were conducted with 72 care team members from nine primary care clinics across three health systems using Epic or Oracle electronic health records. Data were analyzed using CFIR domains: innovation, inner setting, outer setting, individuals, and implementation process. Subdomains were rated from -2 (barrier) to +2 (facilitator).Overall, 79% of CFIR domain scores were positive, suggesting strong readiness for COACH implementation. The innovation domain scored 80% positive, highlighting COACH's user-friendly design, robust evidence base, and perceived advantages over current workflows. The inner setting domain showed 85% positive scores, driven by strong leadership, established infrastructures for patient-centered care, and high motivation for quality improvement. The outer setting domain scored 70% positive, reflecting barriers such as reimbursement policies, resource limitations, and staffing shortages. Participants noted the importance of continued leadership engagement, team-based support, and addressing workload challenges for sustainable implementation.The study demonstrates high organizational readiness for COACH, with critical barriers in reimbursement and resources that must be addressed for successful adoption. Findings underscore COACH's potential to enhance clinical decision-making and patient engagement. Future research should explore long-term impacts on care delivery and outcomes, informing broader adoption of digital health interventions in clinical practice.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1219-1230"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473525/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145179823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-09-19DOI: 10.1055/a-2599-4135
Noah D Bastola, James E Tcheng, David M Schlossman, John R Windle
The Health Level 7 (HL7) Electronic Health Record Workgroup identified home medication list reconciliation as a prime opportunity to improve patient safety and reduce clinician burden. We developed a platform-neutral, Fast Healthcare Interoperability Resources (FHIR)-enabled reference model and demonstration wireframe to articulate the concepts of an interoperable, patient-centric home medication list management ecosystem.Four principal artifacts describe the reference model: (1) a conceptual (high-level) model, (2) a data architecture (detailed) model including representations of the interactions among actors, workflows, data, and functionality, (3) a functionality (style) guide describing expected system behaviors, and (4) a high-fidelity, end-to-end wireframe. The wireframe was constructed using JavaScript, Bootstrap Studio, and FHIR to maximize code modularity, device compatibility, and interoperability.The conceptual and architecture models capture the complex interplay of actors and data occurring among healthcare providers, information systems, and patients, positioning the patient at the center of home medication list management. The style guide reflects functionality requirements. The wireframe demonstrates the use of FHIR for data interoperability while representing patient and clinician interactions that reduce burden. The wireframe accesses standardized data elements via FHIR calls to an EHR sandbox and integrates RxNorm content to improve usability and associated medication metadata. Finally, the wireframe generates a FHIR patient-reconciled medication list data package and printable lists that can be shared with the clinician to facilitate outpatient medication reconciliation.This proof-of-concept highlights the potential of FHIR to facilitate patient-facing medication list management and provides a reference framework for developers.
{"title":"Framework for Improving Patient Safety: Reference Model for FHIR-Enabled, Patient-Centric Home Medication List Management and Medication Reconciliation.","authors":"Noah D Bastola, James E Tcheng, David M Schlossman, John R Windle","doi":"10.1055/a-2599-4135","DOIUrl":"10.1055/a-2599-4135","url":null,"abstract":"<p><p>The Health Level 7 (HL7) Electronic Health Record Workgroup identified home medication list reconciliation as a prime opportunity to improve patient safety and reduce clinician burden. We developed a platform-neutral, Fast Healthcare Interoperability Resources (FHIR)-enabled reference model and demonstration wireframe to articulate the concepts of an interoperable, patient-centric home medication list management ecosystem.Four principal artifacts describe the reference model: (1) a conceptual (high-level) model, (2) a data architecture (detailed) model including representations of the interactions among actors, workflows, data, and functionality, (3) a functionality (style) guide describing expected system behaviors, and (4) a high-fidelity, end-to-end wireframe. The wireframe was constructed using JavaScript, Bootstrap Studio, and FHIR to maximize code modularity, device compatibility, and interoperability.The conceptual and architecture models capture the complex interplay of actors and data occurring among healthcare providers, information systems, and patients, positioning the patient at the center of home medication list management. The style guide reflects functionality requirements. The wireframe demonstrates the use of FHIR for data interoperability while representing patient and clinician interactions that reduce burden. The wireframe accesses standardized data elements via FHIR calls to an EHR sandbox and integrates RxNorm content to improve usability and associated medication metadata. Finally, the wireframe generates a FHIR patient-reconciled medication list data package and printable lists that can be shared with the clinician to facilitate outpatient medication reconciliation.This proof-of-concept highlights the potential of FHIR to facilitate patient-facing medication list management and provides a reference framework for developers.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1136-1145"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12449101/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145092626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-08-14DOI: 10.1055/a-2581-5739
Lydia J Yang, Molly Kuhn, James M Blum, Andrew E Pouw
Electronic health records (EHRs) have revolutionized clinical practice, but clinicians and institutions have not yet fully optimized their use. Inconsistent documentation of ophthalmic test results can increase potential medicolegal risks if providers bill for tests without properly documenting clinical interpretations.To address this, we developed and implemented a logic tool in Epic (Epic Systems, Verona, Wisconsin, United States) that prompts clinicians to document diagnostic test interpretations as discrete data before closing the patient chart.We implemented a "Close Encounter Warning" using logic rules to redirect clinicians to the Imaging and Procedures section of the Epic chart for documenting test interpretations. The implementation only allows clinicians to finalize each outpatient encounter's charting as closed if the logic rules confirm that no unsigned test results remain. The logic rules were revised many times to accommodate the unique workflow of the Ophthalmology department and to consider the roles of fellows, residents, and staff who also work with encounter charting. We implemented the initial logic rule on October 23, 21 and the final iteration on February8, 22. To evaluate the impact, we compared the number of closed charts containing unresulted diagnostic tests from October 2017 to December 2024.Before we implemented the logic rules, clinicians closed an average of 897.1 charts per month with unresulted diagnostic images (median: 916, interquartile range [IQR]: 170, 5.78% of all outpatient encounters). After implementation, this number dropped to 8.3 per month (median: 8, IQR: 5.75, 0.05% of all outpatient encounters), a 108% reduction (p < 0.001).The Close Encounter Warning logic rules significantly reduced the number of Imaging and Procedure-type diagnostic tests lacking final attending signatures in the Ophthalmology department. By implementing this EHR change, we successfully minimized potential medicolegal liability for our clinicians and institution.
电子健康记录(EHRs)已经彻底改变了临床实践,但临床医生和机构尚未充分优化其使用。眼科检查结果文件不一致,如果提供者在没有适当记录临床解释的情况下为检查开出账单,可能会增加潜在的医学风险。为了解决这个问题,我们在Epic (Epic Systems, Verona, Wisconsin, United States)中开发并实现了一个逻辑工具,该工具提示临床医生在关闭患者图表之前将诊断测试解释作为离散数据记录下来。我们使用逻辑规则实现了“近距离接触警告”,将临床医生重定向到Epic图表的成像和程序部分,以记录测试解释。该实施只允许临床医生在逻辑规则确认没有未签名的测试结果存在的情况下,将每次门诊就诊的图表确定为关闭。逻辑规则经过多次修改,以适应眼科独特的工作流程,并考虑到同事、住院医生和工作人员的角色。我们在21年10月23日实现了初始逻辑规则,22年2月8日实现了最终迭代。为了评估影响,我们比较了2017年10月至2024年12月包含未结果诊断测试的封闭图表的数量。在我们实施逻辑规则之前,临床医生每月平均关闭897.1张带有未结果诊断图像的图表(中位数:916,四分位数间距[IQR]: 170,占所有门诊就诊的5.78%)。实施后,这一数字降至每月8.3例(中位数:8,IQR: 5.75,占所有门诊就诊的0.05%),减少了108% (p
{"title":"Optimizing Documentation Integrity of Ophthalmic Diagnostic Test Interpretation through Electronic Health Record Clinical Decision Support.","authors":"Lydia J Yang, Molly Kuhn, James M Blum, Andrew E Pouw","doi":"10.1055/a-2581-5739","DOIUrl":"10.1055/a-2581-5739","url":null,"abstract":"<p><p>Electronic health records (EHRs) have revolutionized clinical practice, but clinicians and institutions have not yet fully optimized their use. Inconsistent documentation of ophthalmic test results can increase potential medicolegal risks if providers bill for tests without properly documenting clinical interpretations.To address this, we developed and implemented a logic tool in Epic (Epic Systems, Verona, Wisconsin, United States) that prompts clinicians to document diagnostic test interpretations as discrete data before closing the patient chart.We implemented a \"Close Encounter Warning\" using logic rules to redirect clinicians to the Imaging and Procedures section of the Epic chart for documenting test interpretations. The implementation only allows clinicians to finalize each outpatient encounter's charting as closed if the logic rules confirm that no unsigned test results remain. The logic rules were revised many times to accommodate the unique workflow of the Ophthalmology department and to consider the roles of fellows, residents, and staff who also work with encounter charting. We implemented the initial logic rule on October 23, 21 and the final iteration on February8, 22. To evaluate the impact, we compared the number of closed charts containing unresulted diagnostic tests from October 2017 to December 2024.Before we implemented the logic rules, clinicians closed an average of 897.1 charts per month with unresulted diagnostic images (median: 916, interquartile range [IQR]: 170, 5.78% of all outpatient encounters). After implementation, this number dropped to 8.3 per month (median: 8, IQR: 5.75, 0.05% of all outpatient encounters), a 108% reduction (<i>p</i> < 0.001).The Close Encounter Warning logic rules significantly reduced the number of Imaging and Procedure-type diagnostic tests lacking final attending signatures in the Ophthalmology department. By implementing this EHR change, we successfully minimized potential medicolegal liability for our clinicians and institution.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"786-795"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12352986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144856733","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-08-27DOI: 10.1055/a-2648-4817
Thomas F Byrd, Molly Mattson, Mary Polt, Katie Pint, Kiril Dimitrov, Angelica Willis, Julia Lister, Evan Beacom, Chris Tignanelli
Traditional early warning systems (EWS) have shown uncertain efficacy in real-world settings. More recently, machine learning models like the Epic Deterioration Index (DTI) have been developed, promising greater accuracy. Recognizing the potential of DTI, but also the pervasive issue of alert fatigue with interruptive (i.e., pop-up) EWS alerts, our institution implemented a DTI-enabled EWS with passive alerts (colored icons visible in prespecified locations within the electronic health record). We hypothesized that our intervention would reduce the time to treatment for deteriorating patients.We piloted a DTI-enabled EWS in a 30-bed intermediate care unit at a large academic medical center. DTI scores, alert icons, and vital signs appeared on a custom Patient List interface. In the event of an alert, charge nurses were expected to conduct a bedside assessment and escalate care as necessary. We compared the 111-day pre- and postimplementation periods, with alert-to-action time as the primary outcome. Secondary outcomes included mortality, length of stay, ICU transfer, documentation rate, and provider acceptance.Among 301 patients with an elevated-risk score (156 pre- and 145 postimplementation), we found no significant differences in alert-to-action time (469 vs. 359 minutes before alert; p = 0.96), with provider actions typically occurring several hours before the alert in both periods. There were no significant differences in mortality (10.3% vs. 13.1%; p = 0.56), length of stay (15.7 vs. 12.8 days; p = 0.23), or ICU transfer (8.3% vs. 6.2%; p = 0.63). Charge nurses documented acknowledgment of the alert in 18.6% of cases, and acceptance was poor. Most nurses expressed a preference for interruptive alerts and more prominent DTI display locations.In this single-unit pilot, passive DTI-enabled EWS alerts did not improve time to intervention or clinical outcomes. High-risk DTI scores often occurred after clinical deterioration had already been recognized.
传统的早期预警系统(EWS)在现实环境中显示出不确定的有效性。最近,像史诗退化指数(DTI)这样的机器学习模型已经开发出来,承诺更高的准确性。认识到DTI的潜力,以及中断(即弹出式)EWS警报普遍存在的警报疲劳问题,我们的机构实现了一个支持DTI的EWS,带有被动警报(在电子健康记录的预先指定位置可见彩色图标)。我们假设我们的干预可以缩短病情恶化患者的治疗时间。我们在一家大型学术医疗中心的30张床位的中级护理单元中试用了支持dti的EWS。DTI评分、警报图标和生命体征出现在自定义患者列表界面上。在警报的情况下,主管护士应进行床边评估,并在必要时升级护理。我们比较了111天的实施前和实施后的时间,以预警到行动的时间作为主要结果。次要结局包括死亡率、住院时间、ICU转移、记录率和提供者接受度。在301名风险评分较高的患者中(156名实施前和145名实施后),我们发现在警报到行动的时间上没有显著差异(警报前469分钟对359分钟;p = 0.96),在这两个时期,提供者的行动通常发生在警报前几个小时。两组患者的死亡率(10.3% vs. 13.1%, p = 0.56)、住院时间(15.7 vs. 12.8天,p = 0.23)和转ICU时间(8.3% vs. 6.2%, p = 0.63)均无显著差异。在18.6%的病例中,主管护士记录了对警报的承认,接受程度较差。大多数护士表达了对中断警报和更突出的DTI显示位置的偏好。在这个单单元试验中,被动dti激活的EWS警报并没有改善干预时间或临床结果。高风险DTI评分通常发生在已经识别出临床恶化的情况下。
{"title":"Implementation of Passive Deterioration Index Alerts in an Intermediate Care Unit: A Failed Early Warning System Strategy.","authors":"Thomas F Byrd, Molly Mattson, Mary Polt, Katie Pint, Kiril Dimitrov, Angelica Willis, Julia Lister, Evan Beacom, Chris Tignanelli","doi":"10.1055/a-2648-4817","DOIUrl":"https://doi.org/10.1055/a-2648-4817","url":null,"abstract":"<p><p>Traditional early warning systems (EWS) have shown uncertain efficacy in real-world settings. More recently, machine learning models like the Epic Deterioration Index (DTI) have been developed, promising greater accuracy. Recognizing the potential of DTI, but also the pervasive issue of alert fatigue with interruptive (i.e., pop-up) EWS alerts, our institution implemented a DTI-enabled EWS with passive alerts (colored icons visible in prespecified locations within the electronic health record). We hypothesized that our intervention would reduce the time to treatment for deteriorating patients.We piloted a DTI-enabled EWS in a 30-bed intermediate care unit at a large academic medical center. DTI scores, alert icons, and vital signs appeared on a custom Patient List interface. In the event of an alert, charge nurses were expected to conduct a bedside assessment and escalate care as necessary. We compared the 111-day pre- and postimplementation periods, with alert-to-action time as the primary outcome. Secondary outcomes included mortality, length of stay, ICU transfer, documentation rate, and provider acceptance.Among 301 patients with an elevated-risk score (156 pre- and 145 postimplementation), we found no significant differences in alert-to-action time (469 vs. 359 minutes before alert; <i>p</i> = 0.96), with provider actions typically occurring several hours before the alert in both periods. There were no significant differences in mortality (10.3% vs. 13.1%; <i>p</i> = 0.56), length of stay (15.7 vs. 12.8 days; <i>p</i> = 0.23), or ICU transfer (8.3% vs. 6.2%; <i>p</i> = 0.63). Charge nurses documented acknowledgment of the alert in 18.6% of cases, and acceptance was poor. Most nurses expressed a preference for interruptive alerts and more prominent DTI display locations.In this single-unit pilot, passive DTI-enabled EWS alerts did not improve time to intervention or clinical outcomes. High-risk DTI scores often occurred after clinical deterioration had already been recognized.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"903-910"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12390366/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144975528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-08-01Epub Date: 2025-09-03DOI: 10.1055/a-2661-3670
Emily E Schildt, Paul R Sutton, Andrew F Lees, Hasan B Ahmad, Albert C Lee, Michael G Leu, Patrick Wedgeworth, Andrew A White
Chemoprophylaxis reduces the risk of hospital-acquired venous thromboembolism (VTE), but is not reliably ordered. Our institution created a clinical decision support (CDS) interruptive alert to remind clinicians to order VTE chemoprophylaxis when it is missing for qualifying inpatients. Unfortunately, this alert has required repeated modifications to ensure accurate logic, and continues to generate negative feedback from users.This study aimed to describe multiple failures in the development and postdeployment optimization of this interruptive alert, and our lessons learned.This study analyzed the number of times this alert fired over 6 months of testing and 16 months of deployment, and changes in either the frequency of alert firing or the frequency of the alert being dismissed without orders placed with iterative changes in the alert logic. Feedback about this alert was compiled and classified into common themes.The initial alert fired an average of 11,154 times per week when tested silently, prompting significant refinements before release. The alert shown to users fired an average of 53.8 times per 1,000 patient days in the first 6 months of the study period. Despite postlaunch improvements, this rose to 61 alerts per 1,000 patient days in the final 6 months of the study. Modifications also did not cause a significant decrease in how frequently the alert was dismissed without further action being taken (88%). Review of narrative feedback and its classification highlights "wrong person" receiving the alert being by far the most prevalent cause for negative submitted user feedback (nearly 50%), despite efforts to develop logic that limits firing to the patient's primary team.Changes to this VTE alert were summarized as failures to meet the "five rights" of CDS. Alerts for high-priority safety issues require persistent feedback-driven improvement, particularly when there is poor performance or negative user experience.
{"title":"Sisyphus' Alert: The Uphill Struggle to Improve Venous Thromboembolism Prophylaxis Clinical Decision Support.","authors":"Emily E Schildt, Paul R Sutton, Andrew F Lees, Hasan B Ahmad, Albert C Lee, Michael G Leu, Patrick Wedgeworth, Andrew A White","doi":"10.1055/a-2661-3670","DOIUrl":"10.1055/a-2661-3670","url":null,"abstract":"<p><p>Chemoprophylaxis reduces the risk of hospital-acquired venous thromboembolism (VTE), but is not reliably ordered. Our institution created a clinical decision support (CDS) interruptive alert to remind clinicians to order VTE chemoprophylaxis when it is missing for qualifying inpatients. Unfortunately, this alert has required repeated modifications to ensure accurate logic, and continues to generate negative feedback from users.This study aimed to describe multiple failures in the development and postdeployment optimization of this interruptive alert, and our lessons learned.This study analyzed the number of times this alert fired over 6 months of testing and 16 months of deployment, and changes in either the frequency of alert firing or the frequency of the alert being dismissed without orders placed with iterative changes in the alert logic. Feedback about this alert was compiled and classified into common themes.The initial alert fired an average of 11,154 times per week when tested silently, prompting significant refinements before release. The alert shown to users fired an average of 53.8 times per 1,000 patient days in the first 6 months of the study period. Despite postlaunch improvements, this rose to 61 alerts per 1,000 patient days in the final 6 months of the study. Modifications also did not cause a significant decrease in how frequently the alert was dismissed without further action being taken (88%). Review of narrative feedback and its classification highlights \"wrong person\" receiving the alert being by far the most prevalent cause for negative submitted user feedback (nearly 50%), despite efforts to develop logic that limits firing to the patient's primary team.Changes to this VTE alert were summarized as failures to meet the \"five rights\" of CDS. Alerts for high-priority safety issues require persistent feedback-driven improvement, particularly when there is poor performance or negative user experience.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"988-994"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12408118/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144993983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}