Pub Date : 2025-10-01Epub Date: 2025-12-03DOI: 10.1055/a-2710-4288
Danny L Scerpella, Liz Salmi, Isabel Hurwitz, Amanda Norris, Kennedy McDaniel, Sara Epstein, Jennifer L Wolff, Catherine M DesRoches
Achieving digital health equity and proper use of identity credentials is crucial as reliance on electronic modalities increases. Proxy access-now increasingly referred to as shared access-is a widely available functionality that offers identity credentials to care partners who assist loved ones in navigating the electronic care delivery demands of patients with complex care needs. However, adoption of these tools has been hindered by complicated user interfaces and low awareness.Drawing on frameworks and principles rooted in human-centered design (HCD), we conducted an evaluation of a multisite quality improvement study designed to increase the awareness and adoption of shared access to patient portals for older adults and their care partners. Through feedback gathered from key informants, we identified barriers to the adoption of materials created for the parent quality improvement project, and synthesize additional implementation strategies from informant feedback to improve shared access.We employed the Double Diamond Model (DDM) of HCD to guide our research. The DDM includes engaging a diverse group of community partners-older adults, care partners, health care system leaders, communications professionals-through focus groups and individual interviews. Our process involved identifying pain points related to registration for shared access, then synthesizing these insights through inductive coding and affinity mapping to generate solutions.An analysis of our community partner feedback revealed several themes, including the necessity for simplified patient portal registration, standardized terminology about shared access, and clear messaging strategies. A step-by-step video tutorial was developed as a prototype. The prototype was then implemented at a partner health system and received positive feedback, suggesting its potential for broader use.These findings emphasize the importance of involving "end users" (patients, care partners, health care system leaders, communications professionals) in the evaluation and implementation of digital health tools. Approaching challenges with an HCD mindset helped our team identify barriers to shared access adoption and led to the development of a tangible resource (prototype and video). This project highlights the potential for HCD to drive improvements in digital health equity.This research demonstrates a practical application of HCD methods in developing effective solutions for enhancing shared access for older adults, and all people using patient portals.
{"title":"Solutions for Increased Adoption of Patient Portal Shared Access: A Human-Centered Design Approach Using the Double Diamond Model.","authors":"Danny L Scerpella, Liz Salmi, Isabel Hurwitz, Amanda Norris, Kennedy McDaniel, Sara Epstein, Jennifer L Wolff, Catherine M DesRoches","doi":"10.1055/a-2710-4288","DOIUrl":"10.1055/a-2710-4288","url":null,"abstract":"<p><p>Achieving digital health equity and proper use of identity credentials is crucial as reliance on electronic modalities increases. Proxy access-now increasingly referred to as <i>shared access</i>-is a widely available functionality that offers identity credentials to care partners who assist loved ones in navigating the electronic care delivery demands of patients with complex care needs. However, adoption of these tools has been hindered by complicated user interfaces and low awareness.Drawing on frameworks and principles rooted in human-centered design (HCD), we conducted an evaluation of a multisite quality improvement study designed to increase the awareness and adoption of shared access to patient portals for older adults and their care partners. Through feedback gathered from key informants, we identified barriers to the adoption of materials created for the parent quality improvement project, and synthesize additional implementation strategies from informant feedback to improve shared access.We employed the Double Diamond Model (DDM) of HCD to guide our research. The DDM includes engaging a diverse group of community partners-older adults, care partners, health care system leaders, communications professionals-through focus groups and individual interviews. Our process involved identifying pain points related to registration for shared access, then synthesizing these insights through inductive coding and affinity mapping to generate solutions.An analysis of our community partner feedback revealed several themes, including the necessity for simplified patient portal registration, standardized terminology about shared access, and clear messaging strategies. A step-by-step video tutorial was developed as a prototype. The prototype was then implemented at a partner health system and received positive feedback, suggesting its potential for broader use.These findings emphasize the importance of involving \"end users\" (patients, care partners, health care system leaders, communications professionals) in the evaluation and implementation of digital health tools. Approaching challenges with an HCD mindset helped our team identify barriers to shared access adoption and led to the development of a tangible resource (prototype and video). This project highlights the potential for HCD to drive improvements in digital health equity.This research demonstrates a practical application of HCD methods in developing effective solutions for enhancing shared access for older adults, and all people using patient portals.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1728-1737"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12674950/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145670365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-24DOI: 10.1055/a-2701-5761
Kristian Feterik, Katherine Lusk, Kathryn Ayers Wickenhauser, James L McCormack, Christoph U Lehmann, Simone Arvisais-Anhalt
Direct Secure Messaging (DSM) is a communication standard for exchanging information between health care entities and practitioners. It relies on access to an address directory. When directory entry is incomplete, health information exchange breaks down. There is an urgent need for standardized DSM address directory management and synchronization workflows that support universal access in a timely manner.Our objective was to develop best practices for maintenance of DSM address directories and create recommendations to encourage adoption of DSM technology in the State of Texas.Texas Health Services Authority (THSA) formed a workgroup focused on increasing DSM adoption. Between August 2021 and March 2022, workgroup members used a modified Delphi process to create a directory management best practice policy and published it in May 2022. To measure the effect of the policy, THSA monitored volume of messages sent in a group of 38 hospitals before and after the workgroup was established.Organizations should standardize DSM address data and routinely sync with external databases to ensure seamless, vendor-independent message flow. Additionally, health systems are expected to update directory entries immediately upon any change in practitioner's status. Between September 2021 and December 2022, there was a decrease in Direct messages not sent due to no known address, from 50 to 42%, respectively. Additionally, between July 2021 and March 2024, organizations participating in the policy development reported a steady monthly increase of new Direct addresses issued.Health care organizations should adopt a consistent workflow for maintaining their DSM address directories and regularly synchronize with external databases to facilitate unobstructed flow of messages and data. The Maintenance of Provider Database Dictionary Policy developed by the THSA can serve as a model for nationwide implementation and optimization of DSM as an important interoperability standard.
{"title":"Improving Direct Secure Messaging through Directory Management.","authors":"Kristian Feterik, Katherine Lusk, Kathryn Ayers Wickenhauser, James L McCormack, Christoph U Lehmann, Simone Arvisais-Anhalt","doi":"10.1055/a-2701-5761","DOIUrl":"10.1055/a-2701-5761","url":null,"abstract":"<p><p>Direct Secure Messaging (DSM) is a communication standard for exchanging information between health care entities and practitioners. It relies on access to an address directory. When directory entry is incomplete, health information exchange breaks down. There is an urgent need for standardized DSM address directory management and synchronization workflows that support universal access in a timely manner.Our objective was to develop best practices for maintenance of DSM address directories and create recommendations to encourage adoption of DSM technology in the State of Texas.Texas Health Services Authority (THSA) formed a workgroup focused on increasing DSM adoption. Between August 2021 and March 2022, workgroup members used a modified Delphi process to create a directory management best practice policy and published it in May 2022. To measure the effect of the policy, THSA monitored volume of messages sent in a group of 38 hospitals before and after the workgroup was established.Organizations should standardize DSM address data and routinely sync with external databases to ensure seamless, vendor-independent message flow. Additionally, health systems are expected to update directory entries immediately upon any change in practitioner's status. Between September 2021 and December 2022, there was a decrease in Direct messages not sent due to no known address, from 50 to 42%, respectively. Additionally, between July 2021 and March 2024, organizations participating in the policy development reported a steady monthly increase of new Direct addresses issued.Health care organizations should adopt a consistent workflow for maintaining their DSM address directories and regularly synchronize with external databases to facilitate unobstructed flow of messages and data. The Maintenance of Provider Database Dictionary Policy developed by the THSA can serve as a model for nationwide implementation and optimization of DSM as an important interoperability standard.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1430-1438"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12552064/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145369149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-24DOI: 10.1055/a-2640-2742
Natali Sorajja, Julia Zheng, Sunit Jariwala
Telemedicine use has surged since the COVID-19 pandemic, offering a convenient way for patients to access health care. Whereas digital literacy (general comfort with and ability to use digital tools) is necessary to utilize telemedicine, digital health literacy is a subset of this, focusing on the ability to use digital tools to seek out, understand, and utilize health information. Barriers such as the lack of high-speed internet and limited digital health literacy can hinder telemedicine's effectiveness, particularly for historically marginalized populations with lower technological access.This study aims to characterize the relationship between baseline digital health literacy, appointment no-shows, and telemedicine usage in a Bronx population.In a Bronx-based cohort, we assessed digital health literacy using eHealth Literacy Scale (eHEALS) and eHealth Literacy Objective Scale-Scenario Based (eHeLiOS-SB), and health literacy with the Newest Vital Sign (NVS) instrument. Baseline sociodemographic characteristics (e.g., age, insurance type) were collected, and appointment no-show rates and telemedicine usage were calculated. Linear regression models were used to assess associations.Higher digital health literacy, private insurance (compared to Medicaid), and older age were associated with fewer no-shows. Higher video visit usage was also associated with fewer no-shows. Individuals at high risk of housing insecurity were less likely to use video visits, and higher phone visit usage was associated with patients experiencing financial resource strain. Digital health literacy was positively associated with White race and negatively associated with Medicare usage (compared to Medicaid).Higher digital health literacy correlates with increased appointment attendance, indicating the need to address digital barriers in health care. Increasing telemedicine use may help reduce no-shows, and patient-specific strategies are needed to enhance digital health literacy and telemedicine effectiveness.
{"title":"Exploring the Relationship between Digital Health Literacy and Patterns of Telemedicine Engagement and Appointment Attendance within an Urban Academic Hospital.","authors":"Natali Sorajja, Julia Zheng, Sunit Jariwala","doi":"10.1055/a-2640-2742","DOIUrl":"10.1055/a-2640-2742","url":null,"abstract":"<p><p>Telemedicine use has surged since the COVID-19 pandemic, offering a convenient way for patients to access health care. Whereas digital literacy (general comfort with and ability to use digital tools) is necessary to utilize telemedicine, digital health literacy is a subset of this, focusing on the ability to use digital tools to seek out, understand, and utilize health information. Barriers such as the lack of high-speed internet and limited digital health literacy can hinder telemedicine's effectiveness, particularly for historically marginalized populations with lower technological access.This study aims to characterize the relationship between baseline digital health literacy, appointment no-shows, and telemedicine usage in a Bronx population.In a Bronx-based cohort, we assessed digital health literacy using eHealth Literacy Scale (eHEALS) and eHealth Literacy Objective Scale-Scenario Based (eHeLiOS-SB), and health literacy with the Newest Vital Sign (NVS) instrument. Baseline sociodemographic characteristics (e.g., age, insurance type) were collected, and appointment no-show rates and telemedicine usage were calculated. Linear regression models were used to assess associations.Higher digital health literacy, private insurance (compared to Medicaid), and older age were associated with fewer no-shows. Higher video visit usage was also associated with fewer no-shows. Individuals at high risk of housing insecurity were less likely to use video visits, and higher phone visit usage was associated with patients experiencing financial resource strain. Digital health literacy was positively associated with White race and negatively associated with Medicare usage (compared to Medicaid).Higher digital health literacy correlates with increased appointment attendance, indicating the need to address digital barriers in health care. Increasing telemedicine use may help reduce no-shows, and patient-specific strategies are needed to enhance digital health literacy and telemedicine effectiveness.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1695-1708"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12623120/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144486749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-11-21DOI: 10.1055/a-2737-5596
Kevin Pearlman, Julie Oyler, Mim Ari, Lisa Vinci, Sachin Shah
Completion of Family and Medical Leave Act (FMLA) paperwork is a necessary but time-intensive task that contributes to clinician administrative burden.This study aimed to implement and evaluate an electronic health record (EHR)-integrated FMLA tool designed to reduce documentation time and improve workflow efficiency.An EHR-embedded FMLA form was deployed at a large academic medical center, piloted in July 2024 in primary care, and expanded to all ambulatory practices in September 2024. The tool enabled clinicians to complete and transmit FMLA documentation electronically, with auto-population of clinician details and the ability to recall prior submissions. Pre- and post-intervention surveys assessed clinician-reported efficiency and time burden, and form utilization was tracked using EHR query tools.A total of 67 clinicians completed a pre-survey (response rate: 19.4%) and 49 completed a post-survey (response rate: 25.4%). About 94% of clinicians using the EHR form (n = 31/33) reported time savings. On a 5-point Likert scale, efficiency improved for initial FMLA completion (2.46-3.06, p = 0.01) and renewal of prior FMLA (2.66-3.31, p = 0.01). The percentage of clinicians completing FMLA in 15 minutes or less increased from 51 to 78% (p = 0.002). The form was used 435 times over 9 months, primarily in primary care, with sustained monthly usage.An EHR-integrated FMLA tool improved clinician-reported efficiency and reduced time spent on documentation. This model may be applicable to other manual administrative workflows and offers a potential strategy to mitigate provider burnout.
{"title":"Reimagining Family and Medical Leave Act (FMLA) Forms-From Pen & Paper to Electronic Health Record (EHR) Integration.","authors":"Kevin Pearlman, Julie Oyler, Mim Ari, Lisa Vinci, Sachin Shah","doi":"10.1055/a-2737-5596","DOIUrl":"10.1055/a-2737-5596","url":null,"abstract":"<p><p>Completion of Family and Medical Leave Act (FMLA) paperwork is a necessary but time-intensive task that contributes to clinician administrative burden.This study aimed to implement and evaluate an electronic health record (EHR)-integrated FMLA tool designed to reduce documentation time and improve workflow efficiency.An EHR-embedded FMLA form was deployed at a large academic medical center, piloted in July 2024 in primary care, and expanded to all ambulatory practices in September 2024. The tool enabled clinicians to complete and transmit FMLA documentation electronically, with auto-population of clinician details and the ability to recall prior submissions. Pre- and post-intervention surveys assessed clinician-reported efficiency and time burden, and form utilization was tracked using EHR query tools.A total of 67 clinicians completed a pre-survey (response rate: 19.4%) and 49 completed a post-survey (response rate: 25.4%). About 94% of clinicians using the EHR form (<i>n</i> = 31/33) reported time savings. On a 5-point Likert scale, efficiency improved for initial FMLA completion (2.46-3.06, <i>p</i> = 0.01) and renewal of prior FMLA (2.66-3.31, <i>p</i> = 0.01). The percentage of clinicians completing FMLA in 15 minutes or less increased from 51 to 78% (<i>p</i> = 0.002). The form was used 435 times over 9 months, primarily in primary care, with sustained monthly usage.An EHR-integrated FMLA tool improved clinician-reported efficiency and reduced time spent on documentation. This model may be applicable to other manual administrative workflows and offers a potential strategy to mitigate provider burnout.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1787-1793"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12638195/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145574795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-11-20DOI: 10.1055/a-2734-1754
Michael Senter-Zapata, Christopher Baugh, Sarah Onorato, Max J N Tiako, Allison Hare, Chiaka Aribeana, Eric Isselbacher, Jared Conley
Patient decompensation necessitating rapid response team (RRT) care in the hospital setting involves complex medical decision making, strong leadership skills, and precise communication where every second matters. However, RRT outcomes can vary based on leader training, knowledge, and experience. We designed five digital, condition-specific, guided algorithms to improve RRT care and compared user survey data among three physician cohorts across the clinical training spectrum to assess the practicality of real-world usage in a small feasibility study.Guided algorithms to common RRT scenarios, including tachycardia, bradycardia, hypotension, hypoxia, and altered mental status, were used by 157 physicians at our institution across three Internal Medicine user cohorts (1: end-of-year PGY-2-5 residents, 2: new PGY-2 residents, and 3: attending hospitalists) from April to December 2024. Survey data from 28 respondents were compared across cohorts using Kruskal-Wallis and Dunn statistical analyses.Survey responses demonstrated consistently high scores across cohorts regarding improvement in patient care, improved RRT leader experience, improved confidence, reduced stress/cognitive load, potential for standardization of care, and likelihood of recommendation to a colleague. Interestingly, new PGY-2 residents rated ease of navigation at 7/10 compared to 10/10 by attending hospitalists (p = 0.016).Digital, guided RRT algorithms are a practical and effective tool for enhancing physician care delivery during inpatient rapid response events across all levels of training. High survey scores across cohorts warrant consideration for broader implementation. Variation in ease of navigation scores highlights the importance of tailoring information flow and usability features to less experienced users. Overall, these algorithms show promise as valuable adjuncts during acute care delivery in high-stakes clinical settings.
{"title":"Physicians Report Benefit from Guided Critical Care Algorithms During Inpatient Rapid Responses.","authors":"Michael Senter-Zapata, Christopher Baugh, Sarah Onorato, Max J N Tiako, Allison Hare, Chiaka Aribeana, Eric Isselbacher, Jared Conley","doi":"10.1055/a-2734-1754","DOIUrl":"10.1055/a-2734-1754","url":null,"abstract":"<p><p>Patient decompensation necessitating rapid response team (RRT) care in the hospital setting involves complex medical decision making, strong leadership skills, and precise communication where every second matters. However, RRT outcomes can vary based on leader training, knowledge, and experience. We designed five digital, condition-specific, guided algorithms to improve RRT care and compared user survey data among three physician cohorts across the clinical training spectrum to assess the practicality of real-world usage in a small feasibility study.Guided algorithms to common RRT scenarios, including tachycardia, bradycardia, hypotension, hypoxia, and altered mental status, were used by 157 physicians at our institution across three Internal Medicine user cohorts (1: end-of-year PGY-2-5 residents, 2: new PGY-2 residents, and 3: attending hospitalists) from April to December 2024. Survey data from 28 respondents were compared across cohorts using Kruskal-Wallis and Dunn statistical analyses.Survey responses demonstrated consistently high scores across cohorts regarding improvement in patient care, improved RRT leader experience, improved confidence, reduced stress/cognitive load, potential for standardization of care, and likelihood of recommendation to a colleague. Interestingly, new PGY-2 residents rated ease of navigation at 7/10 compared to 10/10 by attending hospitalists (<i>p</i> = 0.016).Digital, guided RRT algorithms are a practical and effective tool for enhancing physician care delivery during inpatient rapid response events across all levels of training. High survey scores across cohorts warrant consideration for broader implementation. Variation in ease of navigation scores highlights the importance of tailoring information flow and usability features to less experienced users. Overall, these algorithms show promise as valuable adjuncts during acute care delivery in high-stakes clinical settings.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1771-1778"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12634209/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145565948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-24DOI: 10.1055/a-2702-1574
Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden T Schwenk, Hiroki Morizono, Jonathan D Cogen, Nathan M Pajor, Ravi Jhaveri, Christopher B Forrest, L Charles Bailey
Long COVID, characterized by persistent or recurring symptoms post-COVID-19 infection, poses challenges for pediatric care and research due to the lack of a standardized clinical definition. Adult-focused phenotypes do not translate well to children, given developmental and physiological differences, and pediatric-specific phenotypes have not been compared with chart review.This study introduces and evaluates a pediatric-specific rule-based computable phenotype (CP) to identify long COVID using electronic health record data. We compare its performance to manual chart review.We applied the CP, composed of diagnostic codes empirically associated with long COVID, to 339,467 pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The CP identified 31,781 patients with long COVID. Clinicians conducted chart reviews on a subset of patients across 16 hospital systems to assess performance. We qualitatively reviewed discordant cases to understand differences between CP and clinician identification.Among the 651 reviewed patients (339 females, Mage = 10.10 years), the CP showed moderate agreement with clinician identification (accuracy = 0.62, positive predictive value [PPV] = 0.49, negative predictive value [NPV] = 0.75, sensitivity = 0.52, specificity = 0.84). Performance was largely consistent across age and dominant variant but varied by symptom cluster count. Most discrepancies between the CP and chart review occurred when the CP identified a case, but the clinician did not, often because clinicians attributed symptoms to preexisting conditions (73%). When clinicians identified cases missed by the CP, they often used broader symptom or timing criteria (69%). Model performance improved when the CP accounted for preexisting conditions (accuracy = 0.71, PPV = 0.65, NPV = 0.74, sensitivity = 0.59, specificity = 0.79).This study presents a CP for pediatric long COVID. While agreement with manual review was moderate, most discrepancies were explained by differences in interpreting symptoms when patients had preexisting conditions. Accounting for these conditions improved accuracy and highlights the need for a consensus definition. These findings support the development of reliable, scalable tools for pediatric long COVID research.
{"title":"Identifying Pediatric Long COVID: Comparing an EHR Algorithm to Manual Review.","authors":"Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden T Schwenk, Hiroki Morizono, Jonathan D Cogen, Nathan M Pajor, Ravi Jhaveri, Christopher B Forrest, L Charles Bailey","doi":"10.1055/a-2702-1574","DOIUrl":"10.1055/a-2702-1574","url":null,"abstract":"<p><p>Long COVID, characterized by persistent or recurring symptoms post-COVID-19 infection, poses challenges for pediatric care and research due to the lack of a standardized clinical definition. Adult-focused phenotypes do not translate well to children, given developmental and physiological differences, and pediatric-specific phenotypes have not been compared with chart review.This study introduces and evaluates a pediatric-specific rule-based computable phenotype (CP) to identify long COVID using electronic health record data. We compare its performance to manual chart review.We applied the CP, composed of diagnostic codes empirically associated with long COVID, to 339,467 pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The CP identified 31,781 patients with long COVID. Clinicians conducted chart reviews on a subset of patients across 16 hospital systems to assess performance. We qualitatively reviewed discordant cases to understand differences between CP and clinician identification.Among the 651 reviewed patients (339 females, <i>M</i> <sub>age</sub> = 10.10 years), the CP showed moderate agreement with clinician identification (accuracy = 0.62, positive predictive value [PPV] = 0.49, negative predictive value [NPV] = 0.75, sensitivity = 0.52, specificity = 0.84). Performance was largely consistent across age and dominant variant but varied by symptom cluster count. Most discrepancies between the CP and chart review occurred when the CP identified a case, but the clinician did not, often because clinicians attributed symptoms to preexisting conditions (73%). When clinicians identified cases missed by the CP, they often used broader symptom or timing criteria (69%). Model performance improved when the CP accounted for preexisting conditions (accuracy = 0.71, PPV = 0.65, NPV = 0.74, sensitivity = 0.59, specificity = 0.79).This study presents a CP for pediatric long COVID. While agreement with manual review was moderate, most discrepancies were explained by differences in interpreting symptoms when patients had preexisting conditions. Accounting for these conditions improved accuracy and highlights the need for a consensus definition. These findings support the development of reliable, scalable tools for pediatric long COVID research.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1445-1456"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12552067/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145369125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-05-26DOI: 10.1055/a-2620-6221
Stephon Proctor, Bimal Desai
Clinical decision support systems (CDSS) are central to modern health care, but their effectiveness is compromised during system downtimes, which affect 96% of health care organizations. During these failures, clinicians lose access to critical decision-making tools like order sets, increasing the risk of medical errors. Traditional downtime solutions, such as paper-based protocols, are often impractical and difficult to maintain.This study introduces and evaluates Offsite Repository for Clinical Assets (ORCA), a resilient web-based solution designed to maintain access to electronic health record (EHR) order sets during system failures. We assessed its usability and effectiveness as a downtime decision support tool across various clinical settings.ORCA was developed based on an analysis of previous downtime incidents, replicating essential order set functionality while ensuring offsite accessibility. We conducted usability testing with 16 clinicians from diverse specialties, using structured tasks and think-aloud protocols. User feedback was collected through the Usability Metric for User Experience (UMUX) questionnaire and thematic analysis of interview transcripts.ORCA demonstrated strong usability (mean UMUX score: 86.2). Thematic analysis revealed key implementation challenges: system limitations, workflow integration, and interface navigation. Users valued ORCA's familiar interface and offsite accessibility but identified critical gaps in dynamic decision support capabilities.ORCA represents a viable approach to maintaining basic clinical decision support (CDS) during downtimes. However, significant challenges remain in replicating dynamic CDS features and ensuring effective integration with existing downtime procedures. These findings inform future development of resilient CDSS and highlight the importance of planned fallback pathways in clinical systems.
背景:临床决策支持系统(CDSS)是现代医疗保健的核心,但其有效性在系统停机期间受到损害,这影响了96%的医疗保健组织。在这些故障期间,临床医生无法访问诸如订单集之类的关键决策工具,从而增加了医疗差错的风险。传统的停机解决方案,如基于纸张的协议,通常不切实际且难以维护。目的:本研究介绍并评估了ORCA (Offsite Repository for Clinical Assets),这是一种弹性的基于网络的解决方案,旨在在系统故障期间保持对EHR订单集的访问。我们评估了它在各种临床环境中作为停机决策支持工具的可用性和有效性。方法:ORCA是在分析之前的停机事件的基础上开发的,在确保非现场可访问性的同时,复制了基本的订单集功能。我们对来自不同专业的16名临床医生进行了可用性测试,使用结构化任务和有声思考协议。用户反馈是通过用户体验可用性度量(UMUX)问卷调查和访谈记录的专题分析收集的。结果:ORCA表现出较强的可用性(平均UMUX得分:86.2)。专题分析揭示了主要的实施挑战:系统限制(24.56%)、工作流集成(23.39%)和界面导航(22.22%)。用户重视ORCA熟悉的界面和非现场可访问性,但发现了动态决策支持能力的关键差距。结论:ORCA代表了在停机期间维持基本临床决策支持的可行方法。然而,在复制动态CDS特性和确保与现有停机程序的有效集成方面仍然存在重大挑战。这些发现为弹性CDS系统的未来发展提供了信息,并强调了在临床系统中规划后备途径的重要性。
{"title":"Development and Evaluation of Offsite Repository for Clinical Assets, a Resilient Solution for Order Set Access during EHR Downtimes.","authors":"Stephon Proctor, Bimal Desai","doi":"10.1055/a-2620-6221","DOIUrl":"10.1055/a-2620-6221","url":null,"abstract":"<p><p>Clinical decision support systems (CDSS) are central to modern health care, but their effectiveness is compromised during system downtimes, which affect 96% of health care organizations. During these failures, clinicians lose access to critical decision-making tools like order sets, increasing the risk of medical errors. Traditional downtime solutions, such as paper-based protocols, are often impractical and difficult to maintain.This study introduces and evaluates Offsite Repository for Clinical Assets (ORCA), a resilient web-based solution designed to maintain access to electronic health record (EHR) order sets during system failures. We assessed its usability and effectiveness as a downtime decision support tool across various clinical settings.ORCA was developed based on an analysis of previous downtime incidents, replicating essential order set functionality while ensuring offsite accessibility. We conducted usability testing with 16 clinicians from diverse specialties, using structured tasks and think-aloud protocols. User feedback was collected through the Usability Metric for User Experience (UMUX) questionnaire and thematic analysis of interview transcripts.ORCA demonstrated strong usability (mean UMUX score: 86.2). Thematic analysis revealed key implementation challenges: system limitations, workflow integration, and interface navigation. Users valued ORCA's familiar interface and offsite accessibility but identified critical gaps in dynamic decision support capabilities.ORCA represents a viable approach to maintaining basic clinical decision support (CDS) during downtimes. However, significant challenges remain in replicating dynamic CDS features and ensuring effective integration with existing downtime procedures. These findings inform future development of resilient CDSS and highlight the importance of planned fallback pathways in clinical systems.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1401-1412"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534125/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144152613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-30DOI: 10.1055/a-2735-0527
Hyo Jung Hong, Nigam H Shah, Michael A Pfeffer, Lisa S Lehmann
This study aims to evaluate physicians' practices and perspectives regarding large language models (LLMs) in health care settings.A cross-sectional survey study was conducted between May and July 2024, comparing physician perspectives at two major academic medical centers (AMCs), one with institutional LLM access and one without. Participants included both clinical faculty and trainees recruited through departmental leadership and snowball sampling. Primary outcomes were current LLM use frequency, ranked importance of evaluation metrics, liability concerns, and preferred learning topics.Among 306 respondents (217 attending physicians [70.9%], 80 trainees [26.1%]), 197 (64.4%) reported using LLMs. The AMC with institutional LLM access reported significantly lower liability concerns (49.2 vs. 66.7% reporting high concern; 17.5 percentage points difference [95% CI, 6.8-28.2]; p = 0.0082). Accuracy was prioritized across all specialties (median rank 1.0 [interquartile range; IQR, 1.0-2.0]). Of the respondents, 287 physicians (94%) requested additional training. Key learning priorities were clinical applications (206 [71.9%]) and risk management (181 [63.1%]). Despite widespread personal use, only 8 physicians (2.6%) recommended LLMs to patients. Notable specialty and demographic variations emerged, with younger physicians showing higher enthusiasm but also elevated legal concerns.This survey study provides insights into physicians' current usage patterns and perspectives on LLMs. Liability concerns appear to be lessened in settings with institutional LLM access. The findings suggest opportunities for medical centers to consider when developing LLM-related policies and educational programs.
{"title":"Physician Perspectives on Large Language Models in Health Care: A Cross-Sectional Survey Study.","authors":"Hyo Jung Hong, Nigam H Shah, Michael A Pfeffer, Lisa S Lehmann","doi":"10.1055/a-2735-0527","DOIUrl":"10.1055/a-2735-0527","url":null,"abstract":"<p><p>This study aims to evaluate physicians' practices and perspectives regarding large language models (LLMs) in health care settings.A cross-sectional survey study was conducted between May and July 2024, comparing physician perspectives at two major academic medical centers (AMCs), one with institutional LLM access and one without. Participants included both clinical faculty and trainees recruited through departmental leadership and snowball sampling. Primary outcomes were current LLM use frequency, ranked importance of evaluation metrics, liability concerns, and preferred learning topics.Among 306 respondents (217 attending physicians [70.9%], 80 trainees [26.1%]), 197 (64.4%) reported using LLMs. The AMC with institutional LLM access reported significantly lower liability concerns (49.2 vs. 66.7% reporting high concern; 17.5 percentage points difference [95% CI, 6.8-28.2]; <i>p</i> = 0.0082). Accuracy was prioritized across all specialties (median rank 1.0 [interquartile range; IQR, 1.0-2.0]). Of the respondents, 287 physicians (94%) requested additional training. Key learning priorities were clinical applications (206 [71.9%]) and risk management (181 [63.1%]). Despite widespread personal use, only 8 physicians (2.6%) recommended LLMs to patients. Notable specialty and demographic variations emerged, with younger physicians showing higher enthusiasm but also elevated legal concerns.This survey study provides insights into physicians' current usage patterns and perspectives on LLMs. Liability concerns appear to be lessened in settings with institutional LLM access. The findings suggest opportunities for medical centers to consider when developing LLM-related policies and educational programs.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1738-1748"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12618148/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145410692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-06-02DOI: 10.1055/a-2624-5482
Ellen A Ahlness, Deborah R Levy
Health professionals (HPs) trainee burnout is hard to capture. A lack of rigorous review and systematic methodological consideration hinders the development of qualitative methodological tools that can elicit rich and trustworthy qualitative data on HPs trainee burnout.This study aimed to report the process, results, and lessons learned while developing and pilot testing a qualitative tool to assess HPs' trainee experiences of burnout to complement quantitative tools.We developed a set of semistructured interview questions (n = 3) probing into HP trainee burnout and refined them through a Modified Delphi process. We, then, planned pilot testing of the qualitative tool in initial interviews with HP trainees.We developed a three-question set of semistructured interview questions to probe burnout for HP trainees, which were refined using a Modified Delphi approach (n = 10 subject matter experts). We conducted pilot testing (n = 43 interviews with n = 14 trainees). We developed a novel qualitative tool to assess HPs trainee experiences of burnout, consisting of three core questions and three follow-up probes that elicit data on key dimensions of HPs trainee burnout for integration into a structured or semistructured interview guide.We present results as lessons learned, which can support the further development of tools to articulate HPs' trainee perspectives in studying burnout, especially during health system transitions. Developing qualitative measurement tools designed to be used with well-validated, established quantitative tools may be a complex process, but it is critical in efforts to mitigate HP trainee burnout.
{"title":"Examining Health Professional Trainee Burnout: Lessons Learned Using Qualitative Inquiry to Elicit Rich Data.","authors":"Ellen A Ahlness, Deborah R Levy","doi":"10.1055/a-2624-5482","DOIUrl":"10.1055/a-2624-5482","url":null,"abstract":"<p><p>Health professionals (HPs) trainee burnout is hard to capture. A lack of rigorous review and systematic methodological consideration hinders the development of qualitative methodological tools that can elicit rich and trustworthy qualitative data on HPs trainee burnout.This study aimed to report the process, results, and lessons learned while developing and pilot testing a qualitative tool to assess HPs' trainee experiences of burnout to complement quantitative tools.We developed a set of semistructured interview questions (<i>n</i> = 3) probing into HP trainee burnout and refined them through a Modified Delphi process. We, then, planned pilot testing of the qualitative tool in initial interviews with HP trainees.We developed a three-question set of semistructured interview questions to probe burnout for HP trainees, which were refined using a Modified Delphi approach (<i>n</i> = 10 subject matter experts). We conducted pilot testing (<i>n</i> = 43 interviews with <i>n</i> = 14 trainees). We developed a novel qualitative tool to assess HPs trainee experiences of burnout, consisting of three core questions and three follow-up probes that elicit data on key dimensions of HPs trainee burnout for integration into a structured or semistructured interview guide.We present results as lessons learned, which can support the further development of tools to articulate HPs' trainee perspectives in studying burnout, especially during health system transitions. Developing qualitative measurement tools designed to be used with well-validated, established quantitative tools may be a complex process, but it is critical in efforts to mitigate HP trainee burnout.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1568-1577"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12578574/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-10-01Epub Date: 2025-10-28DOI: 10.1055/a-2706-3092
Thomas S Ledger, Sharifa Yeung, Yuen Su, Melissa T Baysari
There is limited literature on prefilled order sentences, a form of prescription prefilled with dosage, route, and frequency information, and none on their effect in a targeted setting for community-acquired pneumonia, for which reported compliance is poor.Prefilled orders incorporated within computerized provider order entry systems (CPOE) may facilitate compliance guidelines by acting as a form of clinical decision support (CDS), providing a default choice for prescribers. We aim to assess the effect of prefilled order sentences on guideline-compliant prescribing.Prospective observational study featuring introduction of prefilled order sentences relating to community-acquired pneumonia. To assess guideline compliance based on the CURB-65 score, a scoring tool was used to assess the severity of community-acquired pneumonia. A study period of 6 months was chosen based on a sample size of 164 records with power of 80% to detect a 20% change in admissions that had guideline-compliant prescribing.The intervention was implemented on February 28, 2023, and data were extracted 6 months before and 6 months after. A total of 11,682 prescriptions were identified before the intervention, and 14,726 after the intervention. After screening and review, this corresponded to 75 and 53 eligible admissions before and after the intervention, which was lower than the anticipated sample size. The mean age of patients was 76.6 years old (sd. 17.3, range 24-97 years). There was a significant difference between before and after samples in the presence of confusion (17.3% before, and 37.7% after; p = 0.009). There was no significant difference in the other parameters of the CURB-65 score in the before and after patient groups. A mild CURB-65 score was reported in 35% of admissions (n = 45), a moderate score in 26% (n = 33), and a score of severe in 39% (n = 50). Less than half of all admissions (46.9%) had prescriptions that were compliant to antibiotic guidelines. Following the intervention, there was a nonsignificant decrease in overall compliance, with 50.7% of admissions having compliant prescriptions before, and 41.5% after intervention.Although unable to reach our planned sample size, the introduction of prefilled order sentences did not change guideline-compliant prescribing. This likely reflects the fact that prefilled orders do not address more systemic barriers affecting antibiotic use and compliance to guidelines.
{"title":"Prefilled Order Sentences via Free-Text Search for Community-Acquired Pneumonia: A Prospective Observational Study.","authors":"Thomas S Ledger, Sharifa Yeung, Yuen Su, Melissa T Baysari","doi":"10.1055/a-2706-3092","DOIUrl":"10.1055/a-2706-3092","url":null,"abstract":"<p><p>There is limited literature on prefilled order sentences, a form of prescription prefilled with dosage, route, and frequency information, and none on their effect in a targeted setting for community-acquired pneumonia, for which reported compliance is poor.Prefilled orders incorporated within computerized provider order entry systems (CPOE) may facilitate compliance guidelines by acting as a form of clinical decision support (CDS), providing a default choice for prescribers. We aim to assess the effect of prefilled order sentences on guideline-compliant prescribing.Prospective observational study featuring introduction of prefilled order sentences relating to community-acquired pneumonia. To assess guideline compliance based on the CURB-65 score, a scoring tool was used to assess the severity of community-acquired pneumonia. A study period of 6 months was chosen based on a sample size of 164 records with power of 80% to detect a 20% change in admissions that had guideline-compliant prescribing.The intervention was implemented on February 28, 2023, and data were extracted 6 months before and 6 months after. A total of 11,682 prescriptions were identified before the intervention, and 14,726 after the intervention. After screening and review, this corresponded to 75 and 53 eligible admissions before and after the intervention, which was lower than the anticipated sample size. The mean age of patients was 76.6 years old (sd. 17.3, range 24-97 years). There was a significant difference between before and after samples in the presence of confusion (17.3% before, and 37.7% after; <i>p</i> = 0.009). There was no significant difference in the other parameters of the CURB-65 score in the before and after patient groups. A mild CURB-65 score was reported in 35% of admissions (<i>n</i> = 45), a moderate score in 26% (<i>n</i> = 33), and a score of severe in 39% (<i>n</i> = 50). Less than half of all admissions (46.9%) had prescriptions that were compliant to antibiotic guidelines. Following the intervention, there was a nonsignificant decrease in overall compliance, with 50.7% of admissions having compliant prescriptions before, and 41.5% after intervention.Although unable to reach our planned sample size, the introduction of prefilled order sentences did not change guideline-compliant prescribing. This likely reflects the fact that prefilled orders do not address more systemic barriers affecting antibiotic use and compliance to guidelines.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1486-1492"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12566920/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145394416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}