Pub Date : 2024-08-01Epub Date: 2024-02-21DOI: 10.1055/a-2273-5278
Albert Sohn, Anne M Turner, William Speier, Gregg C Fonarow, Michael K Ong, Corey W Arnold
Background: Heart failure is a complex clinical syndrome noted on approximately one in eight death certificates in the United States. Vital to reducing complications of heart failure and preventing hospital readmissions is adherence to heart failure self-care routines. Mobile health offers promising opportunities for enhancing self-care behaviors by facilitating tracking and timely reminders.
Objectives: We sought to investigate three characteristics of heart failure patients with respect to their heart failure self-care behaviors: (1) internet use to search for heart failure information; (2) familiarity with mobile health apps and devices; and (3) perceptions of using activity trackers or smartwatches to aid in their heart failure self-care.
Methods: Forty-nine heart failure patients were asked about their internet and mobile health usage. The structured interview included questions adapted from the Health Information National Trends Survey.
Results: Over 50% of the patients had utilized the internet to search for heart failure information in the past 12 months, experience using health-related apps, and thoughts that an activity tracker or smartwatch could help them manage heart failure. Qualitative analysis of the interviews revealed six themes: trust in their physicians, alternatives to mobile health apps, lack of need for mobile health devices, financial barriers to activity tracker and smartwatch ownership, benefits of tracking and reminders, and uncertainty of their potential due to lack of knowledge.
Conclusion: Trust in their physicians was a major factor for heart failure patients who reported not searching for health information on the internet. While those who used mobile health technologies found them useful, patients who did not use them were generally unaware of or unknowledgeable about them. Considering patients' preferences for recommendations from their physicians and tendency to search for heart failure information including treatment and management options, patient-provider discussions about mobile health may improve patient knowledge and impact their usage.
{"title":"Patients with Heart Failure: Internet Use and Mobile Health Perceptions.","authors":"Albert Sohn, Anne M Turner, William Speier, Gregg C Fonarow, Michael K Ong, Corey W Arnold","doi":"10.1055/a-2273-5278","DOIUrl":"10.1055/a-2273-5278","url":null,"abstract":"<p><strong>Background: </strong> Heart failure is a complex clinical syndrome noted on approximately one in eight death certificates in the United States. Vital to reducing complications of heart failure and preventing hospital readmissions is adherence to heart failure self-care routines. Mobile health offers promising opportunities for enhancing self-care behaviors by facilitating tracking and timely reminders.</p><p><strong>Objectives: </strong> We sought to investigate three characteristics of heart failure patients with respect to their heart failure self-care behaviors: (1) internet use to search for heart failure information; (2) familiarity with mobile health apps and devices; and (3) perceptions of using activity trackers or smartwatches to aid in their heart failure self-care.</p><p><strong>Methods: </strong> Forty-nine heart failure patients were asked about their internet and mobile health usage. The structured interview included questions adapted from the Health Information National Trends Survey.</p><p><strong>Results: </strong> Over 50% of the patients had utilized the internet to search for heart failure information in the past 12 months, experience using health-related apps, and thoughts that an activity tracker or smartwatch could help them manage heart failure. Qualitative analysis of the interviews revealed six themes: trust in their physicians, alternatives to mobile health apps, lack of need for mobile health devices, financial barriers to activity tracker and smartwatch ownership, benefits of tracking and reminders, and uncertainty of their potential due to lack of knowledge.</p><p><strong>Conclusion: </strong> Trust in their physicians was a major factor for heart failure patients who reported not searching for health information on the internet. While those who used mobile health technologies found them useful, patients who did not use them were generally unaware of or unknowledgeable about them. Considering patients' preferences for recommendations from their physicians and tendency to search for heart failure information including treatment and management options, patient-provider discussions about mobile health may improve patient knowledge and impact their usage.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"709-716"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11357730/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139933747","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-01Epub Date: 2024-07-22DOI: 10.1055/a-2370-2298
Yilan Jiangliu, Hannah T Kim, Michelle Lazar, Eileen Liu, Saaz Mantri, Edwin Qiu, Megan Berube, Himani Sood, Anika S Walia, Breanne E Biondi, Andres M Mesias, Rebecca Mishuris, Pablo Buitron de la Vega
Background: The coronavirus disease 2019 pandemic accelerated the use of telehealth. However, this also exacerbated health care disparities for vulnerable populations.
Objectives: This study aimed to explore the feasibility and effectiveness of a medical student-led initiative to identify and address gaps in patient access to digital health resources in adult primary care clinics at an academic safety-net hospital.
Methods: Medical students used an online HIPAA-compliant resource directory to screen for digital needs, connect patients with resources, and track outcome metrics. Through a series of Plan-Do-Study-Act (PDSA) cycles, the program grew to offer services such as information and registration for subsidized internet and phone services via the Affordable Connectivity Program (ACP) and Lifeline, assistance setting up and utilizing MyChart (an online patient portal for access to electronic health records), orientation to telehealth applications, and connection to community-based digital literacy training.
Results: Between November 2021 and March 2023, the program received 608 assistance requests. The most successful intervention was MyChart help, resulting in 83% of those seeking assistance successfully signing up for MyChart accounts and 79% feeling comfortable navigating the portal. However, subsidized internet support, digital literacy training, and telehealth orientation had less favorable outcomes. The PDSA cycles highlighted numerous challenges such as inadequate patient outreach, time-consuming training, limited in-person support, and unequal language assistance. To overcome these barriers, the program evolved to utilize clinic space for outreach, increase flier distribution, standardize training, and enhance integration of multilingual resources.
Conclusion: This study is, to the best of our knowledge, the first time a medical student-led initiative addresses the digital divide with a multipronged approach. We outline a system that can be implemented in other outpatient settings to increase patients' digital literacy and promote health equity, while also engaging students in important aspects of nonclinical patient care.
{"title":"A Medical Student-Led Multipronged Initiative to Close the Digital Divide in Outpatient Primary Care.","authors":"Yilan Jiangliu, Hannah T Kim, Michelle Lazar, Eileen Liu, Saaz Mantri, Edwin Qiu, Megan Berube, Himani Sood, Anika S Walia, Breanne E Biondi, Andres M Mesias, Rebecca Mishuris, Pablo Buitron de la Vega","doi":"10.1055/a-2370-2298","DOIUrl":"10.1055/a-2370-2298","url":null,"abstract":"<p><strong>Background: </strong> The coronavirus disease 2019 pandemic accelerated the use of telehealth. However, this also exacerbated health care disparities for vulnerable populations.</p><p><strong>Objectives: </strong> This study aimed to explore the feasibility and effectiveness of a medical student-led initiative to identify and address gaps in patient access to digital health resources in adult primary care clinics at an academic safety-net hospital.</p><p><strong>Methods: </strong> Medical students used an online HIPAA-compliant resource directory to screen for digital needs, connect patients with resources, and track outcome metrics. Through a series of Plan-Do-Study-Act (PDSA) cycles, the program grew to offer services such as information and registration for subsidized internet and phone services via the Affordable Connectivity Program (ACP) and Lifeline, assistance setting up and utilizing MyChart (an online patient portal for access to electronic health records), orientation to telehealth applications, and connection to community-based digital literacy training.</p><p><strong>Results: </strong> Between November 2021 and March 2023, the program received 608 assistance requests. The most successful intervention was MyChart help, resulting in 83% of those seeking assistance successfully signing up for MyChart accounts and 79% feeling comfortable navigating the portal. However, subsidized internet support, digital literacy training, and telehealth orientation had less favorable outcomes. The PDSA cycles highlighted numerous challenges such as inadequate patient outreach, time-consuming training, limited in-person support, and unequal language assistance. To overcome these barriers, the program evolved to utilize clinic space for outreach, increase flier distribution, standardize training, and enhance integration of multilingual resources.</p><p><strong>Conclusion: </strong> This study is, to the best of our knowledge, the first time a medical student-led initiative addresses the digital divide with a multipronged approach. We outline a system that can be implemented in other outpatient settings to increase patients' digital literacy and promote health equity, while also engaging students in important aspects of nonclinical patient care.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"808-816"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11464158/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141749398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-01Epub Date: 2024-08-28DOI: 10.1055/s-0044-1787975
Anya G Barron, Ada M Fenick, Kaitlin R Maciejewski, Christy B Turer, Mona Sharifi
Objectives: The lack of feasible and meaningful measures of clinicians' behavior hinders efforts to assess and improve obesity management in pediatric primary care. In this study, we examined the external validity of a novel algorithm, previously validated in a single geographic region, using structured electronic health record (EHR) data to identify phenotypes of clinicians' attention to elevated body mass index (BMI) and weight-related comorbidities.
Methods: We extracted structured EHR data for 300 randomly selected 6- to 12-year-old children with elevated BMI seen for well-child visits from June 2018 to May 2019 at pediatric primary care practices affiliated with Yale. Using diagnosis codes, laboratory orders, referrals, and medications adapted from the original algorithm, we categorized encounters as having evidence of attention to BMI only, weight-related comorbidities only, or both BMI and comorbidities. We evaluated the algorithm's sensitivity and specificity for detecting any attention to BMI and/or comorbidities using chart review as the reference standard.
Results: The adapted algorithm yielded a sensitivity of 79.2% and specificity of 94.0% for identifying any attention to high BMI/comorbidities in clinical documentation. Of 86 encounters labeled as "no attention" by the algorithm, 83% had evidence of attention in free-text components of the progress note. The likelihood of classification as "any attention" by both chart review and the algorithm varied by BMI category and by clinician type (p < 0.001).
Conclusion: The electronic phenotyping algorithm had high specificity for detecting attention to high BMI and/or comorbidities in structured EHR inputs. The algorithm's performance may be improved by incorporating unstructured data from clinical notes.
{"title":"External Validation of an Electronic Phenotyping Algorithm Detecting Attention to High Body Mass Index in Pediatric Primary Care.","authors":"Anya G Barron, Ada M Fenick, Kaitlin R Maciejewski, Christy B Turer, Mona Sharifi","doi":"10.1055/s-0044-1787975","DOIUrl":"10.1055/s-0044-1787975","url":null,"abstract":"<p><strong>Objectives: </strong> The lack of feasible and meaningful measures of clinicians' behavior hinders efforts to assess and improve obesity management in pediatric primary care. In this study, we examined the external validity of a novel algorithm, previously validated in a single geographic region, using structured electronic health record (EHR) data to identify phenotypes of clinicians' attention to elevated body mass index (BMI) and weight-related comorbidities.</p><p><strong>Methods: </strong> We extracted structured EHR data for 300 randomly selected 6- to 12-year-old children with elevated BMI seen for well-child visits from June 2018 to May 2019 at pediatric primary care practices affiliated with Yale. Using diagnosis codes, laboratory orders, referrals, and medications adapted from the original algorithm, we categorized encounters as having evidence of attention to BMI only, weight-related comorbidities only, or both BMI and comorbidities. We evaluated the algorithm's sensitivity and specificity for detecting any attention to BMI and/or comorbidities using chart review as the reference standard.</p><p><strong>Results: </strong> The adapted algorithm yielded a sensitivity of 79.2% and specificity of 94.0% for identifying any attention to high BMI/comorbidities in clinical documentation. Of 86 encounters labeled as \"no attention\" by the algorithm, 83% had evidence of attention in free-text components of the progress note. The likelihood of classification as \"any attention\" by both chart review and the algorithm varied by BMI category and by clinician type (<i>p</i> < 0.001).</p><p><strong>Conclusion: </strong> The electronic phenotyping algorithm had high specificity for detecting attention to high BMI and/or comorbidities in structured EHR inputs. The algorithm's performance may be improved by incorporating unstructured data from clinical notes.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 4","pages":"700-708"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11387092/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142094006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emre Sezgin, Joseph Winstead Sirrianni, Kelly Kranz
Objective: We present a proof-of-concept digital scribe system as an Emergency Department (ED) consultation call-based clinical conversation summarization pipeline to support clinical documentation, and report its performance.
Materials and methods: We use four pre-trained large language models to establish the digital scribe system: T5-small, T5-base, PEGASUS-PubMed, and BART-Large-CNN via zero-shot and fine-tuning approaches. Our dataset includes 100 referral conversations among ED clinicians and medical records. We report the ROUGE-1, ROUGE-2, and ROUGE-L to compare model performance. In addition, we annotated transcriptions to assess the quality of generated summaries.
Results: The fine-tuned BART-Large-CNN model demonstrates greater performance in summarization tasks with the highest ROUGE scores (F1ROUGE-1=0.49, F1ROUGE-2=0.23, F1ROUGE-L=0.35) scores. In contrast, PEGASUS-PubMed lags notably (F1ROUGE-1=0.28, F1ROUGE-2=0.11, F1ROUGE-L=0.22). BART-Large-CNN's performance decreases by more than 50% with the zero-shot approach. Annotations show that BART-Large-CNN performs 71.4% recall in identifying key information and a 67.7% accuracy rate.
Discussion: The BART-Large-CNN model demonstrates a high level of understanding of clinical dialogue structure, indicated by its performance with and without fine-tuning. Despite some instances of high recall, there is variability in the model's performance, particularly in achieving consistent correctness, suggesting room for refinement. The model's recall ability varies across different information categories.
Conclusion: The study provides evidence towards the potential of AI-assisted tools in assisting clinical documentation. Future work is suggested on expanding the research scope with additional language models and hybrid approaches, and comparative analysis to measure documentation burden and human factors.
{"title":"Evaluation of a Digital Scribe: Conversation Summarization for Emergency Department Consultation Calls.","authors":"Emre Sezgin, Joseph Winstead Sirrianni, Kelly Kranz","doi":"10.1055/a-2327-4121","DOIUrl":"10.1055/a-2327-4121","url":null,"abstract":"<p><strong>Objective: </strong>We present a proof-of-concept digital scribe system as an Emergency Department (ED) consultation call-based clinical conversation summarization pipeline to support clinical documentation, and report its performance.</p><p><strong>Materials and methods: </strong>We use four pre-trained large language models to establish the digital scribe system: T5-small, T5-base, PEGASUS-PubMed, and BART-Large-CNN via zero-shot and fine-tuning approaches. Our dataset includes 100 referral conversations among ED clinicians and medical records. We report the ROUGE-1, ROUGE-2, and ROUGE-L to compare model performance. In addition, we annotated transcriptions to assess the quality of generated summaries.</p><p><strong>Results: </strong>The fine-tuned BART-Large-CNN model demonstrates greater performance in summarization tasks with the highest ROUGE scores (F1ROUGE-1=0.49, F1ROUGE-2=0.23, F1ROUGE-L=0.35) scores. In contrast, PEGASUS-PubMed lags notably (F1ROUGE-1=0.28, F1ROUGE-2=0.11, F1ROUGE-L=0.22). BART-Large-CNN's performance decreases by more than 50% with the zero-shot approach. Annotations show that BART-Large-CNN performs 71.4% recall in identifying key information and a 67.7% accuracy rate.</p><p><strong>Discussion: </strong>The BART-Large-CNN model demonstrates a high level of understanding of clinical dialogue structure, indicated by its performance with and without fine-tuning. Despite some instances of high recall, there is variability in the model's performance, particularly in achieving consistent correctness, suggesting room for refinement. The model's recall ability varies across different information categories.</p><p><strong>Conclusion: </strong>The study provides evidence towards the potential of AI-assisted tools in assisting clinical documentation. Future work is suggested on expanding the research scope with additional language models and hybrid approaches, and comparative analysis to measure documentation burden and human factors.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140946262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-06-19DOI: 10.1055/s-0044-1787008
Sandra Geisler, Kristina Oldiges, Florim Hamiti, Jens J Storp, M A Masud, Julian A Zimmermann, Stefan Kreutter, Nicole Eter, Thomas Berlage
Background: In times of omnipresent digitization and big data, telemedicine and electronic case files (ECFs) are gaining ground for networking between players in the health care sector. In the context of the SALUS study, this approach is applied in practice in the form of electronic platforms to display and process disease-relevant data of glaucoma patients.
Objectives: The SALUS ECF is designed and implemented to support data acquisition and presentation, monitoring, and outcome control for patients suffering from glaucoma in a clinical setting. Its main aim is to provide a means for out- and inpatient exchange of information between various stakeholders with an intuitive user interface in ophthalmologic care. Instrument data, anamnestic data, and diagnostic assessments need to be accessible and historic data stored for patient monitoring. Quality control of the data is ensured by a reading center.
Methods: Based on an intensive requirement analysis, we implemented the ECF as a web-based application in React with a Datomic back-end exposing REST and GraphQL APIs for data access and import. A flexible role management was developed, which addresses the various tasks of multiple stakeholders in the SALUS study. Data security is ensured by a comprehensive encryption concept. We evaluated the usability and efficiency of the ECF by measuring the durations medical doctors need to enter and work with the data.
Results: The evaluation showed that the ECF is time-saving in comparison to paper-based assessments and offers supportive monitoring and outcome control for numerical and imaging-related data. By allowing patients and physicians to access the digital ECF, data connectivity as well as patient autonomy were enhanced.
Conclusion: ECFs have a great potential to efficiently support all patients and stakeholders involved in the care of glaucoma patients. They benefit from the efficient management and view of the data tailored to their specific role.
{"title":"SALUS-A Study on Self-Tonometry for Glaucoma Patients: Design and Implementation of the Electronic Case File.","authors":"Sandra Geisler, Kristina Oldiges, Florim Hamiti, Jens J Storp, M A Masud, Julian A Zimmermann, Stefan Kreutter, Nicole Eter, Thomas Berlage","doi":"10.1055/s-0044-1787008","DOIUrl":"10.1055/s-0044-1787008","url":null,"abstract":"<p><strong>Background: </strong> In times of omnipresent digitization and big data, telemedicine and electronic case files (ECFs) are gaining ground for networking between players in the health care sector. In the context of the SALUS study, this approach is applied in practice in the form of electronic platforms to display and process disease-relevant data of glaucoma patients.</p><p><strong>Objectives: </strong> The SALUS ECF is designed and implemented to support data acquisition and presentation, monitoring, and outcome control for patients suffering from glaucoma in a clinical setting. Its main aim is to provide a means for out- and inpatient exchange of information between various stakeholders with an intuitive user interface in ophthalmologic care. Instrument data, anamnestic data, and diagnostic assessments need to be accessible and historic data stored for patient monitoring. Quality control of the data is ensured by a reading center.</p><p><strong>Methods: </strong> Based on an intensive requirement analysis, we implemented the ECF as a web-based application in React with a Datomic back-end exposing REST and GraphQL APIs for data access and import. A flexible role management was developed, which addresses the various tasks of multiple stakeholders in the SALUS study. Data security is ensured by a comprehensive encryption concept. We evaluated the usability and efficiency of the ECF by measuring the durations medical doctors need to enter and work with the data.</p><p><strong>Results: </strong> The evaluation showed that the ECF is time-saving in comparison to paper-based assessments and offers supportive monitoring and outcome control for numerical and imaging-related data. By allowing patients and physicians to access the digital ECF, data connectivity as well as patient autonomy were enhanced.</p><p><strong>Conclusion: </strong> ECFs have a great potential to efficiently support all patients and stakeholders involved in the care of glaucoma patients. They benefit from the efficient management and view of the data tailored to their specific role.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"469-478"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186700/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141428048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-07-03DOI: 10.1055/s-0044-1787647
Yiqun Jiang, Yu-Li Huang, Alexandra Watral, Renaldo C Blocker, David R Rushlow
Background: Provider burnout due to workload is a significant concern in primary care settings. Workload for primary care providers encompasses both scheduled visit care and non-visit care interactions. These interactions are highly influenced by patients' health conditions or acuity, which can be measured by the Adjusted Clinical Group (ACG) score. However, new patients typically have minimal health information beyond social determinants of health (SDOH) to determine ACG score.
Objectives: This study aims to assess new patient workload by first predicting the ACG score using SDOH, age, and gender and then using this information to estimate the number of appointments (scheduled visit care) and non-visit care interactions.
Methods: Two years of appointment data were collected for patients who had initial appointment requests in the first year and had the ACG score, appointment, and non-visit care counts in the subsequent year. State-of-art machine learning algorithms were employed to predict ACG scores and compared with current baseline estimation. Linear regression models were then used to predict appointments and non-visit care interactions, integrating demographic data, SDOH, and predicted ACG scores.
Results: The machine learning methods showed promising results in predicting ACG scores. Besides the decision tree, all other methods performed at least 9% better in accuracy than the baseline approach which had an accuracy of 78%. Incorporating SDOH and predicted ACG scores also significantly improved the prediction for both appointments and non-visit care interactions. The R2 values increased by 95.2 and 93.8%, respectively. Furthermore, age, smoking tobacco, family history, gender, usage of injection birth control, and ACG were significant factors for determining appointments. SDOH factors such as tobacco usage, physical exercise, education level, and group activities were strongly correlated with non-visit care interactions.
Conclusion: The study highlights the importance of SDOH and predicted ACG scores in predicting provider workload in primary care settings.
{"title":"Predicting Provider Workload Using Predicted Patient Risk Score and Social Determinants of Health in Primary Care Setting.","authors":"Yiqun Jiang, Yu-Li Huang, Alexandra Watral, Renaldo C Blocker, David R Rushlow","doi":"10.1055/s-0044-1787647","DOIUrl":"10.1055/s-0044-1787647","url":null,"abstract":"<p><strong>Background: </strong> Provider burnout due to workload is a significant concern in primary care settings. Workload for primary care providers encompasses both scheduled visit care and non-visit care interactions. These interactions are highly influenced by patients' health conditions or acuity, which can be measured by the Adjusted Clinical Group (ACG) score. However, new patients typically have minimal health information beyond social determinants of health (SDOH) to determine ACG score.</p><p><strong>Objectives: </strong> This study aims to assess new patient workload by first predicting the ACG score using SDOH, age, and gender and then using this information to estimate the number of appointments (scheduled visit care) and non-visit care interactions.</p><p><strong>Methods: </strong> Two years of appointment data were collected for patients who had initial appointment requests in the first year and had the ACG score, appointment, and non-visit care counts in the subsequent year. State-of-art machine learning algorithms were employed to predict ACG scores and compared with current baseline estimation. Linear regression models were then used to predict appointments and non-visit care interactions, integrating demographic data, SDOH, and predicted ACG scores.</p><p><strong>Results: </strong> The machine learning methods showed promising results in predicting ACG scores. Besides the decision tree, all other methods performed at least 9% better in accuracy than the baseline approach which had an accuracy of 78%. Incorporating SDOH and predicted ACG scores also significantly improved the prediction for both appointments and non-visit care interactions. The <i>R</i> <sup>2</sup> values increased by 95.2 and 93.8%, respectively. Furthermore, age, smoking tobacco, family history, gender, usage of injection birth control, and ACG were significant factors for determining appointments. SDOH factors such as tobacco usage, physical exercise, education level, and group activities were strongly correlated with non-visit care interactions.</p><p><strong>Conclusion: </strong> The study highlights the importance of SDOH and predicted ACG scores in predicting provider workload in primary care settings.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"511-527"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11221991/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141499394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-02-13DOI: 10.1055/a-2267-1727
Nichole K Czuber, Pamela M Garabedian, Hannah Rice, Christian J Tejeda, Patricia C Dykes, Nancy K Latham
Background: Falls in older adults are a serious public health problem that can lead to reduced quality of life or death. Patients often do not receive fall prevention guidance from primary care providers (PCPs), despite evidence that falls can be prevented. Mobile health technologies may help to address this disparity and promote evidence-based fall prevention.
Objective: Our main objective was to use human-centered design to develop a user-friendly, fall prevention exercise app using validated user requirements. The app features evidence-based behavior change strategies and exercise content to support older people initiating and adhering to a progressive fall prevention exercise program.
Methods: We organized our multistage, iterative design process into three phases: gathering user requirements, usability evaluation, and refining app features. Our methods include focus groups, usability testing, and subject-matter expert meetings.
Results: Focus groups (total n = 6), usability testing (n = 30) including a posttest questionnaire [Health-ITUES score: mean (standard deviation [SD]) = 4.2 (0.9)], and subject-matter expert meetings demonstrate participant satisfaction with the app concept and design. Overall, participants saw value in receiving exercise prescriptions from the app that would be recommended by their PCP and reported satisfaction with the content of the app.
Conclusion: This study demonstrates the development, refinement, and usability testing of a fall prevention exercise app and corresponding tools that PCPs may use to prescribe tailored exercise recommendations to their older patients as an evidence-based fall prevention strategy accessible in the context of busy clinical workflows.
{"title":"Human-Centered Design and Development of a Fall Prevention Exercise App for Older Adults in Primary Care Settings.","authors":"Nichole K Czuber, Pamela M Garabedian, Hannah Rice, Christian J Tejeda, Patricia C Dykes, Nancy K Latham","doi":"10.1055/a-2267-1727","DOIUrl":"10.1055/a-2267-1727","url":null,"abstract":"<p><strong>Background: </strong> Falls in older adults are a serious public health problem that can lead to reduced quality of life or death. Patients often do not receive fall prevention guidance from primary care providers (PCPs), despite evidence that falls can be prevented. Mobile health technologies may help to address this disparity and promote evidence-based fall prevention.</p><p><strong>Objective: </strong> Our main objective was to use human-centered design to develop a user-friendly, fall prevention exercise app using validated user requirements. The app features evidence-based behavior change strategies and exercise content to support older people initiating and adhering to a progressive fall prevention exercise program.</p><p><strong>Methods: </strong> We organized our multistage, iterative design process into three phases: gathering user requirements, usability evaluation, and refining app features. Our methods include focus groups, usability testing, and subject-matter expert meetings.</p><p><strong>Results: </strong> Focus groups (total <i>n</i> = 6), usability testing (<i>n</i> = 30) including a posttest questionnaire [Health-ITUES score: mean (standard deviation [SD]) = 4.2 (0.9)], and subject-matter expert meetings demonstrate participant satisfaction with the app concept and design. Overall, participants saw value in receiving exercise prescriptions from the app that would be recommended by their PCP and reported satisfaction with the content of the app.</p><p><strong>Conclusion: </strong> This study demonstrates the development, refinement, and usability testing of a fall prevention exercise app and corresponding tools that PCPs may use to prescribe tailored exercise recommendations to their older patients as an evidence-based fall prevention strategy accessible in the context of busy clinical workflows.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"544-555"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11236445/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139730802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-05-03DOI: 10.1055/a-2319-0598
Matthew T Cerasale, Ali Mansour, Ethan Molitch-Hou, Sean Bernstein, Tokhanh Nguyen, Cheng-Kai Kao
Background: Clinical documentation improvement programs are utilized by most health care systems to enhance provider documentation. Suggestions are sent to providers in a variety of ways, and are commonly referred to as coding queries. Responding to these coding queries can require significant provider time and do not often align with workflows. To enhance provider documentation in a more consistent manner without creating undue burden, alternative strategies are required.
Objectives: The aim of this study is to evaluate the impact of a real-time documentation assistance tool, named AutoDx, on the volume of coding queries and encounter-level outcome metrics, including case-mix index (CMI).
Methods: The AutoDx tool was developed utilizing tools existing within the electronic health record, and is based on the generation of messages when clinical conditions are met. These messages appear within provider notes and required little to no interaction. Initial diagnoses included in the tool were electrolyte deficiencies, obesity, and malnutrition. The tool was piloted in a cohort of Hospital Medicine providers, then expanded to the Neuro Intensive Care Unit (NICU), with addition diagnoses being added.
Results: The initial Hospital Medicine implementation evaluation included 590 encounters pre- and 531 post-implementation. The volume of coding queries decreased 57% (p < 0.0001) for the targeted diagnoses compared with 6% (p = 0.77) in other high-volume diagnoses. In the NICU cohort, 829 encounters pre-implementation were compared with 680 post. The proportion of AutoDx coding queries compared with all other coding queries decreased from 54.9 to 37.1% (p < 0.0001). During the same period, CMI demonstrated a significant increase post-implementation (4.00 vs. 4.55, p = 0.02).
Conclusion: The real-time documentation assistance tool led to a significant decrease in coding queries for targeted diagnoses in two unique provider cohorts. This improvement was also associated with a significant increase in CMI during the implementation time period.
{"title":"Implementation of a Real-Time Documentation Assistance Tool: Automated Diagnosis (AutoDx).","authors":"Matthew T Cerasale, Ali Mansour, Ethan Molitch-Hou, Sean Bernstein, Tokhanh Nguyen, Cheng-Kai Kao","doi":"10.1055/a-2319-0598","DOIUrl":"10.1055/a-2319-0598","url":null,"abstract":"<p><strong>Background: </strong> Clinical documentation improvement programs are utilized by most health care systems to enhance provider documentation. Suggestions are sent to providers in a variety of ways, and are commonly referred to as coding queries. Responding to these coding queries can require significant provider time and do not often align with workflows. To enhance provider documentation in a more consistent manner without creating undue burden, alternative strategies are required.</p><p><strong>Objectives: </strong> The aim of this study is to evaluate the impact of a real-time documentation assistance tool, named AutoDx, on the volume of coding queries and encounter-level outcome metrics, including case-mix index (CMI).</p><p><strong>Methods: </strong> The AutoDx tool was developed utilizing tools existing within the electronic health record, and is based on the generation of messages when clinical conditions are met. These messages appear within provider notes and required little to no interaction. Initial diagnoses included in the tool were electrolyte deficiencies, obesity, and malnutrition. The tool was piloted in a cohort of Hospital Medicine providers, then expanded to the Neuro Intensive Care Unit (NICU), with addition diagnoses being added.</p><p><strong>Results: </strong> The initial Hospital Medicine implementation evaluation included 590 encounters pre- and 531 post-implementation. The volume of coding queries decreased 57% (<i>p</i> < 0.0001) for the targeted diagnoses compared with 6% (<i>p</i> = 0.77) in other high-volume diagnoses. In the NICU cohort, 829 encounters pre-implementation were compared with 680 post. The proportion of AutoDx coding queries compared with all other coding queries decreased from 54.9 to 37.1% (<i>p</i> < 0.0001). During the same period, CMI demonstrated a significant increase post-implementation (4.00 vs. 4.55, <i>p</i> = 0.02).</p><p><strong>Conclusion: </strong> The real-time documentation assistance tool led to a significant decrease in coding queries for targeted diagnoses in two unique provider cohorts. This improvement was also associated with a significant increase in CMI during the implementation time period.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"501-510"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11208109/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140860521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-06-19DOI: 10.1055/s-0044-1787119
Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu
Background: Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.
Objectives: Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.
Methods: Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.
Results: The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.
Conclusion: This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.
{"title":"A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.","authors":"Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu","doi":"10.1055/s-0044-1787119","DOIUrl":"10.1055/s-0044-1787119","url":null,"abstract":"<p><strong>Background: </strong> Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.</p><p><strong>Objectives: </strong> Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.</p><p><strong>Methods: </strong> Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.</p><p><strong>Results: </strong> The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.</p><p><strong>Conclusion: </strong> This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"479-488"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186699/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141428047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-01Epub Date: 2024-07-24DOI: 10.1055/s-0044-1787756
Laura R Baratta, Daphne Lew, Thomas Kannampallil, Sunny S Lou
Objectives: Electronic health record (EHR)-integrated secure messaging is extensively used for communication between clinicians. We investigated the factors contributing to secure messaging use in a large health care system.
Methods: This was a cross-sectional study that included 14 hospitals and 263 outpatient clinic locations. Data on EHR-integrated secure messaging use over a 1-month period (February 1, 2023, through February 28, 2023) were collected. A multilevel mixed effects model was used to assess the contribution of clinical role, clinical unit (i.e., specific inpatient ward or outpatient clinic), hospital or clinic location (i.e., Hospital X or Outpatient Clinic Building Y), and inpatient versus outpatient setting toward secure messaging use.
Results: Of the 33,195 health care professionals who worked during the study period, 20,576 (62%) were secure messaging users. In total, 25.3% of the variability in messaging use was attributable to the clinical unit and 30.5% was attributable to the hospital or clinic location. Compared with nurses, advanced practice providers, pharmacists, and physicians were more likely to use secure messaging, whereas medical assistants, social workers, and therapists were less likely (p < 0.001). After adjusting for other factors, inpatient versus outpatient setting was not associated with secure messaging use.
Conclusion: Secure messaging was widely used; however, there was substantial variation by clinical role, clinical unit, and hospital or clinic location. Our results suggest that interventions and policies for managing secure messaging behaviors are likely to be most effective if they are not only set at the organizational level but also communicated and tailored toward individual clinical units and clinician workflows.
{"title":"Contributors to Electronic Health Record-Integrated Secure Messaging Use: A Study of Over 33,000 Health Care Professionals.","authors":"Laura R Baratta, Daphne Lew, Thomas Kannampallil, Sunny S Lou","doi":"10.1055/s-0044-1787756","DOIUrl":"10.1055/s-0044-1787756","url":null,"abstract":"<p><strong>Objectives: </strong> Electronic health record (EHR)-integrated secure messaging is extensively used for communication between clinicians. We investigated the factors contributing to secure messaging use in a large health care system.</p><p><strong>Methods: </strong> This was a cross-sectional study that included 14 hospitals and 263 outpatient clinic locations. Data on EHR-integrated secure messaging use over a 1-month period (February 1, 2023, through February 28, 2023) were collected. A multilevel mixed effects model was used to assess the contribution of clinical role, clinical unit (i.e., specific inpatient ward or outpatient clinic), hospital or clinic location (i.e., Hospital X or Outpatient Clinic Building Y), and inpatient versus outpatient setting toward secure messaging use.</p><p><strong>Results: </strong> Of the 33,195 health care professionals who worked during the study period, 20,576 (62%) were secure messaging users. In total, 25.3% of the variability in messaging use was attributable to the clinical unit and 30.5% was attributable to the hospital or clinic location. Compared with nurses, advanced practice providers, pharmacists, and physicians were more likely to use secure messaging, whereas medical assistants, social workers, and therapists were less likely (<i>p</i> < 0.001). After adjusting for other factors, inpatient versus outpatient setting was not associated with secure messaging use.</p><p><strong>Conclusion: </strong> Secure messaging was widely used; however, there was substantial variation by clinical role, clinical unit, and hospital or clinic location. Our results suggest that interventions and policies for managing secure messaging behaviors are likely to be most effective if they are not only set at the organizational level but also communicated and tailored toward individual clinical units and clinician workflows.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"612-619"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268985/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}