首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
Patients with Heart Failure: Internet Use and Mobile Health Perceptions. 心力衰竭患者:互联网使用和移动医疗认知。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-08-01 Epub Date: 2024-02-21 DOI: 10.1055/a-2273-5278
Albert Sohn, Anne M Turner, William Speier, Gregg C Fonarow, Michael K Ong, Corey W Arnold

Background:  Heart failure is a complex clinical syndrome noted on approximately one in eight death certificates in the United States. Vital to reducing complications of heart failure and preventing hospital readmissions is adherence to heart failure self-care routines. Mobile health offers promising opportunities for enhancing self-care behaviors by facilitating tracking and timely reminders.

Objectives:  We sought to investigate three characteristics of heart failure patients with respect to their heart failure self-care behaviors: (1) internet use to search for heart failure information; (2) familiarity with mobile health apps and devices; and (3) perceptions of using activity trackers or smartwatches to aid in their heart failure self-care.

Methods:  Forty-nine heart failure patients were asked about their internet and mobile health usage. The structured interview included questions adapted from the Health Information National Trends Survey.

Results:  Over 50% of the patients had utilized the internet to search for heart failure information in the past 12 months, experience using health-related apps, and thoughts that an activity tracker or smartwatch could help them manage heart failure. Qualitative analysis of the interviews revealed six themes: trust in their physicians, alternatives to mobile health apps, lack of need for mobile health devices, financial barriers to activity tracker and smartwatch ownership, benefits of tracking and reminders, and uncertainty of their potential due to lack of knowledge.

Conclusion:  Trust in their physicians was a major factor for heart failure patients who reported not searching for health information on the internet. While those who used mobile health technologies found them useful, patients who did not use them were generally unaware of or unknowledgeable about them. Considering patients' preferences for recommendations from their physicians and tendency to search for heart failure information including treatment and management options, patient-provider discussions about mobile health may improve patient knowledge and impact their usage.

背景:心力衰竭是一种复杂的临床综合征,在美国大约每 8 份死亡证明中就有 1 份涉及心力衰竭。要减少心力衰竭的并发症并防止再次入院,关键在于坚持心力衰竭的自我护理常规。移动医疗通过促进跟踪和及时提醒,为加强自我护理行为提供了大有可为的机会:我们试图调查心力衰竭患者在心力衰竭自我护理行为方面的三个特征:(1)使用互联网搜索心力衰竭信息;(2)对移动医疗应用程序和设备的熟悉程度;以及(3)对使用活动追踪器或智能手表辅助心力衰竭自我护理的看法:对 49 名心力衰竭患者进行了互联网和移动医疗使用情况的调查。结构化访谈包括从全国健康信息趋势调查中改编的问题:结果:50% 以上的患者在过去 12 个月中使用过互联网搜索心衰信息,有使用健康相关应用程序的经验,并认为活动追踪器或智能手表可以帮助他们管理心衰。对访谈的定性分析揭示了六个主题:对医生的信任、移动健康应用程序的替代品、不需要移动健康设备、拥有活动追踪器和智能手表的经济障碍、追踪和提醒的好处以及由于缺乏知识而对其潜力的不确定性:结论:对于不在互联网上搜索健康信息的心衰患者来说,对医生的信任是一个主要因素。使用移动医疗技术的患者认为这些技术很有用,而不使用这些技术的患者则普遍不了解或不了解这些技术。考虑到患者偏好医生的建议以及搜索包括治疗和管理方案在内的心力衰竭信息的倾向,患者与医护人员就移动医疗进行讨论可能会提高患者对移动医疗的了解并影响其使用。
{"title":"Patients with Heart Failure: Internet Use and Mobile Health Perceptions.","authors":"Albert Sohn, Anne M Turner, William Speier, Gregg C Fonarow, Michael K Ong, Corey W Arnold","doi":"10.1055/a-2273-5278","DOIUrl":"10.1055/a-2273-5278","url":null,"abstract":"<p><strong>Background: </strong> Heart failure is a complex clinical syndrome noted on approximately one in eight death certificates in the United States. Vital to reducing complications of heart failure and preventing hospital readmissions is adherence to heart failure self-care routines. Mobile health offers promising opportunities for enhancing self-care behaviors by facilitating tracking and timely reminders.</p><p><strong>Objectives: </strong> We sought to investigate three characteristics of heart failure patients with respect to their heart failure self-care behaviors: (1) internet use to search for heart failure information; (2) familiarity with mobile health apps and devices; and (3) perceptions of using activity trackers or smartwatches to aid in their heart failure self-care.</p><p><strong>Methods: </strong> Forty-nine heart failure patients were asked about their internet and mobile health usage. The structured interview included questions adapted from the Health Information National Trends Survey.</p><p><strong>Results: </strong> Over 50% of the patients had utilized the internet to search for heart failure information in the past 12 months, experience using health-related apps, and thoughts that an activity tracker or smartwatch could help them manage heart failure. Qualitative analysis of the interviews revealed six themes: trust in their physicians, alternatives to mobile health apps, lack of need for mobile health devices, financial barriers to activity tracker and smartwatch ownership, benefits of tracking and reminders, and uncertainty of their potential due to lack of knowledge.</p><p><strong>Conclusion: </strong> Trust in their physicians was a major factor for heart failure patients who reported not searching for health information on the internet. While those who used mobile health technologies found them useful, patients who did not use them were generally unaware of or unknowledgeable about them. Considering patients' preferences for recommendations from their physicians and tendency to search for heart failure information including treatment and management options, patient-provider discussions about mobile health may improve patient knowledge and impact their usage.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"709-716"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11357730/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139933747","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Medical Student-Led Multipronged Initiative to Close the Digital Divide in Outpatient Primary Care. 医科学生领导的多管齐下消除门诊初级保健数字鸿沟计划。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-08-01 Epub Date: 2024-07-22 DOI: 10.1055/a-2370-2298
Yilan Jiangliu, Hannah T Kim, Michelle Lazar, Eileen Liu, Saaz Mantri, Edwin Qiu, Megan Berube, Himani Sood, Anika S Walia, Breanne E Biondi, Andres M Mesias, Rebecca Mishuris, Pablo Buitron de la Vega

Background:  The coronavirus disease 2019 pandemic accelerated the use of telehealth. However, this also exacerbated health care disparities for vulnerable populations.

Objectives:  This study aimed to explore the feasibility and effectiveness of a medical student-led initiative to identify and address gaps in patient access to digital health resources in adult primary care clinics at an academic safety-net hospital.

Methods:  Medical students used an online HIPAA-compliant resource directory to screen for digital needs, connect patients with resources, and track outcome metrics. Through a series of Plan-Do-Study-Act (PDSA) cycles, the program grew to offer services such as information and registration for subsidized internet and phone services via the Affordable Connectivity Program (ACP) and Lifeline, assistance setting up and utilizing MyChart (an online patient portal for access to electronic health records), orientation to telehealth applications, and connection to community-based digital literacy training.

Results:  Between November 2021 and March 2023, the program received 608 assistance requests. The most successful intervention was MyChart help, resulting in 83% of those seeking assistance successfully signing up for MyChart accounts and 79% feeling comfortable navigating the portal. However, subsidized internet support, digital literacy training, and telehealth orientation had less favorable outcomes. The PDSA cycles highlighted numerous challenges such as inadequate patient outreach, time-consuming training, limited in-person support, and unequal language assistance. To overcome these barriers, the program evolved to utilize clinic space for outreach, increase flier distribution, standardize training, and enhance integration of multilingual resources.

Conclusion:  This study is, to the best of our knowledge, the first time a medical student-led initiative addresses the digital divide with a multipronged approach. We outline a system that can be implemented in other outpatient settings to increase patients' digital literacy and promote health equity, while also engaging students in important aspects of nonclinical patient care.

背景:COVID-19 大流行加速了远程医疗的使用。然而,这也加剧了弱势群体的医疗差距:目的:探讨由医科学生主导的一项倡议的可行性和有效性,该倡议旨在确定并解决安全网学术中心成人初级保健诊所中患者在获取数字医疗资源方面存在的差距:方法:医学生使用符合 HIPAA 标准的在线资源目录来筛选数字需求、为患者提供资源并跟踪结果指标。通过一系列 "计划-实施-研究-行动"(PDSA)循环,该计划逐渐发展为提供各种服务,如通过 "可负担连接计划"(ACP)和 "生命线"(Lifeline)获得互联网和电话补贴服务的信息和注册、协助设置和使用 "我的图表"(MyChart,用于访问电子健康记录的在线患者门户网站)、远程医疗应用指导,以及与基于社区的数字扫盲培训建立联系:2021 年 11 月至 2023 年 3 月期间,该计划共收到 608 份援助请求。最成功的干预措施是 MyChart 帮助,83% 的求助者成功注册了 MyChart 账户,79% 的求助者在浏览门户网站时感到得心应手。然而,补贴互联网支持、数字扫盲培训和远程医疗指导的结果却不尽如人意。PDSA 循环凸显了诸多挑战,如患者外联不足、培训耗时、现场支持有限以及语言协助不平等。为了克服这些障碍,该计划不断发展,利用诊所空间开展外联活动,增加传单发放,实现培训标准化,并加强多语言资源的整合:据我们所知,这项研究是首次由医科学生牵头,通过多管齐下的方法解决数字鸿沟问题。我们概述了一个可在其他门诊环境中实施的系统,以提高患者的数字素养,促进健康公平,同时也让学生参与到非临床患者护理的重要环节中。
{"title":"A Medical Student-Led Multipronged Initiative to Close the Digital Divide in Outpatient Primary Care.","authors":"Yilan Jiangliu, Hannah T Kim, Michelle Lazar, Eileen Liu, Saaz Mantri, Edwin Qiu, Megan Berube, Himani Sood, Anika S Walia, Breanne E Biondi, Andres M Mesias, Rebecca Mishuris, Pablo Buitron de la Vega","doi":"10.1055/a-2370-2298","DOIUrl":"10.1055/a-2370-2298","url":null,"abstract":"<p><strong>Background: </strong> The coronavirus disease 2019 pandemic accelerated the use of telehealth. However, this also exacerbated health care disparities for vulnerable populations.</p><p><strong>Objectives: </strong> This study aimed to explore the feasibility and effectiveness of a medical student-led initiative to identify and address gaps in patient access to digital health resources in adult primary care clinics at an academic safety-net hospital.</p><p><strong>Methods: </strong> Medical students used an online HIPAA-compliant resource directory to screen for digital needs, connect patients with resources, and track outcome metrics. Through a series of Plan-Do-Study-Act (PDSA) cycles, the program grew to offer services such as information and registration for subsidized internet and phone services via the Affordable Connectivity Program (ACP) and Lifeline, assistance setting up and utilizing MyChart (an online patient portal for access to electronic health records), orientation to telehealth applications, and connection to community-based digital literacy training.</p><p><strong>Results: </strong> Between November 2021 and March 2023, the program received 608 assistance requests. The most successful intervention was MyChart help, resulting in 83% of those seeking assistance successfully signing up for MyChart accounts and 79% feeling comfortable navigating the portal. However, subsidized internet support, digital literacy training, and telehealth orientation had less favorable outcomes. The PDSA cycles highlighted numerous challenges such as inadequate patient outreach, time-consuming training, limited in-person support, and unequal language assistance. To overcome these barriers, the program evolved to utilize clinic space for outreach, increase flier distribution, standardize training, and enhance integration of multilingual resources.</p><p><strong>Conclusion: </strong> This study is, to the best of our knowledge, the first time a medical student-led initiative addresses the digital divide with a multipronged approach. We outline a system that can be implemented in other outpatient settings to increase patients' digital literacy and promote health equity, while also engaging students in important aspects of nonclinical patient care.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"808-816"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11464158/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141749398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
External Validation of an Electronic Phenotyping Algorithm Detecting Attention to High Body Mass Index in Pediatric Primary Care. 儿科初级保健中检测高体重指数关注度的电子表型算法的外部验证。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-08-01 Epub Date: 2024-08-28 DOI: 10.1055/s-0044-1787975
Anya G Barron, Ada M Fenick, Kaitlin R Maciejewski, Christy B Turer, Mona Sharifi

Objectives:  The lack of feasible and meaningful measures of clinicians' behavior hinders efforts to assess and improve obesity management in pediatric primary care. In this study, we examined the external validity of a novel algorithm, previously validated in a single geographic region, using structured electronic health record (EHR) data to identify phenotypes of clinicians' attention to elevated body mass index (BMI) and weight-related comorbidities.

Methods:  We extracted structured EHR data for 300 randomly selected 6- to 12-year-old children with elevated BMI seen for well-child visits from June 2018 to May 2019 at pediatric primary care practices affiliated with Yale. Using diagnosis codes, laboratory orders, referrals, and medications adapted from the original algorithm, we categorized encounters as having evidence of attention to BMI only, weight-related comorbidities only, or both BMI and comorbidities. We evaluated the algorithm's sensitivity and specificity for detecting any attention to BMI and/or comorbidities using chart review as the reference standard.

Results:  The adapted algorithm yielded a sensitivity of 79.2% and specificity of 94.0% for identifying any attention to high BMI/comorbidities in clinical documentation. Of 86 encounters labeled as "no attention" by the algorithm, 83% had evidence of attention in free-text components of the progress note. The likelihood of classification as "any attention" by both chart review and the algorithm varied by BMI category and by clinician type (p < 0.001).

Conclusion:  The electronic phenotyping algorithm had high specificity for detecting attention to high BMI and/or comorbidities in structured EHR inputs. The algorithm's performance may be improved by incorporating unstructured data from clinical notes.

目的:由于缺乏可行且有意义的临床医生行为衡量标准,评估和改善儿科初级保健中肥胖管理的工作受到了阻碍。在本研究中,我们利用结构化电子健康记录(EHR)数据,对一种新算法的外部有效性进行了检验,该算法之前在一个单一的地理区域进行过验证,用于识别临床医生关注体重指数(BMI)升高和体重相关合并症的表型:我们提取了 2018 年 6 月至 2019 年 5 月期间在耶鲁大学附属儿科初级保健诊所就诊的 300 名随机抽取的 6 至 12 岁 BMI 升高儿童的结构化电子病历数据。我们使用从原始算法改编而来的诊断代码、化验单、转诊单和药物,将就诊情况分为仅有关注 BMI 的证据、仅有关注体重相关合并症的证据或同时关注 BMI 和合并症的证据。我们以病历审查作为参考标准,评估了该算法在检测是否关注体重指数和/或合并症方面的灵敏度和特异性:调整后的算法在识别临床文件中是否关注高体重指数/合并症方面的灵敏度为 79.2%,特异度为 94.0%。在被该算法标记为 "未关注 "的 86 个病例中,83% 的病例在病程记录的自由文本部分有关注的证据。根据 BMI 类别和临床医生类型的不同,病历审查和算法将其归类为 "任何关注 "的可能性也不同(P 结语):电子表型算法在检测结构化电子病历输入中对高体重指数和/或合并症的关注方面具有很高的特异性。该算法的性能可通过纳入临床笔记中的非结构化数据得到改善。
{"title":"External Validation of an Electronic Phenotyping Algorithm Detecting Attention to High Body Mass Index in Pediatric Primary Care.","authors":"Anya G Barron, Ada M Fenick, Kaitlin R Maciejewski, Christy B Turer, Mona Sharifi","doi":"10.1055/s-0044-1787975","DOIUrl":"10.1055/s-0044-1787975","url":null,"abstract":"<p><strong>Objectives: </strong> The lack of feasible and meaningful measures of clinicians' behavior hinders efforts to assess and improve obesity management in pediatric primary care. In this study, we examined the external validity of a novel algorithm, previously validated in a single geographic region, using structured electronic health record (EHR) data to identify phenotypes of clinicians' attention to elevated body mass index (BMI) and weight-related comorbidities.</p><p><strong>Methods: </strong> We extracted structured EHR data for 300 randomly selected 6- to 12-year-old children with elevated BMI seen for well-child visits from June 2018 to May 2019 at pediatric primary care practices affiliated with Yale. Using diagnosis codes, laboratory orders, referrals, and medications adapted from the original algorithm, we categorized encounters as having evidence of attention to BMI only, weight-related comorbidities only, or both BMI and comorbidities. We evaluated the algorithm's sensitivity and specificity for detecting any attention to BMI and/or comorbidities using chart review as the reference standard.</p><p><strong>Results: </strong> The adapted algorithm yielded a sensitivity of 79.2% and specificity of 94.0% for identifying any attention to high BMI/comorbidities in clinical documentation. Of 86 encounters labeled as \"no attention\" by the algorithm, 83% had evidence of attention in free-text components of the progress note. The likelihood of classification as \"any attention\" by both chart review and the algorithm varied by BMI category and by clinician type (<i>p</i> < 0.001).</p><p><strong>Conclusion: </strong> The electronic phenotyping algorithm had high specificity for detecting attention to high BMI and/or comorbidities in structured EHR inputs. The algorithm's performance may be improved by incorporating unstructured data from clinical notes.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 4","pages":"700-708"},"PeriodicalIF":2.1,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11387092/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142094006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of a Digital Scribe: Conversation Summarization for Emergency Department Consultation Calls. 数字抄写员评估:急诊科咨询电话的对话总结。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-15 DOI: 10.1055/a-2327-4121
Emre Sezgin, Joseph Winstead Sirrianni, Kelly Kranz

Objective: We present a proof-of-concept digital scribe system as an Emergency Department (ED) consultation call-based clinical conversation summarization pipeline to support clinical documentation, and report its performance.

Materials and methods: We use four pre-trained large language models to establish the digital scribe system: T5-small, T5-base, PEGASUS-PubMed, and BART-Large-CNN via zero-shot and fine-tuning approaches. Our dataset includes 100 referral conversations among ED clinicians and medical records. We report the ROUGE-1, ROUGE-2, and ROUGE-L to compare model performance. In addition, we annotated transcriptions to assess the quality of generated summaries.

Results: The fine-tuned BART-Large-CNN model demonstrates greater performance in summarization tasks with the highest ROUGE scores (F1ROUGE-1=0.49, F1ROUGE-2=0.23, F1ROUGE-L=0.35) scores. In contrast, PEGASUS-PubMed lags notably (F1ROUGE-1=0.28, F1ROUGE-2=0.11, F1ROUGE-L=0.22). BART-Large-CNN's performance decreases by more than 50% with the zero-shot approach. Annotations show that BART-Large-CNN performs 71.4% recall in identifying key information and a 67.7% accuracy rate.

Discussion: The BART-Large-CNN model demonstrates a high level of understanding of clinical dialogue structure, indicated by its performance with and without fine-tuning. Despite some instances of high recall, there is variability in the model's performance, particularly in achieving consistent correctness, suggesting room for refinement. The model's recall ability varies across different information categories.

Conclusion: The study provides evidence towards the potential of AI-assisted tools in assisting clinical documentation. Future work is suggested on expanding the research scope with additional language models and hybrid approaches, and comparative analysis to measure documentation burden and human factors.

目的:我们提出了一个概念验证数字抄写员系统,作为急诊科(ED)会诊呼叫的临床对话总结管道,为临床文档提供支持:我们提出了一个概念验证数字抄写员系统,作为急诊科(ED)会诊呼叫的临床对话总结管道,以支持临床文档,并报告其性能:我们使用四种预先训练好的大型语言模型来建立数字抄写员系统:我们使用四种预先训练好的大型语言模型来建立数字抄写员系统:T5-small、T5-base、PEGASUS-PubMed 和 BART-Large-CNN。我们的数据集包括 100 个急诊室临床医生之间的转诊对话和医疗记录。我们报告了 ROUGE-1、ROUGE-2 和 ROUGE-L,以比较模型性能。此外,我们还对转录内容进行了注释,以评估生成摘要的质量:结果:经过微调的 BART-Large-CNN 模型在摘要任务中表现出更高的性能,其 ROUGE 分数最高(F1ROUGE-1=0.49,F1ROUGE-2=0.23,F1ROUGE-L=0.35)。相比之下,PEGASUS-PubMed 则明显落后(F1ROUGE-1=0.28,F1ROUGE-2=0.11,F1ROUGE-L=0.22)。采用零镜头方法后,BART-Large-CNN 的性能下降了 50% 以上。注释显示,BART-Large-CNN 在识别关键信息方面的召回率为 71.4%,准确率为 67.7%:BART-Large-CNN 模型在微调和不微调的情况下都表现出了对临床对话结构的高度理解。尽管存在召回率高的情况,但该模型的性能仍存在差异,特别是在实现一致的正确性方面,这表明该模型仍有改进的余地。该模型在不同信息类别中的召回能力也各不相同:本研究证明了人工智能辅助工具在协助临床记录方面的潜力。建议在未来的工作中扩大研究范围,采用更多的语言模型和混合方法,并进行比较分析,以衡量文档编制负担和人为因素。
{"title":"Evaluation of a Digital Scribe: Conversation Summarization for Emergency Department Consultation Calls.","authors":"Emre Sezgin, Joseph Winstead Sirrianni, Kelly Kranz","doi":"10.1055/a-2327-4121","DOIUrl":"10.1055/a-2327-4121","url":null,"abstract":"<p><strong>Objective: </strong>We present a proof-of-concept digital scribe system as an Emergency Department (ED) consultation call-based clinical conversation summarization pipeline to support clinical documentation, and report its performance.</p><p><strong>Materials and methods: </strong>We use four pre-trained large language models to establish the digital scribe system: T5-small, T5-base, PEGASUS-PubMed, and BART-Large-CNN via zero-shot and fine-tuning approaches. Our dataset includes 100 referral conversations among ED clinicians and medical records. We report the ROUGE-1, ROUGE-2, and ROUGE-L to compare model performance. In addition, we annotated transcriptions to assess the quality of generated summaries.</p><p><strong>Results: </strong>The fine-tuned BART-Large-CNN model demonstrates greater performance in summarization tasks with the highest ROUGE scores (F1ROUGE-1=0.49, F1ROUGE-2=0.23, F1ROUGE-L=0.35) scores. In contrast, PEGASUS-PubMed lags notably (F1ROUGE-1=0.28, F1ROUGE-2=0.11, F1ROUGE-L=0.22). BART-Large-CNN's performance decreases by more than 50% with the zero-shot approach. Annotations show that BART-Large-CNN performs 71.4% recall in identifying key information and a 67.7% accuracy rate.</p><p><strong>Discussion: </strong>The BART-Large-CNN model demonstrates a high level of understanding of clinical dialogue structure, indicated by its performance with and without fine-tuning. Despite some instances of high recall, there is variability in the model's performance, particularly in achieving consistent correctness, suggesting room for refinement. The model's recall ability varies across different information categories.</p><p><strong>Conclusion: </strong>The study provides evidence towards the potential of AI-assisted tools in assisting clinical documentation. Future work is suggested on expanding the research scope with additional language models and hybrid approaches, and comparative analysis to measure documentation burden and human factors.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140946262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SALUS-A Study on Self-Tonometry for Glaucoma Patients: Design and Implementation of the Electronic Case File. SALUS--青光眼患者自我眼压测量研究:电子病例档案的设计与实施
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-06-19 DOI: 10.1055/s-0044-1787008
Sandra Geisler, Kristina Oldiges, Florim Hamiti, Jens J Storp, M A Masud, Julian A Zimmermann, Stefan Kreutter, Nicole Eter, Thomas Berlage

Background:  In times of omnipresent digitization and big data, telemedicine and electronic case files (ECFs) are gaining ground for networking between players in the health care sector. In the context of the SALUS study, this approach is applied in practice in the form of electronic platforms to display and process disease-relevant data of glaucoma patients.

Objectives:  The SALUS ECF is designed and implemented to support data acquisition and presentation, monitoring, and outcome control for patients suffering from glaucoma in a clinical setting. Its main aim is to provide a means for out- and inpatient exchange of information between various stakeholders with an intuitive user interface in ophthalmologic care. Instrument data, anamnestic data, and diagnostic assessments need to be accessible and historic data stored for patient monitoring. Quality control of the data is ensured by a reading center.

Methods:  Based on an intensive requirement analysis, we implemented the ECF as a web-based application in React with a Datomic back-end exposing REST and GraphQL APIs for data access and import. A flexible role management was developed, which addresses the various tasks of multiple stakeholders in the SALUS study. Data security is ensured by a comprehensive encryption concept. We evaluated the usability and efficiency of the ECF by measuring the durations medical doctors need to enter and work with the data.

Results:  The evaluation showed that the ECF is time-saving in comparison to paper-based assessments and offers supportive monitoring and outcome control for numerical and imaging-related data. By allowing patients and physicians to access the digital ECF, data connectivity as well as patient autonomy were enhanced.

Conclusion:  ECFs have a great potential to efficiently support all patients and stakeholders involved in the care of glaucoma patients. They benefit from the efficient management and view of the data tailored to their specific role.

背景:在数字化和大数据无处不在的时代,远程医疗和电子病例档案(ECFs)在医疗保健领域的参与者之间的网络化进程中占据着越来越重要的地位。在 SALUS 研究中,这种方法以电子平台的形式得到了实际应用,用于显示和处理青光眼患者的疾病相关数据:SALUS ECF 的设计和实施旨在支持临床环境中青光眼患者的数据采集和展示、监测和结果控制。其主要目的是通过直观的用户界面,为眼科护理中各相关方之间的门诊和住院信息交流提供一种手段。需要访问仪器数据、异常数据和诊断评估,并存储历史数据,以便对患者进行监测。数据的质量控制由读取中心负责:基于深入的需求分析,我们将 ECF 作为基于 React 的网络应用程序实施,后端为 Datomic,提供 REST 和 GraphQL API,用于数据访问和导入。我们还开发了灵活的角色管理,以解决 SALUS 研究中多个利益相关者的各种任务。数据安全由全面的加密概念来保证。我们通过测量医生输入和处理数据所需的时间,评估了ECF的可用性和效率:评估结果表明,与基于纸张的评估相比,ECF 节省了时间,并为数字和成像相关数据提供了支持性监测和结果控制。通过允许患者和医生访问数字ECF,增强了数据连接性和患者自主性:ECF在有效支持所有患者和参与青光眼患者护理的相关人员方面具有巨大潜力。他们可以根据自己的具体职责有效地管理和查看数据,从而从中受益。
{"title":"SALUS-A Study on Self-Tonometry for Glaucoma Patients: Design and Implementation of the Electronic Case File.","authors":"Sandra Geisler, Kristina Oldiges, Florim Hamiti, Jens J Storp, M A Masud, Julian A Zimmermann, Stefan Kreutter, Nicole Eter, Thomas Berlage","doi":"10.1055/s-0044-1787008","DOIUrl":"10.1055/s-0044-1787008","url":null,"abstract":"<p><strong>Background: </strong> In times of omnipresent digitization and big data, telemedicine and electronic case files (ECFs) are gaining ground for networking between players in the health care sector. In the context of the SALUS study, this approach is applied in practice in the form of electronic platforms to display and process disease-relevant data of glaucoma patients.</p><p><strong>Objectives: </strong> The SALUS ECF is designed and implemented to support data acquisition and presentation, monitoring, and outcome control for patients suffering from glaucoma in a clinical setting. Its main aim is to provide a means for out- and inpatient exchange of information between various stakeholders with an intuitive user interface in ophthalmologic care. Instrument data, anamnestic data, and diagnostic assessments need to be accessible and historic data stored for patient monitoring. Quality control of the data is ensured by a reading center.</p><p><strong>Methods: </strong> Based on an intensive requirement analysis, we implemented the ECF as a web-based application in React with a Datomic back-end exposing REST and GraphQL APIs for data access and import. A flexible role management was developed, which addresses the various tasks of multiple stakeholders in the SALUS study. Data security is ensured by a comprehensive encryption concept. We evaluated the usability and efficiency of the ECF by measuring the durations medical doctors need to enter and work with the data.</p><p><strong>Results: </strong> The evaluation showed that the ECF is time-saving in comparison to paper-based assessments and offers supportive monitoring and outcome control for numerical and imaging-related data. By allowing patients and physicians to access the digital ECF, data connectivity as well as patient autonomy were enhanced.</p><p><strong>Conclusion: </strong> ECFs have a great potential to efficiently support all patients and stakeholders involved in the care of glaucoma patients. They benefit from the efficient management and view of the data tailored to their specific role.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"469-478"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186700/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141428048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting Provider Workload Using Predicted Patient Risk Score and Social Determinants of Health in Primary Care Setting. 利用初级医疗机构中的患者风险预测得分和健康的社会决定因素预测医疗服务提供者的工作量。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-07-03 DOI: 10.1055/s-0044-1787647
Yiqun Jiang, Yu-Li Huang, Alexandra Watral, Renaldo C Blocker, David R Rushlow

Background:  Provider burnout due to workload is a significant concern in primary care settings. Workload for primary care providers encompasses both scheduled visit care and non-visit care interactions. These interactions are highly influenced by patients' health conditions or acuity, which can be measured by the Adjusted Clinical Group (ACG) score. However, new patients typically have minimal health information beyond social determinants of health (SDOH) to determine ACG score.

Objectives:  This study aims to assess new patient workload by first predicting the ACG score using SDOH, age, and gender and then using this information to estimate the number of appointments (scheduled visit care) and non-visit care interactions.

Methods:  Two years of appointment data were collected for patients who had initial appointment requests in the first year and had the ACG score, appointment, and non-visit care counts in the subsequent year. State-of-art machine learning algorithms were employed to predict ACG scores and compared with current baseline estimation. Linear regression models were then used to predict appointments and non-visit care interactions, integrating demographic data, SDOH, and predicted ACG scores.

Results:  The machine learning methods showed promising results in predicting ACG scores. Besides the decision tree, all other methods performed at least 9% better in accuracy than the baseline approach which had an accuracy of 78%. Incorporating SDOH and predicted ACG scores also significantly improved the prediction for both appointments and non-visit care interactions. The R 2 values increased by 95.2 and 93.8%, respectively. Furthermore, age, smoking tobacco, family history, gender, usage of injection birth control, and ACG were significant factors for determining appointments. SDOH factors such as tobacco usage, physical exercise, education level, and group activities were strongly correlated with non-visit care interactions.

Conclusion:  The study highlights the importance of SDOH and predicted ACG scores in predicting provider workload in primary care settings.

背景:在初级医疗机构中,因工作量而导致的医疗服务提供者倦怠是一个令人严重关切的问题。初级医疗服务提供者的工作量包括预定的就诊护理和非就诊护理互动。这些互动在很大程度上受患者健康状况或病情严重程度的影响,患者健康状况或病情严重程度可通过调整后临床组(ACG)评分来衡量。然而,新患者除了健康的社会决定因素(SDOH)外,通常只有极少的健康信息可用于确定 ACG 分数:本研究旨在评估新患者的工作量,首先利用 SDOH、年龄和性别预测 ACG 分数,然后利用这些信息估算预约次数(预定就诊护理)和非就诊护理互动次数:方法:我们收集了患者两年的预约数据,这些患者在第一年提出了首次预约请求,并在随后一年获得了 ACG 分数、预约和非就诊护理次数。采用最先进的机器学习算法预测 ACG 分数,并与当前的基线估计值进行比较。然后使用线性回归模型来预测预约和非就诊护理的相互作用,并将人口统计学数据、SDOH 和预测的 ACG 分数整合在一起:结果:机器学习方法在预测 ACG 分数方面显示出良好的效果。除决策树外,所有其他方法的准确率都比基线方法高出至少 9%,基线方法的准确率为 78%。纳入 SDOH 和预测的 ACG 分数也显著提高了对预约和非就诊护理互动的预测。R 2 值分别提高了 95.2% 和 93.8%。此外,年龄、吸烟、家族史、性别、注射避孕药的使用情况和 ACG 都是决定预约的重要因素。烟草使用、体育锻炼、教育水平和团体活动等 SDOH 因素与非就诊护理互动密切相关:该研究强调了 SDOH 和 ACG 预测得分在预测初级医疗机构医疗服务提供者工作量方面的重要性。
{"title":"Predicting Provider Workload Using Predicted Patient Risk Score and Social Determinants of Health in Primary Care Setting.","authors":"Yiqun Jiang, Yu-Li Huang, Alexandra Watral, Renaldo C Blocker, David R Rushlow","doi":"10.1055/s-0044-1787647","DOIUrl":"10.1055/s-0044-1787647","url":null,"abstract":"<p><strong>Background: </strong> Provider burnout due to workload is a significant concern in primary care settings. Workload for primary care providers encompasses both scheduled visit care and non-visit care interactions. These interactions are highly influenced by patients' health conditions or acuity, which can be measured by the Adjusted Clinical Group (ACG) score. However, new patients typically have minimal health information beyond social determinants of health (SDOH) to determine ACG score.</p><p><strong>Objectives: </strong> This study aims to assess new patient workload by first predicting the ACG score using SDOH, age, and gender and then using this information to estimate the number of appointments (scheduled visit care) and non-visit care interactions.</p><p><strong>Methods: </strong> Two years of appointment data were collected for patients who had initial appointment requests in the first year and had the ACG score, appointment, and non-visit care counts in the subsequent year. State-of-art machine learning algorithms were employed to predict ACG scores and compared with current baseline estimation. Linear regression models were then used to predict appointments and non-visit care interactions, integrating demographic data, SDOH, and predicted ACG scores.</p><p><strong>Results: </strong> The machine learning methods showed promising results in predicting ACG scores. Besides the decision tree, all other methods performed at least 9% better in accuracy than the baseline approach which had an accuracy of 78%. Incorporating SDOH and predicted ACG scores also significantly improved the prediction for both appointments and non-visit care interactions. The <i>R</i> <sup>2</sup> values increased by 95.2 and 93.8%, respectively. Furthermore, age, smoking tobacco, family history, gender, usage of injection birth control, and ACG were significant factors for determining appointments. SDOH factors such as tobacco usage, physical exercise, education level, and group activities were strongly correlated with non-visit care interactions.</p><p><strong>Conclusion: </strong> The study highlights the importance of SDOH and predicted ACG scores in predicting provider workload in primary care settings.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"511-527"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11221991/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141499394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human-Centered Design and Development of a Fall Prevention Exercise App for Older Adults in Primary Care Settings. 以人为本,设计和开发基层医疗机构中老年人预防跌倒锻炼应用程序。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-02-13 DOI: 10.1055/a-2267-1727
Nichole K Czuber, Pamela M Garabedian, Hannah Rice, Christian J Tejeda, Patricia C Dykes, Nancy K Latham

Background:  Falls in older adults are a serious public health problem that can lead to reduced quality of life or death. Patients often do not receive fall prevention guidance from primary care providers (PCPs), despite evidence that falls can be prevented. Mobile health technologies may help to address this disparity and promote evidence-based fall prevention.

Objective:  Our main objective was to use human-centered design to develop a user-friendly, fall prevention exercise app using validated user requirements. The app features evidence-based behavior change strategies and exercise content to support older people initiating and adhering to a progressive fall prevention exercise program.

Methods:  We organized our multistage, iterative design process into three phases: gathering user requirements, usability evaluation, and refining app features. Our methods include focus groups, usability testing, and subject-matter expert meetings.

Results:  Focus groups (total n = 6), usability testing (n = 30) including a posttest questionnaire [Health-ITUES score: mean (standard deviation [SD]) = 4.2 (0.9)], and subject-matter expert meetings demonstrate participant satisfaction with the app concept and design. Overall, participants saw value in receiving exercise prescriptions from the app that would be recommended by their PCP and reported satisfaction with the content of the app.

Conclusion:  This study demonstrates the development, refinement, and usability testing of a fall prevention exercise app and corresponding tools that PCPs may use to prescribe tailored exercise recommendations to their older patients as an evidence-based fall prevention strategy accessible in the context of busy clinical workflows.

背景:老年人跌倒是一个严重的公共卫生问题,可导致生活质量下降或死亡。尽管有证据表明跌倒是可以预防的,但患者往往得不到初级保健提供者提供的预防跌倒指导。移动医疗技术可能有助于解决这一差异,并促进以证据为基础的跌倒预防:我们的主要目标是采用以人为本的设计(HCD),根据经过验证的用户需求,开发出一款用户友好的预防跌倒锻炼应用程序。该应用以循证行为改变策略和运动内容为特色,支持老年人启动并坚持渐进式预防跌倒运动计划:我们将多阶段迭代设计过程分为三个阶段:我们将多阶段迭代设计过程分为三个阶段:收集用户需求、可用性评估和完善应用程序功能。我们的方法包括焦点小组、可用性测试和主题专家会议:焦点小组(总人数=6)、可用性测试(人数=30)(包括测试后问卷[Health-ITUES 分数:平均值(标准差)= 4.2 (1.1)])和主题专家会议表明,参与者对应用程序的概念和设计表示满意。总体而言,参与者认为从应用程序中获得由初级保健医生推荐的运动处方很有价值,并对应用程序的内容表示满意,但有几位参与者认为他们并不是应用程序的合适用户:本研究展示了预防跌倒运动应用程序和相应工具的开发、改进和可用性测试,初级保健提供者可利用这些工具为老年患者开具量身定制的运动建议处方,作为一种循证预防跌倒策略,在繁忙的临床工作流程中也可使用。
{"title":"Human-Centered Design and Development of a Fall Prevention Exercise App for Older Adults in Primary Care Settings.","authors":"Nichole K Czuber, Pamela M Garabedian, Hannah Rice, Christian J Tejeda, Patricia C Dykes, Nancy K Latham","doi":"10.1055/a-2267-1727","DOIUrl":"10.1055/a-2267-1727","url":null,"abstract":"<p><strong>Background: </strong> Falls in older adults are a serious public health problem that can lead to reduced quality of life or death. Patients often do not receive fall prevention guidance from primary care providers (PCPs), despite evidence that falls can be prevented. Mobile health technologies may help to address this disparity and promote evidence-based fall prevention.</p><p><strong>Objective: </strong> Our main objective was to use human-centered design to develop a user-friendly, fall prevention exercise app using validated user requirements. The app features evidence-based behavior change strategies and exercise content to support older people initiating and adhering to a progressive fall prevention exercise program.</p><p><strong>Methods: </strong> We organized our multistage, iterative design process into three phases: gathering user requirements, usability evaluation, and refining app features. Our methods include focus groups, usability testing, and subject-matter expert meetings.</p><p><strong>Results: </strong> Focus groups (total <i>n</i> = 6), usability testing (<i>n</i> = 30) including a posttest questionnaire [Health-ITUES score: mean (standard deviation [SD]) = 4.2 (0.9)], and subject-matter expert meetings demonstrate participant satisfaction with the app concept and design. Overall, participants saw value in receiving exercise prescriptions from the app that would be recommended by their PCP and reported satisfaction with the content of the app.</p><p><strong>Conclusion: </strong> This study demonstrates the development, refinement, and usability testing of a fall prevention exercise app and corresponding tools that PCPs may use to prescribe tailored exercise recommendations to their older patients as an evidence-based fall prevention strategy accessible in the context of busy clinical workflows.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"544-555"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11236445/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139730802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of a Real-Time Documentation Assistance Tool: Automated Diagnosis (AutoDx). 实施实时文档辅助工具:自动诊断(AutoDx)。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-05-03 DOI: 10.1055/a-2319-0598
Matthew T Cerasale, Ali Mansour, Ethan Molitch-Hou, Sean Bernstein, Tokhanh Nguyen, Cheng-Kai Kao

Background:  Clinical documentation improvement programs are utilized by most health care systems to enhance provider documentation. Suggestions are sent to providers in a variety of ways, and are commonly referred to as coding queries. Responding to these coding queries can require significant provider time and do not often align with workflows. To enhance provider documentation in a more consistent manner without creating undue burden, alternative strategies are required.

Objectives:  The aim of this study is to evaluate the impact of a real-time documentation assistance tool, named AutoDx, on the volume of coding queries and encounter-level outcome metrics, including case-mix index (CMI).

Methods:  The AutoDx tool was developed utilizing tools existing within the electronic health record, and is based on the generation of messages when clinical conditions are met. These messages appear within provider notes and required little to no interaction. Initial diagnoses included in the tool were electrolyte deficiencies, obesity, and malnutrition. The tool was piloted in a cohort of Hospital Medicine providers, then expanded to the Neuro Intensive Care Unit (NICU), with addition diagnoses being added.

Results:  The initial Hospital Medicine implementation evaluation included 590 encounters pre- and 531 post-implementation. The volume of coding queries decreased 57% (p < 0.0001) for the targeted diagnoses compared with 6% (p = 0.77) in other high-volume diagnoses. In the NICU cohort, 829 encounters pre-implementation were compared with 680 post. The proportion of AutoDx coding queries compared with all other coding queries decreased from 54.9 to 37.1% (p < 0.0001). During the same period, CMI demonstrated a significant increase post-implementation (4.00 vs. 4.55, p = 0.02).

Conclusion:  The real-time documentation assistance tool led to a significant decrease in coding queries for targeted diagnoses in two unique provider cohorts. This improvement was also associated with a significant increase in CMI during the implementation time period.

背景:大多数医疗保健系统都采用临床文档改进计划来加强医疗服务提供者的文档记录。向医疗服务提供者发送建议的方式多种多样,通常被称为编码查询。回复这些编码查询可能需要医疗服务提供者花费大量时间,而且往往与工作流程不一致。为了以更一致的方式加强医疗服务提供者的文档记录,同时又不造成过重的负担,需要采取其他策略:本研究旨在评估名为 AutoDx 的实时文档协助工具对编码查询量和病例组合指数(CMI)等会诊结果指标的影响:AutoDx 工具是利用电子病历中现有的工具开发的,其基础是在满足临床条件时生成信息。这些信息出现在医疗服务提供者的记录中,几乎不需要交互。该工具最初的诊断包括电解质缺乏、肥胖和营养不良。该工具在一批医院内科医疗服务提供者中试用,然后扩展到神经重症监护室(NICU),并增加了新的诊断:结果:最初的医院内科实施前评估了 590 个病例,实施后评估了 531 个病例。目标诊断的编码查询量减少了 57%(p < 0.0001),而其他高查询量诊断的编码查询量则减少了 6%(p = 0.77)。在新生儿重症监护室队列中,实施前有 829 次问诊,实施后有 680 次。与所有其他编码查询相比,AutoDx 编码查询的比例从 54.9% 降至 37.1%(p 结论:在两个独特的医疗服务提供者队列中,实时文档协助工具使目标诊断的编码查询显著减少。这一改善还与实施期间 CMI 的显著增加有关。
{"title":"Implementation of a Real-Time Documentation Assistance Tool: Automated Diagnosis (AutoDx).","authors":"Matthew T Cerasale, Ali Mansour, Ethan Molitch-Hou, Sean Bernstein, Tokhanh Nguyen, Cheng-Kai Kao","doi":"10.1055/a-2319-0598","DOIUrl":"10.1055/a-2319-0598","url":null,"abstract":"<p><strong>Background: </strong> Clinical documentation improvement programs are utilized by most health care systems to enhance provider documentation. Suggestions are sent to providers in a variety of ways, and are commonly referred to as coding queries. Responding to these coding queries can require significant provider time and do not often align with workflows. To enhance provider documentation in a more consistent manner without creating undue burden, alternative strategies are required.</p><p><strong>Objectives: </strong> The aim of this study is to evaluate the impact of a real-time documentation assistance tool, named AutoDx, on the volume of coding queries and encounter-level outcome metrics, including case-mix index (CMI).</p><p><strong>Methods: </strong> The AutoDx tool was developed utilizing tools existing within the electronic health record, and is based on the generation of messages when clinical conditions are met. These messages appear within provider notes and required little to no interaction. Initial diagnoses included in the tool were electrolyte deficiencies, obesity, and malnutrition. The tool was piloted in a cohort of Hospital Medicine providers, then expanded to the Neuro Intensive Care Unit (NICU), with addition diagnoses being added.</p><p><strong>Results: </strong> The initial Hospital Medicine implementation evaluation included 590 encounters pre- and 531 post-implementation. The volume of coding queries decreased 57% (<i>p</i> < 0.0001) for the targeted diagnoses compared with 6% (<i>p</i> = 0.77) in other high-volume diagnoses. In the NICU cohort, 829 encounters pre-implementation were compared with 680 post. The proportion of AutoDx coding queries compared with all other coding queries decreased from 54.9 to 37.1% (<i>p</i> < 0.0001). During the same period, CMI demonstrated a significant increase post-implementation (4.00 vs. 4.55, <i>p</i> = 0.02).</p><p><strong>Conclusion: </strong> The real-time documentation assistance tool led to a significant decrease in coding queries for targeted diagnoses in two unique provider cohorts. This improvement was also associated with a significant increase in CMI during the implementation time period.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"501-510"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11208109/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140860521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation. 一家学术医院利用机器学习、工作流程分析和仿真技术开展神经外科再入院率降低项目。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-06-19 DOI: 10.1055/s-0044-1787119
Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu

Background:  Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.

Objectives:  Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.

Methods:  Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.

Results:  The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.

Conclusion:  This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.

背景:预测 30 天的再入院率对于改善患者预后、优化资源分配和实现经济节约至关重要。现有研究报告了预测神经外科再住院率的机器学习(ML)模型的开发情况,但未报告与临床实施相关的因素:目标:训练性能良好的单个预测模型(接收者操作特征曲线下面积或 AUROC > 0.8),通过半结构化访谈确定潜在的干预措施,并展示这些模型的临床和财务影响估计值:利用电子健康记录和五种 ML 方法:梯度提升、决策树、随机森林、脊逻辑回归和线性支持向量机。相关变量由领域专家和文献确定。数据集被随机分成80%用于训练和验证,20%用于测试。临床工作流程分析是通过半结构化访谈来确定可能的干预点。根据之前的一项干预研究,应用校准代理模型(ABM)模拟降低 30 天再入院率和财务成本:数据集涵盖了12334例神经外科重症监护病房(NSICU)住院病例(11029例患者)、1903例脊柱外科住院病例(1641例患者)和2208例创伤性脑损伤(TBI)住院病例(2185例患者),再入院率分别为13.13%、13.93%和23.73%。用于 NSICU 的随机森林模型性能最佳,AUROC 得分为 0.89,有效捕捉了潜在患者。通过针对术前、住院期间、出院阶段和随访阶段的 12 次半结构化访谈,确定了六项干预措施。经过校准的 ABM 模拟了再入院率的中位数,结果是再入院率从 13.13% 降至 10.12%(非重症监护病房)、13.90% 降至 10.98%(脊柱手术)、23.64% 降至 21.20%(创伤性脑损伤)。潜在的干预措施节省了约 1,300,614.28 美元:本研究报告成功开发并模拟了一种基于 ML 的方法,用于预测和减少神经外科 30 天再住院率。该干预措施在改善患者预后和减少经济损失方面具有可行性。
{"title":"A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.","authors":"Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu","doi":"10.1055/s-0044-1787119","DOIUrl":"10.1055/s-0044-1787119","url":null,"abstract":"<p><strong>Background: </strong> Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.</p><p><strong>Objectives: </strong> Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.</p><p><strong>Methods: </strong> Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.</p><p><strong>Results: </strong> The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.</p><p><strong>Conclusion: </strong> This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"479-488"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186699/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141428047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Contributors to Electronic Health Record-Integrated Secure Messaging Use: A Study of Over 33,000 Health Care Professionals. 电子健康记录集成安全信息使用的促成因素:对 33,000 多名医疗保健专业人员的研究。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-05-01 Epub Date: 2024-07-24 DOI: 10.1055/s-0044-1787756
Laura R Baratta, Daphne Lew, Thomas Kannampallil, Sunny S Lou

Objectives:  Electronic health record (EHR)-integrated secure messaging is extensively used for communication between clinicians. We investigated the factors contributing to secure messaging use in a large health care system.

Methods:  This was a cross-sectional study that included 14 hospitals and 263 outpatient clinic locations. Data on EHR-integrated secure messaging use over a 1-month period (February 1, 2023, through February 28, 2023) were collected. A multilevel mixed effects model was used to assess the contribution of clinical role, clinical unit (i.e., specific inpatient ward or outpatient clinic), hospital or clinic location (i.e., Hospital X or Outpatient Clinic Building Y), and inpatient versus outpatient setting toward secure messaging use.

Results:  Of the 33,195 health care professionals who worked during the study period, 20,576 (62%) were secure messaging users. In total, 25.3% of the variability in messaging use was attributable to the clinical unit and 30.5% was attributable to the hospital or clinic location. Compared with nurses, advanced practice providers, pharmacists, and physicians were more likely to use secure messaging, whereas medical assistants, social workers, and therapists were less likely (p < 0.001). After adjusting for other factors, inpatient versus outpatient setting was not associated with secure messaging use.

Conclusion:  Secure messaging was widely used; however, there was substantial variation by clinical role, clinical unit, and hospital or clinic location. Our results suggest that interventions and policies for managing secure messaging behaviors are likely to be most effective if they are not only set at the organizational level but also communicated and tailored toward individual clinical units and clinician workflows.

目的:集成了电子健康记录(EHR)的安全信息被广泛用于临床医生之间的交流。我们调查了在一个大型医疗系统中使用安全信息的因素:这是一项横断面研究,包括 14 家医院和 263 个门诊诊所。研究收集了为期 1 个月(2023 年 2 月 1 日至 2023 年 2 月 28 日)的电子病历集成安全信息使用数据。采用多层次混合效应模型来评估临床角色、临床单位(即特定住院病房或门诊诊所)、医院或诊所地点(即医院 X 或门诊诊所大楼 Y)以及住院与门诊环境对安全信息使用的影响:在研究期间工作的 33 195 名医护人员中,有 20 576 人(62%)是安全信息用户。总体而言,25.3%的信息使用差异可归因于临床科室,30.5%可归因于医院或诊所地点。与护士相比,高级医疗服务提供者、药剂师和医生更倾向于使用安全信息,而医疗助理、社会工作者和治疗师则不太倾向于使用安全信息(P 结语):安全信息的使用范围很广,但不同临床角色、临床科室以及医院或诊所所在地之间存在很大差异。我们的研究结果表明,管理安全信息行为的干预措施和政策不仅要在组织层面制定,还要针对各个临床科室和临床医生的工作流程进行沟通和调整,这样才可能最有效。
{"title":"Contributors to Electronic Health Record-Integrated Secure Messaging Use: A Study of Over 33,000 Health Care Professionals.","authors":"Laura R Baratta, Daphne Lew, Thomas Kannampallil, Sunny S Lou","doi":"10.1055/s-0044-1787756","DOIUrl":"10.1055/s-0044-1787756","url":null,"abstract":"<p><strong>Objectives: </strong> Electronic health record (EHR)-integrated secure messaging is extensively used for communication between clinicians. We investigated the factors contributing to secure messaging use in a large health care system.</p><p><strong>Methods: </strong> This was a cross-sectional study that included 14 hospitals and 263 outpatient clinic locations. Data on EHR-integrated secure messaging use over a 1-month period (February 1, 2023, through February 28, 2023) were collected. A multilevel mixed effects model was used to assess the contribution of clinical role, clinical unit (i.e., specific inpatient ward or outpatient clinic), hospital or clinic location (i.e., Hospital X or Outpatient Clinic Building Y), and inpatient versus outpatient setting toward secure messaging use.</p><p><strong>Results: </strong> Of the 33,195 health care professionals who worked during the study period, 20,576 (62%) were secure messaging users. In total, 25.3% of the variability in messaging use was attributable to the clinical unit and 30.5% was attributable to the hospital or clinic location. Compared with nurses, advanced practice providers, pharmacists, and physicians were more likely to use secure messaging, whereas medical assistants, social workers, and therapists were less likely (<i>p</i> < 0.001). After adjusting for other factors, inpatient versus outpatient setting was not associated with secure messaging use.</p><p><strong>Conclusion: </strong> Secure messaging was widely used; however, there was substantial variation by clinical role, clinical unit, and hospital or clinic location. Our results suggest that interventions and policies for managing secure messaging behaviors are likely to be most effective if they are not only set at the organizational level but also communicated and tailored toward individual clinical units and clinician workflows.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"15 3","pages":"612-619"},"PeriodicalIF":2.1,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268985/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1