首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
A Mixed-Method Case Study to Evaluate Adoption of Clinical Decision Support for Cancer Symptom Management. 一项评估临床决策支持在癌症症状管理中的应用的混合方法案例研究。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-08-22 DOI: 10.1055/a-2587-6081
Jennifer L Ridgeway, Deirdre R Pachman, Lila J Finney Rutten, Joan M Griffin, Sarah A Minteer, Jessica D Austin, Linda L Chlan, Cindy Tofthagen, Kyle A Tobin, Veronica Grzegorcyzk, Parvez Rahman, Kathryn J Ruddy, Andrea L Cheville

Electronic patient-reported outcome measures (ePROMs) can improve care for people with cancer, but effectiveness hinges on well-supported integration in clinical settings.We evaluated clinician use of specific clinical decision support (CDS) tools in the electronic health record (EHR) designed to facilitate timely, clinically appropriate responses to ePROM scores for six symptoms commonly experienced by cancer patients.The parent pragmatic trial, which took place at Mayo Clinic (Rochester, Minnesota, United States) and its affiliated community health care system between March 2019 and January 2023, evaluated the population-level effectiveness and implementation of an ePROM surveillance and EHR-facilitated collaborative care symptom management intervention. The present evaluation used a case study approach with four data sources: (1) clinician interactions with CDS tools abstracted from the EHR; (2) clinician notes identified with an institution-specific textual search tool; (3) qualitative interviews and group discussions with care teams; and (4) administrative records reviewed to identify training and outreach to care teams.EHR metrics showed very low adoption of CDS tools including alerts and symptom-specific order sets, despite educational outreach and information technology support provided to clinical care teams. Qualitative findings revealed that CDS use was not easy to integrate into busy clinical workflows and highlighted clinician perceptions that the collaborative care intervention provided additional patient support that reduced clinicians' need to utilize CDS tools. They also highlight the importance of contextual factors, including institutional priorities and EHR changes.This pragmatic clinical trial case study found limited adoption of EHR CDS tools that had been developed to increase clinicians' awareness of and responses to ePROM data. Findings suggest the need to align clinician and organizational implementation strategies, simplify CDS tools to fit practice expectations, and identify and address contextual factors that could undercut strategies like education and peer support. This may be especially important for teams who aim to iteratively evaluate and refine CDS and implementation strategies for multicomponent interventions or introduce new strategies that are responsive to barriers while maintaining scalability.

电子患者报告结果测量(ePROMs)可以改善对癌症患者的护理,但有效性取决于临床环境中得到良好支持的整合。我们评估了临床医生在电子健康记录(EHR)中使用特定临床决策支持(CDS)工具的情况,这些工具旨在促进对癌症患者常见的六种症状的ePROM评分做出及时、临床适当的反应。父母实用试验于2019年3月至2023年1月在Mayo诊所(Rochester, Minnesota, usa)及其附属社区卫生保健系统进行,评估了ePROM监测和ehrs促进的协作护理症状管理干预在人群水平上的有效性和实施情况。本评估采用案例研究方法,采用四个数据源:(1)临床医生与从电子病历中提取的CDS工具的互动;(2)通过机构特定文本搜索工具识别的临床医生笔记;(3)与护理团队进行定性访谈和小组讨论;(4)审查行政记录,以确定对护理团队的培训和外展。电子病历指标显示,尽管向临床护理团队提供了教育外展和信息技术支持,但CDS工具(包括警报和针对症状的命令集)的采用率非常低。定性研究结果显示,CDS的使用不容易整合到繁忙的临床工作流程中,并强调了临床医生的看法,即协作护理干预提供了额外的患者支持,减少了临床医生使用CDS工具的需要。他们还强调了环境因素的重要性,包括机构优先事项和电子病历变化。这个实用的临床试验案例研究发现,EHR CDS工具的采用有限,这些工具的开发是为了提高临床医生对ePROM数据的认识和反应。研究结果表明,需要使临床医生和组织实施战略保持一致,简化CDS工具以适应实践期望,并确定和解决可能削弱教育和同伴支持等战略的背景因素。这对于那些旨在迭代地评估和改进CDS以及实现多组件干预策略或引入在保持可伸缩性的同时对障碍做出响应的新策略的团队来说可能尤其重要。
{"title":"A Mixed-Method Case Study to Evaluate Adoption of Clinical Decision Support for Cancer Symptom Management.","authors":"Jennifer L Ridgeway, Deirdre R Pachman, Lila J Finney Rutten, Joan M Griffin, Sarah A Minteer, Jessica D Austin, Linda L Chlan, Cindy Tofthagen, Kyle A Tobin, Veronica Grzegorcyzk, Parvez Rahman, Kathryn J Ruddy, Andrea L Cheville","doi":"10.1055/a-2587-6081","DOIUrl":"10.1055/a-2587-6081","url":null,"abstract":"<p><p>Electronic patient-reported outcome measures (ePROMs) can improve care for people with cancer, but effectiveness hinges on well-supported integration in clinical settings.We evaluated clinician use of specific clinical decision support (CDS) tools in the electronic health record (EHR) designed to facilitate timely, clinically appropriate responses to ePROM scores for six symptoms commonly experienced by cancer patients.The parent pragmatic trial, which took place at Mayo Clinic (Rochester, Minnesota, United States) and its affiliated community health care system between March 2019 and January 2023, evaluated the population-level effectiveness and implementation of an ePROM surveillance and EHR-facilitated collaborative care symptom management intervention. The present evaluation used a case study approach with four data sources: (1) clinician interactions with CDS tools abstracted from the EHR; (2) clinician notes identified with an institution-specific textual search tool; (3) qualitative interviews and group discussions with care teams; and (4) administrative records reviewed to identify training and outreach to care teams.EHR metrics showed very low adoption of CDS tools including alerts and symptom-specific order sets, despite educational outreach and information technology support provided to clinical care teams. Qualitative findings revealed that CDS use was not easy to integrate into busy clinical workflows and highlighted clinician perceptions that the collaborative care intervention provided additional patient support that reduced clinicians' need to utilize CDS tools. They also highlight the importance of contextual factors, including institutional priorities and EHR changes.This pragmatic clinical trial case study found limited adoption of EHR CDS tools that had been developed to increase clinicians' awareness of and responses to ePROM data. Findings suggest the need to align clinician and organizational implementation strategies, simplify CDS tools to fit practice expectations, and identify and address contextual factors that could undercut strategies like education and peer support. This may be especially important for teams who aim to iteratively evaluate and refine CDS and implementation strategies for multicomponent interventions or introduce new strategies that are responsive to barriers while maintaining scalability.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"804-814"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12373467/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144975005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An AI-Powered Strategy for Managing Patient Messaging Load and Reducing Burnout. 专题倦怠:管理患者信息负荷和减少倦怠的人工智能驱动策略。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-04-08 DOI: 10.1055/a-2576-0579
Stephon Proctor, Greg Lawton, Shikha Sinha

This study aims to evaluate the impact of using a large language model (LLM) for generating draft responses to patient messages in the electronic health record (EHR) system on clinicians and support staff workload and efficiency.We partnered with Epic Systems to implement OpenAI's ChatGPT 4.0 for responding to patient messages. A pilot study was conducted from August 2023 to July 2024 across 13 ambulatory specialties involving 323 participants, including clinicians and support staff. Data on draft utilization rates and message response times were collected and analyzed using statistical methods.The overall mean generated draft utilization rate was 38%, with significant differences by role and specialty. Clinicians had a higher utilization rate (43%) than scheduling staff (33%). Draft message usage significantly reduced all users' message response time (13 seconds on average). Support staff experienced a more substantial and statistically significant time saving (23 seconds) compared to negligible time savings seen by clinicians (3 seconds). Variability in utilization rates and time savings was observed across different specialties.Implementing LLMs for drafting patient message replies can reduce response times and alleviate message burden. However, the effectiveness of artificial intelligence (AI)-generated draft responses varies by clinical role and specialty, indicating the need for tailored implementations. Further investigation into this variability, and development and personalization of AI tools are recommended to maximize their utility and ensure safe and effective use in diverse clinical contexts.

目的:本研究旨在评估使用大型语言模型(LLM)在电子健康记录(EHR)系统中生成患者信息回复草稿对临床医生和支持人员工作量和效率的影响。方法:我们与Epic Systems合作,实施OpenAI的ChatGPT 4.0来响应患者信息。一项试点研究于2023年8月至2024年7月在13个门诊专科进行,涉及323名参与者,包括临床医生和支持人员。使用统计方法收集和分析草稿利用率和消息响应时间的数据。结果:总体平均生成草稿利用率为38%,角色和专业之间存在显著差异。临床医生的使用率(43%)高于调度人员(33%)。草稿消息的使用显著减少了所有用户的消息响应时间(平均为13秒)。与临床医生(3秒)相比,支持人员节省的时间(23秒)更大,在统计上也更显著。在不同的专业中观察到利用率和时间节约的差异。结论:在患者信息回复中实施llm可以减少响应时间,减轻信息负担。然而,人工智能生成的草案响应的有效性因临床角色和专业而异,这表明需要量身定制的实施。建议进一步开发和个性化AI(人工智能)工具,以最大限度地发挥其效用,并确保在各种临床环境中安全有效地使用。
{"title":"An AI-Powered Strategy for Managing Patient Messaging Load and Reducing Burnout.","authors":"Stephon Proctor, Greg Lawton, Shikha Sinha","doi":"10.1055/a-2576-0579","DOIUrl":"10.1055/a-2576-0579","url":null,"abstract":"<p><p>This study aims to evaluate the impact of using a large language model (LLM) for generating draft responses to patient messages in the electronic health record (EHR) system on clinicians and support staff workload and efficiency.We partnered with Epic Systems to implement OpenAI's ChatGPT 4.0 for responding to patient messages. A pilot study was conducted from August 2023 to July 2024 across 13 ambulatory specialties involving 323 participants, including clinicians and support staff. Data on draft utilization rates and message response times were collected and analyzed using statistical methods.The overall mean generated draft utilization rate was 38%, with significant differences by role and specialty. Clinicians had a higher utilization rate (43%) than scheduling staff (33%). Draft message usage significantly reduced all users' message response time (13 seconds on average). Support staff experienced a more substantial and statistically significant time saving (23 seconds) compared to negligible time savings seen by clinicians (3 seconds). Variability in utilization rates and time savings was observed across different specialties.Implementing LLMs for drafting patient message replies can reduce response times and alleviate message burden. However, the effectiveness of artificial intelligence (AI)-generated draft responses varies by clinical role and specialty, indicating the need for tailored implementations. Further investigation into this variability, and development and personalization of AI tools are recommended to maximize their utility and ensure safe and effective use in diverse clinical contexts.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"747-752"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12328029/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143812760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Better Attitudes toward Cybersecurity and Greater Self-Control Predict Lower Risky Online Behaviors among Nurses. 更好的网络安全态度和更强的自我控制预示着护士更低的网络风险行为。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-10-08 DOI: 10.1055/a-2699-9179
Elham H Othman, Wasem I Al Haj, Mohammad R Alosta, Yousef Qan'Ir, Mohannad Eid Aburuz, Wesam Taher Almagharbeh

The current study examined the moderating effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors among direct care nurses.A cross-sectional study collected data from 260 direct care nurses in Saudi Arabia using a self-reported questionnaire. Hierarchical multiple regression analysis and simple slope analysis examined the moderation effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors.We found that a better attitude toward cybersecurity and greater self-control predicted lower risky online behaviors. Simple slope tests revealed a significant negative association between attitude toward cybersecurity and risky online behaviors at low levels of self-control, but this association disappears at high levels of self-control, meaning that high levels of self-control have a protective/moderating effect on the relationship between attitude toward cybersecurity and risky online behaviors.Self-control moderates the effect of attitudes on online practices. The negative attitudes' influence on risky online behaviors is stronger when self-control is low. On the other hand, at high levels of self-control, individuals may engage in safer practices regardless of their attitudes.

本研究考察了自我控制对直护护士网络安全态度与网络危险行为之间关系的调节作用。一项横断面研究收集了沙特阿拉伯260名直接护理护士的数据,采用自我报告的问卷调查。层次多元回归分析和简单斜率分析检验了自我控制对网络安全态度与网络风险行为关系的调节作用。我们发现,更好的网络安全态度和更强的自我控制能力预示着更低的网络风险行为。简单斜率检验显示,低自我控制水平下网络安全态度与网络风险行为之间存在显著的负相关关系,而高自我控制水平下网络安全态度与网络风险行为之间的负相关关系消失,说明高自我控制水平对网络安全态度与网络风险行为之间的关系具有保护/调节作用。自我控制调节态度对网络行为的影响。当自我控制能力较低时,消极态度对网络风险行为的影响更大。另一方面,在高水平的自我控制下,个人可能会从事更安全的行为,而不管他们的态度如何。
{"title":"Better Attitudes toward Cybersecurity and Greater Self-Control Predict Lower Risky Online Behaviors among Nurses.","authors":"Elham H Othman, Wasem I Al Haj, Mohammad R Alosta, Yousef Qan'Ir, Mohannad Eid Aburuz, Wesam Taher Almagharbeh","doi":"10.1055/a-2699-9179","DOIUrl":"10.1055/a-2699-9179","url":null,"abstract":"<p><p>The current study examined the moderating effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors among direct care nurses.A cross-sectional study collected data from 260 direct care nurses in Saudi Arabia using a self-reported questionnaire. Hierarchical multiple regression analysis and simple slope analysis examined the moderation effect of self-control on the relationship between attitudes toward cybersecurity and risky online behaviors.We found that a better attitude toward cybersecurity and greater self-control predicted lower risky online behaviors. Simple slope tests revealed a significant negative association between attitude toward cybersecurity and risky online behaviors at low levels of self-control, but this association disappears at high levels of self-control, meaning that high levels of self-control have a protective/moderating effect on the relationship between attitude toward cybersecurity and risky online behaviors.Self-control moderates the effect of attitudes on online practices. The negative attitudes' influence on risky online behaviors is stronger when self-control is low. On the other hand, at high levels of self-control, individuals may engage in safer practices regardless of their attitudes.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1310-1318"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12507492/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145253306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-World Challenges of Using Assisted Living Technologies across Different Australian Aged Care Settings: A Qualitative Study of User Experiences. 在不同的澳大利亚老年护理环境中使用辅助生活技术的现实挑战:用户体验的定性研究。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-08-29 DOI: 10.1055/a-2591-4016
Nida Afzal, Amy D Nguyen, Annie Lau

Aging populations strain health care systems. Assisted Living Technologies (ALTs) emerge as a potential solution for promoting independent living among older adults. However, the real-world effect of ALTs remains unclear.This study explores benefits and challenges (anticipated and unanticipated) of ALTs for older adults and informal caregivers across three aged care settings (residential aged care facilities [RACFs], retirement villages [RVs], and home-dwelling communities [HDCs]) in Australia.Three ALTs (fall detection sensors, sleep monitors, and smartwatches) were deployed across three settings. NASSS framework (Non-adoption, Abandonment, Scale-up, Spread, and Sustainability), informed by sociotechnical theories, guided analysis of the interplay between technology, user needs, and caregiving context in ALTs implementation. Semistructured interviews with 14 older adults and 9 caregivers from 19 households explored user experiences. Benefits and challenges of using ALTs for older adults and informal caregivers were categorized using the consequences framework.Setting-specific challenges alongside common benefits and challenges across care settings were revealed. The NASSS framework analysis showed how technology limitations, user needs, and caregiving context influenced these outcomes. In RACFs, where residents receive constant nursing assistance, informal caregivers faced uncertainty regarding who was responsible for monitoring residents. In RVs, with a strong sense of community, informal caregivers (often neighbors) were more prone to overreacting to false alarms. Shared sleeping arrangements among HDCs made interpreting sleep data challenging.Implementing ALTs in elderly care settings requires a context-sensitive approach. In RACFs, clear role definitions for informal caregivers and staff are essential. For RVs, design should support help-seeking aligned with residents' social and geographical contexts. Home-dwelling settings may benefit from advanced sleep monitoring tailored to shared living arrangements. Future ALTs development should focus on real-world contexts to promote successful aging in place.

人口老龄化给医疗保健系统带来压力。辅助生活技术(ALTs)成为促进老年人独立生活的潜在解决方案。然而,alt对现实世界的影响仍不清楚。本研究探讨了澳大利亚三种老年护理环境(住宅老年护理设施[racf],退休村[rv]和家庭居住社区[HDCs])中老年人和非正式护理人员的alt的好处和挑战(预期和未预期)。三种alt(跌倒检测传感器、睡眠监视器和智能手表)被部署在三种设置中。NASSS框架(不采用、放弃、扩大规模、传播和可持续性)在社会技术理论的指导下,指导了人工智能技术实施中技术、用户需求和护理环境之间相互作用的分析。对来自19个家庭的14名老年人和9名护理人员进行了半结构化访谈,探讨了用户体验。使用后果框架对老年人和非正式护理人员使用alt的好处和挑战进行了分类。揭示了在护理环境中设置特定挑战以及共同利益和挑战。NASSS框架分析显示了技术限制、用户需求和护理环境如何影响这些结果。在居民得到持续护理援助的乡村社区,非正式护理人员面临着谁负责监测居民的不确定性。在有强烈社区意识的房车里,非正式的看护者(通常是邻居)更容易对假警报反应过度。高收入国家之间共享睡眠安排使得解释睡眠数据具有挑战性。在老年护理环境中实施人工智能治疗需要一种对环境敏感的方法。在区域协调基金中,非正式照顾者和工作人员的明确角色定义至关重要。对于房车来说,设计应该支持与居民的社会和地理环境相一致的求助。家庭居住环境可能受益于为共享生活安排量身定制的先进睡眠监测。未来人工智能的发展应着眼于现实环境,以促进成功的老龄化。
{"title":"Real-World Challenges of Using Assisted Living Technologies across Different Australian Aged Care Settings: A Qualitative Study of User Experiences.","authors":"Nida Afzal, Amy D Nguyen, Annie Lau","doi":"10.1055/a-2591-4016","DOIUrl":"https://doi.org/10.1055/a-2591-4016","url":null,"abstract":"<p><p>Aging populations strain health care systems. Assisted Living Technologies (ALTs) emerge as a potential solution for promoting independent living among older adults. However, the real-world effect of ALTs remains unclear.This study explores benefits and challenges (anticipated and unanticipated) of ALTs for older adults and informal caregivers across three aged care settings (residential aged care facilities [RACFs], retirement villages [RVs], and home-dwelling communities [HDCs]) in Australia.Three ALTs (fall detection sensors, sleep monitors, and smartwatches) were deployed across three settings. NASSS framework (Non-adoption, Abandonment, Scale-up, Spread, and Sustainability), informed by sociotechnical theories, guided analysis of the interplay between technology, user needs, and caregiving context in ALTs implementation. Semistructured interviews with 14 older adults and 9 caregivers from 19 households explored user experiences. Benefits and challenges of using ALTs for older adults and informal caregivers were categorized using the consequences framework.Setting-specific challenges alongside common benefits and challenges across care settings were revealed. The NASSS framework analysis showed how technology limitations, user needs, and caregiving context influenced these outcomes. In RACFs, where residents receive constant nursing assistance, informal caregivers faced uncertainty regarding who was responsible for monitoring residents. In RVs, with a strong sense of community, informal caregivers (often neighbors) were more prone to overreacting to false alarms. Shared sleeping arrangements among HDCs made interpreting sleep data challenging.Implementing ALTs in elderly care settings requires a context-sensitive approach. In RACFs, clear role definitions for informal caregivers and staff are essential. For RVs, design should support help-seeking aligned with residents' social and geographical contexts. Home-dwelling settings may benefit from advanced sleep monitoring tailored to shared living arrangements. Future ALTs development should focus on real-world contexts to promote successful aging in place.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"930-942"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12396903/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144975501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Clinical Decision Support Leveraging Health Information Exchange Improves Concordance with Patients' Resuscitation Orders and End-of-Life Wishes. 利用健康信息交换的临床决策支持提高了与患者复苏命令和临终愿望的一致性。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-04-23 DOI: 10.1055/a-2591-9040
Eesha Chakravartty, Jared Silberlust, Saul B Blecker, Yunan Zhao, Fariza Alendy, Heather Menzer, Aamina Ahmed, Simon Jones, Meg Ferrauiola, Jonathan Austrian

This study aims to improve concordance between patient end-of-life preferences and code status orders by incorporating data from a state registry with clinical decision support (CDS) within the electronic health record (EHR) to preserve patient autonomy and ensure that patients receive care that aligns with their wishes.Leveraging a health information exchange (HIE) interface between the New York State Medical Orders for Life-Sustaining Treatment (eMOLST) registry and the EHR of our academic health system, we developed a bundled CDS intervention that displays eMOLST information at the time of code status ordering and provides an in-line alert when providers enter a resuscitation order discordant with wishes documented in the eMOLST registry. To evaluate this intervention, we performed a segmented regression analysis of an interrupted time series to compare the percentage of discordant orders before and after implementation among all hospitalizations for which an eMOLST was available.We identified a total of 3,648 visits that had an eMOLST filed prior to inpatient admission and a code status order placed during admission. There was a statistically significant decrease of discordant resuscitation orders of -5.95% after the intervention went live, with a relative risk reduction of 25% (95% CI: -9.95%, -1.94%; p = 0.009) in the pre- and post-intervention period. Logistic regression model after adjusting for covariates showed an average marginal effect of -5.12% after the intervention (CI: -9.75%, -0.50%; p = 0.03).Our intervention resulted in a decrease in discordant resuscitation orders. This study demonstrates that accessibility to eMOLST data within the provider workflow supported by CDS can reduce discrepancies between patient end-of-life wishes and hospital code status orders.

目标:通过在电子健康记录(EHR)中纳入具有临床决策支持(CDS)的州登记处的数据,改善患者临终偏好和代码状态命令之间的一致性,以保持患者的自主权,并确保患者接受符合其意愿的护理。方法利用纽约州维持生命治疗医嘱(eMOLST)登记系统和学术卫生系统EHR之间的健康信息交换(HIE)接口,我们开发了一种捆绑的CDS干预措施,在代码状态订购时显示eMOLST信息,并在提供者输入与eMOLST登记中记录的愿望不一致的复苏医嘱时提供在线警报。为了评估该干预措施,我们对中断时间序列进行了分段回归分析,以比较在所有可获得eMOLST的住院治疗中实施前后不一致订单的百分比。结果:我们共确定了3648次就诊,在住院前有eMOLST存档,并在住院期间放置了代码状态订单。干预前后,不一致复苏指令的发生率降低了-5.95%,相对风险降低了25%,[95% CI: -9.95%, -1.94%, p=0.009]。经协变量调整后的Logistic回归模型显示,干预后平均边际效应为-5.12% [CI =-9.75%, -0.50%, p=0.03]。结论我们的干预减少了不一致的复苏顺序。本研究表明,在CDS支持的提供者工作流程中访问eMOLST数据可以减少患者临终愿望与医院代码状态命令之间的差异。
{"title":"Clinical Decision Support Leveraging Health Information Exchange Improves Concordance with Patients' Resuscitation Orders and End-of-Life Wishes.","authors":"Eesha Chakravartty, Jared Silberlust, Saul B Blecker, Yunan Zhao, Fariza Alendy, Heather Menzer, Aamina Ahmed, Simon Jones, Meg Ferrauiola, Jonathan Austrian","doi":"10.1055/a-2591-9040","DOIUrl":"10.1055/a-2591-9040","url":null,"abstract":"<p><p>This study aims to improve concordance between patient end-of-life preferences and code status orders by incorporating data from a state registry with clinical decision support (CDS) within the electronic health record (EHR) to preserve patient autonomy and ensure that patients receive care that aligns with their wishes.Leveraging a health information exchange (HIE) interface between the New York State Medical Orders for Life-Sustaining Treatment (eMOLST) registry and the EHR of our academic health system, we developed a bundled CDS intervention that displays eMOLST information at the time of code status ordering and provides an in-line alert when providers enter a resuscitation order discordant with wishes documented in the eMOLST registry. To evaluate this intervention, we performed a segmented regression analysis of an interrupted time series to compare the percentage of discordant orders before and after implementation among all hospitalizations for which an eMOLST was available.We identified a total of 3,648 visits that had an eMOLST filed prior to inpatient admission and a code status order placed during admission. There was a statistically significant decrease of discordant resuscitation orders of -5.95% after the intervention went live, with a relative risk reduction of 25% (95% CI: -9.95%, -1.94%; <i>p</i> = 0.009) in the pre- and post-intervention period. Logistic regression model after adjusting for covariates showed an average marginal effect of -5.12% after the intervention (CI: -9.75%, -0.50%; <i>p</i> = 0.03).Our intervention resulted in a decrease in discordant resuscitation orders. This study demonstrates that accessibility to eMOLST data within the provider workflow supported by CDS can reduce discrepancies between patient end-of-life wishes and hospital code status orders.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"943-950"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12396902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144055133","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Parental Access to Adolescent Online Healthcare Portals: Benefits, Problems, and Barriers. 父母访问青少年在线医疗门户网站:好处、问题和障碍。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-05-12 DOI: 10.1055/a-2605-4893
Bryan A Sisk, Alison Antes, Christine Bereitschaft, Fabienne Bourgeois, James M DuBois

Online healthcare portals provide access to electronic health information and support clinical communication. Almost no studies have examined perspectives on parental portal access. We aimed to characterize parental and adolescent perspectives on parental portal access.Semi-structured interviews with 51 dyads of parents and adolescents (102 total interviews). We stratified sampling for equal proportions of adolescents with and without chronic illnesses. We analyzed interview transcripts using thematic analysis.Parents and adolescents identified several benefits of parental portal access: improving understanding and access to information; supporting parents in managing adolescents' health and logistics; and supporting parents in teaching adolescents about their health. Parents and adolescents identified the following problems: threatening the adolescent's privacy; creating or exacerbating tension within the family; struggling to understand medical information; and creating emotional distress for parents. Parents described the following barriers to portal use: difficulties with enrollment and maintaining access; interface challenges; lack of awareness; and lack of interest. Some parents preferred to maintain access after their child was legally an adult. Although the portal has the potential to support collaborative care management between parents and adolescents, few parents use this tool collaboratively with their adolescents. Parents and adolescents identified multiple benefits, problems, and barriers to parents accessing the adolescent portal. Parents need sufficient access to health-related information in the portal to help them manage their adolescent's health and illness, especially for adolescents with chronic illness. Future efforts could better leverage the portal as a way of supporting collaboration in care between parents and adolescents.Portals offer several potential benefits to parents and adolescents. However, these benefits are impeded by technological limitations and lack of engagement of the adolescent.

目的:在线医疗门户网站提供对电子医疗信息的访问并支持临床交流。几乎没有研究检查了父母门户访问的观点。我们的目的是表征父母和青少年对父母门户访问的观点。材料与方法:对51对家长和青少年进行半结构化访谈(共102次访谈)。我们对有和没有慢性疾病的青少年进行了等比分层抽样。我们使用主题分析来分析访谈记录。结果:家长和青少年发现了父母门户访问的几个好处:增进理解和获取信息;支持父母管理青少年的健康和后勤;支持父母对青少年进行健康教育。家长和青少年发现了以下问题:威胁青少年的隐私;紧张的:在家庭中制造或加剧紧张的;难以理解医疗信息;给父母造成情绪困扰。家长描述了使用门户网站的以下障碍:注册和维护访问的困难;接口的挑战;缺乏意识;缺乏兴趣。一些父母更愿意在孩子合法成年后继续使用。虽然门户网站有潜力支持父母和青少年之间的协作护理管理,但很少有父母与他们的青少年协作使用这个工具。讨论:父母和青少年确定了父母访问青少年门户网站的多种好处、问题和障碍。父母需要在门户网站中充分获取与健康有关的信息,以帮助他们管理青少年的健康和疾病,特别是患有慢性病的青少年。今后的努力可以更好地利用门户网站,作为支持父母和青少年之间护理合作的一种方式。结论:门户网站为家长和青少年提供了几个潜在的好处。然而,这些好处受到技术限制和青少年缺乏参与的阻碍。
{"title":"Parental Access to Adolescent Online Healthcare Portals: Benefits, Problems, and Barriers.","authors":"Bryan A Sisk, Alison Antes, Christine Bereitschaft, Fabienne Bourgeois, James M DuBois","doi":"10.1055/a-2605-4893","DOIUrl":"10.1055/a-2605-4893","url":null,"abstract":"<p><p>Online healthcare portals provide access to electronic health information and support clinical communication. Almost no studies have examined perspectives on parental portal access. We aimed to characterize parental and adolescent perspectives on parental portal access.Semi-structured interviews with 51 dyads of parents and adolescents (102 total interviews). We stratified sampling for equal proportions of adolescents with and without chronic illnesses. We analyzed interview transcripts using thematic analysis.Parents and adolescents identified several benefits of parental portal access: improving understanding and access to information; supporting parents in managing adolescents' health and logistics; and supporting parents in teaching adolescents about their health. Parents and adolescents identified the following problems: threatening the adolescent's privacy; creating or exacerbating tension within the family; struggling to understand medical information; and creating emotional distress for parents. Parents described the following barriers to portal use: difficulties with enrollment and maintaining access; interface challenges; lack of awareness; and lack of interest. Some parents preferred to maintain access after their child was legally an adult. Although the portal has the potential to support collaborative care management between parents and adolescents, few parents use this tool collaboratively with their adolescents. Parents and adolescents identified multiple benefits, problems, and barriers to parents accessing the adolescent portal. Parents need sufficient access to health-related information in the portal to help them manage their adolescent's health and illness, especially for adolescents with chronic illness. Future efforts could better leverage the portal as a way of supporting collaboration in care between parents and adolescents.Portals offer several potential benefits to parents and adolescents. However, these benefits are impeded by technological limitations and lack of engagement of the adolescent.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1208-1218"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473516/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144032795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lessons Learned from Sepsis Microlearning Intervention. 败血症微学习干预的经验教训。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-09-26 DOI: 10.1055/a-2677-6012
Eduardo R Osegueda, Ben Webber, Tanvi Mehta, Deborah L Pestka, Joseph S Koopmeiners, Ivana Ninkovic, Genevieve B Melton, Timothy J Beebe, Michael G Usher

Improving early recognition and treatment of sepsis is key to decreasing patient mortality. A large academic health system implemented several quality improvement initiatives, yet monthly compliance with sepsis best practices remained low.Develop and evaluate an electronic health record (EHR)-embedded microlearning intervention to address suboptimal adherence to sepsis care best practices.We conducted a randomized stepped-wedge trial of our microlearning intervention with randomization done at the nursing block level. Antibiotic delay and secondary outcomes extracted from the EHR were analyzed using mixed models to account for intracluster correlation.The microlearning intervention did not reduce antibiotic delay (mean difference = 0.71 hours; p = 0.49). Despite the alert firing over 30,000 times during the study period, the microlearning intervention was viewed only a total of 30 times.Our microlearning intervention did not improve sepsis care outcomes. We believe that although the content addressed key knowledge gaps, delivering the intervention through disruptive EHR alerts was not an accessible delivery channel to the nursing staff we targeted.

提高败血症的早期识别和治疗是降低患者死亡率的关键。一个大型学术卫生系统实施了几项质量改进举措,但每月对败血症最佳实践的依从性仍然很低。开发和评估嵌入电子健康记录(EHR)的微学习干预措施,以解决败血症护理最佳实践的次优依从性问题。我们对我们的微学习干预进行了一项随机的阶梯形试验,在护理区水平进行了随机化。使用混合模型分析从电子病历中提取的抗生素延迟和次要结局,以解释簇内相关性。微学习干预没有减少抗生素延迟(平均差异= 0.71小时;p = 0.49)。尽管在研究期间警报发出超过3万次,但微学习干预总共只被观看了30次。我们的微学习干预并没有改善败血症的护理结果。我们认为,尽管内容解决了关键的知识差距,但通过破坏性的电子病历警报提供干预措施并不是我们所针对的护理人员的可访问的交付渠道。
{"title":"Lessons Learned from Sepsis Microlearning Intervention.","authors":"Eduardo R Osegueda, Ben Webber, Tanvi Mehta, Deborah L Pestka, Joseph S Koopmeiners, Ivana Ninkovic, Genevieve B Melton, Timothy J Beebe, Michael G Usher","doi":"10.1055/a-2677-6012","DOIUrl":"10.1055/a-2677-6012","url":null,"abstract":"<p><p>Improving early recognition and treatment of sepsis is key to decreasing patient mortality. A large academic health system implemented several quality improvement initiatives, yet monthly compliance with sepsis best practices remained low.Develop and evaluate an electronic health record (EHR)-embedded microlearning intervention to address suboptimal adherence to sepsis care best practices.We conducted a randomized stepped-wedge trial of our microlearning intervention with randomization done at the nursing block level. Antibiotic delay and secondary outcomes extracted from the EHR were analyzed using mixed models to account for intracluster correlation.The microlearning intervention did not reduce antibiotic delay (mean difference = 0.71 hours; <i>p</i> = 0.49). Despite the alert firing over 30,000 times during the study period, the microlearning intervention was viewed only a total of 30 times.Our microlearning intervention did not improve sepsis care outcomes. We believe that although the content addressed key knowledge gaps, delivering the intervention through disruptive EHR alerts was not an accessible delivery channel to the nursing staff we targeted.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"1165-1171"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473517/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145179792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Effect of Ambient Artificial Intelligence Scribes on Trainee Documentation Burden. 环境人工智能抄写员对实习生文档负担的影响。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-07-02 DOI: 10.1055/a-2647-1142
Donald S Wright, Naga S Kanaparthy, Edward R Melnick, Deborah R Levy, Stephen J Huot, Allen Hsiao, Lee H Schwamm, Shawn Y Ong

Ambient artificial intelligence scribes have become widespread commercial products in the era of generative artificial intelligence. While studies have examined the effect of these tools on the experience of attending physicians, little evidence is available regarding their use by resident physician trainees.To assess trainee experience with an ambient artificial intelligence scribe using measures of usability, acceptability, and documentation burden.This prospective observational study enrolled 47 trainees in a 2-month pilot. Pre/postsurveys were conducted with the NASA Task Load Index (NASA-TLX, raw unweighted form, pre/post, for cognitive load during the documentation), the System Usability Scale (post; general usability), the Net Promoter Score (post; acceptability), and the AMIA TrendBurden Survey (pre/post; documentation burden). Electronic health record utilization metrics were obtained from Epic Signal for both the pilot period and a 6-month baseline.In total, 43/47 (91.5%) of participants adopted the intervention in practice. NASA-TLX scores improved from 56.3 to 43.3 (p < 0.001), and multiple items on the TrendBurden survey improved with high measures of acceptability. No significant difference in time spent on notes activity per note written was observed, with a median increase of 0.4 minutes (p = 0.568).Trainee use of an ambient artificial intelligence scribe was associated with improvements in documentation burden. Additional research on the effect of this technology on trainee learning and expertise development is needed.

背景:在生成式人工智能时代,环境人工智能抄写器已经成为广泛的商业产品。虽然研究已经检查了这些工具对主治医师经验的影响,但关于住院医师培训生使用这些工具的证据很少。目的:通过可用性、可接受性和文档负担的度量来评估受训人员使用环境人工智能抄写员的经验。方法:这项前瞻性观察性研究招募了47名受训者,为期2个月。前后调查采用NASA任务负荷指数(NASA- tlx,原始未加权表格,前/后,用于文档编制过程中的认知负荷)、系统可用性量表(后,一般可用性)、净推荐值(后,可接受性)和AMIA趋势负担调查(前/后,文档编制负担)进行。从Epic Signal获得了试验期间和6个月基线的EHR利用率指标。结果:共有43/47(91.5%)的参与者在实践中采用了干预措施。NASA-TLX评分从56.3分提高到43.3分(p结论:受训人员使用环境人工智能抄写员与文件负担的改善有关。需要进一步研究这项技术对受训人员学习和专业知识发展的影响。
{"title":"The Effect of Ambient Artificial Intelligence Scribes on Trainee Documentation Burden.","authors":"Donald S Wright, Naga S Kanaparthy, Edward R Melnick, Deborah R Levy, Stephen J Huot, Allen Hsiao, Lee H Schwamm, Shawn Y Ong","doi":"10.1055/a-2647-1142","DOIUrl":"10.1055/a-2647-1142","url":null,"abstract":"<p><p>Ambient artificial intelligence scribes have become widespread commercial products in the era of generative artificial intelligence. While studies have examined the effect of these tools on the experience of attending physicians, little evidence is available regarding their use by resident physician trainees.To assess trainee experience with an ambient artificial intelligence scribe using measures of usability, acceptability, and documentation burden.This prospective observational study enrolled 47 trainees in a 2-month pilot. Pre/postsurveys were conducted with the NASA Task Load Index (NASA-TLX, raw unweighted form, pre/post, for cognitive load during the documentation), the System Usability Scale (post; general usability), the Net Promoter Score (post; acceptability), and the AMIA TrendBurden Survey (pre/post; documentation burden). Electronic health record utilization metrics were obtained from Epic Signal for both the pilot period and a 6-month baseline.In total, 43/47 (91.5%) of participants adopted the intervention in practice. NASA-TLX scores improved from 56.3 to 43.3 (<i>p</i> < 0.001), and multiple items on the TrendBurden survey improved with high measures of acceptability. No significant difference in time spent on notes activity per note written was observed, with a median increase of 0.4 minutes (<i>p</i> = 0.568).Trainee use of an ambient artificial intelligence scribe was associated with improvements in documentation burden. Additional research on the effect of this technology on trainee learning and expertise development is needed.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"872-878"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12367366/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144555398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lessons Learned from the Usability Assessment of an EHR-Based Tool to Support Adherence to Antihypertensive Medications. 基于电子病历的抗高血压药物依从性工具可用性评估的经验教训
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-08-14 DOI: 10.1055/a-2576-1596
Safa Elkefi, Tiffany R Martinez, Talia Nadel, Antoinette M Schoenthaler, Devin M Mann, Saul Blecker

Uncontrolled hypertension is common and frequently related to inadequate adherence to prescribed medications, resulting in suboptimal blood pressure control and increased healthcare utilization. Although healthcare providers have the opportunity to improve medication adherence, they may lack the tools to address adherence at the point of care. This study aims to assess the usability of a digital tool designed to improve medication adherence and blood pressure control among patients with hypertension who are not adherent to therapy. By evaluating usability, the study seeks to refine the tool's design, underscore the role of technology in managing hypertension, and provide insights to inform clinical decisions.We performed qualitative usability testing of an electronic health record (EHR)-integrated intervention with medical assistants (MAs) and primary care providers (PCPs) from a large integrated health system. Usability was assessed with these end-users using the "think aloud" and "near live" approaches. This evaluation was guided by two frameworks: the End-User Computing Satisfaction Index (EUCSI) and the Technology Acceptance Model (TAM). Interviews were analyzed using a thematic analysis approach.Thematic saturation was reached after usability testing was performed with 10 participants, comprising 5 PCPs and 5 MAs. The study identified several strengths within the content, format, ease of use, timeliness, accuracy, and usefulness of the tool, including the user-friendly content presentation, the usefulness of adherence information, and timely alerts that fit into the workflow. Challenges centered around alert visibility and specificity of information.Leveraging the two conceptual frameworks (TAM and EUCSI) to test the usability of the medication adherence tool was helpful. The tool's several strengths and opportunities for improvement were found. The resulting suggestions will be used to support the enhancement of the design for optimal implementation in a clinical trial.

不受控制的高血压很常见,通常与不充分遵守处方药物有关,导致血压控制不佳和医疗保健利用率增加。虽然医疗保健提供者有机会提高药物依从性,但他们可能缺乏在护理点解决依从性的工具。本研究旨在评估一种数字工具的可用性,该工具旨在改善未坚持治疗的高血压患者的药物依从性和血压控制。通过评估可用性,该研究旨在完善工具的设计,强调技术在高血压管理中的作用,并为临床决策提供见解。我们对来自大型综合卫生系统的医疗助理(MAs)和初级保健提供者(pcp)进行了电子健康记录(EHR)综合干预的定性可用性测试。这些终端用户使用“大声思考”和“接近现场”的方法来评估可用性。该评估由两个框架指导:最终用户计算满意度指数(EUCSI)和技术接受模型(TAM)。访谈采用专题分析方法进行分析。通过10个参与者(包括5个pcp和5个ma)进行可用性测试,主题饱和达到。该研究确定了该工具在内容、格式、易用性、及时性、准确性和有用性方面的几个优势,包括用户友好的内容表示、依从性信息的有用性以及适合工作流程的及时警报。挑战集中在警报可见性和信息的特异性上。利用两个概念框架(TAM和EUCSI)来测试药物依从性工具的可用性是有帮助的。发现了该工具的几个优点和改进的机会。所得的建议将用于支持在临床试验中优化实施的设计。
{"title":"Lessons Learned from the Usability Assessment of an EHR-Based Tool to Support Adherence to Antihypertensive Medications.","authors":"Safa Elkefi, Tiffany R Martinez, Talia Nadel, Antoinette M Schoenthaler, Devin M Mann, Saul Blecker","doi":"10.1055/a-2576-1596","DOIUrl":"10.1055/a-2576-1596","url":null,"abstract":"<p><p>Uncontrolled hypertension is common and frequently related to inadequate adherence to prescribed medications, resulting in suboptimal blood pressure control and increased healthcare utilization. Although healthcare providers have the opportunity to improve medication adherence, they may lack the tools to address adherence at the point of care. This study aims to assess the usability of a digital tool designed to improve medication adherence and blood pressure control among patients with hypertension who are not adherent to therapy. By evaluating usability, the study seeks to refine the tool's design, underscore the role of technology in managing hypertension, and provide insights to inform clinical decisions.We performed qualitative usability testing of an electronic health record (EHR)-integrated intervention with medical assistants (MAs) and primary care providers (PCPs) from a large integrated health system. Usability was assessed with these end-users using the \"think aloud\" and \"near live\" approaches. This evaluation was guided by two frameworks: the End-User Computing Satisfaction Index (EUCSI) and the Technology Acceptance Model (TAM). Interviews were analyzed using a thematic analysis approach.Thematic saturation was reached after usability testing was performed with 10 participants, comprising 5 PCPs and 5 MAs. The study identified several strengths within the content, format, ease of use, timeliness, accuracy, and usefulness of the tool, including the user-friendly content presentation, the usefulness of adherence information, and timely alerts that fit into the workflow. Challenges centered around alert visibility and specificity of information.Leveraging the two conceptual frameworks (TAM and EUCSI) to test the usability of the medication adherence tool was helpful. The tool's several strengths and opportunities for improvement were found. The resulting suggestions will be used to support the enhancement of the design for optimal implementation in a clinical trial.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 4","pages":"760-768"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12352985/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144856732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance Degradation between Development and Deployment of a Predictive Model for Central Line-Associated Bloodstream Infections in Hospitalized Children. 关于CDS失效的特刊:住院儿童中央线相关血流感染预测模型的开发和部署之间的性能下降。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-08-01 Epub Date: 2025-05-12 DOI: 10.1055/a-2605-1847
Jonathan M Beus, Mark Mai, Nikolay P Braykov, Swaminathan Kandaswamy, Edwin Ray, David B Cundiff, Paulette Djachechi, Sarah Thompson, Azade Tabaie, Ryan Birmingham, Rishi Kamaleswaran, Evan Orenstein

Central line-associated bloodstream infections (CLABSIs) are associated with substantial pediatric morbidity and mortality. The capacity to predict which children with central lines are at greatest risk of CLABSI could inform surveillance and prevention efforts. Our team previously published in silico predictive models for CLABSI.To prospectively implement a pediatric CLABSI predictive model and achieve adequate performance in offline validation for implementation in clinical practice.Most performant predictive models were deep learning models requiring substantial pre-processing of many features into 8-hour windows including the current day and up to 56 days prior for the current admission. To replicate this pre-processing, we created a novel infrastructure to (1) organize current-day data for all the relevant features and (2) create a staged historical data store for those same features with application programming interfaces to connect the two. We compared predictive performance of these scores for CLABSI in the next 48 hours with two labels, one based on manual review of positive blood cultures in children with central lines and another based on positive blood culture and receipt of at least 4 days of new IV antibiotics.The area under the receiver-operating characteristic (AUROC) fell from 0.97 from retrospective data to <0.60 despite multiple iterations of troubleshooting. Primary root causes included train/serve skew, feature leakage, and overfitting. Hypothesized secondary drivers were complex model specification, poor data governance, inadequate testing, challenging feature translation between real-time and historical data models, limited monitoring and logging infrastructure for troubleshooting, and suboptimal handoff between the model development and deployment teams.Bridging the gap from predictive model development to clinical deployment requires early and close coordination between data governance, data science, clinical informatics, and implementation engineers. Balancing predictive performance with implementation feasibility can accelerate the adoption of predictive clinical decision support systems.

背景:中心线相关血流感染(CLABSIs)与大量儿科发病率和死亡率相关。预测哪些有中心静脉管的儿童有最大的CLABSI风险的能力可以为监测和预防工作提供信息。我们的团队之前发表了CLABSI的计算机预测模型。目的:前瞻性地实施儿童CLABSI预测模型,并在临床实践中实现足够的离线验证。方法:最高效的预测模型是深度学习模型,需要对许多特征进行大量预处理,进入8小时的窗口,包括当天和当前入院前56天。为了复制这种预处理,我们创建了新的基础设施来(1)组织所有相关特性的当前数据,(2)为这些相同的特性创建一个分阶段的历史数据存储,并使用应用程序编程接口将两者连接起来。我们比较了未来48小时CLABSI评分与两种标签的预测性能,一种是基于对中心静脉导管儿童阳性血培养的人工审查,另一种是基于阳性血培养和接受至少4天新的静脉注射抗生素。结果:接受者操作特征下面积(AUROC)从回顾性数据的0.97下降到结论:要弥合从预测模型开发到临床部署的差距,需要数据治理、数据科学、临床信息学和实施工程师之间的早期密切协调。平衡预测性能和实施可行性可以加速采用预测性临床决策支持系统。
{"title":"Performance Degradation between Development and Deployment of a Predictive Model for Central Line-Associated Bloodstream Infections in Hospitalized Children.","authors":"Jonathan M Beus, Mark Mai, Nikolay P Braykov, Swaminathan Kandaswamy, Edwin Ray, David B Cundiff, Paulette Djachechi, Sarah Thompson, Azade Tabaie, Ryan Birmingham, Rishi Kamaleswaran, Evan Orenstein","doi":"10.1055/a-2605-1847","DOIUrl":"10.1055/a-2605-1847","url":null,"abstract":"<p><p>Central line-associated bloodstream infections (CLABSIs) are associated with substantial pediatric morbidity and mortality. The capacity to predict which children with central lines are at greatest risk of CLABSI could inform surveillance and prevention efforts. Our team previously published <i>in silico</i> predictive models for CLABSI.To prospectively implement a pediatric CLABSI predictive model and achieve adequate performance in offline validation for implementation in clinical practice.Most performant predictive models were deep learning models requiring substantial pre-processing of many features into 8-hour windows including the current day and up to 56 days prior for the current admission. To replicate this pre-processing, we created a novel infrastructure to (1) organize current-day data for all the relevant features and (2) create a staged historical data store for those same features with application programming interfaces to connect the two. We compared predictive performance of these scores for CLABSI in the next 48 hours with two labels, one based on manual review of positive blood cultures in children with central lines and another based on positive blood culture and receipt of at least 4 days of new IV antibiotics.The area under the receiver-operating characteristic (AUROC) fell from 0.97 from retrospective data to <0.60 despite multiple iterations of troubleshooting. Primary root causes included train/serve skew, feature leakage, and overfitting. Hypothesized secondary drivers were complex model specification, poor data governance, inadequate testing, challenging feature translation between real-time and historical data models, limited monitoring and logging infrastructure for troubleshooting, and suboptimal handoff between the model development and deployment teams.Bridging the gap from predictive model development to clinical deployment requires early and close coordination between data governance, data science, clinical informatics, and implementation engineers. Balancing predictive performance with implementation feasibility can accelerate the adoption of predictive clinical decision support systems.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1192-1199"},"PeriodicalIF":2.2,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473521/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144035943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1