首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
Effect of a Clinical Decision Support Tool for Identifying Patients Benefiting from End-of-Life Discussions on Emergency Department Clinician Behavior. 临床决策支持工具识别患者受益于临终讨论对急诊科临床医生行为的影响。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-11-14 DOI: 10.1055/a-2638-9340
Monisha Dilip, Craig Rothenberg, Reinier Van Tonder, Karen Jubanyik, Arjun K Venkatesh, Deborah Rhodes, Rohit B Sangal, Nancy Kim

Electronic health records (EHRs) are intended to improve clinical practice, but excessive alerts can be counterproductive, leading to workarounds. The Mortality Surprise Question (MSQ), a tool for identifying patients who might benefit from early end-of-life discussions, was integrated into the Emergency Department (ED) EHR admission process.This study investigated how the staged implementation of a clinical decision support tool at the point of admission order entry affected ED clinician admission order practices.This retrospective cohort study examined ED admission orders from 2023 across three EDs. Clinicians used either the Quicklist or Disposition tab in the Epic EHR for admissions. The MSQ was introduced in two phases, first to the Quicklist on May 31, 2023, and then to the Disposition tab on September 11, 2023. Admissions from both tabs were analyzed pre- and post-MSQ implementation. Statistical analysis included chi-square testing to compare the admission source in the EHR after each phase of implementation of the MSQ to examine changes in the clinicians' admission workflow, with further categorization based on clinician EHR experience.Overall, 53,897 patients were admitted from the ED, with 29,542 (55%) admissions via the Quicklist and 24,355 (45%) via the Disposition tab. A statistically significant difference was found in Quicklist admission proportions before and after MSQ implementation in both workflows. As compared with clinicians with less than 2 years of experience with the EHR, clinicians with 2 to 4 years of EHR use were less likely to use the Quicklist after MSQ implementation, whereas those with over 4 years of use were more likely to use it.The MSQ disrupted established workflows, prompting clinicians to initially adopt more effortful alternatives to avoid the new cognitive task. Embedding the MSQ into these alternatives reduced resistance, highlighting that removing optionality promotes adoption. Accounting for clinician habits and potential workarounds can enhance the integration and efficiency of new quality improvement measures.

电子健康记录(EHRs)旨在改善临床实践,但过多的警报可能会适得其反,导致解决方案。死亡率意外问题(MSQ)是一种识别可能从早期临终讨论中受益的患者的工具,已被纳入急诊科(ED) EHR入院过程。本研究调查了在住院令输入点分阶段实施临床决策支持工具如何影响急诊科临床医生的住院令实践。这项回顾性队列研究调查了三个急诊科从2023年开始的住院医嘱。临床医生在Epic EHR中使用快速列表或处置选项卡进行入院。MSQ分两个阶段引入,首先是2023年5月31日的快速列表,然后是2023年9月11日的处置选项卡。在实施msq之前和之后,分析了两个标签的录取情况。统计分析包括卡方检验,比较实施MSQ各阶段后电子病历中的入院来源,以检查临床医生入院工作流程的变化,并根据临床医生的电子病历经验进一步分类。总体而言,53,897例患者从急诊科入院,其中29,542例(55%)通过快速列表入院,24,355例(45%)通过处置标签入院。在两个工作流程中,在实施MSQ之前和之后的快速列表准入比例有统计学上的显著差异。与使用电子病历少于2年的临床医生相比,使用电子病历2至4年的临床医生在实施MSQ后使用快速清单的可能性较小,而使用超过4年的临床医生更有可能使用它。MSQ打乱了既定的工作流程,促使临床医生最初采用更费力的替代方法来避免新的认知任务。将MSQ嵌入到这些替代方案中减少了阻力,强调了消除可选性促进了采用。考虑到临床医生的习惯和潜在的变通方法可以提高新的质量改进措施的整合和效率。
{"title":"Effect of a Clinical Decision Support Tool for Identifying Patients Benefiting from End-of-Life Discussions on Emergency Department Clinician Behavior.","authors":"Monisha Dilip, Craig Rothenberg, Reinier Van Tonder, Karen Jubanyik, Arjun K Venkatesh, Deborah Rhodes, Rohit B Sangal, Nancy Kim","doi":"10.1055/a-2638-9340","DOIUrl":"10.1055/a-2638-9340","url":null,"abstract":"<p><p>Electronic health records (EHRs) are intended to improve clinical practice, but excessive alerts can be counterproductive, leading to workarounds. The Mortality Surprise Question (MSQ), a tool for identifying patients who might benefit from early end-of-life discussions, was integrated into the Emergency Department (ED) EHR admission process.This study investigated how the staged implementation of a clinical decision support tool at the point of admission order entry affected ED clinician admission order practices.This retrospective cohort study examined ED admission orders from 2023 across three EDs. Clinicians used either the Quicklist or Disposition tab in the Epic EHR for admissions. The MSQ was introduced in two phases, first to the Quicklist on May 31, 2023, and then to the Disposition tab on September 11, 2023. Admissions from both tabs were analyzed pre- and post-MSQ implementation. Statistical analysis included chi-square testing to compare the admission source in the EHR after each phase of implementation of the MSQ to examine changes in the clinicians' admission workflow, with further categorization based on clinician EHR experience.Overall, 53,897 patients were admitted from the ED, with 29,542 (55%) admissions via the Quicklist and 24,355 (45%) via the Disposition tab. A statistically significant difference was found in Quicklist admission proportions before and after MSQ implementation in both workflows. As compared with clinicians with less than 2 years of experience with the EHR, clinicians with 2 to 4 years of EHR use were less likely to use the Quicklist after MSQ implementation, whereas those with over 4 years of use were more likely to use it.The MSQ disrupted established workflows, prompting clinicians to initially adopt more effortful alternatives to avoid the new cognitive task. Embedding the MSQ into these alternatives reduced resistance, highlighting that removing optionality promotes adoption. Accounting for clinician habits and potential workarounds can enhance the integration and efficiency of new quality improvement measures.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1677-1682"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12618147/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145524294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving the Observed-to-Expected Mortality Ratio with the Combination of Standardized Documentation and a Multidisciplinary Mortality Review Committee. 通过标准化文件和多学科死亡率审查委员会的结合,提高观察到的死亡率与预期的死亡率。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-12-12 DOI: 10.1055/a-2767-1161
Ellen Overson, Jacob Wagner, James Grace, Melissa Haala, Bradley Burns, Abraham Jacob, Rebecca Markowitz

Many academic medical centers (AMCs) rely on systems like the Vizient Quality and Accountability Scorecard to track quality metrics such as the observed-to-expected (O/E) mortality ratio. The O/E mortality ratio calculation relies on clinical documentation. Missed documentation of diagnoses and risk factors for mortality leads to an underestimated expected mortality, which negatively affects the O/E metric.We aimed to reduce our O/E mortality ratio from a median of 1.08 (± 0.10) to a median well below 0.90 within 12 months by improving the accuracy of clinical documentation.We used a continuous quality improvement process that began with creating a rule-based tool within a standardized documentation template. The tool was designed to pull pertinent discrete electronic health record data into clinician documentation. The tool only pulled in data that were present on admission, and it especially prioritized inclusion of frequently missed risk factors according to prior coding query data. We then formed a multidisciplinary mortality review committee where providers reviewed mortality cases, made suggestions for documentation clarification, and found potential diagnoses and risk factors that the patient had which were missing from the documentation. We then leveraged the committee's expertise and feedback to improve the rule-based clinical tool.Over the 21-month period following implementation, the median O/E mortality ratio decreased by 30%, from 1.08 (± 0.10) to 0.72 (± 0.13) and consistently remained below the prior levels. Importantly, the intervention also led to a reduction in the total number of coding queries sent to clinicians, indicating a lower administrative burden for clinicians and coders.Our interventions showed a clear improvement in the O/E mortality ratio at our AMC and in the expected mortality percentage compared with other similar institutions without significantly increasing burden on clinicians or coding specialists.

许多学术医疗中心(amc)依靠像Vizient质量和责任记分卡这样的系统来跟踪质量指标,如观察到的预期死亡率(O/E)。O/E死亡率的计算依赖于临床文献。诊断和死亡危险因素的遗漏记录导致预期死亡率被低估,从而对O/E指标产生负面影响。目的:我们旨在通过提高临床文献的准确性,在12个月内将O/E死亡率中位数从1.08(±0.10)降低到远低于0.90的中位数。方法:我们使用了一个持续的质量改进过程,它开始于在一个标准化的文档模板中创建一个基于规则的工具。该工具旨在将相关的离散电子健康记录数据拉入临床医生文档。该工具仅提取入院时存在的数据,并且根据先前的编码查询数据,它特别优先包含经常遗漏的风险因素。然后,我们成立了一个多学科死亡率审查委员会,由提供者审查死亡率病例,为文件澄清提出建议,并发现文件中遗漏的患者的潜在诊断和风险因素。然后,我们利用委员会的专业知识和反馈来改进基于规则的临床工具。结果:在实施后的21个月期间,中位O/E死亡率下降了30%,从1.08(±0.10)降至0.72(±0.13),并始终低于先前的水平。重要的是,干预还导致发送给临床医生的编码查询总数减少,表明临床医生和编码人员的管理负担较低。结论:与其他类似机构相比,我们的干预措施明显改善了AMC的O/E死亡率和预期死亡率,而没有显著增加临床医生或编码专家的负担。
{"title":"Improving the Observed-to-Expected Mortality Ratio with the Combination of Standardized Documentation and a Multidisciplinary Mortality Review Committee.","authors":"Ellen Overson, Jacob Wagner, James Grace, Melissa Haala, Bradley Burns, Abraham Jacob, Rebecca Markowitz","doi":"10.1055/a-2767-1161","DOIUrl":"10.1055/a-2767-1161","url":null,"abstract":"<p><p>Many academic medical centers (AMCs) rely on systems like the Vizient Quality and Accountability Scorecard to track quality metrics such as the observed-to-expected (O/E) mortality ratio. The O/E mortality ratio calculation relies on clinical documentation. Missed documentation of diagnoses and risk factors for mortality leads to an underestimated expected mortality, which negatively affects the O/E metric.We aimed to reduce our O/E mortality ratio from a median of 1.08 (± 0.10) to a median well below 0.90 within 12 months by improving the accuracy of clinical documentation.We used a continuous quality improvement process that began with creating a rule-based tool within a standardized documentation template. The tool was designed to pull pertinent discrete electronic health record data into clinician documentation. The tool only pulled in data that were present on admission, and it especially prioritized inclusion of frequently missed risk factors according to prior coding query data. We then formed a multidisciplinary mortality review committee where providers reviewed mortality cases, made suggestions for documentation clarification, and found potential diagnoses and risk factors that the patient had which were missing from the documentation. We then leveraged the committee's expertise and feedback to improve the rule-based clinical tool.Over the 21-month period following implementation, the median O/E mortality ratio decreased by 30%, from 1.08 (± 0.10) to 0.72 (± 0.13) and consistently remained below the prior levels. Importantly, the intervention also led to a reduction in the total number of coding queries sent to clinicians, indicating a lower administrative burden for clinicians and coders.Our interventions showed a clear improvement in the O/E mortality ratio at our AMC and in the expected mortality percentage compared with other similar institutions without significantly increasing burden on clinicians or coding specialists.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1909-1916"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12737979/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145745291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
User-Centered Assessment of MRI Equipment Flexibility, Workspace Adequacy, User Interface Usability, and Technical Proficiency. 以用户为中心的MRI设备灵活性、工作空间充分性、用户界面可用性和技术熟练度评估。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-11-07 DOI: 10.1055/a-2721-6170
Albert D Piersson, George Nunoo, Evans Tettey, Nicholas Otumi

The effective operation of magnetic resonance imaging (MRI) systems relies on physical interactions with complex imaging environments, equipment, and user interfaces (UIs). However, there is limited empirical data evaluating how physical interactions with MRI equipment and accessories, workspace configuration, MRI UI design, and technical proficiency influence clinical workflow.In this study, a cross-sectional survey was conducted among MRI end-users, across public and private health facilities (n = 13), using a structured questionnaire to assess demographics, patient positioning and equipment handling, MRI workspace adequacy, interface usability (guided by Nielsen's heuristics), and self-reported MRI skill proficiency.The predominant field strength of scanners in current use was 1.5T. General Electric was the most frequently used MRI scanner brand. Most respondents received their MRI training from nonvendor sources-such as academic institutions or peer-based instruction-rather than directly from equipment manufacturers. High ease-of-use ratings were reported for patient positioning and equipment handling tasks. Workspace adequacy was mostly rated as very adequate to highly adequate. Computed Tomography-experienced users showed moderate-to-high proficiency in MRI pulse sequencing and image optimization. However, lower proficiency was noted in quality assurance and physiologic monitoring. Help documentation within the MRI interface received the lowest usability scores. No significant differences in usability or proficiency were found between those trained by vendors versus nonvendors (U = 8.5-15.0; p = 0.376-0.921).Opportunities exist to enhance clinical workflow and patient throughput by refining error-handling features, improving support documentation, reinforcing ongoing professional development, and re-evaluating training delivery by incorporating iterative, multimedia-based learning modules and regular postinstallation refresher sessions. End-user input in UI design and user feedback analysis should be prioritized to improve system usability and clinical efficiency.

磁共振成像(MRI)系统的有效运行依赖于与复杂成像环境、设备和用户界面(ui)的物理交互。然而,评估与MRI设备和配件、工作空间配置、MRI UI设计和技术熟练程度的物理交互如何影响临床工作流程的经验数据有限。在这项研究中,我们在公立和私立医疗机构的MRI终端用户中进行了一项横断面调查(n = 13),使用结构化问卷来评估人口统计、患者定位和设备处理、MRI工作空间充分性、界面可用性(由尼尔森启发式指导)和自我报告的MRI技能熟练程度。目前使用的扫描仪的主要场强为1.5T。通用电气是使用频率最高的MRI扫描仪品牌。大多数受访者接受的MRI培训来自非供应商来源,如学术机构或同行指导,而不是直接来自设备制造商。据报道,患者定位和设备处理任务的易用性评分较高。工作空间的充足性通常被评为非常充足到高度充足。计算机断层扫描经验丰富的用户在MRI脉冲测序和图像优化方面表现出中等到高度的熟练程度。然而,在质量保证和生理监测方面的熟练程度较低。MRI界面中的帮助文档获得了最低的可用性分数。供应商与非供应商在可用性或熟练程度上没有显著差异(U = 8.5-15.0; p = 0.376-0.921)。通过改进错误处理功能、改进支持文档、加强正在进行的专业发展,以及通过结合迭代的、基于多媒体的学习模块和定期的安装后复习课程来重新评估培训交付,存在改进临床工作流程和患者吞吐量的机会。应优先考虑用户在UI设计和用户反馈分析中的输入,以提高系统的可用性和临床效率。
{"title":"User-Centered Assessment of MRI Equipment Flexibility, Workspace Adequacy, User Interface Usability, and Technical Proficiency.","authors":"Albert D Piersson, George Nunoo, Evans Tettey, Nicholas Otumi","doi":"10.1055/a-2721-6170","DOIUrl":"10.1055/a-2721-6170","url":null,"abstract":"<p><p>The effective operation of magnetic resonance imaging (MRI) systems relies on physical interactions with complex imaging environments, equipment, and user interfaces (UIs). However, there is limited empirical data evaluating how physical interactions with MRI equipment and accessories, workspace configuration, MRI UI design, and technical proficiency influence clinical workflow.In this study, a cross-sectional survey was conducted among MRI end-users, across public and private health facilities (<i>n</i> = 13), using a structured questionnaire to assess demographics, patient positioning and equipment handling, MRI workspace adequacy, interface usability (guided by Nielsen's heuristics), and self-reported MRI skill proficiency.The predominant field strength of scanners in current use was 1.5T. General Electric was the most frequently used MRI scanner brand. Most respondents received their MRI training from nonvendor sources-such as academic institutions or peer-based instruction-rather than directly from equipment manufacturers. High ease-of-use ratings were reported for patient positioning and equipment handling tasks. Workspace adequacy was mostly rated as very adequate to highly adequate. Computed Tomography-experienced users showed moderate-to-high proficiency in MRI pulse sequencing and image optimization. However, lower proficiency was noted in quality assurance and physiologic monitoring. Help documentation within the MRI interface received the lowest usability scores. No significant differences in usability or proficiency were found between those trained by vendors versus nonvendors (<i>U</i> = 8.5-15.0; <i>p</i> = 0.376-0.921).Opportunities exist to enhance clinical workflow and patient throughput by refining error-handling features, improving support documentation, reinforcing ongoing professional development, and re-evaluating training delivery by incorporating iterative, multimedia-based learning modules and regular postinstallation refresher sessions. End-user input in UI design and user feedback analysis should be prioritized to improve system usability and clinical efficiency.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1595-1605"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594564/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145472367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Finding the Right Level of Interruption to Improve Suicide Screening Compliance in the Emergency Department. 关于CDS失败的特刊:在急诊科找到适当的中断水平以提高自杀筛查的依从性。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-06-04 DOI: 10.1055/a-2627-2493
Katrina Ann-Marie Lee, Christopher S Evans, Misty Skinner

The use of real-time clinical decision support (CDS), such as Our Practice Advisory (OPAs), augments clinical decisions while helping to reduce errors and ensuring compliance with organizational best practices.1 In complex large health systems, processes for standardization and adherence to emergency department (ED)-based suicide screening practices are challenging and may benefit from the use of CDS-based tools adhering to the five rights of CDS.2 To improve suicide screening compliance for the ED to 95% by implementing a contextually appropriate CDS-based tool within the electronic health record (EHR).A multidisciplinary group of quality and ED nursing leadership aimed to develop a chief complaint-driven OPA that improved adherence to and completion of suicide screening in the ED. Using an iterative design process over 3 months, a series of two distinct suicide screening OPAs were developed with varying levels of interruption, but both relied on rule-based logic to identify if an ED patient met one of the 57 predefined "Reasons for Visit" or chief complaints requiring suicide screening. Use of chief complaint-driving CDS removed the need for manually remembering complex criteria while contributing to meeting regulatory and organizational standards.The ED suicide screening compliance improved from 64.96 to 77.66% with the initial implementation of the noninterruptive OPA. Subsequently, an interruptive OPA (pop-up window based on a defined trigger that stops the clinician and requires a response), was introduced which further increased screenings being completed to 91.69%. The use of CDS interruptive OPAs significantly improved compliance with suicide screening by including the Columbia Suicide Severity Rating Scale tool directly in the OPA.Use of contextually relevant information, such as reason for visit or chief complaint, and interruptive CDS tools embedded into EHR workflows may improve ED-based suicide screening.

背景:实时临床决策支持(CDS)的使用,如Our Practice Advisory (OPAs),增加了临床决策,同时有助于减少错误并确保符合组织最佳实践1。在复杂的大型卫生系统中,标准化和遵守基于急诊科(ED)的自杀筛查做法的过程具有挑战性,并且可能受益于使用符合CDS2五项权利的基于cds的工具。目的:通过在电子健康记录(EHR)中实施上下文适当的基于cd的工具,将ED的自杀筛查依从性提高到95%。方法:护理领导一个多学科小组的质量和ED旨在开发一个主诉OPA驱动,提高遵守并完成自杀。使用一个迭代设计过程中筛选超过3个月,一系列的两种截然不同的自杀式筛选赞助方是发达与不同级别的中断,但都依赖于基于规则的逻辑来确定如果一个ED患者遇到的57个预定义的“访问”的理由或首席投诉要求自杀筛查。使用主诉驱动CDS消除了手动记忆复杂标准的需要,同时有助于满足法规和组织标准。结果:初步实施不间断OPA后,ED自杀筛查依从性由64.96%提高到77.66%。随后,引入了中断OPA(基于定义的触发因素的弹出窗口,可以阻止临床医生并要求做出反应),进一步将筛查完成率提高到91.69%。通过将哥伦比亚自杀严重程度评定量表(C-SSRS)直接纳入OPA, CDS中断性OPA的使用显著提高了自杀筛查的依从性。结论:使用情境相关信息,如就诊原因或主诉,以及嵌入EHR工作流程的中断性CDS工具可以改善基于ED的自杀筛查。
{"title":"Finding the Right Level of Interruption to Improve Suicide Screening Compliance in the Emergency Department.","authors":"Katrina Ann-Marie Lee, Christopher S Evans, Misty Skinner","doi":"10.1055/a-2627-2493","DOIUrl":"10.1055/a-2627-2493","url":null,"abstract":"<p><p>The use of real-time clinical decision support (CDS), such as Our Practice Advisory (OPAs), augments clinical decisions while helping to reduce errors and ensuring compliance with organizational best practices.1 In complex large health systems, processes for standardization and adherence to emergency department (ED)-based suicide screening practices are challenging and may benefit from the use of CDS-based tools adhering to the five rights of CDS.2 To improve suicide screening compliance for the ED to 95% by implementing a contextually appropriate CDS-based tool within the electronic health record (EHR).A multidisciplinary group of quality and ED nursing leadership aimed to develop a chief complaint-driven OPA that improved adherence to and completion of suicide screening in the ED. Using an iterative design process over 3 months, a series of two distinct suicide screening OPAs were developed with varying levels of interruption, but both relied on rule-based logic to identify if an ED patient met one of the 57 predefined \"Reasons for Visit\" or chief complaints requiring suicide screening. Use of chief complaint-driving CDS removed the need for manually remembering complex criteria while contributing to meeting regulatory and organizational standards.The ED suicide screening compliance improved from 64.96 to 77.66% with the initial implementation of the noninterruptive OPA. Subsequently, an interruptive OPA (pop-up window based on a defined trigger that stops the clinician and requires a response), was introduced which further increased screenings being completed to 91.69%. The use of CDS interruptive OPAs significantly improved compliance with suicide screening by including the Columbia Suicide Severity Rating Scale tool directly in the OPA.Use of contextually relevant information, such as reason for visit or chief complaint, and interruptive CDS tools embedded into EHR workflows may improve ED-based suicide screening.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1615-1620"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594562/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144975641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Artificial Intelligence-Based Hospital Malnutrition Screening: Validation of a Novel Machine Learning Model. 基于人工智能的医院营养不良筛查:一种新型机器学习模型的验证。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-06-16 DOI: 10.1055/a-2635-3158
Adam M Bernstein, Pierre Janeke, Richard V Riggs, Emily Burke, Jemima Meyer, Meagan F Moyer, Keiy Murofushi, Raymond A Botha, Josiah El Michael Meyer

Despite its morbidity, mortality, and financial burden, in-hospital malnutrition remains underdiagnosed and undertreated. Artificial intelligence (AI) offers a promising clinical informatics solution for identifying malnutrition risk and one that can be coupled with clinician-delivered patient care.The objectives of the study were to evaluate an AI-based hospital malnutrition screening model in a large and diverse inpatient population and to compare it to the currently used clinician-delivered malnutrition screening tool.We studied the performance of a gradient-boosted decision tree model incorporating a large language model (LLM) for feature extraction using the electronic medical record data of 106,449 patients over 3.75 years.The model's area under the receiver operating curve was 0.92 (95% confidence interval [CI]: 0.91-0.92) on the first day of hospitalization and rose to 0.95 (95% CI: 0.95-0.96) using the maximum risk predicted for each patient throughout hospitalization, indexed against discharge-coded malnutrition. Similar results were observed when indexed against dietitian-recorded malnutrition. The model outperformed the nurse-administered, modified version of the Malnutrition Screening Tool (MST) that was used in practice. Patients identified by the model had higher likelihoods of readmission and death compared with patients identified by the nurse-administered screener.Our study findings provide validation for a novel model's use in the prediction of in-hospital malnutrition.

背景:尽管其发病率、死亡率和经济负担,但医院营养不良仍然未得到充分诊断和治疗。人工智能为识别营养不良风险提供了一个很有前途的临床信息学解决方案,并且可以与临床医生提供的患者护理相结合。目的:本研究的目的是评估基于人工智能的医院营养不良筛查模型,并将其与目前使用的临床提供的营养不良筛查工具进行比较。方法:我们研究了结合大语言模型(LLM)的梯度增强决策树模型的性能,该模型使用了106,449名超过3.75年的患者的电子病历数据进行特征提取。结果:在住院第一天,模型在接受者操作曲线下的面积为0.92 (95% CI: 0.91-0.92),使用每个患者在整个住院期间预测的最大风险上升到0.95 (95% CI: 0.95-0.96),以出院编码的营养不良为指标。当与营养师记录的营养不良进行对照时,也观察到类似的结果。该模型优于护士管理的改良版营养不良筛查工具(MST),与护士管理的筛查器识别的患者相比,该模型识别的患者再入院和死亡的可能性更高。结论:我们的研究结果为一种新的模型在院内营养不良预测中的应用提供了验证。
{"title":"Artificial Intelligence-Based Hospital Malnutrition Screening: Validation of a Novel Machine Learning Model.","authors":"Adam M Bernstein, Pierre Janeke, Richard V Riggs, Emily Burke, Jemima Meyer, Meagan F Moyer, Keiy Murofushi, Raymond A Botha, Josiah El Michael Meyer","doi":"10.1055/a-2635-3158","DOIUrl":"10.1055/a-2635-3158","url":null,"abstract":"<p><p>Despite its morbidity, mortality, and financial burden, in-hospital malnutrition remains underdiagnosed and undertreated. Artificial intelligence (AI) offers a promising clinical informatics solution for identifying malnutrition risk and one that can be coupled with clinician-delivered patient care.The objectives of the study were to evaluate an AI-based hospital malnutrition screening model in a large and diverse inpatient population and to compare it to the currently used clinician-delivered malnutrition screening tool.We studied the performance of a gradient-boosted decision tree model incorporating a large language model (LLM) for feature extraction using the electronic medical record data of 106,449 patients over 3.75 years.The model's area under the receiver operating curve was 0.92 (95% confidence interval [CI]: 0.91-0.92) on the first day of hospitalization and rose to 0.95 (95% CI: 0.95-0.96) using the maximum risk predicted for each patient throughout hospitalization, indexed against discharge-coded malnutrition. Similar results were observed when indexed against dietitian-recorded malnutrition. The model outperformed the nurse-administered, modified version of the Malnutrition Screening Tool (MST) that was used in practice. Patients identified by the model had higher likelihoods of readmission and death compared with patients identified by the nurse-administered screener.Our study findings provide validation for a novel model's use in the prediction of in-hospital malnutrition.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1646-1657"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12618146/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144310650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Preliminary Conceptual Framework of Clinical Documentation Burden: Exploratory Factor Analysis Investigating Usability, Effort, and Perceived Burden among Health Care Providers. 临床文件负担的初步概念框架:探索性因素分析调查可用性,努力,和感知负担在医疗保健提供者。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-11-24 DOI: 10.1055/a-2751-1896
Rhiannon Doherty, Abby Swanson Kazley, Eva Karp, Jennifer Ferrand

For every 30 minutes a provider spends seeing a patient, they spend 36 minutes charting in the electronic health record (EHR). Clinical documentation burden in U.S. health care is driven by increasing administrative tasks associated with EHRs, regulatory demands, and workflow inefficiencies. This burden contributes to increased cognitive load, fragmented care, and staff burnout. No comprehensive conceptual framework guides researchers addressing these challenges.This study aimed to develop a conceptual framework clarifying the interplay between psychological factors, technology, and documentation attributes-usability, effort, and perceived burden-among health care providers.Data were collected from a cross-sectional survey using a convenience sample of hospital- and ambulatory-based physicians, advanced practice registered nurses, and physician assistants. A newly constructed questionnaire was used, incorporating elements from well-established instruments. Descriptive and exploratory factor analysis was performed to identify significant findings and develop the preliminary Clinical Documentation Burden Framework.The analysis revealed three main factors underpinning clinical documentation burden: Poor usability, perceived task value, and excessive mental exertion. These factors were significantly correlated with professional dissonance (PD) and burnout, underscoring the complex interplay between time requirements, design challenges, task engagement, and cognitive load. The resulting conceptual framework highlights the importance of aligning documentation tasks with provider values to mitigate burden.The study offers new insights into the complex phenomenon of documentation burden affecting health care providers by incorporating key psychological factors. This conceptual framework provides a preliminary foundation for understanding this multifaceted problem. Like prior burnout research, conceptual clarity is key to creating shared definitions and a dedicated measurement instrument to support effective interventions. Given that the sample was predominantly advanced practice providers with underpowered subgroup comparisons, the framework should be interpreted as preliminary. This new appreciation of the dimensionality of documentation burden expands the potential levers available to alleviate operational strain and reduce PD and burnout.

背景:医生每花30分钟看病人,他们就花36分钟在电子健康记录(EHR)上。美国医疗保健行业的临床文档负担是由与电子病历相关的管理任务增加、监管要求和工作流程效率低下造成的。这种负担导致认知负荷增加、护理碎片化和员工倦怠。没有一个全面的概念框架来指导研究人员应对这些挑战。目的:建立一个概念框架,澄清医疗保健提供者之间心理因素、技术和文档属性(可用性、努力和感知负担)之间的相互作用。方法:数据收集自横断面调查,使用医院和门诊医生、高级执业注册护士(APRNs)和医师助理的方便样本。使用了一份新编制的调查表,其中纳入了来自成熟工具的要素。进行描述性和探索性因素分析,以确定重要的发现,并制定初步的临床文件负担框架。结果:分析揭示了临床文献负担的三个主要因素:可用性差、感知任务价值和过度的精神消耗。这些因素与职业失调和职业倦怠显著相关,强调了时间要求、设计挑战、任务参与和认知负荷之间复杂的相互作用。由此产生的概念框架强调了将文档任务与提供者值对齐以减轻负担的重要性。结论:本研究通过纳入关键的心理因素,对影响医护人员文书负担的复杂现象提供了新的见解。这个概念框架为理解这个多方面的问题提供了一个初步的基础。与之前的职业倦怠研究一样,概念清晰是创建共享定义和专用测量工具以支持有效干预的关键。考虑到样本主要是高级执业医师,亚组比较效果不足,该框架应被解释为初步的。这种对文件负担维度的新认识扩大了可用于减轻业务压力和减少专业失调和倦怠的潜在杠杆。
{"title":"A Preliminary Conceptual Framework of Clinical Documentation Burden: Exploratory Factor Analysis Investigating Usability, Effort, and Perceived Burden among Health Care Providers.","authors":"Rhiannon Doherty, Abby Swanson Kazley, Eva Karp, Jennifer Ferrand","doi":"10.1055/a-2751-1896","DOIUrl":"10.1055/a-2751-1896","url":null,"abstract":"<p><p>For every 30 minutes a provider spends seeing a patient, they spend 36 minutes charting in the electronic health record (EHR). Clinical documentation burden in U.S. health care is driven by increasing administrative tasks associated with EHRs, regulatory demands, and workflow inefficiencies. This burden contributes to increased cognitive load, fragmented care, and staff burnout. No comprehensive conceptual framework guides researchers addressing these challenges.This study aimed to develop a conceptual framework clarifying the interplay between psychological factors, technology, and documentation attributes-usability, effort, and perceived burden-among health care providers.Data were collected from a cross-sectional survey using a convenience sample of hospital- and ambulatory-based physicians, advanced practice registered nurses, and physician assistants. A newly constructed questionnaire was used, incorporating elements from well-established instruments. Descriptive and exploratory factor analysis was performed to identify significant findings and develop the preliminary Clinical Documentation Burden Framework.The analysis revealed three main factors underpinning clinical documentation burden: Poor usability, perceived task value, and excessive mental exertion. These factors were significantly correlated with professional dissonance (PD) and burnout, underscoring the complex interplay between time requirements, design challenges, task engagement, and cognitive load. The resulting conceptual framework highlights the importance of aligning documentation tasks with provider values to mitigate burden.The study offers new insights into the complex phenomenon of documentation burden affecting health care providers by incorporating key psychological factors. This conceptual framework provides a preliminary foundation for understanding this multifaceted problem. Like prior burnout research, conceptual clarity is key to creating shared definitions and a dedicated measurement instrument to support effective interventions. Given that the sample was predominantly advanced practice providers with underpowered subgroup comparisons, the framework should be interpreted as preliminary. This new appreciation of the dimensionality of documentation burden expands the potential levers available to alleviate operational strain and reduce PD and burnout.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1815-1827"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12700715/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145596932","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and Evaluation of a Web-Based Outcome Database for Advanced Melanoma with Rare BRAF Mutations. 基于网络的BRAF突变晚期黑色素瘤预后数据库的开发与评估
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-10-30 DOI: 10.1055/a-2717-3119
Susanne Dugas-Breit, Christian Menzer, Christian U Blank, Matteo S Carlino, Christoph U Lehmann, Jessica C Hassel, Martin Dugas

Rare B-rapidly accelerated fibrosarcoma gene (BRAF) mutations in advanced melanoma, and other malignancies, represent a significant clinical challenge due to sparse evidence on the efficiency of targeted therapy. Conventional genomic databases do not integrate detailed outcome data on treatments for patients with these mutations, requiring innovative informatics approaches.For the use case of patients with rare BRAF-mutated melanoma, we developed a "Treatment Outcome Tool" as a web-based database on rare cancers that aggregates anonymized, expert-validated clinical data. Unstructured interviews with dermato-oncologic experts guided the design, ensuring that the system allows users to query specific or combined rare BRAF mutations and retrieve key outcome measures, such as progression-free survival, overall response rate, and disease control rate with BRAF and/or mitogen-activated proteinkinase kinase (MEK) inhibition. Data are collected via a structured input form. After rigorous review and quality assurance by dedicated experts, data are then transferred to an externally accessible R/Shiny platform, where they can be assessed. The usability of the developed database was then evaluated by the System Usability Scale (SUS) of contributing dermato-oncologic experts.The first productive database version was implemented in October 2024. As of May 2025, the database contained data from 130 patients with 23 BRAF mutations. Evaluation of the "Treatment Outcome Tool" by 14 international dermato-oncologic experts yielded a median SUS score of 92.5, confirming excellent usability.Our database fills a critical gap in personalized oncology therapy by directly correlating rare BRAF mutation profiles with treatment outcomes. Our tool had usability and was found to be of high clinical value. The generic informatics framework chosen by us has the potential to be expanded to other rare tumors, ultimately enhancing evidence-based clinical practice and fostering international collaboration in cancer research.

晚期黑色素瘤和其他恶性肿瘤中罕见的b快速加速纤维肉瘤基因(BRAF)突变,由于缺乏靶向治疗效率的证据,代表了一个重大的临床挑战。传统的基因组数据库没有整合这些突变患者治疗的详细结果数据,需要创新的信息学方法。对于罕见braf突变黑色素瘤患者的用例,我们开发了一个“治疗结果工具”,作为一个基于网络的罕见癌症数据库,汇集了匿名的、专家验证的临床数据。与皮肤肿瘤学专家的非结构化访谈指导了设计,确保系统允许用户查询特定或组合罕见的BRAF突变,并检索关键的结果测量,如无进展生存期、总缓解率和BRAF和/或丝裂原活化蛋白激酶(MEK)抑制的疾病控制率。数据通过结构化的输入表单收集。经过专业专家的严格审查和质量保证,数据然后被转移到外部可访问的R/Shiny平台,在那里他们可以进行评估。开发的数据库的可用性,然后由贡献皮肤肿瘤学专家的系统可用性量表(SUS)进行评估。第一个生产性数据库版本于2024年10月实现。截至2025年5月,该数据库包含来自130例BRAF突变患者的数据。14位国际皮肤肿瘤学专家对“治疗结果工具”进行了评估,SUS得分中位数为92.5,证实了出色的可用性。我们的数据库通过将罕见的BRAF突变谱与治疗结果直接关联,填补了个性化肿瘤治疗的关键空白。我们的工具实用性强,临床应用价值高。我们选择的通用信息学框架有可能扩展到其他罕见肿瘤,最终加强循证临床实践,促进癌症研究的国际合作。
{"title":"Development and Evaluation of a Web-Based Outcome Database for Advanced Melanoma with Rare BRAF Mutations.","authors":"Susanne Dugas-Breit, Christian Menzer, Christian U Blank, Matteo S Carlino, Christoph U Lehmann, Jessica C Hassel, Martin Dugas","doi":"10.1055/a-2717-3119","DOIUrl":"10.1055/a-2717-3119","url":null,"abstract":"<p><p>Rare <i>B-rapidly accelerated fibrosarcoma gene</i> (<i>BRAF</i>) mutations in advanced melanoma, and other malignancies, represent a significant clinical challenge due to sparse evidence on the efficiency of targeted therapy. Conventional genomic databases do not integrate detailed outcome data on treatments for patients with these mutations, requiring innovative informatics approaches.For the use case of patients with rare <i>BRAF</i>-mutated melanoma, we developed a \"Treatment Outcome Tool\" as a web-based database on rare cancers that aggregates anonymized, expert-validated clinical data. Unstructured interviews with dermato-oncologic experts guided the design, ensuring that the system allows users to query specific or combined rare <i>BRAF</i> mutations and retrieve key outcome measures, such as progression-free survival, overall response rate, and disease control rate with BRAF and/or mitogen-activated proteinkinase kinase (MEK) inhibition. Data are collected via a structured input form. After rigorous review and quality assurance by dedicated experts, data are then transferred to an externally accessible R/Shiny platform, where they can be assessed. The usability of the developed database was then evaluated by the System Usability Scale (SUS) of contributing dermato-oncologic experts.The first productive database version was implemented in October 2024. As of May 2025, the database contained data from 130 patients with 23 <i>BRAF</i> mutations. Evaluation of the \"Treatment Outcome Tool\" by 14 international dermato-oncologic experts yielded a median SUS score of 92.5, confirming excellent usability.Our database fills a critical gap in personalized oncology therapy by directly correlating rare <i>BRAF</i> mutation profiles with treatment outcomes. Our tool had usability and was found to be of high clinical value. The generic informatics framework chosen by us has the potential to be expanded to other rare tumors, ultimately enhancing evidence-based clinical practice and fostering international collaboration in cancer research.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1541-1549"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12575071/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145410679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o. 比较54年前的计算机咨询与chatgpt - 40的表现。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-06-06 DOI: 10.1055/a-2628-8408
Elvan Burak Verdi, Oguz Akbilgic

This study aimed to evaluate and compare the diagnostic responses generated by two artificial intelligence (AI) models developed 54 years apart, and encourage physicians to explore the use of large language models (LLMs) like GPT-4o in clinical practice.A clinical case of metabolic acidosis was presented to GPT-4o, and the model's diagnostic reasoning, data interpretation, and management recommendations were recorded. These outputs were then compared with the responses from Schwartz's 1970 AI model built with a decision-tree algorithm using Conversational Algebraic Language (CAL). Both models were given the same patient data to ensure a fair comparison.GPT-4o generated an advanced analysis of the patient's acid-base disturbance, correctly identifying likely causes and suggesting relevant diagnostic tests and treatments. It provided a detailed, narrative explanation of the metabolic acidosis. The 1970 CAL model, while correctly recognizing the metabolic acidosis and flagging implausible inputs, was constrained by its rule-based design. CAL offered only basic stepwise guidance and required sequential prompts for each data point, reflecting a limited capacity to handle complex or unanticipated information. GPT-4o, by contrast, integrated the data more holistically, although it occasionally ventured beyond the provided information.This comparison illustrates substantial advances in AI capabilities over five decades. GPT-4o's performance demonstrates the transformative potential of modern LLMs in clinical decision-making, showcasing abilities to synthesize complex data and assist diagnosis without specialized training, yet necessitating further validation, rigorous clinical trials, and adaptation to clinical contexts. Although innovative for its era and offering certain advantages over GPT-4o, the rule-based CAL system had technical limitations. Rather than viewing one as simply "better," this study provides perspective on how far AI in medicine has progressed while acknowledging that current AI tools remain supplements to-not replacements for-physician judgment.

目的:评估和比较两种相距54年的人工智能模型产生的诊断反应,并鼓励医生探索在临床实践中使用像gpt - 40这样的大语言模型(LLMs)。方法:向gpt - 40报告1例代谢性酸中毒的临床病例,记录该模型的诊断推理、数据解释和管理建议。然后将这些输出与Schwartz 1970年使用会话代数语言(CAL)的决策树算法构建的AI模型的响应进行比较。两种模型的患者数据相同,以确保公平的比较。结果:gpt - 40对患者的酸碱紊乱进行了先进的分析,正确识别可能的原因,并建议相关的诊断测试和治疗。它提供了代谢性酸中毒的详细叙述解释。1970年CAL模型虽然正确识别代谢性酸中毒并标记不合理的输入,但受到其基于规则的设计的限制。CAL只提供基本的逐步指导,并要求对每个数据点进行顺序提示,这反映了处理复杂或意外信息的能力有限。相比之下,gpt - 40更全面地整合了数据,尽管它偶尔会超出所提供的信息。结论:这一对比说明了人工智能在过去50年里的巨大进步。gpt - 40的表现展示了现代法学硕士在临床决策方面的变革潜力,展示了在没有专业培训的情况下合成复杂数据和辅助诊断的能力,但需要进一步验证、严格的临床试验和适应临床环境。尽管在当时是创新的,并且比gpt - 40有一定的优势,但基于规则的CAL系统有技术局限性。这项研究并不是简单地认为一种工具“更好”,而是提供了人工智能在医学领域取得进展的视角,同时承认目前的人工智能工具仍然是对医生判断的补充,而不是替代。
{"title":"Comparing the Performances of a 54-Year-Old Computer-Based Consultation to ChatGPT-4o.","authors":"Elvan Burak Verdi, Oguz Akbilgic","doi":"10.1055/a-2628-8408","DOIUrl":"10.1055/a-2628-8408","url":null,"abstract":"<p><p>This study aimed to evaluate and compare the diagnostic responses generated by two artificial intelligence (AI) models developed 54 years apart, and encourage physicians to explore the use of large language models (LLMs) like GPT-4o in clinical practice.A clinical case of metabolic acidosis was presented to GPT-4o, and the model's diagnostic reasoning, data interpretation, and management recommendations were recorded. These outputs were then compared with the responses from Schwartz's 1970 AI model built with a decision-tree algorithm using Conversational Algebraic Language (CAL). Both models were given the same patient data to ensure a fair comparison.GPT-4o generated an advanced analysis of the patient's acid-base disturbance, correctly identifying likely causes and suggesting relevant diagnostic tests and treatments. It provided a detailed, narrative explanation of the metabolic acidosis. The 1970 CAL model, while correctly recognizing the metabolic acidosis and flagging implausible inputs, was constrained by its rule-based design. CAL offered only basic stepwise guidance and required sequential prompts for each data point, reflecting a limited capacity to handle complex or unanticipated information. GPT-4o, by contrast, integrated the data more holistically, although it occasionally ventured beyond the provided information.This comparison illustrates substantial advances in AI capabilities over five decades. GPT-4o's performance demonstrates the transformative potential of modern LLMs in clinical decision-making, showcasing abilities to synthesize complex data and assist diagnosis without specialized training, yet necessitating further validation, rigorous clinical trials, and adaptation to clinical contexts. Although innovative for its era and offering certain advantages over GPT-4o, the rule-based CAL system had technical limitations. Rather than viewing one as simply \"better,\" this study provides perspective on how far AI in medicine has progressed while acknowledging that current AI tools remain supplements to-not replacements for-physician judgment.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1627-1636"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12594563/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144250521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Case Report in Using a Laboratory-Based Decision Support Alert for Research Enrollment and Randomization. 使用基于实验室的决策支持警报进行研究登记和随机化的案例报告。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-10-24 DOI: 10.1055/a-2702-1770
April Barnado, Ryan P Moore, Henry J Domenico, Emily Grace, Sarah Green, Ashley Suh, Nikol Nikolova, Bryan Han, Allison B McCoy

Our objective was to identify barriers to implementing a custom clinical decision support (CDS) alert to randomize individuals in a pragmatic study, specifically those with a positive antinuclear antibody (ANA) test.We integrated a validated logistic regression model into the electronic health record to predict the risk of developing autoimmune disease for individuals with a positive ANA (titer ≥ 1:80). A custom CDS alert was created to randomize eligible individuals into a pragmatic study evaluating whether the risk model reduces time to autoimmune disease diagnosis. The custom CDS alert runs silently in the background and is not visible to providers. Individuals were randomized to either an intervention or control arm. In the intervention arm, the study team reviewed risk model results, notified providers of high-risk scores, and offered expedited rheumatology referrals to high-risk individuals in addition to standard of care. The control arm received standard care only. The study team accessed a daily Epic report containing randomization assignments and model variables.Starting in June 2023, the risk model assessed 3,961 individuals and successfully randomized 2,105 individuals to date. Technical challenges that prevented the custom CDS alert from firing included an unanticipated change in the laboratory testing vendor and reporting due to a broken laboratory machine, followed by a change in the laboratory test name.This case report showcases the successful implementation of a laboratory-based custom CDS alert to randomize individuals for a pragmatic study. This approach enabled our study to be feasible across a large health care system. Key lessons learned included the importance of close collaboration with the laboratory team and thorough understanding of the laboratory testing, workflow, and reporting to ensure successful execution of the laboratory-based custom CDS alert.

我们的目的是确定在一项实用研究中实施定制临床决策支持(CDS)警报以随机分配个体的障碍,特别是那些抗核抗体(ANA)测试阳性的个体。我们将一个经过验证的逻辑回归模型整合到电子健康记录中,以预测ANA阳性个体(滴度≥1:80)发生自身免疫性疾病的风险。创建自定义CDS警报,将符合条件的个体随机纳入一项实用研究,评估风险模型是否缩短了自身免疫性疾病诊断的时间。自定义CDS警报在后台静默运行,对提供者不可见。个体被随机分为干预组和对照组。在干预方面,研究小组审查了风险模型结果,通知了高风险评分的提供者,并在标准护理之外,为高风险个体提供了快速的风湿病转诊。对照组只接受标准护理。研究小组访问了包含随机分配和模型变量的每日Epic报告。从2023年6月开始,风险模型评估了3961人,迄今为止成功地随机抽取了2105人。阻止自定义CDS警报触发的技术挑战包括由于实验室机器损坏而导致的实验室测试供应商和报告的意外更改,以及随后实验室测试名称的更改。本案例报告展示了基于实验室的自定义CDS警报的成功实现,该警报随机分配个体进行实用研究。这种方法使我们的研究在一个大型医疗保健系统中是可行的。学到的主要经验包括与实验室团队密切合作的重要性,以及对实验室测试、工作流程和报告的全面理解,以确保成功执行基于实验室的自定义CDS警报。
{"title":"A Case Report in Using a Laboratory-Based Decision Support Alert for Research Enrollment and Randomization.","authors":"April Barnado, Ryan P Moore, Henry J Domenico, Emily Grace, Sarah Green, Ashley Suh, Nikol Nikolova, Bryan Han, Allison B McCoy","doi":"10.1055/a-2702-1770","DOIUrl":"10.1055/a-2702-1770","url":null,"abstract":"<p><p>Our objective was to identify barriers to implementing a custom clinical decision support (CDS) alert to randomize individuals in a pragmatic study, specifically those with a positive antinuclear antibody (ANA) test.We integrated a validated logistic regression model into the electronic health record to predict the risk of developing autoimmune disease for individuals with a positive ANA (titer ≥ 1:80). A custom CDS alert was created to randomize eligible individuals into a pragmatic study evaluating whether the risk model reduces time to autoimmune disease diagnosis. The custom CDS alert runs silently in the background and is not visible to providers. Individuals were randomized to either an intervention or control arm. In the intervention arm, the study team reviewed risk model results, notified providers of high-risk scores, and offered expedited rheumatology referrals to high-risk individuals in addition to standard of care. The control arm received standard care only. The study team accessed a daily Epic report containing randomization assignments and model variables.Starting in June 2023, the risk model assessed 3,961 individuals and successfully randomized 2,105 individuals to date. Technical challenges that prevented the custom CDS alert from firing included an unanticipated change in the laboratory testing vendor and reporting due to a broken laboratory machine, followed by a change in the laboratory test name.This case report showcases the successful implementation of a laboratory-based custom CDS alert to randomize individuals for a pragmatic study. This approach enabled our study to be feasible across a large health care system. Key lessons learned included the importance of close collaboration with the laboratory team and thorough understanding of the laboratory testing, workflow, and reporting to ensure successful execution of the laboratory-based custom CDS alert.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1439-1444"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12552065/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145369136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Changes in Pediatric Portal Use Among Caregivers Before, During, and After the Coronavirus Disease 2019 Pandemic: A Longitudinal Study. 在COVID-19大流行之前、期间和之后,护理人员儿科门户网站使用的变化:一项纵向研究
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-09-19 DOI: 10.1055/a-2703-3735
Philipp Haessner, Jessica M Ray, Megan E Gregory

Patient portals are increasingly used to support digital health engagement, but little is known about how caregivers used patient portals before, during, and after the coronavirus disease 2019 (COVID-19) pandemic.This study aimed to examine longitudinal changes in caregiver engagement with pediatric patient portals, focusing on logins, session duration, messaging behaviors, and provider response times across prepandemic, pandemic, and postpandemic periods.We conducted a retrospective cohort study using deidentified MyChart data from caregivers of children aged 0 through 11 who received care at four pediatric primary care clinics in the Southeastern United States between March 2018 and March 2023. Generalized linear models were used to compare portal engagement across prepandemic, pandemic, and postpandemic periods. Outcomes included login frequency, session duration, message volume, message types and recipients, and provider response times, all normalized per user per year.Among 478 caregivers, portal logins and session duration increased significantly during and postpandemic, with 16-fold increases postpandemic compared with prepandemic (p < 0.001). Message volume declined substantially during the pandemic (p < 0.001) but returned to baseline levels. Provider response times shortened during the pandemic and remained lower than prepandemic levels (p = 0.032). Messaging to primary care declined and did not recover fully, while specialty care messaging increased across all periods. Appointment and medical advice messages declined during the pandemic, with only the latter rebounding. Customer service inquiries rose significantly and remained elevated, and medication renewal messages increased markedly postpandemic.The COVID-19 pandemic initiated lasting changes in caregivers' engagement with pediatric patient portals, including deeper engagement, quicker provider responses, and shifts in messaging patterns. Findings can be used to guide and optimize caregiver-centered digital health strategies in pediatrics. Future work should explore potential provider burnout from increased portal workload, incorporate multicenter studies, and link portal use to clinical characteristics to better inform digital health interventions.

背景:患者门户网站越来越多地用于支持数字卫生参与,但对于护理人员在2019冠状病毒病大流行之前、期间和之后如何使用患者门户网站,人们知之甚少。目的:研究护理人员参与儿科患者门户网站的纵向变化,重点关注大流行前、大流行前和大流行后期间的登录、会话持续时间、信息传递行为和提供者响应时间。方法:我们进行了一项回顾性队列研究,使用了2018年3月至2023年3月期间在美国东南部四家儿科初级保健诊所接受治疗的0至11岁儿童护理人员的去识别MyChart数据。使用广义线性模型比较大流行前、大流行和大流行后时期的门户网站参与度。结果包括登录频率、会话持续时间、消息量、消息类型和收件人以及提供者响应时间,所有这些都是每年每个用户标准化的。结果:在478名护理人员中,门户登录和会话持续时间在大流行期间和大流行后显着增加,与大流行前相比,大流行后增加了16倍(p < 0.001)。大流行期间信息量大幅下降(p < 0.001),但已恢复到基线水平。供应商的响应时间在大流行期间缩短,仍低于大流行前的水平(p = 0.032)。向初级保健发送的信息有所下降,并没有完全恢复,而专科护理发送的信息在所有时期都有所增加。大流行期间,预约和医疗咨询信息有所下降,只有后者有所反弹。客户服务咨询大幅增加,并保持在较高水平,大流行后药物更新信息显著增加。结论:2019冠状病毒病大流行引发了护理人员与儿科患者门户网站互动的持久变化,包括更深层次的参与、更快的提供者响应以及信息传递模式的转变。研究结果可用于指导和优化儿科以护理人员为中心的数字健康策略。未来的工作应探讨门户网站工作量增加可能导致的提供者倦怠,纳入多中心研究,并将门户网站的使用与临床特征联系起来,以更好地为数字卫生干预提供信息。
{"title":"Changes in Pediatric Portal Use Among Caregivers Before, During, and After the Coronavirus Disease 2019 Pandemic: A Longitudinal Study.","authors":"Philipp Haessner, Jessica M Ray, Megan E Gregory","doi":"10.1055/a-2703-3735","DOIUrl":"10.1055/a-2703-3735","url":null,"abstract":"<p><p>Patient portals are increasingly used to support digital health engagement, but little is known about how caregivers used patient portals before, during, and after the coronavirus disease 2019 (COVID-19) pandemic.This study aimed to examine longitudinal changes in caregiver engagement with pediatric patient portals, focusing on logins, session duration, messaging behaviors, and provider response times across prepandemic, pandemic, and postpandemic periods.We conducted a retrospective cohort study using deidentified MyChart data from caregivers of children aged 0 through 11 who received care at four pediatric primary care clinics in the Southeastern United States between March 2018 and March 2023. Generalized linear models were used to compare portal engagement across prepandemic, pandemic, and postpandemic periods. Outcomes included login frequency, session duration, message volume, message types and recipients, and provider response times, all normalized per user per year.Among 478 caregivers, portal logins and session duration increased significantly during and postpandemic, with 16-fold increases postpandemic compared with prepandemic (<i>p</i> < 0.001). Message volume declined substantially during the pandemic (<i>p</i> < 0.001) but returned to baseline levels. Provider response times shortened during the pandemic and remained lower than prepandemic levels (<i>p</i> = 0.032). Messaging to primary care declined and did not recover fully, while specialty care messaging increased across all periods. Appointment and medical advice messages declined during the pandemic, with only the latter rebounding. Customer service inquiries rose significantly and remained elevated, and medication renewal messages increased markedly postpandemic.The COVID-19 pandemic initiated lasting changes in caregivers' engagement with pediatric patient portals, including deeper engagement, quicker provider responses, and shifts in messaging patterns. Findings can be used to guide and optimize caregiver-centered digital health strategies in pediatrics. Future work should explore potential provider burnout from increased portal workload, incorporate multicenter studies, and link portal use to clinical characteristics to better inform digital health interventions.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1465-1474"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12566923/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145092628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1