首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
Improving Direct Secure Messaging through Directory Management. 通过目录管理改进直接安全消息传递。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-10-24 DOI: 10.1055/a-2701-5761
Kristian Feterik, Katherine Lusk, Kathryn Ayers Wickenhauser, James L McCormack, Christoph U Lehmann, Simone Arvisais-Anhalt

Direct Secure Messaging (DSM) is a communication standard for exchanging information between health care entities and practitioners. It relies on access to an address directory. When directory entry is incomplete, health information exchange breaks down. There is an urgent need for standardized DSM address directory management and synchronization workflows that support universal access in a timely manner.Our objective was to develop best practices for maintenance of DSM address directories and create recommendations to encourage adoption of DSM technology in the State of Texas.Texas Health Services Authority (THSA) formed a workgroup focused on increasing DSM adoption. Between August 2021 and March 2022, workgroup members used a modified Delphi process to create a directory management best practice policy and published it in May 2022. To measure the effect of the policy, THSA monitored volume of messages sent in a group of 38 hospitals before and after the workgroup was established.Organizations should standardize DSM address data and routinely sync with external databases to ensure seamless, vendor-independent message flow. Additionally, health systems are expected to update directory entries immediately upon any change in practitioner's status. Between September 2021 and December 2022, there was a decrease in Direct messages not sent due to no known address, from 50 to 42%, respectively. Additionally, between July 2021 and March 2024, organizations participating in the policy development reported a steady monthly increase of new Direct addresses issued.Health care organizations should adopt a consistent workflow for maintaining their DSM address directories and regularly synchronize with external databases to facilitate unobstructed flow of messages and data. The Maintenance of Provider Database Dictionary Policy developed by the THSA can serve as a model for nationwide implementation and optimization of DSM as an important interoperability standard.

直接安全消息传递(DSM)是用于在医疗保健实体和从业者之间交换信息的通信标准。它依赖于对地址目录的访问。当目录条目不完整时,运行状况信息交换将中断。迫切需要标准化的DSM地址目录管理和同步工作流程,以支持及时的普遍访问。我们的目标是开发维护DSM地址目录的最佳实践,并创建建议,以鼓励在德克萨斯州采用DSM技术。德克萨斯州卫生服务管理局(THSA)成立了一个工作组,专注于提高DSM的采用。在2021年8月至2022年3月期间,工作组成员使用修改后的Delphi流程创建了目录管理最佳实践策略,并于2022年5月发布。为了衡量该政策的效果,THSA监测了工作组成立前后38家医院的消息发送量。组织应该标准化DSM地址数据,并定期与外部数据库同步,以确保无缝的、独立于供应商的消息流。此外,卫生系统预计更新目录条目立即在任何变化的执业状态。在2021年9月至2022年12月期间,由于没有已知地址而未发送的直接邮件分别从50%下降到42%。此外,在2021年7月至2024年3月期间,参与政策制定的机构报告每月新增的直接地址数量稳步增长。医疗保健组织应该采用一致的工作流程来维护其DSM地址目录,并定期与外部数据库同步,以促进消息和数据的畅通。THSA制定的提供者数据库字典维护策略可以作为DSM作为重要的互操作性标准在全国范围内实施和优化的模型。
{"title":"Improving Direct Secure Messaging through Directory Management.","authors":"Kristian Feterik, Katherine Lusk, Kathryn Ayers Wickenhauser, James L McCormack, Christoph U Lehmann, Simone Arvisais-Anhalt","doi":"10.1055/a-2701-5761","DOIUrl":"10.1055/a-2701-5761","url":null,"abstract":"<p><p>Direct Secure Messaging (DSM) is a communication standard for exchanging information between health care entities and practitioners. It relies on access to an address directory. When directory entry is incomplete, health information exchange breaks down. There is an urgent need for standardized DSM address directory management and synchronization workflows that support universal access in a timely manner.Our objective was to develop best practices for maintenance of DSM address directories and create recommendations to encourage adoption of DSM technology in the State of Texas.Texas Health Services Authority (THSA) formed a workgroup focused on increasing DSM adoption. Between August 2021 and March 2022, workgroup members used a modified Delphi process to create a directory management best practice policy and published it in May 2022. To measure the effect of the policy, THSA monitored volume of messages sent in a group of 38 hospitals before and after the workgroup was established.Organizations should standardize DSM address data and routinely sync with external databases to ensure seamless, vendor-independent message flow. Additionally, health systems are expected to update directory entries immediately upon any change in practitioner's status. Between September 2021 and December 2022, there was a decrease in Direct messages not sent due to no known address, from 50 to 42%, respectively. Additionally, between July 2021 and March 2024, organizations participating in the policy development reported a steady monthly increase of new Direct addresses issued.Health care organizations should adopt a consistent workflow for maintaining their DSM address directories and regularly synchronize with external databases to facilitate unobstructed flow of messages and data. The Maintenance of Provider Database Dictionary Policy developed by the THSA can serve as a model for nationwide implementation and optimization of DSM as an important interoperability standard.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1430-1438"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12552064/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145369149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the Relationship between Digital Health Literacy and Patterns of Telemedicine Engagement and Appointment Attendance within an Urban Academic Hospital. 城市学术型医院数字健康素养与远程医疗参与和预约就诊模式的关系探讨
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-06-24 DOI: 10.1055/a-2640-2742
Natali Sorajja, Julia Zheng, Sunit Jariwala

Telemedicine use has surged since the COVID-19 pandemic, offering a convenient way for patients to access health care. Whereas digital literacy (general comfort with and ability to use digital tools) is necessary to utilize telemedicine, digital health literacy is a subset of this, focusing on the ability to use digital tools to seek out, understand, and utilize health information. Barriers such as the lack of high-speed internet and limited digital health literacy can hinder telemedicine's effectiveness, particularly for historically marginalized populations with lower technological access.This study aims to characterize the relationship between baseline digital health literacy, appointment no-shows, and telemedicine usage in a Bronx population.In a Bronx-based cohort, we assessed digital health literacy using eHealth Literacy Scale (eHEALS) and eHealth Literacy Objective Scale-Scenario Based (eHeLiOS-SB), and health literacy with the Newest Vital Sign (NVS) instrument. Baseline sociodemographic characteristics (e.g., age, insurance type) were collected, and appointment no-show rates and telemedicine usage were calculated. Linear regression models were used to assess associations.Higher digital health literacy, private insurance (compared to Medicaid), and older age were associated with fewer no-shows. Higher video visit usage was also associated with fewer no-shows. Individuals at high risk of housing insecurity were less likely to use video visits, and higher phone visit usage was associated with patients experiencing financial resource strain. Digital health literacy was positively associated with White race and negatively associated with Medicare usage (compared to Medicaid).Higher digital health literacy correlates with increased appointment attendance, indicating the need to address digital barriers in health care. Increasing telemedicine use may help reduce no-shows, and patient-specific strategies are needed to enhance digital health literacy and telemedicine effectiveness.

背景:自2019冠状病毒病大流行以来,远程医疗的使用激增,为患者提供了一种获得医疗服务的便捷方式。虽然数字素养(对数字工具的普遍熟悉和使用能力)是利用远程医疗的必要条件,但数字健康素养是其中的一个子集,侧重于使用数字工具寻找、理解和利用健康信息的能力。因此,缺乏高速互联网和数字卫生知识有限等障碍可能会阻碍远程医疗的有效性,特别是对于那些技术获取较少的历史边缘化人群。目的:本研究旨在描述布朗克斯人群中基线数字健康素养、预约未到和远程医疗使用之间的关系。方法:在基于布朗克斯的队列中,我们使用e-HEALS和e-HeLiOS-SB评估数字健康素养,并使用最新生命体征(NVS)仪器评估健康素养。收集基线社会人口学特征(如年龄、保险类型),并计算预约失诊率和远程医疗使用情况。线性回归模型用于评估相关性。结果:更高的数字健康素养、私人保险(与医疗补助相比)和年龄较大与更少的缺勤有关。更高的视频访问使用率也与更少的失约有关。住房不安全风险高的个体不太可能使用视频就诊,而较高的电话就诊使用率与经历财务资源紧张的患者有关。数字健康素养与白人种族呈正相关,与医疗保险使用负相关(与医疗补助相比)。结论:更高的数字健康素养与更高的预约出勤率相关,表明需要解决医疗保健中的数字障碍。增加远程医疗的使用可能有助于减少缺席,需要针对患者的战略来提高数字卫生素养和远程医疗的有效性。
{"title":"Exploring the Relationship between Digital Health Literacy and Patterns of Telemedicine Engagement and Appointment Attendance within an Urban Academic Hospital.","authors":"Natali Sorajja, Julia Zheng, Sunit Jariwala","doi":"10.1055/a-2640-2742","DOIUrl":"10.1055/a-2640-2742","url":null,"abstract":"<p><p>Telemedicine use has surged since the COVID-19 pandemic, offering a convenient way for patients to access health care. Whereas digital literacy (general comfort with and ability to use digital tools) is necessary to utilize telemedicine, digital health literacy is a subset of this, focusing on the ability to use digital tools to seek out, understand, and utilize health information. Barriers such as the lack of high-speed internet and limited digital health literacy can hinder telemedicine's effectiveness, particularly for historically marginalized populations with lower technological access.This study aims to characterize the relationship between baseline digital health literacy, appointment no-shows, and telemedicine usage in a Bronx population.In a Bronx-based cohort, we assessed digital health literacy using eHealth Literacy Scale (eHEALS) and eHealth Literacy Objective Scale-Scenario Based (eHeLiOS-SB), and health literacy with the Newest Vital Sign (NVS) instrument. Baseline sociodemographic characteristics (e.g., age, insurance type) were collected, and appointment no-show rates and telemedicine usage were calculated. Linear regression models were used to assess associations.Higher digital health literacy, private insurance (compared to Medicaid), and older age were associated with fewer no-shows. Higher video visit usage was also associated with fewer no-shows. Individuals at high risk of housing insecurity were less likely to use video visits, and higher phone visit usage was associated with patients experiencing financial resource strain. Digital health literacy was positively associated with White race and negatively associated with Medicare usage (compared to Medicaid).Higher digital health literacy correlates with increased appointment attendance, indicating the need to address digital barriers in health care. Increasing telemedicine use may help reduce no-shows, and patient-specific strategies are needed to enhance digital health literacy and telemedicine effectiveness.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1695-1708"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12623120/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144486749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reimagining Family and Medical Leave Act (FMLA) Forms-From Pen & Paper to Electronic Health Record (EHR) Integration. 重新构想家庭和医疗休假法案(FMLA)表格-从笔和纸到电子健康记录(EHR)集成。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-11-21 DOI: 10.1055/a-2737-5596
Kevin Pearlman, Julie Oyler, Mim Ari, Lisa Vinci, Sachin Shah

Completion of Family and Medical Leave Act (FMLA) paperwork is a necessary but time-intensive task that contributes to clinician administrative burden.This study aimed to implement and evaluate an electronic health record (EHR)-integrated FMLA tool designed to reduce documentation time and improve workflow efficiency.An EHR-embedded FMLA form was deployed at a large academic medical center, piloted in July 2024 in primary care, and expanded to all ambulatory practices in September 2024. The tool enabled clinicians to complete and transmit FMLA documentation electronically, with auto-population of clinician details and the ability to recall prior submissions. Pre- and post-intervention surveys assessed clinician-reported efficiency and time burden, and form utilization was tracked using EHR query tools.A total of 67 clinicians completed a pre-survey (response rate: 19.4%) and 49 completed a post-survey (response rate: 25.4%). About 94% of clinicians using the EHR form (n = 31/33) reported time savings. On a 5-point Likert scale, efficiency improved for initial FMLA completion (2.46-3.06, p = 0.01) and renewal of prior FMLA (2.66-3.31, p = 0.01). The percentage of clinicians completing FMLA in 15 minutes or less increased from 51 to 78% (p = 0.002). The form was used 435 times over 9 months, primarily in primary care, with sustained monthly usage.An EHR-integrated FMLA tool improved clinician-reported efficiency and reduced time spent on documentation. This model may be applicable to other manual administrative workflows and offers a potential strategy to mitigate provider burnout.

完成家庭和医疗休假法案(FMLA)的文书工作是一项必要但耗时的任务,增加了临床医生的行政负担。本研究旨在实施和评估电子健康记录(EHR)集成的FMLA工具,旨在减少记录时间并提高工作流程效率。在一家大型学术医疗中心部署了嵌入ehr的FMLA表格,于2024年7月在初级保健中进行了试点,并于2024年9月扩展到所有门诊诊所。该工具使临床医生能够以电子方式完成和传输FMLA文档,具有临床医生详细信息的自动填充和回忆先前提交的能力。干预前和干预后的调查评估了临床医生报告的效率和时间负担,并使用电子病历查询工具跟踪表格的使用情况。共有67名临床医生完成了预调查(有效率:19.4%),49名临床医生完成了后调查(有效率:25.4%)。约94%使用电子病历表格的临床医生(n = 31/33)报告节省了时间。在5点李克特量表上,首次FMLA完成(2.46-3.06,p = 0.01)和先前FMLA更新(2.66-3.31,p = 0.01)的效率有所提高。临床医生在15分钟或更短时间内完成FMLA的百分比从51%增加到78% (p = 0.002)。该表格在9个月内使用了435次,主要用于初级保健,每月持续使用。ehr集成的FMLA工具提高了临床报告效率,减少了记录时间。此模型可能适用于其他手动管理工作流,并提供了一种减轻提供者倦怠的潜在策略。
{"title":"Reimagining Family and Medical Leave Act (FMLA) Forms-From Pen & Paper to Electronic Health Record (EHR) Integration.","authors":"Kevin Pearlman, Julie Oyler, Mim Ari, Lisa Vinci, Sachin Shah","doi":"10.1055/a-2737-5596","DOIUrl":"10.1055/a-2737-5596","url":null,"abstract":"<p><p>Completion of Family and Medical Leave Act (FMLA) paperwork is a necessary but time-intensive task that contributes to clinician administrative burden.This study aimed to implement and evaluate an electronic health record (EHR)-integrated FMLA tool designed to reduce documentation time and improve workflow efficiency.An EHR-embedded FMLA form was deployed at a large academic medical center, piloted in July 2024 in primary care, and expanded to all ambulatory practices in September 2024. The tool enabled clinicians to complete and transmit FMLA documentation electronically, with auto-population of clinician details and the ability to recall prior submissions. Pre- and post-intervention surveys assessed clinician-reported efficiency and time burden, and form utilization was tracked using EHR query tools.A total of 67 clinicians completed a pre-survey (response rate: 19.4%) and 49 completed a post-survey (response rate: 25.4%). About 94% of clinicians using the EHR form (<i>n</i> = 31/33) reported time savings. On a 5-point Likert scale, efficiency improved for initial FMLA completion (2.46-3.06, <i>p</i> = 0.01) and renewal of prior FMLA (2.66-3.31, <i>p</i> = 0.01). The percentage of clinicians completing FMLA in 15 minutes or less increased from 51 to 78% (<i>p</i> = 0.002). The form was used 435 times over 9 months, primarily in primary care, with sustained monthly usage.An EHR-integrated FMLA tool improved clinician-reported efficiency and reduced time spent on documentation. This model may be applicable to other manual administrative workflows and offers a potential strategy to mitigate provider burnout.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1787-1793"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12638195/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145574795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Physicians Report Benefit from Guided Critical Care Algorithms During Inpatient Rapid Responses. 医生报告在住院病人快速反应中受益于指导重症监护算法。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-11-20 DOI: 10.1055/a-2734-1754
Michael Senter-Zapata, Christopher Baugh, Sarah Onorato, Max J N Tiako, Allison Hare, Chiaka Aribeana, Eric Isselbacher, Jared Conley

Patient decompensation necessitating rapid response team (RRT) care in the hospital setting involves complex medical decision making, strong leadership skills, and precise communication where every second matters. However, RRT outcomes can vary based on leader training, knowledge, and experience. We designed five digital, condition-specific, guided algorithms to improve RRT care and compared user survey data among three physician cohorts across the clinical training spectrum to assess the practicality of real-world usage in a small feasibility study.Guided algorithms to common RRT scenarios, including tachycardia, bradycardia, hypotension, hypoxia, and altered mental status, were used by 157 physicians at our institution across three Internal Medicine user cohorts (1: end-of-year PGY-2-5 residents, 2: new PGY-2 residents, and 3: attending hospitalists) from April to December 2024. Survey data from 28 respondents were compared across cohorts using Kruskal-Wallis and Dunn statistical analyses.Survey responses demonstrated consistently high scores across cohorts regarding improvement in patient care, improved RRT leader experience, improved confidence, reduced stress/cognitive load, potential for standardization of care, and likelihood of recommendation to a colleague. Interestingly, new PGY-2 residents rated ease of navigation at 7/10 compared to 10/10 by attending hospitalists (p = 0.016).Digital, guided RRT algorithms are a practical and effective tool for enhancing physician care delivery during inpatient rapid response events across all levels of training. High survey scores across cohorts warrant consideration for broader implementation. Variation in ease of navigation scores highlights the importance of tailoring information flow and usability features to less experienced users. Overall, these algorithms show promise as valuable adjuncts during acute care delivery in high-stakes clinical settings.

在医院环境中,患者失代偿需要快速反应小组(RRT)护理,涉及复杂的医疗决策、强大的领导技能和精确的沟通,其中每一秒都很重要。然而,RRT的结果会根据领导者的培训、知识和经验而有所不同。我们设计了五种针对具体情况的数字化引导算法来改善RRT护理,并比较了临床培训范围内三个医生队列的用户调查数据,以在一项小型可行性研究中评估现实世界中使用RRT的实用性。2024年4月至12月,我们机构的157名医生在三个内科用户队列(1名:年终PGY-2-5住院医师,2名:新PGY-2住院医师,3名:住院医师)中使用了常见RRT场景的引导算法,包括心动过速、心动过缓、低血压、缺氧和精神状态改变。使用Kruskal-Wallis和Dunn统计分析对来自28名受访者的调查数据进行了跨队列比较。调查结果显示,在改善患者护理、改善RRT领导经验、提高信心、减轻压力/认知负荷、标准化护理的潜力以及向同事推荐的可能性方面,各队列的得分始终很高。有趣的是,新的PGY-2居民将导航便利性评为7/10,而住院医生的评分为10/10 (p = 0.016)。数字化、指导性RRT算法是一种实用而有效的工具,可在所有级别的培训中提高住院患者快速反应事件期间医生的护理服务。在整个队列中的高调查得分值得考虑更广泛的实施。导航易用性得分的变化强调了为经验不足的用户量身定制信息流和可用性功能的重要性。总的来说,这些算法在高风险的临床环境中作为有价值的辅助手段。
{"title":"Physicians Report Benefit from Guided Critical Care Algorithms During Inpatient Rapid Responses.","authors":"Michael Senter-Zapata, Christopher Baugh, Sarah Onorato, Max J N Tiako, Allison Hare, Chiaka Aribeana, Eric Isselbacher, Jared Conley","doi":"10.1055/a-2734-1754","DOIUrl":"10.1055/a-2734-1754","url":null,"abstract":"<p><p>Patient decompensation necessitating rapid response team (RRT) care in the hospital setting involves complex medical decision making, strong leadership skills, and precise communication where every second matters. However, RRT outcomes can vary based on leader training, knowledge, and experience. We designed five digital, condition-specific, guided algorithms to improve RRT care and compared user survey data among three physician cohorts across the clinical training spectrum to assess the practicality of real-world usage in a small feasibility study.Guided algorithms to common RRT scenarios, including tachycardia, bradycardia, hypotension, hypoxia, and altered mental status, were used by 157 physicians at our institution across three Internal Medicine user cohorts (1: end-of-year PGY-2-5 residents, 2: new PGY-2 residents, and 3: attending hospitalists) from April to December 2024. Survey data from 28 respondents were compared across cohorts using Kruskal-Wallis and Dunn statistical analyses.Survey responses demonstrated consistently high scores across cohorts regarding improvement in patient care, improved RRT leader experience, improved confidence, reduced stress/cognitive load, potential for standardization of care, and likelihood of recommendation to a colleague. Interestingly, new PGY-2 residents rated ease of navigation at 7/10 compared to 10/10 by attending hospitalists (<i>p</i> = 0.016).Digital, guided RRT algorithms are a practical and effective tool for enhancing physician care delivery during inpatient rapid response events across all levels of training. High survey scores across cohorts warrant consideration for broader implementation. Variation in ease of navigation scores highlights the importance of tailoring information flow and usability features to less experienced users. Overall, these algorithms show promise as valuable adjuncts during acute care delivery in high-stakes clinical settings.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1771-1778"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12634209/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145565948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Baseline Evaluation of Claude Opus 4 for Diabetes Management: A Preliminary Assessment and Lessons for Implementation. 克劳德Opus 4对糖尿病管理的基线评价:初步评估和实施经验教训。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-12-08 DOI: 10.1055/a-2765-6930
Pouyan Esmaeilzadeh

Claude Opus 4 is a large language model (LLM) that features improved reasoning capabilities and broader contextual understanding compared to earlier versions. Despite the growing use of LLM systems for seeking medical information, structured and simulation-based evaluations of Claude Opus 4's capabilities in diabetes management remain limited, particularly across domains such as patient education, clinical reasoning, and emotional support.This study aimed to conduct a baseline evaluation of Claude Opus 4's performance across key domains of diabetes care (i.e., patient education, clinical reasoning, and emotional support), and to identify preliminary insights that can inform future, evidence-based integration strategies.A three-step evaluation was conducted: (1) 30 diabetes management questions assessed using expert endocrinologist evaluation, (2) five fictional diabetes cases evaluated for clinical decision-making, and (3) emotional support responses assessed for appropriateness and empathy. Three expert endocrinologists graded responses according to American Diabetes Association guidelines.Claude Opus 4 achieved 80% accuracy in general diabetes knowledge, with high response reproducibility (96.7%), indicating baseline rather than clinically adequate performance. Clinical case evaluations showed moderate utility (mean expert rating = 4.4/7), while emotional-support assessments yielded high scores for empathy (6.2/7) and appropriateness (6.0/7). These findings suggest that although the model demonstrates promising informational and emotional-support capabilities, its current performance remains insufficient for autonomous clinical use and should be viewed as preliminary evidence to guide future, patient-inclusive validation studies.Although Claude Opus 4 demonstrates preliminary findings suggesting potential applications in diabetes care, education, and emotional support, this baseline assessment using fictional cases underscores the need for real-world validation with clinical data to determine true clinical utility and patient-centered impact. This simulation-based evaluation also offers practical lessons learned for researchers designing future LLM assessments, highlighting the need for mixed expert-patient panels, contextual validation, and person-centered metrics beyond numerical accuracy.

背景:Claude Opus 4是一个大型语言模型(LLM),与早期版本相比,它具有改进的推理能力和更广泛的上下文理解。尽管越来越多地使用法学硕士系统来寻求医疗信息,但对Claude Opus 4在糖尿病管理方面的能力进行结构化和基于模拟的评估仍然有限,特别是在患者教育、临床推理和情感支持等领域。目的:对Claude Opus 4在糖尿病护理的关键领域(即患者教育、临床推理和情感支持)的表现进行基线评估,并确定初步见解,为未来的循证整合策略提供信息。方法:采用三步评估法:(1)采用内分泌专家评估法对30个糖尿病管理问题进行评估;(2)对5个虚构的糖尿病病例进行临床决策评估;(3)对情绪支持反应进行适当性和共情评估。三位内分泌专家根据美国糖尿病协会的指南对反应进行评分。结果:Claude Opus 4对一般糖尿病知识的准确度达到80%,反应重现性高(96.7%),表明基线而非临床表现足够。临床病例评估显示中等效用(专家平均评分为4.4/7),而情感支持评估在共情(6.2/7)和适当性(6.0/7)方面获得高分。这些发现表明,尽管该模型显示出有希望的信息和情感支持能力,但其目前的表现仍不足以用于自主临床应用,应被视为指导未来患者验证研究的初步证据。结论:虽然Claude Opus 4展示了初步研究结果,提示在糖尿病护理、教育和情感支持方面的潜在应用,但使用虚构病例的基线评估强调了用临床数据验证真实世界的必要性,以确定真正的临床效用和以患者为中心的影响。这种基于模拟的评估也为设计未来法学硕士评估的研究人员提供了实践经验,强调了混合专家-患者小组、上下文验证和以人为本的指标的需求,而不仅仅是数字准确性。
{"title":"Baseline Evaluation of Claude Opus 4 for Diabetes Management: A Preliminary Assessment and Lessons for Implementation.","authors":"Pouyan Esmaeilzadeh","doi":"10.1055/a-2765-6930","DOIUrl":"10.1055/a-2765-6930","url":null,"abstract":"<p><p>Claude Opus 4 is a large language model (LLM) that features improved reasoning capabilities and broader contextual understanding compared to earlier versions. Despite the growing use of LLM systems for seeking medical information, structured and simulation-based evaluations of Claude Opus 4's capabilities in diabetes management remain limited, particularly across domains such as patient education, clinical reasoning, and emotional support.This study aimed to conduct a baseline evaluation of Claude Opus 4's performance across key domains of diabetes care (i.e., patient education, clinical reasoning, and emotional support), and to identify preliminary insights that can inform future, evidence-based integration strategies.A three-step evaluation was conducted: (1) 30 diabetes management questions assessed using expert endocrinologist evaluation, (2) five fictional diabetes cases evaluated for clinical decision-making, and (3) emotional support responses assessed for appropriateness and empathy. Three expert endocrinologists graded responses according to American Diabetes Association guidelines.Claude Opus 4 achieved 80% accuracy in general diabetes knowledge, with high response reproducibility (96.7%), indicating baseline rather than clinically adequate performance. Clinical case evaluations showed moderate utility (mean expert rating = 4.4/7), while emotional-support assessments yielded high scores for empathy (6.2/7) and appropriateness (6.0/7). These findings suggest that although the model demonstrates promising informational and emotional-support capabilities, its current performance remains insufficient for autonomous clinical use and should be viewed as preliminary evidence to guide future, patient-inclusive validation studies.Although Claude Opus 4 demonstrates preliminary findings suggesting potential applications in diabetes care, education, and emotional support, this baseline assessment using fictional cases underscores the need for real-world validation with clinical data to determine true clinical utility and patient-centered impact. This simulation-based evaluation also offers practical lessons learned for researchers designing future LLM assessments, highlighting the need for mixed expert-patient panels, contextual validation, and person-centered metrics beyond numerical accuracy.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1881-1891"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714427/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145709090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Provider Documentation Using a Pediatric Automated Documentation Assistance Tool. 使用儿科自动文档辅助工具改进提供者文档。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-12-18 DOI: 10.1055/a-2765-7021
Kevin D Smith, Riley Boland, Matthew Cerasale, Cheng-Kai Kao

Clinical documentation improvement is critical for pediatric care, yet leveraging electronic health record (EHR) tools for this population is not well established. We aimed to adapt and implement a real-time, automated documentation assistance tool (AutoDx) to decrease clinical documentation integrity (CDI) coding queries and improve perceived ease of practice for pediatric inpatient providers.In this quality improvement study at an urban academic pediatric hospital, we adapted and implemented AutoDx for pediatric use by developing and validating pediatric-specific logic rules to alert providers to potential diagnoses based on EHR data. The primary outcome was the rate of CDI queries per 1,000 discharges for targeted diagnoses, aiming for a 50% reduction over a 5-month implementation period compared with a 12-month baseline. Secondary outcomes included provider-surveyed ease of practice, with a goal of a 25% improvement, and tool uptake.The aggregate rate of targeted CDI queries decreased by 58% postimplementation, from 80.7 to 33.9 per 1,000 discharges (p < 0.001). Moreover, analysis by interrupted time series demonstrated an immediate 45.5% reduction in the rate of coding queries (p = 0.028) following the implementation of the tool. The rate of queries for nontargeted diagnoses remained unchanged. Tool adoption increased steadily throughout the study period. While provider-reported time spent on queries did not significantly decrease, a majority of survey respondents (59%) perceived receiving fewer queries, and 46% agreed the tool made it easier to provide quality care.Implementation of a real-time, automated documentation support tool in a pediatric inpatient setting significantly reduced CDI coding queries for targeted diagnoses. Despite a "task substitution" effect where perceived workload did not decrease, the tool improved perceived ease of practice, demonstrating that targeted EHR interventions can enhance documentation accuracy and efficiency in pediatrics.

临床文件的改进对儿科护理至关重要,但利用电子健康记录(EHR)工具为这一人群服务还没有很好地建立起来。我们的目标是适应和实现一个实时、自动化文档辅助工具(AutoDx),以减少临床文档完整性(CDI)编码查询,并提高儿科住院医生实践的易用性。在这个城市学术儿科医院的质量改进研究中,我们通过开发和验证儿科特定的逻辑规则来提醒提供者基于EHR数据的潜在诊断,从而适应并实施了AutoDx用于儿科。主要结果是针对目标诊断的每1000例出院患者的CDI查询率,目标是在5个月的实施期内与12个月的基线相比减少50%。次要结果包括供应商调查的操作便利性,目标是提高25%,以及工具使用率。实施该工具后,目标CDI查询的总比率下降了58%,从每1,000次查询80.7次下降到33.9次(p p = 0.028)。非目标诊断的查询率保持不变。在整个研究期间,工具的采用稳步增加。虽然提供者报告的查询时间并没有显著减少,但大多数受访者(59%)认为收到的查询减少了,46%的受访者认为该工具更容易提供高质量的护理。在儿科住院患者设置中实现实时、自动化文档支持工具可显著减少针对目标诊断的CDI编码查询。尽管存在“任务替代”效应,即感知到的工作量没有减少,但该工具提高了感知到的实践便利性,表明有针对性的电子病历干预可以提高儿科文档的准确性和效率。
{"title":"Improving Provider Documentation Using a Pediatric Automated Documentation Assistance Tool.","authors":"Kevin D Smith, Riley Boland, Matthew Cerasale, Cheng-Kai Kao","doi":"10.1055/a-2765-7021","DOIUrl":"10.1055/a-2765-7021","url":null,"abstract":"<p><p>Clinical documentation improvement is critical for pediatric care, yet leveraging electronic health record (EHR) tools for this population is not well established. We aimed to adapt and implement a real-time, automated documentation assistance tool (AutoDx) to decrease clinical documentation integrity (CDI) coding queries and improve perceived ease of practice for pediatric inpatient providers.In this quality improvement study at an urban academic pediatric hospital, we adapted and implemented AutoDx for pediatric use by developing and validating pediatric-specific logic rules to alert providers to potential diagnoses based on EHR data. The primary outcome was the rate of CDI queries per 1,000 discharges for targeted diagnoses, aiming for a 50% reduction over a 5-month implementation period compared with a 12-month baseline. Secondary outcomes included provider-surveyed ease of practice, with a goal of a 25% improvement, and tool uptake.The aggregate rate of targeted CDI queries decreased by 58% postimplementation, from 80.7 to 33.9 per 1,000 discharges (<i>p</i> < 0.001). Moreover, analysis by interrupted time series demonstrated an immediate 45.5% reduction in the rate of coding queries (<i>p</i> = 0.028) following the implementation of the tool. The rate of queries for nontargeted diagnoses remained unchanged. Tool adoption increased steadily throughout the study period. While provider-reported time spent on queries did not significantly decrease, a majority of survey respondents (59%) perceived receiving fewer queries, and 46% agreed the tool made it easier to provide quality care.Implementation of a real-time, automated documentation support tool in a pediatric inpatient setting significantly reduced CDI coding queries for targeted diagnoses. Despite a \"task substitution\" effect where perceived workload did not decrease, the tool improved perceived ease of practice, demonstrating that targeted EHR interventions can enhance documentation accuracy and efficiency in pediatrics.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1900-1908"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12714432/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145783430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Solutions for Increased Adoption of Patient Portal Shared Access: A Human-Centered Design Approach Using the Double Diamond Model. 增加患者门户共享访问的解决方案:使用双菱形模型的以人为本的设计方法。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-12-03 DOI: 10.1055/a-2710-4288
Danny L Scerpella, Liz Salmi, Isabel Hurwitz, Amanda Norris, Kennedy McDaniel, Sara Epstein, Jennifer L Wolff, Catherine M DesRoches

Achieving digital health equity and proper use of identity credentials is crucial as reliance on electronic modalities increases. Proxy access-now increasingly referred to as shared access-is a widely available functionality that offers identity credentials to care partners who assist loved ones in navigating the electronic care delivery demands of patients with complex care needs. However, adoption of these tools has been hindered by complicated user interfaces and low awareness.Drawing on frameworks and principles rooted in human-centered design (HCD), we conducted an evaluation of a multisite quality improvement study designed to increase the awareness and adoption of shared access to patient portals for older adults and their care partners. Through feedback gathered from key informants, we identified barriers to the adoption of materials created for the parent quality improvement project, and synthesize additional implementation strategies from informant feedback to improve shared access.We employed the Double Diamond Model (DDM) of HCD to guide our research. The DDM includes engaging a diverse group of community partners-older adults, care partners, health care system leaders, communications professionals-through focus groups and individual interviews. Our process involved identifying pain points related to registration for shared access, then synthesizing these insights through inductive coding and affinity mapping to generate solutions.An analysis of our community partner feedback revealed several themes, including the necessity for simplified patient portal registration, standardized terminology about shared access, and clear messaging strategies. A step-by-step video tutorial was developed as a prototype. The prototype was then implemented at a partner health system and received positive feedback, suggesting its potential for broader use.These findings emphasize the importance of involving "end users" (patients, care partners, health care system leaders, communications professionals) in the evaluation and implementation of digital health tools. Approaching challenges with an HCD mindset helped our team identify barriers to shared access adoption and led to the development of a tangible resource (prototype and video). This project highlights the potential for HCD to drive improvements in digital health equity.This research demonstrates a practical application of HCD methods in developing effective solutions for enhancing shared access for older adults, and all people using patient portals.

随着对电子模式的依赖日益增加,实现数字卫生公平和正确使用身份凭证至关重要。代理访问——现在越来越多地被称为共享访问——是一种广泛使用的功能,它为护理伙伴提供身份凭证,帮助亲人在具有复杂护理需求的患者的电子护理交付需求中导航。然而,复杂的用户界面和低认知度阻碍了这些工具的采用。基于以人为本设计(HCD)的框架和原则,我们对一项多站点质量改进研究进行了评估,该研究旨在提高老年人及其护理伙伴对患者门户网站共享访问的认识和采用。通过从关键举报人那里收集的反馈,我们确定了采用为家长质量改进项目创建的材料的障碍,并从举报人的反馈中综合了额外的实施策略,以改进共享访问。我们采用HCD的双钻石模型(DDM)来指导我们的研究。DDM包括通过焦点小组和个人访谈吸引不同群体的社区合作伙伴——老年人、护理伙伴、卫生保健系统领导人、通信专业人员。我们的过程包括识别与共享访问注册相关的痛点,然后通过归纳编码和关联映射综合这些见解,以生成解决方案。对我们的社区合作伙伴反馈的分析揭示了几个主题,包括简化患者门户注册的必要性、关于共享访问的标准化术语和明确的消息传递策略。一个循序渐进的视频教程被开发为原型。然后在合作伙伴的卫生系统中实施了原型,并收到了积极的反馈,表明其具有更广泛使用的潜力。这些发现强调了让“最终用户”(患者、护理合作伙伴、卫生保健系统领导者、通信专业人员)参与评估和实施数字卫生工具的重要性。以HCD的思维方式应对挑战,帮助我们的团队确定了采用共享访问的障碍,并促成了有形资源(原型和视频)的开发。该项目强调了HCD推动数字卫生公平改善的潜力。这项研究展示了HCD方法在开发有效解决方案方面的实际应用,以加强老年人和所有使用患者门户网站的人的共享访问。
{"title":"Solutions for Increased Adoption of Patient Portal Shared Access: A Human-Centered Design Approach Using the Double Diamond Model.","authors":"Danny L Scerpella, Liz Salmi, Isabel Hurwitz, Amanda Norris, Kennedy McDaniel, Sara Epstein, Jennifer L Wolff, Catherine M DesRoches","doi":"10.1055/a-2710-4288","DOIUrl":"10.1055/a-2710-4288","url":null,"abstract":"<p><p>Achieving digital health equity and proper use of identity credentials is crucial as reliance on electronic modalities increases. Proxy access-now increasingly referred to as <i>shared access</i>-is a widely available functionality that offers identity credentials to care partners who assist loved ones in navigating the electronic care delivery demands of patients with complex care needs. However, adoption of these tools has been hindered by complicated user interfaces and low awareness.Drawing on frameworks and principles rooted in human-centered design (HCD), we conducted an evaluation of a multisite quality improvement study designed to increase the awareness and adoption of shared access to patient portals for older adults and their care partners. Through feedback gathered from key informants, we identified barriers to the adoption of materials created for the parent quality improvement project, and synthesize additional implementation strategies from informant feedback to improve shared access.We employed the Double Diamond Model (DDM) of HCD to guide our research. The DDM includes engaging a diverse group of community partners-older adults, care partners, health care system leaders, communications professionals-through focus groups and individual interviews. Our process involved identifying pain points related to registration for shared access, then synthesizing these insights through inductive coding and affinity mapping to generate solutions.An analysis of our community partner feedback revealed several themes, including the necessity for simplified patient portal registration, standardized terminology about shared access, and clear messaging strategies. A step-by-step video tutorial was developed as a prototype. The prototype was then implemented at a partner health system and received positive feedback, suggesting its potential for broader use.These findings emphasize the importance of involving \"end users\" (patients, care partners, health care system leaders, communications professionals) in the evaluation and implementation of digital health tools. Approaching challenges with an HCD mindset helped our team identify barriers to shared access adoption and led to the development of a tangible resource (prototype and video). This project highlights the potential for HCD to drive improvements in digital health equity.This research demonstrates a practical application of HCD methods in developing effective solutions for enhancing shared access for older adults, and all people using patient portals.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1728-1737"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12674950/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145670365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifying Pediatric Long COVID: Comparing an EHR Algorithm to Manual Review. 识别儿科长COVID:比较EHR算法与人工审查。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-10-24 DOI: 10.1055/a-2702-1574
Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden T Schwenk, Hiroki Morizono, Jonathan D Cogen, Nathan M Pajor, Ravi Jhaveri, Christopher B Forrest, L Charles Bailey

Long COVID, characterized by persistent or recurring symptoms post-COVID-19 infection, poses challenges for pediatric care and research due to the lack of a standardized clinical definition. Adult-focused phenotypes do not translate well to children, given developmental and physiological differences, and pediatric-specific phenotypes have not been compared with chart review.This study introduces and evaluates a pediatric-specific rule-based computable phenotype (CP) to identify long COVID using electronic health record data. We compare its performance to manual chart review.We applied the CP, composed of diagnostic codes empirically associated with long COVID, to 339,467 pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The CP identified 31,781 patients with long COVID. Clinicians conducted chart reviews on a subset of patients across 16 hospital systems to assess performance. We qualitatively reviewed discordant cases to understand differences between CP and clinician identification.Among the 651 reviewed patients (339 females, M age = 10.10 years), the CP showed moderate agreement with clinician identification (accuracy = 0.62, positive predictive value [PPV] = 0.49, negative predictive value [NPV] = 0.75, sensitivity = 0.52, specificity = 0.84). Performance was largely consistent across age and dominant variant but varied by symptom cluster count. Most discrepancies between the CP and chart review occurred when the CP identified a case, but the clinician did not, often because clinicians attributed symptoms to preexisting conditions (73%). When clinicians identified cases missed by the CP, they often used broader symptom or timing criteria (69%). Model performance improved when the CP accounted for preexisting conditions (accuracy = 0.71, PPV = 0.65, NPV = 0.74, sensitivity = 0.59, specificity = 0.79).This study presents a CP for pediatric long COVID. While agreement with manual review was moderate, most discrepancies were explained by differences in interpreting symptoms when patients had preexisting conditions. Accounting for these conditions improved accuracy and highlights the need for a consensus definition. These findings support the development of reliable, scalable tools for pediatric long COVID research.

由于缺乏标准化的临床定义,长冠状病毒感染后症状持续或反复出现,给儿科护理和研究带来了挑战。鉴于发育和生理差异,以成人为中心的表型不能很好地转化为儿童,儿科特异性表型尚未与图表回顾进行比较。本研究引入并评估了一种儿科特异性的基于规则的可计算表型(CP),以使用电子健康记录数据识别长COVID。我们将其性能与手动图表检查进行比较。我们将由与长冠相关的诊断代码组成的CP应用于RECOVER PCORnet EHR数据库中339,467例SARS-CoV-2感染的儿科患者。新冠肺炎确诊病例31781例。临床医生对16家医院系统的一部分患者进行了图表审查,以评估其表现。我们定性地回顾了不一致的病例,以了解CP和临床医生鉴定之间的差异。在651例患者中(女性339例,年龄10.10岁),CP与临床医师鉴定的一致性中等(准确性= 0.62,阳性预测值[PPV] = 0.49,阴性预测值[NPV] = 0.75,敏感性= 0.52,特异性= 0.84)。表现在年龄和显性变异上基本一致,但因症状群计数而异。大多数CP和图表回顾之间的差异发生在CP确定病例时,但临床医生没有,通常是因为临床医生将症状归因于先前存在的疾病(73%)。当临床医生发现被CP遗漏的病例时,他们通常使用更广泛的症状或时间标准(69%)。当CP考虑到先前存在的条件时,模型性能得到改善(准确性= 0.71,PPV = 0.65, NPV = 0.74,敏感性= 0.59,特异性= 0.79)。本研究提出了儿童长COVID的CP。虽然与手工检查的一致性是中等的,但大多数差异是由于患者先前存在疾病时对症状的解释差异。对这些条件的考虑提高了准确性,并突出了达成一致定义的必要性。这些发现支持为儿科长期COVID研究开发可靠、可扩展的工具。
{"title":"Identifying Pediatric Long COVID: Comparing an EHR Algorithm to Manual Review.","authors":"Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden T Schwenk, Hiroki Morizono, Jonathan D Cogen, Nathan M Pajor, Ravi Jhaveri, Christopher B Forrest, L Charles Bailey","doi":"10.1055/a-2702-1574","DOIUrl":"10.1055/a-2702-1574","url":null,"abstract":"<p><p>Long COVID, characterized by persistent or recurring symptoms post-COVID-19 infection, poses challenges for pediatric care and research due to the lack of a standardized clinical definition. Adult-focused phenotypes do not translate well to children, given developmental and physiological differences, and pediatric-specific phenotypes have not been compared with chart review.This study introduces and evaluates a pediatric-specific rule-based computable phenotype (CP) to identify long COVID using electronic health record data. We compare its performance to manual chart review.We applied the CP, composed of diagnostic codes empirically associated with long COVID, to 339,467 pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The CP identified 31,781 patients with long COVID. Clinicians conducted chart reviews on a subset of patients across 16 hospital systems to assess performance. We qualitatively reviewed discordant cases to understand differences between CP and clinician identification.Among the 651 reviewed patients (339 females, <i>M</i> <sub>age</sub> = 10.10 years), the CP showed moderate agreement with clinician identification (accuracy = 0.62, positive predictive value [PPV] = 0.49, negative predictive value [NPV] = 0.75, sensitivity = 0.52, specificity = 0.84). Performance was largely consistent across age and dominant variant but varied by symptom cluster count. Most discrepancies between the CP and chart review occurred when the CP identified a case, but the clinician did not, often because clinicians attributed symptoms to preexisting conditions (73%). When clinicians identified cases missed by the CP, they often used broader symptom or timing criteria (69%). Model performance improved when the CP accounted for preexisting conditions (accuracy = 0.71, PPV = 0.65, NPV = 0.74, sensitivity = 0.59, specificity = 0.79).This study presents a CP for pediatric long COVID. While agreement with manual review was moderate, most discrepancies were explained by differences in interpreting symptoms when patients had preexisting conditions. Accounting for these conditions improved accuracy and highlights the need for a consensus definition. These findings support the development of reliable, scalable tools for pediatric long COVID research.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"16 5","pages":"1445-1456"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12552067/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145369125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and Evaluation of Offsite Repository for Clinical Assets, a Resilient Solution for Order Set Access during EHR Downtimes. 关于CDS故障的特刊:ORCA的开发和评估,一个在EHR停机期间访问订单集的弹性解决方案。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-05-26 DOI: 10.1055/a-2620-6221
Stephon Proctor, Bimal Desai

Clinical decision support systems (CDSS) are central to modern health care, but their effectiveness is compromised during system downtimes, which affect 96% of health care organizations. During these failures, clinicians lose access to critical decision-making tools like order sets, increasing the risk of medical errors. Traditional downtime solutions, such as paper-based protocols, are often impractical and difficult to maintain.This study introduces and evaluates Offsite Repository for Clinical Assets (ORCA), a resilient web-based solution designed to maintain access to electronic health record (EHR) order sets during system failures. We assessed its usability and effectiveness as a downtime decision support tool across various clinical settings.ORCA was developed based on an analysis of previous downtime incidents, replicating essential order set functionality while ensuring offsite accessibility. We conducted usability testing with 16 clinicians from diverse specialties, using structured tasks and think-aloud protocols. User feedback was collected through the Usability Metric for User Experience (UMUX) questionnaire and thematic analysis of interview transcripts.ORCA demonstrated strong usability (mean UMUX score: 86.2). Thematic analysis revealed key implementation challenges: system limitations, workflow integration, and interface navigation. Users valued ORCA's familiar interface and offsite accessibility but identified critical gaps in dynamic decision support capabilities.ORCA represents a viable approach to maintaining basic clinical decision support (CDS) during downtimes. However, significant challenges remain in replicating dynamic CDS features and ensuring effective integration with existing downtime procedures. These findings inform future development of resilient CDSS and highlight the importance of planned fallback pathways in clinical systems.

背景:临床决策支持系统(CDSS)是现代医疗保健的核心,但其有效性在系统停机期间受到损害,这影响了96%的医疗保健组织。在这些故障期间,临床医生无法访问诸如订单集之类的关键决策工具,从而增加了医疗差错的风险。传统的停机解决方案,如基于纸张的协议,通常不切实际且难以维护。目的:本研究介绍并评估了ORCA (Offsite Repository for Clinical Assets),这是一种弹性的基于网络的解决方案,旨在在系统故障期间保持对EHR订单集的访问。我们评估了它在各种临床环境中作为停机决策支持工具的可用性和有效性。方法:ORCA是在分析之前的停机事件的基础上开发的,在确保非现场可访问性的同时,复制了基本的订单集功能。我们对来自不同专业的16名临床医生进行了可用性测试,使用结构化任务和有声思考协议。用户反馈是通过用户体验可用性度量(UMUX)问卷调查和访谈记录的专题分析收集的。结果:ORCA表现出较强的可用性(平均UMUX得分:86.2)。专题分析揭示了主要的实施挑战:系统限制(24.56%)、工作流集成(23.39%)和界面导航(22.22%)。用户重视ORCA熟悉的界面和非现场可访问性,但发现了动态决策支持能力的关键差距。结论:ORCA代表了在停机期间维持基本临床决策支持的可行方法。然而,在复制动态CDS特性和确保与现有停机程序的有效集成方面仍然存在重大挑战。这些发现为弹性CDS系统的未来发展提供了信息,并强调了在临床系统中规划后备途径的重要性。
{"title":"Development and Evaluation of Offsite Repository for Clinical Assets, a Resilient Solution for Order Set Access during EHR Downtimes.","authors":"Stephon Proctor, Bimal Desai","doi":"10.1055/a-2620-6221","DOIUrl":"10.1055/a-2620-6221","url":null,"abstract":"<p><p>Clinical decision support systems (CDSS) are central to modern health care, but their effectiveness is compromised during system downtimes, which affect 96% of health care organizations. During these failures, clinicians lose access to critical decision-making tools like order sets, increasing the risk of medical errors. Traditional downtime solutions, such as paper-based protocols, are often impractical and difficult to maintain.This study introduces and evaluates Offsite Repository for Clinical Assets (ORCA), a resilient web-based solution designed to maintain access to electronic health record (EHR) order sets during system failures. We assessed its usability and effectiveness as a downtime decision support tool across various clinical settings.ORCA was developed based on an analysis of previous downtime incidents, replicating essential order set functionality while ensuring offsite accessibility. We conducted usability testing with 16 clinicians from diverse specialties, using structured tasks and think-aloud protocols. User feedback was collected through the Usability Metric for User Experience (UMUX) questionnaire and thematic analysis of interview transcripts.ORCA demonstrated strong usability (mean UMUX score: 86.2). Thematic analysis revealed key implementation challenges: system limitations, workflow integration, and interface navigation. Users valued ORCA's familiar interface and offsite accessibility but identified critical gaps in dynamic decision support capabilities.ORCA represents a viable approach to maintaining basic clinical decision support (CDS) during downtimes. However, significant challenges remain in replicating dynamic CDS features and ensuring effective integration with existing downtime procedures. These findings inform future development of resilient CDSS and highlight the importance of planned fallback pathways in clinical systems.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1401-1412"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12534125/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144152613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Physician Perspectives on Large Language Models in Health Care: A Cross-Sectional Survey Study. 医生对医疗保健中大语言模型的看法:一项横断面调查研究。
IF 2.2 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2025-10-01 Epub Date: 2025-10-30 DOI: 10.1055/a-2735-0527
Hyo Jung Hong, Nigam H Shah, Michael A Pfeffer, Lisa S Lehmann

This study aims to evaluate physicians' practices and perspectives regarding large language models (LLMs) in health care settings.A cross-sectional survey study was conducted between May and July 2024, comparing physician perspectives at two major academic medical centers (AMCs), one with institutional LLM access and one without. Participants included both clinical faculty and trainees recruited through departmental leadership and snowball sampling. Primary outcomes were current LLM use frequency, ranked importance of evaluation metrics, liability concerns, and preferred learning topics.Among 306 respondents (217 attending physicians [70.9%], 80 trainees [26.1%]), 197 (64.4%) reported using LLMs. The AMC with institutional LLM access reported significantly lower liability concerns (49.2 vs. 66.7% reporting high concern; 17.5 percentage points difference [95% CI, 6.8-28.2]; p = 0.0082). Accuracy was prioritized across all specialties (median rank 1.0 [interquartile range; IQR, 1.0-2.0]). Of the respondents, 287 physicians (94%) requested additional training. Key learning priorities were clinical applications (206 [71.9%]) and risk management (181 [63.1%]). Despite widespread personal use, only 8 physicians (2.6%) recommended LLMs to patients. Notable specialty and demographic variations emerged, with younger physicians showing higher enthusiasm but also elevated legal concerns.This survey study provides insights into physicians' current usage patterns and perspectives on LLMs. Liability concerns appear to be lessened in settings with institutional LLM access. The findings suggest opportunities for medical centers to consider when developing LLM-related policies and educational programs.

目的:本研究旨在评估医生在医疗保健环境中关于大语言模型(llm)的实践和观点。方法:在2024年5月至7月期间进行了一项横断面调查研究,比较了两家主要学术医学中心(amc)的医生观点,其中一家获得了机构法学硕士学位,另一家没有。参与者包括通过部门领导和滚雪球抽样招募的临床教员和实习生。主要结果是当前法学硕士的使用频率、评估指标的重要性排序、责任问题和首选学习主题。结果:306名受访医师(217名主治医师[70.9%],80名培训生[26.1%])中,197名(64.4%)使用法学硕士。获得机构LLM的AMC报告了明显较低的责任担忧(49.2%对66.7%报告了高度担忧;17.5个百分点的差异[95% CI, 6.8-28.2]; P= 0.0082)。准确度在所有专科中被优先考虑(中位等级为1.0 [IQR, 1.0-2.0])。在受访者中,287名医生(94%)要求额外培训。主要学习重点是临床应用(206例[71.9%])和风险管理(181例[63.1%])。尽管个人使用广泛,但只有8名医生(2.6%)向患者推荐llm。明显的专业和人口变化出现了,年轻的医生表现出更高的热情,但也增加了法律上的担忧。结论:这项调查研究提供了对医生目前使用llm的模式和观点的见解。在有机构法学硕士机会的环境中,责任问题似乎减轻了。研究结果为医疗中心在制定法学硕士相关政策和教育计划时提供了考虑的机会。
{"title":"Physician Perspectives on Large Language Models in Health Care: A Cross-Sectional Survey Study.","authors":"Hyo Jung Hong, Nigam H Shah, Michael A Pfeffer, Lisa S Lehmann","doi":"10.1055/a-2735-0527","DOIUrl":"10.1055/a-2735-0527","url":null,"abstract":"<p><p>This study aims to evaluate physicians' practices and perspectives regarding large language models (LLMs) in health care settings.A cross-sectional survey study was conducted between May and July 2024, comparing physician perspectives at two major academic medical centers (AMCs), one with institutional LLM access and one without. Participants included both clinical faculty and trainees recruited through departmental leadership and snowball sampling. Primary outcomes were current LLM use frequency, ranked importance of evaluation metrics, liability concerns, and preferred learning topics.Among 306 respondents (217 attending physicians [70.9%], 80 trainees [26.1%]), 197 (64.4%) reported using LLMs. The AMC with institutional LLM access reported significantly lower liability concerns (49.2 vs. 66.7% reporting high concern; 17.5 percentage points difference [95% CI, 6.8-28.2]; <i>p</i> = 0.0082). Accuracy was prioritized across all specialties (median rank 1.0 [interquartile range; IQR, 1.0-2.0]). Of the respondents, 287 physicians (94%) requested additional training. Key learning priorities were clinical applications (206 [71.9%]) and risk management (181 [63.1%]). Despite widespread personal use, only 8 physicians (2.6%) recommended LLMs to patients. Notable specialty and demographic variations emerged, with younger physicians showing higher enthusiasm but also elevated legal concerns.This survey study provides insights into physicians' current usage patterns and perspectives on LLMs. Liability concerns appear to be lessened in settings with institutional LLM access. The findings suggest opportunities for medical centers to consider when developing LLM-related policies and educational programs.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":"1738-1748"},"PeriodicalIF":2.2,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12618148/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145410692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1