首页 > 最新文献

Learning Health Systems最新文献

英文 中文
A model of academic-practice collaboration for facilitating informatics capacity and building a learning health system framework in public health 在公共卫生领域促进信息学能力和建立学习型卫生系统框架的学术与实践合作模式。
IF 2.6 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-08-12 DOI: 10.1002/lrh2.10446
Sripriya Rajamani, Sarah Solarz, Miriam Halstead Muscoplat, Aasa Dahlberg Schmit, Ann Gonderinger, Chris Brueske, Jennifer Fritz, Emily Emerson, Genevieve B. Melton

Background and Objective

The data modernization initiative (DMI) is a multi-year, multi-billion-dollar endeavor toward a robust public health information infrastructure. The various DMI projects (interoperability, analytics, workforce, governance) present an opportunity for a learning health system (LHS) framework in public health. The objective is to share an academic-practice partnership model between the University of Minnesota (UMN) and the Minnesota Department of Health (MDH) in advancing public health informatics (PHI) and its relationship to an LHS model.

Methods

The UMN-MDH partnership was conceptualized in 2018 as a 1-year pilot with annual renewals through a time/cost-sharing faculty position with PHI expertise. The partnership focus was decided based on MDH's needs and mutual interests, with the core collaborating faculty (SR) being an embedded researcher at MDH. Responsibilities included supporting electronic case reporting (eCR), interoperability projects, and assisting MDH staff with PHI presentations/publications. The partnership has expanded to PHI workforce development through a national grant and now includes an interest in applying the LHS framework to MDH-DMI work.

Results

The MDH-DMI team has embarked upon 13 projects for assessment through an LHS approach: systems interoperability projects between MDH and healthcare/local public health (n = 6); systems modernization for MDH programs (n = 5); informatics workforce development (n = 1); and program governance (n = 1). Each project has been evaluated and/or has current/future assessment plans to synthesize learnings and create a feedback loop for iterative improvement. The partnership has been mutually beneficial as it met agreed upon metrics across both institutions. The program's productivity is showcased with shared authorship in 10 peer-reviewed proceedings/publications, 22 presentations and 16 posters across local/national conferences.

Conclusion

The current case report of the UMN-MDH partnership is a relatively recent exemplar to support tangible LHS demonstration in public health. Building LHS momentum at MDH and other public health entities will require LHS champion(s) and continued academic collaboration.

背景和目标:数据现代化计划(DMI)是一项耗资数十亿美元的多年计划,旨在建立一个强大的公共卫生信息基础设施。各种 DMI 项目(互操作性、分析、劳动力、管理)为公共卫生领域的学习型卫生系统(LHS)框架提供了机会。本文旨在分享明尼苏达大学(UMN)与明尼苏达州卫生局(MDH)在推进公共卫生信息学(PHI)方面的学术与实践合作模式及其与 LHS 模式的关系:明尼苏达大学与明尼苏达州卫生部的合作于 2018 年开始构想,作为为期 1 年的试点项目,每年通过一个具有 PHI 专业知识的时间/成本共享教职进行续约。合作重点是根据 MDH 的需求和共同利益决定的,核心合作教师(SR)是 MDH 的一名嵌入式研究员。其职责包括支持电子病例报告 (eCR)、互操作性项目,以及协助 MDH 员工进行 PHI 介绍/出版。通过一项国家拨款,合作关系扩展到了 PHI 劳动力发展,现在还包括将 LHS 框架应用于 MDH-DMI 工作的兴趣:MDH-DMI 团队通过 LHS 方法开展了 13 个评估项目:MDH 与医疗保健/地方公共卫生之间的系统互操作性项目(n = 6);MDH 计划的系统现代化(n = 5);信息学人才培养(n = 1);以及计划管理(n = 1)。每个项目都进行了评估和/或制定了当前/未来的评估计划,以总结经验教训,建立反馈循环,实现迭代改进。这种合作关系对双方都有利,因为它达到了两个机构商定的指标。通过在 10 份同行评审的论文集/出版物、22 份本地/全国性会议的演讲稿和 16 份海报中的共同作者身份,该计划的成果得到了展示:目前关于 UMN-MDH 合作伙伴关系的案例报告是支持公共卫生领域切实可行的 LHS 示范的一个相对较新的范例。要在 MDH 和其他公共卫生实体建立 LHS 的势头,需要 LHS 的支持者和持续的学术合作。
{"title":"A model of academic-practice collaboration for facilitating informatics capacity and building a learning health system framework in public health","authors":"Sripriya Rajamani,&nbsp;Sarah Solarz,&nbsp;Miriam Halstead Muscoplat,&nbsp;Aasa Dahlberg Schmit,&nbsp;Ann Gonderinger,&nbsp;Chris Brueske,&nbsp;Jennifer Fritz,&nbsp;Emily Emerson,&nbsp;Genevieve B. Melton","doi":"10.1002/lrh2.10446","DOIUrl":"10.1002/lrh2.10446","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background and Objective</h3>\u0000 \u0000 <p>The data modernization initiative (DMI) is a multi-year, multi-billion-dollar endeavor toward a robust public health information infrastructure. The various DMI projects (interoperability, analytics, workforce, governance) present an opportunity for a learning health system (LHS) framework in public health. The objective is to share an academic-practice partnership model between the University of Minnesota (UMN) and the Minnesota Department of Health (MDH) in advancing public health informatics (PHI) and its relationship to an LHS model.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The UMN-MDH partnership was conceptualized in 2018 as a 1-year pilot with annual renewals through a time/cost-sharing faculty position with PHI expertise. The partnership focus was decided based on MDH's needs and mutual interests, with the core collaborating faculty (SR) being an embedded researcher at MDH. Responsibilities included supporting electronic case reporting (eCR), interoperability projects, and assisting MDH staff with PHI presentations/publications. The partnership has expanded to PHI workforce development through a national grant and now includes an interest in applying the LHS framework to MDH-DMI work.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The MDH-DMI team has embarked upon 13 projects for assessment through an LHS approach: systems interoperability projects between MDH and healthcare/local public health (<i>n</i> = 6); systems modernization for MDH programs (<i>n</i> = 5); informatics workforce development (<i>n</i> = 1); and program governance (<i>n</i> = 1). Each project has been evaluated and/or has current/future assessment plans to synthesize learnings and create a feedback loop for iterative improvement. The partnership has been mutually beneficial as it met agreed upon metrics across both institutions. The program's productivity is showcased with shared authorship in 10 peer-reviewed proceedings/publications, 22 presentations and 16 posters across local/national conferences.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>The current case report of the UMN-MDH partnership is a relatively recent exemplar to support tangible LHS demonstration in public health. Building LHS momentum at MDH and other public health entities will require LHS champion(s) and continued academic collaboration.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 4","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11493548/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142510005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
2023 MCBK global meeting—Lightning talk abstracts 2023 MCBK 全球会议-闪电讲座摘要
IF 2.6 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-07-06 DOI: 10.1002/lrh2.10443
<p>Muhammad Afzal, School of Computing and Digital Technology, Birmingham City University</p><p><span>[email protected]</span></p><p>Contemporary scientific communication relies heavily on document-based systems like journal articles, books, and reports for sharing research findings. However, large documents limit opportunities for efficient knowledge dissemination due to limitation in processing of different subsections within a document to understand the meaning of information units. This research aims to develop a smart repository that moves beyond documents and introduces smaller, computable units of knowledge. By assessing biomedical data sources, we will build a repository to make scientific knowledge more representable, computable, and shareable. The rationale is to enhance how researchers communicate and manage information in the rapidly evolving digital era.</p><p>The work focuses on developing a new repository that goes beyond the document-based paradigm by fusing biomedical and health and life sciences data sources, such as PubMed Central. New protocols and methods will be designed to identify relevant sections in the documents to extract smaller knowledge units. The proposed repository with key features storage, retrieval, representation, and sharing will be optimized for the granular units. Integration strategies with existing platforms like PubMed will be devised. Usability testing will refine the interface to boost engagement. Interoperability mechanisms will ensure compatibility with existing systems.</p><p>By enabling scientific knowledge to be shared in smaller units, this repository has the potential to revolutionize scientific communication and collaboration. Breaking down information into granular components is expected to create new opportunities for innovation, discovery, and the development of advanced analytics tools. The repository will facilitate efficient access to health evidence, benefiting researchers, clinicians in creating systematic reviewers that require rapid evidence synthesis. Further, the computable units extracted from documents could be modeled into interoperable resources like FHIR, thereby support the Evidence Based Medicine on FHIR (EBMonFHIR) project is extending FHIR to provide a standard for machine-interpretable exchange of scientific knowledge. This would also allow developers to build innovative AI systems for objectives such as diagnostic and treatment support.</p><p>By reducing the need for manual effort in finding and formatting evidence, the repository will pave the way for automating knowledge synthesis and management and will empower various stakeholders with enhanced efficiency, interoperability, and analytical capabilities to progress research and practice.</p><p>Miguel Aljibe, University of the Philippines</p><p><span>[email protected]</span></p><p>Alvin Marcelo, University of the Philippines-Manila</p><p><span>[email protected]</span></p><p>Janus Ong, University of the Philippines-Manila
本研究旨在开发基于机器学习的工具,该工具可根据脓毒症发生最初 3 小时内收集的临床数据预测重症监护室内脓毒症患者的住院死亡率风险。液体疗法是一种临床治疗方法,主要通过补充或限制特定液体来维持液体平衡。作为一种危及生命的疾病,早期复苏量对脓毒症患者非常重要,它影响着患者的预后和治疗效果。遗憾的是,现有的大多数脓毒症死亡率预测模型都没有将早期复苏量纳入分析范围。在临床实践中,脓毒症患者应尽早进行液体复苏。2016 年 "脓毒症生存运动 "指南建议,在脓毒症患者复苏的最初 3 小时内,应给予至少 30 mL/kg 的静脉注射晶体液。从指南中可以看出,脓毒症确诊后的最初 3 小时被视为早期复苏的关键 "黄金时间"。因此,本研究将早期复苏干预纳入了死亡率风险预测模型。数据来源是重症监护医学信息市场-IV(MIMIC-IV)数据库,该数据库包含 2008 年至 2019 年期间贝斯以色列女执事医疗中心重症监护室收治的 4 万多名重症监护室患者的记录。从 MIMIC-IV 中提取的脓毒症患者数据形成了一个庞大的研究群体,其中包含的临床信息包括人口统计学、实验室检查、临床评估和医疗治疗。在分析方法方面,本研究采用了几种具有良好可解释性的机器学习方法,包括随机森林(RF)和极端梯度提升(XGBoost),以及多元逻辑回归,这些方法在医学领域也表现出了令人满意的预测能力。最后,将两种基于机器学习的模型的预测性能与传统的逻辑回归进行了比较,并选择了性能最佳的预测模型作为临床推荐。本研究开发的预测工具将有助于早期识别院内死亡风险较高的败血症患者。希望它能帮助重症监护室的医生提供及时、最佳的干预措施,从而有助于改善重症监护室患者的预后,降低院内死亡率。不断加强手术培训是确保高手术标准和保持良好手术视觉效果的关键。传统上,手术培训和反馈几乎完全基于手术室中由教员主导的实时反馈。机器学习(特别是深度学习模型)的出现有可能通过分析常规拍摄的手术视频,对手术表现进行更精细、更客观的分析,从而增强手术反馈。在之前的工作中,我们开发了深度学习模型,可以识别白内障手术视频中的关键手术地标和正在进行的手术步骤,从而提供了一种量化评估手术技能的新方法。PhacoTrainer 平台是一个基于网络的应用程序,用户可以上传白内障手术视频,并获得对其白内障手术表现的见解。该平台针对上传的视频部署了一个深度学习模型,即混合卷积神经网络和循环神经网络,以检测哪些手术包含特殊的手术技术或并发症。模型输出还能计算出手术每个步骤所花费的时间,然后将其显示在仪表板上,直观显示外科医生积累更多经验后每个步骤手术时间的变化。每个手术视频的时间轴也会自动注释,逐帧确定正在进行的手术步骤,以便外科医生更好地浏览手术视频。因此,PhacoTrainer 根据这些模型提供的反馈意见为外科医生提供了有洞察力的指标,以监控他们在多个维度上的手术表现,找出可能需要改进的地方。 PhacoTrainer 平台预示着白内障手术培训领域的重大进步,它将非结构化的白内障手术视频转化为可计算的洞察力。通过利用深度学习对手术视频进行客观分析,它为外科医生提供了自我评估技能、跟踪改进情况、记录手术元数据并最终提高手术效果的工具。PhacoTrainer 还能为所有学员提供高质量的反馈,不受地域或机构限制。PhacoTrainer 能够积累大量有关白内障手术的元数据,它还有望促进未来有关白内障手术的研究,促进对手术技术随时间推移和白内障手术培训的更细致入微的了解。"犹他大学医学博士 Alan H. Morris[email protected]对于可复制的决策支持小组来说,临床决策是以知识、专长和权威为基础的,临床医生根据希波克拉底临床决策模式批准几乎所有的干预措施。这是提供 "所有正确的医疗服务,但只有正确的医疗服务 "的起点,但这一质量目标尚未实现,因为在没有辅助的情况下,临床医生仅根据自己的培训、专业知识和经验做出决策时,会受到人类认知局限性和偏见的影响。强大的决策支持工具可以减少临床医生决策和行动中不必要的偏差,从而改善医疗服务。目前的电子病历(EHR)侧重于结果审查、记录和核算。电子病历既笨拙又耗时,还会造成临床医生的压力和职业倦怠。决策支持工具可以减轻临床医生的负担,并使临床医生的决策和行动具有可复制性,从而实现对患者的个性化护理。然而,目前大多数临床决策支持工具/辅助工具缺乏细节,既不能减轻临床医生的负担,也不能让临床医生采取可复制的行动。临床医生必须提供主观解释和缺失的逻辑,从而引入了个人偏见和无意识、无理由的循证实践差异。当不同的临床医生在相同的患者信息和背景下做出相同的决定和行动时,就会出现可复制性。基于可靠临床结果证据的治疗决策支持工具的一个子集是计算机协议(eActions),包括闭环系统,可导致临床医生采取可复制的行动。在先进的现代医疗保健服务环境中,eActions 克服了负担过重的临床医生的认知局限性。eActions 包括以证据、经验、电子病历数据和患者个体状况为依据的良好日常决策。eActions 可以减少临床医生不必要的差异,提高临床护理和研究质量,减少电子病历噪音,并可实现学习型医疗保健系统。循证指南只能解决一小部分临床护理问题。医疗服务不足的地区很少能实时获得最先进的循证指南,也往往无法实施先进的指南。这些地区的医疗服务提供者往往没有足够的培训或时间来实施先进的指南。要广泛使用电子行动,就必须克服当前的医疗保健技术和文化障碍,并安装临床证据/数据整理系统,以便在真正的学习型医疗保健系统中,通过在常规医疗保健服务过程中开展的比较有效性临床研究,产生新的或修改过的循证指南。佛蒙特大学医学中心的 Katelin Morrissette[email protected]医疗决策的许多重要组成部分,如诊断的确定性、考虑但避免的干预措施或患者在管理决策中的投入,都很难通过医疗记录中的现有数据元素来衡量。我们介绍了一种建立自定义数据元素的方法,以反映医疗管理的这些组成部分,并描述了实施过程。医疗管理的新创新可能无法在电子病历的传统元素中体现,因此也将依赖于这些定制的数据元素。例如,在重症监护医学中,病人进入重症监护室(ICU)之前的护理阶段可被视为重症监护室周边阶段(peri-ICU)。这一阶段的干预措施可以避免患者进入重症监护室,或确定初步诊断和管理。 主刀医生的乳化中心定位和眼球固定效果更好。大多数指标与人类评定的 OSACSS 平均分相关,包括特定工具指标和与显微镜控制相关的指标(固定:-0.349;变焦水平变化:-0.322)。机器生成的指标与相应的 OSACSS 子项目也表现出显著的负相关(固定:-0.65;超声乳化探头面积指标:-0.67):自动生成的人工智能指标可用于区分主治医生和实习医生的手术,并与人类对手术表现的评价相关联。这些指标可以在手术后分析中以快速、可扩展的方式自动生成,使外科学员在培训期间及时获得有用的反馈。此外,这些指标的数值可以被记录下来,并在以后进行审查,以跟踪手术技能不同方面的改进情况。该模型有望在眼科培训中建立一个全自动、客观的手术反馈系统,从而对手术技术进行标准化和一致的分析。史彤悦,北京大学国家健康数据科学研究院[
{"title":"2023 MCBK global meeting—Lightning talk abstracts","authors":"","doi":"10.1002/lrh2.10443","DOIUrl":"10.1002/lrh2.10443","url":null,"abstract":"&lt;p&gt;Muhammad Afzal, School of Computing and Digital Technology, Birmingham City University&lt;/p&gt;&lt;p&gt;&lt;span&gt;[email protected]&lt;/span&gt;&lt;/p&gt;&lt;p&gt;Contemporary scientific communication relies heavily on document-based systems like journal articles, books, and reports for sharing research findings. However, large documents limit opportunities for efficient knowledge dissemination due to limitation in processing of different subsections within a document to understand the meaning of information units. This research aims to develop a smart repository that moves beyond documents and introduces smaller, computable units of knowledge. By assessing biomedical data sources, we will build a repository to make scientific knowledge more representable, computable, and shareable. The rationale is to enhance how researchers communicate and manage information in the rapidly evolving digital era.&lt;/p&gt;&lt;p&gt;The work focuses on developing a new repository that goes beyond the document-based paradigm by fusing biomedical and health and life sciences data sources, such as PubMed Central. New protocols and methods will be designed to identify relevant sections in the documents to extract smaller knowledge units. The proposed repository with key features storage, retrieval, representation, and sharing will be optimized for the granular units. Integration strategies with existing platforms like PubMed will be devised. Usability testing will refine the interface to boost engagement. Interoperability mechanisms will ensure compatibility with existing systems.&lt;/p&gt;&lt;p&gt;By enabling scientific knowledge to be shared in smaller units, this repository has the potential to revolutionize scientific communication and collaboration. Breaking down information into granular components is expected to create new opportunities for innovation, discovery, and the development of advanced analytics tools. The repository will facilitate efficient access to health evidence, benefiting researchers, clinicians in creating systematic reviewers that require rapid evidence synthesis. Further, the computable units extracted from documents could be modeled into interoperable resources like FHIR, thereby support the Evidence Based Medicine on FHIR (EBMonFHIR) project is extending FHIR to provide a standard for machine-interpretable exchange of scientific knowledge. This would also allow developers to build innovative AI systems for objectives such as diagnostic and treatment support.&lt;/p&gt;&lt;p&gt;By reducing the need for manual effort in finding and formatting evidence, the repository will pave the way for automating knowledge synthesis and management and will empower various stakeholders with enhanced efficiency, interoperability, and analytical capabilities to progress research and practice.&lt;/p&gt;&lt;p&gt;Miguel Aljibe, University of the Philippines&lt;/p&gt;&lt;p&gt;&lt;span&gt;[email protected]&lt;/span&gt;&lt;/p&gt;&lt;p&gt;Alvin Marcelo, University of the Philippines-Manila&lt;/p&gt;&lt;p&gt;&lt;span&gt;[email protected]&lt;/span&gt;&lt;/p&gt;&lt;p&gt;Janus Ong, University of the Philippines-Manila","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 3","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10443","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141672062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
2023 Inaugural Healthcare Delivery Science: Innovation and Partnerships for Health Equity Research (DESCIPHER) Symposium 2023 年首届医疗保健服务科学:创新与合作促进健康公平研究(DESCIPHER)研讨会
IF 2.6 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-07-04 DOI: 10.1002/lrh2.10442
Allison Z. Orechwa, Anshu Abhat, Lilyana Amezcua, Bernadette Boden-Albala, Thomas A. Buchanan, Steve Chen, Lauren P. Daskivich, Brett Feldman, Michael K. Gould, Wei-an Lee, Christopher Lynch, Carolyn C. Meltzer, Brian S. Mittman, Margarita Pereyda, Evan Raff, Jehni Robinson, Sonali Saluja, Barbara J. Turner, Breena R. Taira, Rebecca Trotzky-Sirr, Linda Williams, Shinyi Wu, Hal Yee Jr., Amytis Towfighi

Introduction

This article provides an overview of presentations and discussions from the inaugural Healthcare Delivery Science: Innovation and Partnerships for Health Equity Research (DESCIPHER) Symposium.

Methods

The symposium brought together esteemed experts from various disciplines to explore models for translating evidence-based interventions into practice.

Results

The symposium highlighted the importance of disruptive innovation in healthcare, the need for multi-stakeholder engagement, and the significance of family and community involvement in healthcare interventions.

Conclusions

The article concluded with a call to action for advancing healthcare delivery science to achieve health equity.

本文概述了首届 "医疗保健服务科学:健康公平研究的创新与合作"(DESCIPHER)研讨会上的发言和讨论:研讨会强调了医疗保健领域颠覆性创新的重要性、多方利益相关者参与的必要性以及家庭和社区参与医疗保健干预的意义。文章最后呼吁采取行动,推动医疗保健服务科学发展,实现健康公平。
{"title":"2023 Inaugural Healthcare Delivery Science: Innovation and Partnerships for Health Equity Research (DESCIPHER) Symposium","authors":"Allison Z. Orechwa,&nbsp;Anshu Abhat,&nbsp;Lilyana Amezcua,&nbsp;Bernadette Boden-Albala,&nbsp;Thomas A. Buchanan,&nbsp;Steve Chen,&nbsp;Lauren P. Daskivich,&nbsp;Brett Feldman,&nbsp;Michael K. Gould,&nbsp;Wei-an Lee,&nbsp;Christopher Lynch,&nbsp;Carolyn C. Meltzer,&nbsp;Brian S. Mittman,&nbsp;Margarita Pereyda,&nbsp;Evan Raff,&nbsp;Jehni Robinson,&nbsp;Sonali Saluja,&nbsp;Barbara J. Turner,&nbsp;Breena R. Taira,&nbsp;Rebecca Trotzky-Sirr,&nbsp;Linda Williams,&nbsp;Shinyi Wu,&nbsp;Hal Yee Jr.,&nbsp;Amytis Towfighi","doi":"10.1002/lrh2.10442","DOIUrl":"10.1002/lrh2.10442","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>This article provides an overview of presentations and discussions from the inaugural Healthcare Delivery Science: Innovation and Partnerships for Health Equity Research (DESCIPHER) Symposium.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The symposium brought together esteemed experts from various disciplines to explore models for translating evidence-based interventions into practice.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The symposium highlighted the importance of disruptive innovation in healthcare, the need for multi-stakeholder engagement, and the significance of family and community involvement in healthcare interventions.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>The article concluded with a call to action for advancing healthcare delivery science to achieve health equity.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 3","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10442","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141679467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Diagnostic accuracy of GPT-4 on common clinical scenarios and challenging cases GPT-4 对常见临床情况和疑难病例的诊断准确性
IF 2.6 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-06-25 DOI: 10.1002/lrh2.10438
Geoffrey W. Rutledge

Introduction

Large language models (LLMs) have a high diagnostic accuracy when they evaluate previously published clinical cases.

Methods

We compared the accuracy of GPT-4's differential diagnoses for previously unpublished challenging case scenarios with the diagnostic accuracy for previously published cases.

Results

For a set of previously unpublished challenging clinical cases, GPT-4 achieved 61.1% correct in its top 6 diagnoses versus the previously reported 49.1% for physicians. For a set of 45 clinical vignettes of more common clinical scenarios, GPT-4 included the correct diagnosis in its top 3 diagnoses 100% of the time versus the previously reported 84.3% for physicians.

Conclusions

GPT-4 performs at a level at least as good as, if not better than, that of experienced physicians on highly challenging cases in internal medicine. The extraordinary performance of GPT-4 on diagnosing common clinical scenarios could be explained in part by the fact that these cases were previously published and may have been included in the training dataset for this LLM.

引言 大型语言模型(LLM)在评估以前发表的临床病例时具有很高的诊断准确性。 方法 我们比较了 GPT-4 对以前未发表的高难度病例的鉴别诊断准确率和对以前已发表病例的诊断准确率。 结果 对于一组之前未发表的具有挑战性的临床病例,GPT-4 的前 6 项诊断正确率为 61.1%,而之前报道的医生的正确率为 49.1%。在一组 45 个更常见的临床案例中,GPT-4 在前 3 个诊断中的正确率为 100%,而之前报道的医生的正确率为 84.3%。 结论 GPT-4 在内科高难度病例上的表现至少与经验丰富的医生相当,甚至更好。GPT-4 在诊断常见临床病例时表现非凡,部分原因可能是这些病例之前已经发表过,并且可能已经包含在本 LLM 的训练数据集中。
{"title":"Diagnostic accuracy of GPT-4 on common clinical scenarios and challenging cases","authors":"Geoffrey W. Rutledge","doi":"10.1002/lrh2.10438","DOIUrl":"https://doi.org/10.1002/lrh2.10438","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Large language models (LLMs) have a high diagnostic accuracy when they evaluate previously published clinical cases.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We compared the accuracy of GPT-4's differential diagnoses for previously unpublished challenging case scenarios with the diagnostic accuracy for previously published cases.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>For a set of previously unpublished challenging clinical cases, GPT-4 achieved 61.1% correct in its top 6 diagnoses versus the previously reported 49.1% for physicians. For a set of 45 clinical vignettes of more common clinical scenarios, GPT-4 included the correct diagnosis in its top 3 diagnoses 100% of the time versus the previously reported 84.3% for physicians.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>GPT-4 performs at a level at least as good as, if not better than, that of experienced physicians on highly challenging cases in internal medicine. The extraordinary performance of GPT-4 on diagnosing common clinical scenarios could be explained in part by the fact that these cases were previously published and may have been included in the training dataset for this LLM.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 3","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10438","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141730353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing data practices for Whole Health: Strategies for a transformative future 加强整体健康的数据实践:变革未来的战略
IF 3.1 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-05-30 DOI: 10.1002/lrh2.10426
Lei Guo, Kavitha P. Reddy, Theresa Van Iseghem, Whitney N. Pierce

We explored the challenges and solutions for managing data within the Whole Health System (WHS), which operates as a Learning Health System and a patient-centered healthcare approach that combines conventional and complementary approaches. Addressing these challenges is critical for enhancing patient care and improving outcomes within WHS. The proposed solutions include prioritizing interoperability for seamless data exchange, incorporating patient-centered comparative clinical effectiveness research and real-world data to personalize treatment plans and validate integrative approaches, and leveraging advanced data analytics tools to incorporate patient-reported outcomes, objective metrics, robust data platforms. Implementing these measures will enable WHS to fulfill its mission as a holistic and patient-centered healthcare model, promoting greater collaboration among providers, boosting the well-being of patients and providers, and improving patient outcomes.

我们探讨了在 "整体健康系统"(WHS)内管理数据所面临的挑战和解决方案。"整体健康系统 "是一个学习型健康系统,是一种以患者为中心的医疗保健方法,结合了传统方法和互补方法。应对这些挑战对于加强病人护理和改善 WHS 的成果至关重要。建议的解决方案包括:优先考虑无缝数据交换的互操作性;纳入以患者为中心的临床效果比较研究和真实世界数据,以个性化治疗方案和验证综合方法;利用先进的数据分析工具,纳入患者报告的结果、客观指标和强大的数据平台。实施这些措施将使 WHS 履行其使命,成为一个以患者为中心的综合医疗保健模式,促进医疗服务提供者之间的合作,提高患者和医疗服务提供者的福利,并改善患者的治疗效果。
{"title":"Enhancing data practices for Whole Health: Strategies for a transformative future","authors":"Lei Guo,&nbsp;Kavitha P. Reddy,&nbsp;Theresa Van Iseghem,&nbsp;Whitney N. Pierce","doi":"10.1002/lrh2.10426","DOIUrl":"https://doi.org/10.1002/lrh2.10426","url":null,"abstract":"<p>We explored the challenges and solutions for managing data within the Whole Health System (WHS), which operates as a Learning Health System and a patient-centered healthcare approach that combines conventional and complementary approaches. Addressing these challenges is critical for enhancing patient care and improving outcomes within WHS. The proposed solutions include prioritizing interoperability for seamless data exchange, incorporating patient-centered comparative clinical effectiveness research and real-world data to personalize treatment plans and validate integrative approaches, and leveraging advanced data analytics tools to incorporate patient-reported outcomes, objective metrics, robust data platforms. Implementing these measures will enable WHS to fulfill its mission as a holistic and patient-centered healthcare model, promoting greater collaboration among providers, boosting the well-being of patients and providers, and improving patient outcomes.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 S1","pages":""},"PeriodicalIF":3.1,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10426","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141326698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Right Stuff: Getting the right data at the right time and using that data to drive evidence-based practice and policy 正确的东西:在正确的时间获取正确的数据,并利用这些数据推动循证实践和政策
IF 3.1 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-05-27 DOI: 10.1002/lrh2.10432
Lucy A. Savitz, Sarah M. Greene, Michael K. Gould, Harold S. Luft

When researchers are embedded within healthcare systems and collaborate with practitioners and operational leaders, they may be able to rapidly identify problems and opportunities that can be addressed to improve quality and affordability. While other industries have well-developed data exploration processes (e.g., banking), healthcare is still developing its methods with widely varying data sources, huge quantities of unstructured data, uncertain precision in measurement, uncertainties about data quality, and complicated and stringent regulations and policies on data access. In recognition of these challenges, the AcademyHealth Learning Health System (LHS) Interest Group (In 2021, Learning Health Systems journal established a formal relationship with AcademyHealth, serving as the official journal of its LHS Interest Group.) released a call for papers in June 2023 to focus on challenges encountered by investigators related to the use of real-world data in embedded research.

We use the term “embedded researcher” to characterize a broad range of people well-trained in research methods using real-world data. Being located inside a health system, they often have privileged access to data and the practitioners who may be observing new situations, problems, or opportunities for improvement. Unlike colleagues only involved in internal quality improvement efforts, embedded researchers also seek to broadly share their findings and create generalizable knowledge. The sharing is less focused on the specific findings—too many things may be unique about the setting, people, and other factors to be directly generalizable. The challenges faced and techniques used to overcome them, however, may offer important lessons for other embedded researchers.

As LHSs mature and internally tackle increasingly complex problems with embedded research, the challenges presented in using real-world data for locally applied health services research are important to understand. Taken together, the papers in this Special Issue offer insights into the frontiers of embedded research as LHSs embark on their own learning journey. Accelerating the transformation of data to knowledge requires an understanding of the underlying data and techniques needed to draw useful lessons from the data. Sharing experiences across teams and settings will help others in anticipating and addressing the challenges they are likely to encounter.

当研究人员融入医疗保健系统并与从业人员和业务领导者合作时,他们就能迅速发现问题和机遇,从而提高质量和经济效益。其他行业(如银行业)拥有完善的数据探索流程,而医疗保健行业仍在开发其方法,数据来源千差万别,非结构化数据数量巨大,测量精度不确定,数据质量不确定,数据访问法规和政策复杂而严格。鉴于这些挑战,AcademyHealth 学习健康系统(LHS)兴趣小组(2021 年,《学习健康系统》杂志与 AcademyHealth 建立了正式关系,成为其学习健康系统兴趣小组的官方期刊)于 2023 年 6 月发出论文征集令,重点关注研究人员在嵌入式研究中使用真实世界数据时遇到的挑战。由于身处医疗系统内部,他们往往拥有接触数据和从业人员的特权,而从业人员可能会观察到新的情况、问题或改进机会。与只参与内部质量改进工作的同事不同,嵌入式研究人员还寻求广泛分享他们的研究成果,并创造可推广的知识。分享的重点不在于具体的研究结果--环境、人员和其他因素可能有太多独特之处,无法直接推广。随着本地健康服务系统的成熟,以及内部通过嵌入式研究解决日益复杂的问题,我们有必要了解在本地应用健康服务研究中使用真实世界数据所面临的挑战。综上所述,本特刊中的论文为地方保健系统踏上自己的学习之旅提供了对嵌入式研究前沿的见解。要加快将数据转化为知识,就必须了解从数据中汲取有用经验所需的基础数据和技术。在不同团队和环境中分享经验将有助于其他人预测和应对可能遇到的挑战。
{"title":"The Right Stuff: Getting the right data at the right time and using that data to drive evidence-based practice and policy","authors":"Lucy A. Savitz,&nbsp;Sarah M. Greene,&nbsp;Michael K. Gould,&nbsp;Harold S. Luft","doi":"10.1002/lrh2.10432","DOIUrl":"https://doi.org/10.1002/lrh2.10432","url":null,"abstract":"<p>When researchers are embedded within healthcare systems and collaborate with practitioners and operational leaders, they may be able to rapidly identify problems and opportunities that can be addressed to improve quality and affordability. While other industries have well-developed data exploration processes (e.g., banking), healthcare is still developing its methods with widely varying data sources, huge quantities of unstructured data, uncertain precision in measurement, uncertainties about data quality, and complicated and stringent regulations and policies on data access. In recognition of these challenges, the AcademyHealth Learning Health System (LHS) Interest Group (In 2021, <i>Learning Health Systems</i> journal established a formal relationship with AcademyHealth, serving as the official journal of its LHS Interest Group.) released a call for papers in June 2023 to focus on challenges encountered by investigators related to the use of real-world data in embedded research.</p><p>We use the term “embedded researcher” to characterize a broad range of people well-trained in research methods using real-world data. Being located inside a health system, they often have privileged access to data and the practitioners who may be observing new situations, problems, or opportunities for improvement. Unlike colleagues only involved in internal quality improvement efforts, embedded researchers also seek to broadly share their findings and create generalizable knowledge. The sharing is less focused on the specific findings—too many things may be unique about the setting, people, and other factors to be directly generalizable. The challenges faced and techniques used to overcome them, however, may offer important lessons for other embedded researchers.</p><p>As LHSs mature and internally tackle increasingly complex problems with embedded research, the challenges presented in using real-world data for locally applied health services research are important to understand. Taken together, the papers in this Special Issue offer insights into the frontiers of embedded research as LHSs embark on their own learning journey. Accelerating the transformation of data to knowledge requires an understanding of the underlying data and techniques needed to draw useful lessons from the data. Sharing experiences across teams and settings will help others in anticipating and addressing the challenges they are likely to encounter.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 S1","pages":""},"PeriodicalIF":3.1,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10432","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141326796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patient care in complex Sociotechnological ecosystems and learning health systems 复杂社会技术生态系统和学习型医疗系统中的病人护理
IF 3.1 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-05-23 DOI: 10.1002/lrh2.10427
Shin-Ping Tu, Brittany Garcia, Xi Zhu, Daniel Sewell, Vimal Mishra, Khalid Matin, Alan Dow

The learning health system (LHS) model was proposed to provide real-time, bi-directional flow of learning using data captured in health information technology systems to deliver rapid learning in healthcare delivery. As highlighted by the landmark National Academy of Medicine report “Crossing the Quality Chasm,” the U.S. healthcare delivery industry represents complex adaptive systems, and there is an urgent need to develop innovative methods to identify efficient team structures by harnessing real-world care delivery data found in the electronic health record (EHR). We offer a discussion surrounding the complexities of team communication and how solutions may be guided by theories such as the Multiteam System (MTS) framework and the Multitheoretical Multilevel Framework of Communication Networks. To advance healthcare delivery science and promote LHSs, our team has been building a new line of research using EHR data to study MTS in the complex real world of cancer care delivery. We are developing new network metrics to study MTSs and will be analyzing the impact of EHR communication network structures on patient outcomes. As this research leads to patient care delivery interventions/tools, healthcare leaders and healthcare professionals can effectively use health IT data to implement the most evidence-based collaboration approaches in order to achieve the optimal LHS and patient outcomes.

学习型医疗系统(LHS)模式的提出是为了利用医疗信息技术系统获取的数据提供实时、双向的学习流,从而在医疗保健服务中实现快速学习。正如具有里程碑意义的美国国家医学院报告《跨越质量鸿沟》所强调的那样,美国医疗保健服务行业是一个复杂的自适应系统,迫切需要开发创新方法,通过利用电子健康记录(EHR)中的真实医疗服务数据来确定高效的团队结构。我们将围绕团队沟通的复杂性以及如何在多团队系统(MTS)框架和沟通网络多理论多层次框架等理论指导下解决问题展开讨论。为了推动医疗保健服务科学的发展并促进长效医疗系统,我们的团队一直在利用电子病历数据建立一条新的研究路线,以研究在复杂的癌症护理服务现实世界中的多团队系统。我们正在开发研究 MTS 的新网络指标,并将分析电子病历通信网络结构对患者预后的影响。这项研究将为患者护理提供干预措施/工具,医疗保健领导者和医疗保健专业人员可以有效地利用健康 IT 数据,实施最循证的协作方法,以实现最佳的 LHS 和患者疗效。
{"title":"Patient care in complex Sociotechnological ecosystems and learning health systems","authors":"Shin-Ping Tu,&nbsp;Brittany Garcia,&nbsp;Xi Zhu,&nbsp;Daniel Sewell,&nbsp;Vimal Mishra,&nbsp;Khalid Matin,&nbsp;Alan Dow","doi":"10.1002/lrh2.10427","DOIUrl":"10.1002/lrh2.10427","url":null,"abstract":"<p>The learning health system (LHS) model was proposed to provide real-time, bi-directional flow of learning using data captured in health information technology systems to deliver rapid learning in healthcare delivery. As highlighted by the landmark National Academy of Medicine report “Crossing the Quality Chasm,” the U.S. healthcare delivery industry represents complex adaptive systems, and there is an urgent need to develop innovative methods to identify efficient team structures by harnessing real-world care delivery data found in the electronic health record (EHR). We offer a discussion surrounding the complexities of team communication and how solutions may be guided by theories such as the Multiteam System (MTS) framework and the Multitheoretical Multilevel Framework of Communication Networks. To advance healthcare delivery science and promote LHSs, our team has been building a new line of research using EHR data to study MTS in the complex real world of cancer care delivery. We are developing new network metrics to study MTSs and will be analyzing the impact of EHR communication network structures on patient outcomes. As this research leads to patient care delivery interventions/tools, healthcare leaders and healthcare professionals can effectively use health IT data to implement the most evidence-based collaboration approaches in order to achieve the optimal LHS and patient outcomes.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 S1","pages":""},"PeriodicalIF":3.1,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10427","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141103173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Overcoming challenges in real-world evidence generation: An example from an Adult Medical Care Coordination program 克服现实世界中证据生成的挑战:以成人医疗护理协调计划为例
IF 3.1 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-05-22 DOI: 10.1002/lrh2.10430
Samuel T. Savitz, Michelle A. Lampman, Shealeigh A. Inselman, Ruchita Dholakia, Vicki L. Hunt, Angela B. Mattson, Robert J. Stroebel, Pamela J. McCabe, Stephanie G. Witwer, Bijan J. Borah

The Adult Medical Care Coordination program (“the program”) was implemented at Mayo Clinic to promote patient self-management and improve 30-day unplanned readmission for patients with high risk for readmission after hospital discharge. This study aimed to evaluate the impact of the program compared to usual care using a pragmatic, stepped wedge cluster randomized trial (“stepped wedge trial”). However, several challenges arose including large differences between the study arms. Our goal is to describe the challenges and present lessons learned on how to overcome such challenges and generate evidence to support practice decisions. We describe the challenges encountered during the trial, the approach to addressing these challenges, and lessons learned for other learning health system researchers facing similar challenges. The trial experienced several challenges in implementation including several clinics dropping from the study and care disruptions due to COVID-19. Additionally, there were large differences in the patient population between the program and usual care arms. For example, the mean age was 76.8 for the program and 68.1 for usual care. Due to these differences, we adapted the methods using the propensity score matching approach that is traditionally applied to observational designs and adjusted for differences in observable characteristics. When conducting pragmatic research, researchers will encounter factors beyond their control that may introduce bias. The lessons learned include the need to weigh the tradeoffs of pragmatic design elements and the potential value of adaptive designs for pragmatic trials. Applying these lessons would promote the successful generation of evidence that informs practice decisions.

梅奥诊所实施了成人医疗护理协调计划(以下简称 "该计划"),旨在促进患者自我管理,改善出院后再入院高风险患者的 30 天非计划再入院情况。这项研究旨在通过一项务实的阶梯式楔形分组随机试验("阶梯式楔形试验"),评估该计划与常规护理相比所产生的影响。然而,研究中也遇到了一些挑战,包括研究臂之间的巨大差异。我们的目标是描述这些挑战,并就如何克服这些挑战和生成支持实践决策的证据提出经验教训。我们描述了试验过程中遇到的挑战、应对这些挑战的方法,以及为面临类似挑战的其他学习型医疗系统研究人员提供的经验教训。试验在实施过程中遇到了一些挑战,包括一些诊所退出研究以及 COVID-19 导致的护理中断。此外,计划组和常规护理组的患者人群也存在很大差异。例如,该计划的平均年龄为 76.8 岁,而常规护理的平均年龄为 68.1 岁。鉴于这些差异,我们采用了传统上应用于观察性设计的倾向得分匹配方法,并根据可观察特征的差异进行了调整。在进行实用性研究时,研究人员会遇到一些无法控制的因素,这些因素可能会带来偏差。吸取的经验教训包括需要权衡实用性设计要素的利弊,以及适应性设计对实用性试验的潜在价值。应用这些经验教训将有助于成功地生成为实践决策提供依据的证据。
{"title":"Overcoming challenges in real-world evidence generation: An example from an Adult Medical Care Coordination program","authors":"Samuel T. Savitz,&nbsp;Michelle A. Lampman,&nbsp;Shealeigh A. Inselman,&nbsp;Ruchita Dholakia,&nbsp;Vicki L. Hunt,&nbsp;Angela B. Mattson,&nbsp;Robert J. Stroebel,&nbsp;Pamela J. McCabe,&nbsp;Stephanie G. Witwer,&nbsp;Bijan J. Borah","doi":"10.1002/lrh2.10430","DOIUrl":"10.1002/lrh2.10430","url":null,"abstract":"<p>The Adult Medical Care Coordination program (“the program”) was implemented at Mayo Clinic to promote patient self-management and improve 30-day unplanned readmission for patients with high risk for readmission after hospital discharge. This study aimed to evaluate the impact of the program compared to usual care using a pragmatic, stepped wedge cluster randomized trial (“stepped wedge trial”). However, several challenges arose including large differences between the study arms. Our goal is to describe the challenges and present lessons learned on how to overcome such challenges and generate evidence to support practice decisions. We describe the challenges encountered during the trial, the approach to addressing these challenges, and lessons learned for other learning health system researchers facing similar challenges. The trial experienced several challenges in implementation including several clinics dropping from the study and care disruptions due to COVID-19. Additionally, there were large differences in the patient population between the program and usual care arms. For example, the mean age was 76.8 for the program and 68.1 for usual care. Due to these differences, we adapted the methods using the propensity score matching approach that is traditionally applied to observational designs and adjusted for differences in observable characteristics. When conducting pragmatic research, researchers will encounter factors beyond their control that may introduce bias. The lessons learned include the need to weigh the tradeoffs of pragmatic design elements and the potential value of adaptive designs for pragmatic trials. Applying these lessons would promote the successful generation of evidence that informs practice decisions.</p>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 S1","pages":""},"PeriodicalIF":3.1,"publicationDate":"2024-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10430","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141111069","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using incident reports to diagnose communication challenges for precision intervention in learning health systems: A methods paper 利用事件报告诊断传播挑战,在学习型医疗系统中进行精准干预:方法论文
IF 3.1 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-05-09 DOI: 10.1002/lrh2.10425
Rebecca R. S. Clark, Tamar Klaiman, Kathy Sliwinski, Rebecca F. Hamm, Emilia Flores

Introduction

Poor communication is a leading root cause of preventable maternal mortality in the United States. Communication challenges are compounded with the presence of biases, including racism. Hospital administrators and clinicians are often aware that communication is a problem, but understanding where to intervene can be difficult to determine. While clinical leadership routinely reviews incident reports and acts on them to improve care, we hypothesized that reviewing incident reports in a systematic way might reveal thematic patterns, providing targeted opportunities to improve communication in direct interaction with patients and within the healthcare team itself.

Methods

We abstracted incident reports from the Women's Health service and linked them with patient charts to join patient's race/ethnicity, birth outcome, and presence of maternal morbidity and mortality to the incident report. We conducted a qualitative content analysis of incident reports using an inductive and deductive approach to categorizing communication challenges. We then described the intersection of different types of communication challenges with patient race/ethnicity and morbidity outcomes.

Results

The use of incident reports to conduct research on communication was new for the health system. Conversations with health system-level stakeholders were important to determine the best way to manage data. We developed a thematic codebook based on prior research in healthcare communication. We found that we needed to add codes that were equity focused, as this was missing from the existing codebook. We also found that clinical and contextual expertise was necessary for conducting the analysis—requiring more resources to conduct coding than initially estimated. We shared our findings back with leadership iteratively during the work.

Conclusions

Incident reports represent a promising source of health system data for rapid improvement to transform organizational practice around communication. There are barriers to conducting this work in a rapid manner, however, that require further iteration and innovation.

沟通不畅是美国可预防的孕产妇死亡的主要根源。由于存在偏见,包括种族主义,沟通方面的挑战变得更加复杂。医院管理者和临床医生通常都意识到沟通存在问题,但却难以确定应在何处进行干预。我们从妇女健康服务中摘录了事件报告,并将其与患者病历联系起来,将患者的种族/民族、分娩结果、产妇发病率和死亡率与事件报告联系起来。我们对事件报告进行了定性内容分析,采用归纳和演绎的方法对沟通挑战进行分类。然后,我们描述了不同类型的沟通挑战与患者种族/族裔和发病率结果之间的交集。使用事故报告来开展沟通研究对于医疗系统来说是一项全新的尝试。与医疗系统层面的利益相关者进行对话对于确定管理数据的最佳方式非常重要。我们根据之前在医疗沟通方面的研究制定了一个主题编码手册。我们发现,我们需要增加以公平为重点的代码,因为现有的代码手册中缺少这一点。我们还发现,进行分析需要临床和背景方面的专业知识--进行编码所需的资源比最初估计的要多。在工作过程中,我们与领导层反复交流了我们的发现。事件报告是医疗系统数据的一个很有前景的来源,可用于快速改进,以改变组织在沟通方面的做法。然而,快速开展这项工作存在一些障碍,需要进一步的迭代和创新。
{"title":"Using incident reports to diagnose communication challenges for precision intervention in learning health systems: A methods paper","authors":"Rebecca R. S. Clark,&nbsp;Tamar Klaiman,&nbsp;Kathy Sliwinski,&nbsp;Rebecca F. Hamm,&nbsp;Emilia Flores","doi":"10.1002/lrh2.10425","DOIUrl":"10.1002/lrh2.10425","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Poor communication is a leading root cause of preventable maternal mortality in the United States. Communication challenges are compounded with the presence of biases, including racism. Hospital administrators and clinicians are often aware that communication is a problem, but understanding where to intervene can be difficult to determine. While clinical leadership routinely reviews incident reports and acts on them to improve care, we hypothesized that reviewing incident reports in a systematic way might reveal thematic patterns, providing targeted opportunities to improve communication in direct interaction with patients and within the healthcare team itself.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We abstracted incident reports from the Women's Health service and linked them with patient charts to join patient's race/ethnicity, birth outcome, and presence of maternal morbidity and mortality to the incident report. We conducted a qualitative content analysis of incident reports using an inductive and deductive approach to categorizing communication challenges. We then described the intersection of different types of communication challenges with patient race/ethnicity and morbidity outcomes.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>The use of incident reports to conduct research on communication was new for the health system. Conversations with health system-level stakeholders were important to determine the best way to manage data. We developed a thematic codebook based on prior research in healthcare communication. We found that we needed to add codes that were equity focused, as this was missing from the existing codebook. We also found that clinical and contextual expertise was necessary for conducting the analysis—requiring more resources to conduct coding than initially estimated. We shared our findings back with leadership iteratively during the work.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Incident reports represent a promising source of health system data for rapid improvement to transform organizational practice around communication. There are barriers to conducting this work in a rapid manner, however, that require further iteration and innovation.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 S1","pages":""},"PeriodicalIF":3.1,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10425","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140997446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Building to learn: Information technology innovations to enable rapid pragmatic evaluation in a learning health system 建设学习:在学习型卫生系统中实现快速务实评估的信息技术创新
IF 2.6 Q2 HEALTH POLICY & SERVICES Pub Date : 2024-04-16 DOI: 10.1002/lrh2.10420
Geetanjali Rajamani, Genevieve B. Melton, Deborah L. Pestka, Maya Peters, Iva Ninkovic, Elizabeth Lindemann, Timothy J. Beebe, Nathan Shippee, Bradley Benson, Abraham Jacob, Christopher Tignanelli, Nicholas E. Ingraham, Joseph S. Koopmeiners, Michael G. Usher

Background

Learning health systems (LHSs) iteratively generate evidence that can be implemented into practice to improve care and produce generalizable knowledge. Pragmatic clinical trials fit well within LHSs as they combine real-world data and experiences with a degree of methodological rigor which supports generalizability.

Objectives

We established a pragmatic clinical trial unit (“RapidEval”) to support the development of an LHS. To further advance the field of LHS, we sought to further characterize the role of health information technology (HIT), including innovative solutions and challenges that occur, to improve LHS project delivery.

Methods

During the period from December 2021 to February 2023, eight projects were selected out of 51 applications to the RapidEval program, of which five were implemented, one is currently in pilot testing, and two are in planning. We evaluated pre-study planning, implementation, analysis, and study closure approaches across all RapidEval initiatives to summarize approaches across studies and identify key innovations and learnings by gathering data from study investigators, quality staff, and IT staff, as well as RapidEval staff and leadership.

Implementation (Results)

Implementation approaches spanned a range of HIT capabilities including interruptive alerts, clinical decision support integrated into order systems, patient navigators, embedded micro-education, targeted outpatient hand-off documentation, and patient communication. Study approaches include pre-post with time-concordant controls (1), randomized stepped-wedge (1), cluster randomized across providers (1) and location (3), and simple patient level randomization (2).

Conclusions

Study selection, design, deployment, data collection, and analysis required close collaboration between data analysts, informaticists, and the RapidEval team.

学习型医疗系统(LHSs)可以反复生成可用于实践的证据,从而改善医疗服务并产生可推广的知识。实用临床试验非常适合 LHS,因为它们将真实世界的数据和经验与一定程度的方法论严谨性相结合,从而支持可推广性。为了进一步推动 LHS 领域的发展,我们试图进一步确定医疗信息技术 (HIT) 的作用,包括创新解决方案和出现的挑战,以改善 LHS 项目的交付。在 2021 年 12 月至 2023 年 2 月期间,我们从 51 份 RapidEval 计划申请中选出了 8 个项目,其中 5 个已经实施,1 个目前正在进行试点测试,2 个正在规划中。我们对所有 RapidEval 计划的研究前规划、实施、分析和研究结束方法进行了评估,通过收集研究调查人员、质量人员、IT 人员以及 RapidEval 工作人员和领导层的数据,总结了各项研究的方法,并确定了关键的创新和经验。实施方法涵盖一系列 HIT 功能,包括中断警报、集成到订单系统中的临床决策支持、患者导航、嵌入式微观教育、有针对性的门诊病人交接文档和患者沟通。研究方法包括预后与时间一致对照(1)、随机阶梯式对冲(1)、跨提供者(1)和地点(3)的群组随机化,以及简单的患者水平随机化(2)。研究的选择、设计、部署、数据收集和分析需要数据分析师、信息学家和 RapidEval 团队之间的密切合作。
{"title":"Building to learn: Information technology innovations to enable rapid pragmatic evaluation in a learning health system","authors":"Geetanjali Rajamani,&nbsp;Genevieve B. Melton,&nbsp;Deborah L. Pestka,&nbsp;Maya Peters,&nbsp;Iva Ninkovic,&nbsp;Elizabeth Lindemann,&nbsp;Timothy J. Beebe,&nbsp;Nathan Shippee,&nbsp;Bradley Benson,&nbsp;Abraham Jacob,&nbsp;Christopher Tignanelli,&nbsp;Nicholas E. Ingraham,&nbsp;Joseph S. Koopmeiners,&nbsp;Michael G. Usher","doi":"10.1002/lrh2.10420","DOIUrl":"10.1002/lrh2.10420","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Learning health systems (LHSs) iteratively generate evidence that can be implemented into practice to improve care and produce generalizable knowledge. Pragmatic clinical trials fit well within LHSs as they combine real-world data and experiences with a degree of methodological rigor which supports generalizability.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>We established a pragmatic clinical trial unit (“RapidEval”) to support the development of an LHS. To further advance the field of LHS, we sought to further characterize the role of health information technology (HIT), including innovative solutions and challenges that occur, to improve LHS project delivery.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>During the period from December 2021 to February 2023, eight projects were selected out of 51 applications to the RapidEval program, of which five were implemented, one is currently in pilot testing, and two are in planning. We evaluated pre-study planning, implementation, analysis, and study closure approaches across all RapidEval initiatives to summarize approaches across studies and identify key innovations and learnings by gathering data from study investigators, quality staff, and IT staff, as well as RapidEval staff and leadership.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Implementation (Results)</h3>\u0000 \u0000 <p>Implementation approaches spanned a range of HIT capabilities including interruptive alerts, clinical decision support integrated into order systems, patient navigators, embedded micro-education, targeted outpatient hand-off documentation, and patient communication. Study approaches include pre-post with time-concordant controls (1), randomized stepped-wedge (1), cluster randomized across providers (1) and location (3), and simple patient level randomization (2).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Study selection, design, deployment, data collection, and analysis required close collaboration between data analysts, informaticists, and the RapidEval team.</p>\u0000 </section>\u0000 </div>","PeriodicalId":43916,"journal":{"name":"Learning Health Systems","volume":"8 3","pages":""},"PeriodicalIF":2.6,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/lrh2.10420","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140697315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Learning Health Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1