首页 > 最新文献

EGEMS (Washington, DC)最新文献

英文 中文
The Healthcare Systems Research Network (HCSRN) as an Environment for Dissemination and Implementation Research: A Case Study of Developing a Multi-Site Research Study in Precision Medicine. 医疗保健系统研究网络(HCSRN)作为传播和实施研究的环境:开展精准医学多站点研究的案例研究》。
Pub Date : 2019-04-12 DOI: 10.5334/egems.283
Alanna Kulchak Rahm, Ilene Ladd, Andrea N Burnett-Hartman, Mara M Epstein, Jan T Lowery, Christine Y Lu, Pamala A Pawloski, Ravi N Sharaf, Su-Ying Liang, Jessica Ezzell Hunter

Context: In existence for nearly 25 years, the Healthcare Systems Research Network (HCSRN) is an established and sustainable network of health care systems that serves as a "real world" laboratory to enable the integration of research findings into practice. The objective of this paper is to demonstrate how the HCSRN serves as an ideal environment for studying dissemination and implementation of evidence-based practices into health care systems through the example of developing a multi-site study on the implementation of evidence-based precision medicine practices.

Case description: The "Implementing Universal Lynch Syndrome Screening (IMPULSS)" study (NIH R01CA211723) involves seven HCSRN health care systems and two external health care systems. The IMPULSS study will describe and explain organizational variability around Lynch syndrome (LS) screening to identify which factors in different organizational contexts are important for successful implementation of LS screening programs and will create a toolkit to facilitate organizational decision making around implementation and improvement of precision medicine programs in health care systems.

Major themes: The strengths of the HCSRN that facilitate D&I research include: 1) a culture of collaboration, 2) standardization of data and processes across systems, and 3) researchers embedded in diverse health care systems. We describe how these strengths contributed to developing the IMPULSS study.

Conclusion: Given the importance of conducting research in real world settings to improve patient outcomes, the unique strengths of the HCSRN are of vital importance. The IMPULSS study is one case example of how the strengths of the HCSRN make it an excellent environment for research on implementing evidence-based precision medicine practices in health care systems.

背景:医疗保健系统研究网络(HCSRN)已成立近 25 年,是一个成熟且可持续发展的医疗保健系统网络,可作为 "真实世界 "的实验室,将研究成果融入实践。本文旨在通过开展一项关于循证精准医学实践实施的多站点研究,说明 HCSRN 如何成为研究循证实践在医疗保健系统中传播和实施的理想环境:实施普遍林奇综合征筛查(IMPULSS)"研究(美国国立卫生研究院 R01CA211723)涉及七个 HCSRN 医疗保健系统和两个外部医疗保健系统。IMPULSS 研究将描述并解释围绕林奇综合征(LS)筛查的组织变异性,以确定不同组织背景下哪些因素对成功实施林奇综合征筛查计划非常重要,并将创建一个工具包,以促进医疗保健系统中围绕实施和改进精准医学计划的组织决策:HCSRN 促进 D&I 研究的优势包括1) 协作文化;2) 跨系统的数据和流程标准化;3) 研究人员融入不同的医疗保健系统。我们将介绍这些优势如何促进了 IMPULSS 研究的发展:鉴于在现实环境中开展研究以改善患者预后的重要性,HCSRN 的独特优势至关重要。IMPULSS 研究就是一个实例,说明了 HCSRN 的优势如何使其成为在医疗保健系统中实施循证精准医学实践研究的绝佳环境。
{"title":"The Healthcare Systems Research Network (HCSRN) as an Environment for Dissemination and Implementation Research: A Case Study of Developing a Multi-Site Research Study in Precision Medicine.","authors":"Alanna Kulchak Rahm, Ilene Ladd, Andrea N Burnett-Hartman, Mara M Epstein, Jan T Lowery, Christine Y Lu, Pamala A Pawloski, Ravi N Sharaf, Su-Ying Liang, Jessica Ezzell Hunter","doi":"10.5334/egems.283","DOIUrl":"10.5334/egems.283","url":null,"abstract":"<p><strong>Context: </strong>In existence for nearly 25 years, the Healthcare Systems Research Network (HCSRN) is an established and sustainable network of health care systems that serves as a \"real world\" laboratory to enable the integration of research findings into practice. The objective of this paper is to demonstrate how the HCSRN serves as an ideal environment for studying dissemination and implementation of evidence-based practices into health care systems through the example of developing a multi-site study on the implementation of evidence-based precision medicine practices.</p><p><strong>Case description: </strong>The \"Implementing Universal Lynch Syndrome Screening (IMPULSS)\" study (NIH R01CA211723) involves seven HCSRN health care systems and two external health care systems. The IMPULSS study will describe and explain organizational variability around Lynch syndrome (LS) screening to identify which factors in different organizational contexts are important for successful implementation of LS screening programs and will create a toolkit to facilitate organizational decision making around implementation and improvement of precision medicine programs in health care systems.</p><p><strong>Major themes: </strong>The strengths of the HCSRN that facilitate D&I research include: 1) a culture of collaboration, 2) standardization of data and processes across systems, and 3) researchers embedded in diverse health care systems. We describe how these strengths contributed to developing the IMPULSS study.</p><p><strong>Conclusion: </strong>Given the importance of conducting research in real world settings to improve patient outcomes, the unique strengths of the HCSRN are of vital importance. The IMPULSS study is one case example of how the strengths of the HCSRN make it an excellent environment for research on implementing evidence-based precision medicine practices in health care systems.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"16"},"PeriodicalIF":0.0,"publicationDate":"2019-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6460496/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37151221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Priorities Wizard: Multisite Web-Based Primary Care Clinical Decision Support Improved Chronic Care Outcomes with High Use Rates and High Clinician Satisfaction Rates. 优先级向导:基于Web的多站点初级保健临床决策支持以高使用率和高临床医生满意度改善慢性护理结果。
Pub Date : 2019-04-03 DOI: 10.5334/egems.284
JoAnn M Sperl-Hillen, Rebecca C Rossom, Elyse O Kharbanda, Rachel Gold, Erik D Geissal, Thomas E Elliott, Jay R Desai, D Brad Rindal, Daniel M Saman, Stephen C Waring, Karen L Margolis, Patrick J O'Connor

Introduction: Priorities Wizard is an electronic health record-linked, web-based clinical decision support (CDS) system designed and implemented at multiple Health Care Systems Research Network (HCSRN) sites to support high quality outpatient chronic disease and preventive care. The CDS system (a) identifies patients who could substantially benefit from evidence-based actions; (b) presents prioritized evidence-based treatment options to both patient and clinician at the point of care; and (c) facilitates efficient ordering of recommended medications, referrals or procedures.

Methods: The CDS system extracts relevant data from electronic health records (EHRs), processes the data using Web-based clinical decision support algorithms, and displays the CDS output seamlessly on the EHR screen for use by the clinician and patient. Through a series of National Institutes of Health-funded projects led by HealthPartners Institute and the HealthPartners Center for Chronic Care Innovation and HCSRN partners, Priorities Wizard has been evaluated in cluster-randomized trials and expanded to include over 20 clinical domains.

Results: Cluster-randomized trials show that this CDS system significantly improved glucose and blood pressure control in diabetes patients, reduced 10-year cardiovascular (CV) risk in high-CV risk adults without diabetes, improved management of smoking in dental patients, and improved high blood pressure identification and management in adolescents. CDS output was used at 71-77 percent of targeted visits, 85-98 percent of clinicians were satisfied with the CDS system, and 94 percent reported they would recommend it to colleagues.

Conclusions: Recently developed EHR-linked, Web-based CDS systems have significantly improved chronic disease care outcomes and have high use rates and primary care clinician satisfaction.

简介:优先级向导是一个电子健康记录链接、基于网络的临床决策支持(CDS)系统,在多个医疗保健系统研究网络(HCSRN)站点设计和实施,以支持高质量的门诊慢性病和预防性护理。CDS系统(a)确定可以从循证行动中受益的患者;(b) 在护理点向患者和临床医生提供优先的循证治疗选择;以及(c)促进推荐药物、转诊或程序的有效订购。方法:CDS系统从电子健康记录(EHR)中提取相关数据,使用基于Web的临床决策支持算法处理数据,并在EHR屏幕上无缝显示CDS输出,供临床医生和患者使用。通过由HealthPartners Institute、HealthPartners慢性病护理创新中心和HCSRN合作伙伴领导的一系列美国国立卫生研究院资助的项目,Priorities Wizard已在集群随机试验中进行了评估,并扩展到包括20多个临床领域。结果:集群随机试验表明,该CDS系统显著改善了糖尿病患者的血糖和血压控制,降低了无糖尿病的高心血管风险成年人的10年心血管(CV)风险,改善了牙科患者的吸烟管理,并改善了青少年的高血压识别和管理。在71-77%的靶向就诊中使用了CDS输出,85-98%的临床医生对CDS系统感到满意,94%的临床医生表示他们会向同事推荐。结论:最近开发的与EHR相关的、基于Web的CDS系统显著改善了慢性病护理的结果,并且具有较高的使用率和初级保健临床医生的满意度。
{"title":"Priorities Wizard: Multisite Web-Based Primary Care Clinical Decision Support Improved Chronic Care Outcomes with High Use Rates and High Clinician Satisfaction Rates.","authors":"JoAnn M Sperl-Hillen, Rebecca C Rossom, Elyse O Kharbanda, Rachel Gold, Erik D Geissal, Thomas E Elliott, Jay R Desai, D Brad Rindal, Daniel M Saman, Stephen C Waring, Karen L Margolis, Patrick J O'Connor","doi":"10.5334/egems.284","DOIUrl":"10.5334/egems.284","url":null,"abstract":"<p><strong>Introduction: </strong>Priorities Wizard is an electronic health record-linked, web-based clinical decision support (CDS) system designed and implemented at multiple Health Care Systems Research Network (HCSRN) sites to support high quality outpatient chronic disease and preventive care. The CDS system (a) identifies patients who could substantially benefit from evidence-based actions; (b) presents prioritized evidence-based treatment options to both patient and clinician at the point of care; and (c) facilitates efficient ordering of recommended medications, referrals or procedures.</p><p><strong>Methods: </strong>The CDS system extracts relevant data from electronic health records (EHRs), processes the data using Web-based clinical decision support algorithms, and displays the CDS output seamlessly on the EHR screen for use by the clinician and patient. Through a series of National Institutes of Health-funded projects led by HealthPartners Institute and the HealthPartners Center for Chronic Care Innovation and HCSRN partners, Priorities Wizard has been evaluated in cluster-randomized trials and expanded to include over 20 clinical domains.</p><p><strong>Results: </strong>Cluster-randomized trials show that this CDS system significantly improved glucose and blood pressure control in diabetes patients, reduced 10-year cardiovascular (CV) risk in high-CV risk adults without diabetes, improved management of smoking in dental patients, and improved high blood pressure identification and management in adolescents. CDS output was used at 71-77 percent of targeted visits, 85-98 percent of clinicians were satisfied with the CDS system, and 94 percent reported they would recommend it to colleagues.</p><p><strong>Conclusions: </strong>Recently developed EHR-linked, Web-based CDS systems have significantly improved chronic disease care outcomes and have high use rates and primary care clinician satisfaction.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"9"},"PeriodicalIF":0.0,"publicationDate":"2019-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450247/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37143345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Promise of Pragmatic Clinical Trials Embedded in Learning Health Systems. 在学习健康系统中嵌入实用临床试验的前景。
Pub Date : 2019-04-03 DOI: 10.5334/egems.285
Leah Tuzzio, Eric B Larson

This commentary describes the need for a different context to clinical research that could speed the discovery and implementation of evidence-based advancements to health care delivery. Pragmatic clinical trials (PCTs) are a promising type of trial conducted within real-world health care delivery systems like organizations within the Health Care Systems Research Network, that embrace research as part of their culture of continuous learning and improvement. In these learning health systems (LHSs) clinical practice influences research and vice versa. A goal of LHSs is to operationalize evidence generated by research, particularly PCTs, into improvements that are sustained after a trial ends. PCTs that demonstrate value to health systems and foster implementation could reduce delays in translating research into practice.

这篇评论描述了临床研究需要一个不同的背景,以加快发现和实施循证医疗保健进展。实用临床试验(PCT)是在现实世界的医疗保健提供系统中进行的一种很有前途的试验,如医疗保健系统研究网络中的组织,这些组织将研究作为其持续学习和改进文化的一部分。在这些学习健康系统中,临床实践影响研究,反之亦然。LHS的一个目标是将研究产生的证据,特别是PCT,转化为试验结束后持续的改进。证明对卫生系统有价值并促进实施的PCT可以减少将研究转化为实践的延误。
{"title":"The Promise of Pragmatic Clinical Trials Embedded in Learning Health Systems.","authors":"Leah Tuzzio, Eric B Larson","doi":"10.5334/egems.285","DOIUrl":"10.5334/egems.285","url":null,"abstract":"<p><p>This commentary describes the need for a different context to clinical research that could speed the discovery and implementation of evidence-based advancements to health care delivery. Pragmatic clinical trials (PCTs) are a promising type of trial conducted within real-world health care delivery systems like organizations within the Health Care Systems Research Network, that embrace research as part of their culture of continuous learning and improvement. In these learning health systems (LHSs) clinical practice influences research and vice versa. A goal of LHSs is to operationalize evidence generated by research, particularly PCTs, into improvements that are sustained after a trial ends. PCTs that demonstrate value to health systems and foster implementation could reduce delays in translating research into practice.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"10"},"PeriodicalIF":0.0,"publicationDate":"2019-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450240/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37143346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing and Minimizing Re-identification Risk in Research Data Derived from Health Care Records. 评估和最小化来自医疗记录的研究数据的再识别风险。
Pub Date : 2019-03-29 DOI: 10.5334/egems.270
Gregory E Simon, Susan M Shortreed, R Yates Coley, Robert B Penfold, Rebecca C Rossom, Beth E Waitzfelder, Katherine Sanchez, Frances L Lynch

Background: Sharing of research data derived from health system records supports the rigor and reproducibility of primary research and can accelerate research progress through secondary use. But public sharing of such data can create risk of re-identifying individuals, exposing sensitive health information.

Method: We describe a framework for assessing re-identification risk that includes: identifying data elements in a research dataset that overlap with external data sources, identifying small classes of records defined by unique combinations of those data elements, and considering the pattern of population overlap between the research dataset and an external source. We also describe alternative strategies for mitigating risk when the external data source can or cannot be directly examined.

Results: We illustrate this framework using the example of a large database used to develop and validate models predicting suicidal behavior after an outpatient visit. We identify elements in the research dataset that might create risk and propose a specific risk mitigation strategy: deleting indicators for health system (a proxy for state of residence) and visit year.

Discussion: Researchers holding health system data must balance the public health value of data sharing against the duty to protect the privacy of health system members. Specific steps can provide a useful estimate of re-identification risk and point to effective risk mitigation strategies.

背景:共享来自卫生系统记录的研究数据支持了初级研究的严谨性和可重复性,并可通过二次使用加速研究进展。但是,公开分享这些数据可能会产生重新识别个人身份的风险,暴露敏感的健康信息。方法:我们描述了一个评估再识别风险的框架,该框架包括:识别研究数据集中与外部数据源重叠的数据元素,识别由这些数据元素的独特组合定义的小类记录,并考虑研究数据集与外部数据源之间的总体重叠模式。我们还描述了当可以或不能直接检查外部数据源时降低风险的替代策略。结果:我们使用一个大型数据库的例子来说明这个框架,该数据库用于开发和验证预测门诊就诊后自杀行为的模型。我们确定了研究数据集中可能产生风险的元素,并提出了具体的风险缓解策略:删除卫生系统(居住州的代理)和访问年份的指标。讨论:持有卫生系统数据的研究人员必须在数据共享的公共卫生价值与保护卫生系统成员隐私的责任之间取得平衡。具体步骤可以提供对重新识别风险的有用估计,并指出有效的风险缓解战略。
{"title":"Assessing and Minimizing Re-identification Risk in Research Data Derived from Health Care Records.","authors":"Gregory E Simon,&nbsp;Susan M Shortreed,&nbsp;R Yates Coley,&nbsp;Robert B Penfold,&nbsp;Rebecca C Rossom,&nbsp;Beth E Waitzfelder,&nbsp;Katherine Sanchez,&nbsp;Frances L Lynch","doi":"10.5334/egems.270","DOIUrl":"https://doi.org/10.5334/egems.270","url":null,"abstract":"<p><strong>Background: </strong>Sharing of research data derived from health system records supports the rigor and reproducibility of primary research and can accelerate research progress through secondary use. But public sharing of such data can create risk of re-identifying individuals, exposing sensitive health information.</p><p><strong>Method: </strong>We describe a framework for assessing re-identification risk that includes: identifying data elements in a research dataset that overlap with external data sources, identifying small classes of records defined by unique combinations of those data elements, and considering the pattern of population overlap between the research dataset and an external source. We also describe alternative strategies for mitigating risk when the external data source can or cannot be directly examined.</p><p><strong>Results: </strong>We illustrate this framework using the example of a large database used to develop and validate models predicting suicidal behavior after an outpatient visit. We identify elements in the research dataset that might create risk and propose a specific risk mitigation strategy: deleting indicators for health system (a proxy for state of residence) and visit year.</p><p><strong>Discussion: </strong>Researchers holding health system data must balance the public health value of data sharing against the duty to protect the privacy of health system members. Specific steps can provide a useful estimate of re-identification risk and point to effective risk mitigation strategies.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"6"},"PeriodicalIF":0.0,"publicationDate":"2019-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450246/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37317725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Identification of Incident Uterine Fibroids Using Electronic Medical Record Data. 使用电子病历数据识别意外子宫肌瘤。
Pub Date : 2019-03-29 DOI: 10.5334/egems.264
Onchee Yu, Susan D Reed, Renate Schulze-Rath, Jane Grafton, Kelly Hansen, Delia Scholes

Introduction: Uterine fibroids are the most common benign tumors of the uterus and are associated with considerable morbidity. Diagnosis codes have been used to identify fibroid cases, but their accuracy, especially for incident cases, is uncertain.

Methods: We performed medical record review on a random sample of 617 women who received a fibroid diagnosis during 2012-2014 to assess diagnostic accuracy for incident fibroids. We developed 2 algorithms aimed at improving incident case-finding using classification and regression tree analysis that incorporated additional electronic health care data on demographics, symptoms, treatment, imaging, health care utilization, comorbidities and medication. Algorithm performance was assessed using medical record as gold standard.

Results: Medical record review confirmed 482 fibroid cases as incident, resulting a 78 percent positive predictive value (PPV) for incident cases based on diagnosis codes alone. Incorporating additional electronic data, the first algorithm classified 395 women with a pelvic ultrasound on diagnosis date but none before as incident cases. Of these, 344 were correctly classified, yielding an 87 percent PPV, 71 percent sensitivity, and 62 percent specificity. A second algorithm built on the first algorithm and further classified women based on a fibroid diagnosis code of 218.9 in 2 years after incident diagnosis and lower body mass index; yielded 93 percent PPV, 53 percent sensitivity, and 85 percent specificity.

Conclusions: Compared to diagnosis codes alone, our algorithms using fibroid diagnosis codes and additional electronic data improved identification of incident cases with higher PPV, and high sensitivity or specificity to meet different aims of future studies seeking to identify incident fibroids from electronic data.

子宫肌瘤是子宫最常见的良性肿瘤,发病率高。诊断代码已被用于识别肌瘤病例,但其准确性,特别是对偶发病例,是不确定的。方法:我们对2012-2014年期间接受肌瘤诊断的617名女性随机样本进行医疗记录回顾,以评估偶发肌瘤的诊断准确性。我们开发了两种算法,旨在通过分类和回归树分析来改善事件病例发现,这些分析结合了额外的电子医疗保健数据,包括人口统计、症状、治疗、成像、医疗保健利用、合并症和药物。以病历为金标准评估算法性能。结果:病历回顾确认482例肌瘤为偶发病例,仅基于诊断代码的偶发病例阳性预测值(PPV)为78%。结合额外的电子数据,第一种算法将395名在诊断日期进行盆腔超声检查但之前没有进行过的女性分类为意外病例。其中,344例被正确分类,产生87%的PPV, 71%的敏感性和62%的特异性。第二种算法建立在第一种算法的基础上,根据事故诊断后2年内子宫肌瘤诊断代码218.9和较低的身体质量指数对女性进行进一步分类;产生了93%的PPV, 53%的敏感性和85%的特异性。结论:与单独诊断代码相比,我们使用肌瘤诊断代码和附加电子数据的算法提高了对PPV较高的事件病例的识别,并且具有高灵敏度或特异性,以满足未来研究寻求从电子数据中识别事件肌瘤的不同目的。
{"title":"Identification of Incident Uterine Fibroids Using Electronic Medical Record Data.","authors":"Onchee Yu,&nbsp;Susan D Reed,&nbsp;Renate Schulze-Rath,&nbsp;Jane Grafton,&nbsp;Kelly Hansen,&nbsp;Delia Scholes","doi":"10.5334/egems.264","DOIUrl":"https://doi.org/10.5334/egems.264","url":null,"abstract":"<p><strong>Introduction: </strong>Uterine fibroids are the most common benign tumors of the uterus and are associated with considerable morbidity. Diagnosis codes have been used to identify fibroid cases, but their accuracy, especially for incident cases, is uncertain.</p><p><strong>Methods: </strong>We performed medical record review on a random sample of 617 women who received a fibroid diagnosis during 2012-2014 to assess diagnostic accuracy for incident fibroids. We developed 2 algorithms aimed at improving incident case-finding using classification and regression tree analysis that incorporated additional electronic health care data on demographics, symptoms, treatment, imaging, health care utilization, comorbidities and medication. Algorithm performance was assessed using medical record as gold standard.</p><p><strong>Results: </strong>Medical record review confirmed 482 fibroid cases as incident, resulting a 78 percent positive predictive value (PPV) for incident cases based on diagnosis codes alone. Incorporating additional electronic data, the first algorithm classified 395 women with a pelvic ultrasound on diagnosis date but none before as incident cases. Of these, 344 were correctly classified, yielding an 87 percent PPV, 71 percent sensitivity, and 62 percent specificity. A second algorithm built on the first algorithm and further classified women based on a fibroid diagnosis code of 218.9 in 2 years after incident diagnosis and lower body mass index; yielded 93 percent PPV, 53 percent sensitivity, and 85 percent specificity.</p><p><strong>Conclusions: </strong>Compared to diagnosis codes alone, our algorithms using fibroid diagnosis codes and additional electronic data improved identification of incident cases with higher PPV, and high sensitivity or specificity to meet different aims of future studies seeking to identify incident fibroids from electronic data.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"5"},"PeriodicalIF":0.0,"publicationDate":"2019-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450248/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37317724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collaborating on Data, Science, and Infrastructure: The 20-Year Journey of the Cancer Research Network. 数据、科学和基础设施合作:癌症研究网络的20年历程。
Pub Date : 2019-03-29 DOI: 10.5334/egems.273
V Paul Doria-Rose, Robert T Greenlee, Diana S M Buist, Diana L Miglioretti, Douglas A Corley, Jeffrey S Brown, Heather A Clancy, Leah Tuzzio, Lisa M Moy, Mark C Hornbrook, Martin L Brown, Debra P Ritzwoller, Lawrence H Kushi, Sarah M Greene

The Cancer Research Network (CRN) is a consortium of 12 research groups, each affiliated with a nonprofit integrated health care delivery system, that was first funded in 1998. The overall goal of the CRN is to support and facilitate collaborative cancer research within its component delivery systems. This paper describes the CRN's 20-year experience and evolution. The network combined its members' scientific capabilities and data resources to create an infrastructure that has ultimately supported over 275 projects. Insights about the strengths and limitations of electronic health data for research, approaches to optimizing multidisciplinary collaboration, and the role of a health services research infrastructure to complement traditional clinical trials and large observational datasets are described, along with recommendations for other research consortia.

癌症研究网络(CRN)是一个由12个研究小组组成的联盟,每个小组都隶属于一个非营利的综合医疗保健提供系统,该系统于1998年首次获得资助。CRN的总体目标是支持和促进其成分递送系统内的癌症合作研究。本文介绍了CRN 20年的发展历程。该网络将其成员的科学能力和数据资源相结合,创建了一个基础设施,最终支持了275多个项目。介绍了关于研究用电子健康数据的优势和局限性的见解、优化多学科合作的方法,以及卫生服务研究基础设施在补充传统临床试验和大型观测数据集方面的作用,以及对其他研究联盟的建议。
{"title":"Collaborating on Data, Science, and Infrastructure: The 20-Year Journey of the Cancer Research Network.","authors":"V Paul Doria-Rose, Robert T Greenlee, Diana S M Buist, Diana L Miglioretti, Douglas A Corley, Jeffrey S Brown, Heather A Clancy, Leah Tuzzio, Lisa M Moy, Mark C Hornbrook, Martin L Brown, Debra P Ritzwoller, Lawrence H Kushi, Sarah M Greene","doi":"10.5334/egems.273","DOIUrl":"10.5334/egems.273","url":null,"abstract":"<p><p>The Cancer Research Network (CRN) is a consortium of 12 research groups, each affiliated with a nonprofit integrated health care delivery system, that was first funded in 1998. The overall goal of the CRN is to support and facilitate collaborative cancer research within its component delivery systems. This paper describes the CRN's 20-year experience and evolution. The network combined its members' scientific capabilities and data resources to create an infrastructure that has ultimately supported over 275 projects. Insights about the strengths and limitations of electronic health data for research, approaches to optimizing multidisciplinary collaboration, and the role of a health services research infrastructure to complement traditional clinical trials and large observational datasets are described, along with recommendations for other research consortia.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"7"},"PeriodicalIF":0.0,"publicationDate":"2019-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450242/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37317726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data Quality Assessment and Multi-Organizational Reporting: Tools to Enhance Network Knowledge. 数据质量评估和多组织报告:增强网络知识的工具。
Pub Date : 2019-03-29 DOI: 10.5334/egems.280
Sanchita Sengupta, Don Bachman, Reesa Laws, Gwyn Saylor, Jenny Staab, Daniel Vaughn, Qing Zhou, Alan Bauck

Objective: Multi-organizational research requires a multi-organizational data quality assessment (DQA) process that combines and compares data across participating organizations. We demonstrate how such a DQA approach complements traditional checks of internal reliability and validity by allowing for assessments of data consistency and the evaluation of data patterns in the absence of an external "gold standard."

Methods: We describe the DQA process employed by the Data Coordinating Center (DCC) for Kaiser Permanente's (KP) Center for Effectiveness and Safety Research (CESR). We emphasize the CESR DQA reporting system that compares data summaries from the eight KP organizations in a consistent, standardized manner.

Results: We provide examples of multi-organization comparisons from DQA to confirm expectations about different aspects of data quality. These include: 1) comparison of direct data extraction from the electronic health records (EHR) and 2) comparison of non-EHR data from disparate sources.

Discussion: The CESR DCC has developed codes and procedures for efficiently implementing and reporting DQA. The CESR DCC approach is to 1) distribute DQA tools to empower data managers at each organization to assess their data quality at any time, 2) summarize and disseminate findings to address data shortfalls or document idiosyncrasies, and 3) engage data managers and end-users in an exchange of knowledge about the quality and its fitness for use.

Conclusion: The KP CESR DQA model is applicable to networks hoping to improve data quality. The multi-organizational reporting system promotes transparency of DQA, adds to network knowledge about data quality, and informs research.

目的:多组织研究需要一个多组织数据质量评估(DQA)过程,该过程结合并比较参与组织的数据。我们演示了这种DQA方法如何通过允许在没有外部“金标准”的情况下评估数据一致性和评估数据模式来补充传统的内部可靠性和有效性检查。方法:我们描述了数据协调中心(DCC)为Kaiser Permanente (KP)有效性和安全性研究中心(CESR)所采用的DQA过程。我们强调CESR DQA报告系统,该系统以一致、标准化的方式比较八个KP组织的数据摘要。结果:我们提供了来自DQA的多组织比较的例子,以确认对数据质量不同方面的期望。其中包括:1)比较从电子健康记录(EHR)中直接提取的数据;2)比较来自不同来源的非电子健康记录数据。讨论:CESR DCC已经开发了有效实施和报告DQA的代码和程序。CESR DCC方法是:1)分发DQA工具,授权每个组织的数据管理人员随时评估其数据质量;2)总结和传播发现,以解决数据不足或文档特性;3)让数据管理人员和最终用户交流关于质量及其适用性的知识。结论:KP CESR DQA模型适用于希望提高数据质量的网络。多组织报告系统提高了DQA的透明度,增加了关于数据质量的网络知识,并为研究提供了信息。
{"title":"Data Quality Assessment and Multi-Organizational Reporting: Tools to Enhance Network Knowledge.","authors":"Sanchita Sengupta,&nbsp;Don Bachman,&nbsp;Reesa Laws,&nbsp;Gwyn Saylor,&nbsp;Jenny Staab,&nbsp;Daniel Vaughn,&nbsp;Qing Zhou,&nbsp;Alan Bauck","doi":"10.5334/egems.280","DOIUrl":"https://doi.org/10.5334/egems.280","url":null,"abstract":"<p><strong>Objective: </strong>Multi-organizational research requires a multi-organizational data quality assessment (DQA) process that combines and compares data across participating organizations. We demonstrate how such a DQA approach complements traditional checks of internal reliability and validity by allowing for assessments of data consistency and the evaluation of data patterns in the absence of an external \"gold standard.\"</p><p><strong>Methods: </strong>We describe the DQA process employed by the Data Coordinating Center (DCC) for Kaiser Permanente's (KP) Center for Effectiveness and Safety Research (CESR). We emphasize the CESR DQA reporting system that compares data summaries from the eight KP organizations in a consistent, standardized manner.</p><p><strong>Results: </strong>We provide examples of multi-organization comparisons from DQA to confirm expectations about different aspects of data quality. These include: 1) comparison of direct data extraction from the electronic health records (EHR) and 2) comparison of non-EHR data from disparate sources.</p><p><strong>Discussion: </strong>The CESR DCC has developed codes and procedures for efficiently implementing and reporting DQA. The CESR DCC approach is to 1) distribute DQA tools to empower data managers at each organization to assess their data quality at any time, 2) summarize and disseminate findings to address data shortfalls or document idiosyncrasies, and 3) engage data managers and end-users in an exchange of knowledge about the quality and its fitness for use.</p><p><strong>Conclusion: </strong>The KP CESR DQA model is applicable to networks hoping to improve data quality. The multi-organizational reporting system promotes transparency of DQA, adds to network knowledge about data quality, and informs research.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"8"},"PeriodicalIF":0.0,"publicationDate":"2019-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6450241/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37143344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Improving Health Care with Advanced Analytics: Practical Considerations. 改善医疗保健与先进的分析:实际考虑。
Pub Date : 2019-03-25 DOI: 10.5334/egems.276
Jose Benuzillo, Lucy A Savitz, Scott Evans

Artificial intelligence (AI) is becoming ubiquitous in health care, largely through machine learning and predictive analytics applications. Recent applications of AI to common health care scenarios, such as screening and diagnosing, have fueled optimism about the use of advanced analytics to improve care. Careful and objective considerations need to be made before implementing an advanced analytics solution. Critical evaluation before, during, and after its implementation will ensure safe care, good outcomes, and the elimination of waste. In this commentary we offer basic practical considerations for developing, implementing, and evaluating such solutions based on many years of experience.

人工智能(AI)在医疗保健领域正变得无处不在,主要是通过机器学习和预测分析应用。最近,人工智能在筛查和诊断等常见医疗场景中的应用,引发了人们对使用高级分析来改善医疗的乐观情绪。在实现高级分析解决方案之前,需要进行仔细和客观的考虑。在实施之前、期间和之后进行严格的评估将确保安全护理、取得良好结果并消除浪费。在这篇评论中,我们根据多年的经验提供了开发、实施和评估此类解决方案的基本实际考虑因素。
{"title":"Improving Health Care with Advanced Analytics: Practical Considerations.","authors":"Jose Benuzillo,&nbsp;Lucy A Savitz,&nbsp;Scott Evans","doi":"10.5334/egems.276","DOIUrl":"https://doi.org/10.5334/egems.276","url":null,"abstract":"<p><p>Artificial intelligence (AI) is becoming ubiquitous in health care, largely through machine learning and predictive analytics applications. Recent applications of AI to common health care scenarios, such as screening and diagnosing, have fueled optimism about the use of advanced analytics to improve care. Careful and objective considerations need to be made before implementing an advanced analytics solution. Critical evaluation before, during, and after its implementation will ensure safe care, good outcomes, and the elimination of waste. In this commentary we offer basic practical considerations for developing, implementing, and evaluating such solutions based on many years of experience.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"3"},"PeriodicalIF":0.0,"publicationDate":"2019-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6437691/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37112158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Developing a Prognostic Information System for Personalized Care in Real Time. 开发个性化护理的实时预后信息系统。
Pub Date : 2019-03-25 DOI: 10.5334/egems.266
Tracy A Lieu, Lisa J Herrinton, Dimitri E Buzkov, Liyan Liu, Deborah Lyons, Romain Neugebauer, Tami Needham, Daniel Ng, Stephanie Prausnitz, Kam Stewart, Stephen K Van Den Eeden, David M Baer

Context: Electronic medical records hold promise to transform clinical practice. However, technological and other barriers may preclude using them to guide care in real time. We used the Virtual Data Warehouse (VDW) to develop a tool that enables physicians to generate real-time, personalized prognostic information about survival after cancer.

Case description: Patients with cancer often ask their oncologists, "Have you ever seen a patient like me?" To help oncologists answer this question, we developed a prototype Prognostic Information System (PRISM), a web-based tool that gathers data about the index patient from Kaiser Permanente's clinical information systems, selects a historical cohort of similar patients, and displays the survival curve of the similar patients relative to key points in their treatment course.

Findings and major themes: The prototype was developed by a multidisciplinary team with expertise in oncology, research, and technology. We have completed two rounds of user testing and refinement. Successful development rested on: (1) executive support and a clinical champion; (2) collaboration among experts from multiple disciplines; (3) starting with simple cases rather than ambitious ones; (4) extensive research experience with the Virtual Data Warehouse, related databases, and an existing query tool; and (5) following agile software development principles, especially iterative user testing.

Conclusion: Clinical data stored in health care systems' electronic medical records can be used to personalize clinical care in real time. Development of prognostic information systems can be accelerated by collaborations among researchers, technology specialists, and clinicians and by use of existing technology like the Virtual Data Warehouse.

背景:电子病历有望改变临床实践。然而,技术和其他障碍可能妨碍使用它们实时指导护理。我们使用虚拟数据仓库(VDW)来开发一种工具,使医生能够生成有关癌症后生存的实时、个性化预后信息。病例描述:癌症患者经常问他们的肿瘤医生:“你见过像我这样的病人吗?”为了帮助肿瘤学家回答这个问题,我们开发了一个原型预后信息系统(PRISM),这是一个基于网络的工具,从Kaiser Permanente的临床信息系统中收集关于索引患者的数据,选择一个相似患者的历史队列,并显示相似患者相对于其治疗过程中的关键点的生存曲线。研究结果和主要主题:该原型是由一个具有肿瘤学、研究和技术专业知识的多学科团队开发的。我们已经完成了两轮用户测试和改进。成功的发展依赖于:(1)管理层的支持和临床冠军;(2)多学科专家协作;(3)从简单的案例入手,而不是从宏大的案例入手;(4)对虚拟数据仓库、相关数据库和现有查询工具有丰富的研究经验;(5)遵循敏捷软件开发原则,特别是迭代式用户测试。结论:医疗卫生系统电子病历中存储的临床数据可用于实时个性化临床护理。通过研究人员、技术专家和临床医生之间的合作,以及利用虚拟数据仓库等现有技术,可以加速预后信息系统的开发。
{"title":"Developing a Prognostic Information System for Personalized Care in Real Time.","authors":"Tracy A Lieu,&nbsp;Lisa J Herrinton,&nbsp;Dimitri E Buzkov,&nbsp;Liyan Liu,&nbsp;Deborah Lyons,&nbsp;Romain Neugebauer,&nbsp;Tami Needham,&nbsp;Daniel Ng,&nbsp;Stephanie Prausnitz,&nbsp;Kam Stewart,&nbsp;Stephen K Van Den Eeden,&nbsp;David M Baer","doi":"10.5334/egems.266","DOIUrl":"https://doi.org/10.5334/egems.266","url":null,"abstract":"<p><strong>Context: </strong>Electronic medical records hold promise to transform clinical practice. However, technological and other barriers may preclude using them to guide care in real time. We used the Virtual Data Warehouse (VDW) to develop a tool that enables physicians to generate real-time, personalized prognostic information about survival after cancer.</p><p><strong>Case description: </strong>Patients with cancer often ask their oncologists, \"Have you ever seen a patient like me?\" To help oncologists answer this question, we developed a prototype Prognostic Information System (PRISM), a web-based tool that gathers data about the index patient from Kaiser Permanente's clinical information systems, selects a historical cohort of similar patients, and displays the survival curve of the similar patients relative to key points in their treatment course.</p><p><strong>Findings and major themes: </strong>The prototype was developed by a multidisciplinary team with expertise in oncology, research, and technology. We have completed two rounds of user testing and refinement. Successful development rested on: (1) executive support and a clinical champion; (2) collaboration among experts from multiple disciplines; (3) starting with simple cases rather than ambitious ones; (4) extensive research experience with the Virtual Data Warehouse, related databases, and an existing query tool; and (5) following agile software development principles, especially iterative user testing.</p><p><strong>Conclusion: </strong>Clinical data stored in health care systems' electronic medical records can be used to personalize clinical care in real time. Development of prognostic information systems can be accelerated by collaborations among researchers, technology specialists, and clinicians and by use of existing technology like the Virtual Data Warehouse.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"2"},"PeriodicalIF":0.0,"publicationDate":"2019-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6437692/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37112157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Learning to Share Health Care Data: A Brief Timeline of Influential Common Data Models and Distributed Health Data Networks in U.S. Health Care Research. 学习共享卫生保健数据:美国卫生保健研究中有影响力的公共数据模型和分布式卫生数据网络的简要时间表。
Pub Date : 2019-03-25 DOI: 10.5334/egems.279
John Weeks, Roy Pardee

The last twenty years of health care research has seen a steady stream of common health care data models implemented for multi-organization research. Each model offers a uniform interface on data from the diverse organizations that implement them, enabling the sharing of research tools and data. While the groups designing the models have had various needs and aims, and the data available has changed significantly in this time, there are nevertheless striking similarities between them. This paper traces the evolution of common data models, describing their similarities and points of departure. We believe the history of this work should be understood and preserved. The work has empowered collaborative research across competing organizations and brought together researchers from clinical practice, universities and research institutes around the planet. Understanding the eco-system of data models designed for collaborative research allows readers to evaluate where we have been, where we are going as a field, and to evaluate the utility of different models to their own work.

在过去的二十年中,医疗保健研究已经看到了用于多组织研究的常见医疗保健数据模型的稳定流。每个模型都为来自不同组织的数据提供统一的接口,从而实现研究工具和数据的共享。虽然设计模型的小组有不同的需求和目标,并且在此期间可用的数据也发生了重大变化,但它们之间仍然存在惊人的相似之处。本文追溯了常用数据模型的演变,描述了它们的相似之处和出发点。我们认为,这项工作的历史应该得到理解和保护。这项工作为竞争组织之间的合作研究提供了动力,并将来自全球临床实践、大学和研究机构的研究人员聚集在一起。理解为合作研究而设计的数据模型的生态系统,可以让读者评估我们作为一个领域已经取得的成就,以及我们将走向的方向,并评估不同模型对他们自己工作的效用。
{"title":"Learning to Share Health Care Data: A Brief Timeline of Influential Common Data Models and Distributed Health Data Networks in U.S. Health Care Research.","authors":"John Weeks,&nbsp;Roy Pardee","doi":"10.5334/egems.279","DOIUrl":"https://doi.org/10.5334/egems.279","url":null,"abstract":"<p><p>The last twenty years of health care research has seen a steady stream of common health care data models implemented for multi-organization research. Each model offers a uniform interface on data from the diverse organizations that implement them, enabling the sharing of research tools and data. While the groups designing the models have had various needs and aims, and the data available has changed significantly in this time, there are nevertheless striking similarities between them. This paper traces the evolution of common data models, describing their similarities and points of departure. We believe the history of this work should be understood and preserved. The work has empowered collaborative research across competing organizations and brought together researchers from clinical practice, universities and research institutes around the planet. Understanding the eco-system of data models designed for collaborative research allows readers to evaluate where we have been, where we are going as a field, and to evaluate the utility of different models to their own work.</p>","PeriodicalId":72880,"journal":{"name":"EGEMS (Washington, DC)","volume":"7 1","pages":"4"},"PeriodicalIF":0.0,"publicationDate":"2019-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6437693/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37112159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 51
期刊
EGEMS (Washington, DC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1