首页 > 最新文献

Medical Decision Making最新文献

英文 中文
Value-of-Information Analysis for External Validation of Risk Prediction Models. 风险预测模型外部验证的信息价值分析。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-07-01 DOI: 10.1177/0272989X231178317
Mohsen Sadatsafavi, Tae Yoon Lee, Laure Wynants, Andrew J Vickers, Paul Gustafson

Background: A previously developed risk prediction model needs to be validated before being used in a new population. The finite size of the validation sample entails that there is uncertainty around model performance. We apply value-of-information (VoI) methodology to quantify the consequence of uncertainty in terms of net benefit (NB).

Methods: We define the expected value of perfect information (EVPI) for model validation as the expected loss in NB due to not confidently knowing which of the alternative decisions confers the highest NB. We propose bootstrap-based and asymptotic methods for EVPI computations and conduct simulation studies to compare their performance. In a case study, we use the non-US subsets of a clinical trial as the development sample for predicting mortality after myocardial infarction and calculate the validation EVPI for the US subsample.

Results: The computation methods generated similar EVPI values in simulation studies. EVPI generally declined with larger samples. In the case study, at the prespecified threshold of 0.02, the best decision with current information would be to use the model, with an incremental NB of 0.0020 over treating all. At this threshold, the EVPI was 0.0005 (relative EVPI = 25%). When scaled to the annual number of heart attacks in the US, the expected NB loss due to uncertainty was equal to 400 true positives or 19,600 false positives, indicating the value of further model validation.

Conclusion: VoI methods can be applied to the NB calculated during external validation of clinical prediction models. While uncertainty does not directly affect the clinical implications of NB findings, validation EVPI provides an objective perspective to the need for further validation and can be reported alongside NB in external validation studies.

Highlights: External validation is a critical step when transporting a risk prediction model to a new setting, but the finite size of the validation sample creates uncertainty about the performance of the model.In decision theory, such uncertainty is associated with loss of net benefit because it can prevent one from identifying whether the use of the model is beneficial over alternative strategies.We define the expected value of perfect information for external validation as the expected loss in net benefit by not confidently knowing if the use of the model is net beneficial.The adoption of a model for a new population should be based on its expected net benefit; independently, value-of-information methods can be used to decide whether further validation studies are warranted.

背景:先前开发的风险预测模型在用于新人群之前需要进行验证。验证样本的有限大小意味着模型性能存在不确定性。我们应用信息价值(VoI)方法,以净效益(NB)来量化不确定性的后果。方法:我们将模型验证的完美信息(EVPI)的期望值定义为由于无法自信地知道哪个备选决策赋予最高的NB而导致的NB的预期损失。我们提出了基于自举和渐近的EVPI计算方法,并进行了仿真研究来比较它们的性能。在一个案例研究中,我们使用临床试验的非美国子集作为预测心肌梗死后死亡率的开发样本,并计算美国子样本的验证EVPI。结果:两种计算方法在模拟研究中得到相似的EVPI值。EVPI总体上随着样本量的增大而下降。在案例研究中,在预先指定的阈值为0.02时,使用当前信息的最佳决策将是使用该模型,其增量NB为0.0020。在该阈值下,EVPI为0.0005(相对EVPI = 25%)。当缩放到美国每年心脏病发作的数量时,由于不确定性导致的预期NB损失等于400个真阳性或19,600个假阳性,表明进一步模型验证的价值。结论:VoI方法可用于临床预测模型外部验证时计算的NB。虽然不确定性并不直接影响NB结果的临床意义,但验证EVPI为进一步验证的需要提供了客观的视角,并且可以在外部验证研究中与NB一起报告。重点:外部验证是将风险预测模型转移到新设置时的关键步骤,但是验证样本的有限大小会对模型的性能产生不确定性。在决策理论中,这种不确定性与净收益损失有关,因为它可以阻止人们识别模型的使用是否优于替代策略。我们将外部验证的完美信息的期望值定义为净收益的预期损失,因为我们不能自信地知道模型的使用是否具有净收益。新人口模式的采用应以预期的净效益为基础;独立地,信息价值方法可以用来决定是否需要进一步的验证研究。
{"title":"Value-of-Information Analysis for External Validation of Risk Prediction Models.","authors":"Mohsen Sadatsafavi,&nbsp;Tae Yoon Lee,&nbsp;Laure Wynants,&nbsp;Andrew J Vickers,&nbsp;Paul Gustafson","doi":"10.1177/0272989X231178317","DOIUrl":"https://doi.org/10.1177/0272989X231178317","url":null,"abstract":"<p><strong>Background: </strong>A previously developed risk prediction model needs to be validated before being used in a new population. The finite size of the validation sample entails that there is uncertainty around model performance. We apply value-of-information (VoI) methodology to quantify the consequence of uncertainty in terms of net benefit (NB).</p><p><strong>Methods: </strong>We define the expected value of perfect information (EVPI) for model validation as the expected loss in NB due to not confidently knowing which of the alternative decisions confers the highest NB. We propose bootstrap-based and asymptotic methods for EVPI computations and conduct simulation studies to compare their performance. In a case study, we use the non-US subsets of a clinical trial as the development sample for predicting mortality after myocardial infarction and calculate the validation EVPI for the US subsample.</p><p><strong>Results: </strong>The computation methods generated similar EVPI values in simulation studies. EVPI generally declined with larger samples. In the case study, at the prespecified threshold of 0.02, the best decision with current information would be to use the model, with an incremental NB of 0.0020 over treating all. At this threshold, the EVPI was 0.0005 (relative EVPI = 25%). When scaled to the annual number of heart attacks in the US, the expected NB loss due to uncertainty was equal to 400 true positives or 19,600 false positives, indicating the value of further model validation.</p><p><strong>Conclusion: </strong>VoI methods can be applied to the NB calculated during external validation of clinical prediction models. While uncertainty does not directly affect the clinical implications of NB findings, validation EVPI provides an objective perspective to the need for further validation and can be reported alongside NB in external validation studies.</p><p><strong>Highlights: </strong>External validation is a critical step when transporting a risk prediction model to a new setting, but the finite size of the validation sample creates uncertainty about the performance of the model.In decision theory, such uncertainty is associated with loss of net benefit because it can prevent one from identifying whether the use of the model is beneficial over alternative strategies.We define the expected value of perfect information for external validation as the expected loss in net benefit by not confidently knowing if the use of the model is net beneficial.The adoption of a model for a new population should be based on its expected net benefit; independently, value-of-information methods can be used to decide whether further validation studies are warranted.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 5","pages":"564-575"},"PeriodicalIF":3.6,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336716/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9790151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
A Systematic Review of Methods to Incorporate External Evidence into Trial-Based Survival Extrapolations for Health Technology Assessment. 关于将外部证据纳入健康技术评估中基于试验的生存推断的方法的系统性综述。
IF 3.1 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-07-01 Epub Date: 2023-04-26 DOI: 10.1177/0272989X231168618
Ash Bullement, Matthew D Stevenson, Gianluca Baio, Gemma E Shields, Nicholas R Latimer

Background: External evidence is commonly used to inform survival modeling for health technology assessment (HTA). While there are a range of methodological approaches that have been proposed, it is unclear which methods could be used and how they compare.

Purpose: This review aims to identify, describe, and categorize established methods to incorporate external evidence into survival extrapolation for HTA.

Data sources: Embase, MEDLINE, EconLit, and Web of Science databases were searched to identify published methodological studies, supplemented by hand searching and citation tracking.

Study selection: Eligible studies were required to present a novel extrapolation approach incorporating external evidence (i.e., data or information) within survival model estimation.

Data extraction: Studies were classified according to how the external evidence was integrated as a part of model fitting. Information was extracted concerning the model-fitting process, key requirements, assumptions, software, application contexts, and presentation of comparisons with, or validation against, other methods.

Data synthesis: Across 18 methods identified from 22 studies, themes included use of informative prior(s) (n = 5), piecewise (n = 7), and general population adjustment (n = 9), plus a variety of "other" (n = 8) approaches. Most methods were applied in cancer populations (n = 13). No studies compared or validated their method against another method that also incorporated external evidence.

Limitations: As only studies with a specific methodological objective were included, methods proposed as part of another study type (e.g., an economic evaluation) were excluded from this review.

Conclusions: Several methods were identified in this review, with common themes based on typical data sources and analytical approaches. Of note, no evidence was found comparing the identified methods to one another, and so an assessment of different methods would be a useful area for further research.HighlightsThis review aims to identify methods that have been used to incorporate external evidence into survival extrapolations, focusing on those that may be used to inform health technology assessment.We found a range of different approaches, including piecewise methods, Bayesian methods using informative priors, and general population adjustment methods, as well as a variety of "other" approaches.No studies attempted to compare the performance of alternative methods for incorporating external evidence with respect to the accuracy of survival predictions. Further research investigating this would be valuable.

背景:外部证据通常用于为卫生技术评估(HTA)的生存模型提供信息。目的:本综述旨在确定、描述和归类将外部证据纳入 HTA 生存推断的既定方法:数据来源:对 Embase、MEDLINE、EconLit 和 Web of Science 数据库进行检索,以确定已发表的方法学研究,并辅以人工检索和引文追踪:符合条件的研究必须提出一种新的外推方法,将外部证据(即数据或信息)纳入生存模型估算中:数据提取:根据外部证据作为模型拟合一部分的整合方式对研究进行分类。提取的信息涉及模型拟合过程、关键要求、假设、软件、应用环境,以及与其他方法的比较或验证:在 22 项研究中确定的 18 种方法中,主题包括使用信息先验(n = 5)、片断(n = 7)和一般人群调整(n = 9),以及各种 "其他"(n = 8)方法。大多数方法都应用于癌症人群(n = 13)。没有研究将自己的方法与另一种也包含外部证据的方法进行比较或验证:由于只纳入了具有特定方法目标的研究,因此本综述排除了作为其他研究类型(如经济评估)一部分而提出的方法:本综述确定了几种方法,其共同主题基于典型的数据来源和分析方法。本综述旨在确定将外部证据纳入生存推断的方法,重点关注可用于健康技术评估的方法。我们发现了一系列不同的方法,包括计件方法、使用信息先验的贝叶斯方法、一般人群调整方法以及各种 "其他 "方法。对此进行进一步研究将是非常有价值的。
{"title":"A Systematic Review of Methods to Incorporate External Evidence into Trial-Based Survival Extrapolations for Health Technology Assessment.","authors":"Ash Bullement, Matthew D Stevenson, Gianluca Baio, Gemma E Shields, Nicholas R Latimer","doi":"10.1177/0272989X231168618","DOIUrl":"10.1177/0272989X231168618","url":null,"abstract":"<p><strong>Background: </strong>External evidence is commonly used to inform survival modeling for health technology assessment (HTA). While there are a range of methodological approaches that have been proposed, it is unclear which methods could be used and how they compare.</p><p><strong>Purpose: </strong>This review aims to identify, describe, and categorize established methods to incorporate external evidence into survival extrapolation for HTA.</p><p><strong>Data sources: </strong>Embase, MEDLINE, EconLit, and Web of Science databases were searched to identify published methodological studies, supplemented by hand searching and citation tracking.</p><p><strong>Study selection: </strong>Eligible studies were required to present a novel extrapolation approach incorporating external evidence (i.e., data or information) within survival model estimation.</p><p><strong>Data extraction: </strong>Studies were classified according to how the external evidence was integrated as a part of model fitting. Information was extracted concerning the model-fitting process, key requirements, assumptions, software, application contexts, and presentation of comparisons with, or validation against, other methods.</p><p><strong>Data synthesis: </strong>Across 18 methods identified from 22 studies, themes included use of informative prior(s) (<i>n</i> = 5), piecewise (<i>n</i> = 7), and general population adjustment (<i>n</i> = 9), plus a variety of \"other\" (<i>n</i> = 8) approaches. Most methods were applied in cancer populations (<i>n</i> = 13). No studies compared or validated their method against another method that also incorporated external evidence.</p><p><strong>Limitations: </strong>As only studies with a specific methodological objective were included, methods proposed as part of another study type (e.g., an economic evaluation) were excluded from this review.</p><p><strong>Conclusions: </strong>Several methods were identified in this review, with common themes based on typical data sources and analytical approaches. Of note, no evidence was found comparing the identified methods to one another, and so an assessment of different methods would be a useful area for further research.HighlightsThis review aims to identify methods that have been used to incorporate external evidence into survival extrapolations, focusing on those that may be used to inform health technology assessment.We found a range of different approaches, including piecewise methods, Bayesian methods using informative priors, and general population adjustment methods, as well as a variety of \"other\" approaches.No studies attempted to compare the performance of alternative methods for incorporating external evidence with respect to the accuracy of survival predictions. Further research investigating this would be valuable.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 5","pages":"610-620"},"PeriodicalIF":3.1,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336710/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9794502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
General-Purpose Methods for Simulating Survival Data for Expected Value of Sample Information Calculations. 为计算样本信息的期望值而模拟生存数据的通用方法。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-07-01 Epub Date: 2023-03-27 DOI: 10.1177/0272989X231162069
Mathyn Vervaart, Eline Aas, Karl P Claxton, Mark Strong, Nicky J Welton, Torbjørn Wisløff, Anna Heath
<p><strong>Background: </strong>Expected value of sample information (EVSI) quantifies the expected value to a decision maker of reducing uncertainty by collecting additional data. EVSI calculations require simulating plausible data sets, typically achieved by evaluating quantile functions at random uniform numbers using standard inverse transform sampling (ITS). This is straightforward when closed-form expressions for the quantile function are available, such as for standard parametric survival models, but these are often unavailable when assuming treatment effect waning and for flexible survival models. In these circumstances, the standard ITS method could be implemented by numerically evaluating the quantile functions at each iteration in a probabilistic analysis, but this greatly increases the computational burden. Thus, our study aims to develop general-purpose methods that standardize and reduce the computational burden of the EVSI data-simulation step for survival data.</p><p><strong>Methods: </strong>We developed a discrete sampling method and an interpolated ITS method for simulating survival data from a probabilistic sample of survival probabilities over discrete time units. We compared the general-purpose and standard ITS methods using an illustrative partitioned survival model with and without adjustment for treatment effect waning.</p><p><strong>Results: </strong>The discrete sampling and interpolated ITS methods agree closely with the standard ITS method, with the added benefit of a greatly reduced computational cost in the scenario with adjustment for treatment effect waning.</p><p><strong>Conclusions: </strong>We present general-purpose methods for simulating survival data from a probabilistic sample of survival probabilities that greatly reduce the computational burden of the EVSI data-simulation step when we assume treatment effect waning or use flexible survival models. The implementation of our data-simulation methods is identical across all possible survival models and can easily be automated from standard probabilistic decision analyses.</p><p><strong>Highlights: </strong>Expected value of sample information (EVSI) quantifies the expected value to a decision maker of reducing uncertainty through a given data collection exercise, such as a randomized clinical trial. In this article, we address the problem of computing EVSI when we assume treatment effect waning or use flexible survival models, by developing general-purpose methods that standardize and reduce the computational burden of the EVSI data-generation step for survival data.We developed 2 methods for simulating survival data from a probabilistic sample of survival probabilities over discrete time units, a discrete sampling method and an interpolated inverse transform sampling method, which can be combined with a recently proposed nonparametric EVSI method to accurately estimate EVSI for collecting survival data.Our general-purpose data-simulation methods greatly redu
背景:样本信息的预期值(EVSI)量化了决策者通过收集额外数据减少不确定性的预期值。EVSI 计算需要模拟可信的数据集,通常是通过使用标准反变换采样(ITS)对随机均匀数的量化函数进行评估来实现。如果有量化函数的闭式表达式(如标准参数生存模型),这种方法就很简单,但如果假设治疗效果减弱或采用灵活的生存模型,则往往无法获得这些表达式。在这种情况下,标准的 ITS 方法可以通过在概率分析的每次迭代中对量化函数进行数值评估来实现,但这大大增加了计算负担。因此,我们的研究旨在开发通用方法,使生存数据的 EVSI 数据模拟步骤标准化并减轻计算负担:方法:我们开发了一种离散采样方法和一种内插 ITS 方法,用于模拟离散时间单位上生存概率概率样本的生存数据。我们使用一个说明性的分区生存模型,对通用 ITS 方法和标准 ITS 方法进行了比较:结果:离散采样和插值 ITS 方法与标准 ITS 方法非常接近,而且在调整治疗效果减弱的情况下,计算成本大大降低:我们提出了从生存概率概率样本模拟生存数据的通用方法,当我们假设治疗效果减弱或使用灵活的生存模型时,这些方法可大大减轻 EVSI 数据模拟步骤的计算负担。在所有可能的生存模型中,我们的数据模拟方法都是相同的,可以很容易地从标准概率决策分析中自动实现:样本信息的期望值(EVSI)量化了决策者通过特定数据收集活动(如随机临床试验)减少不确定性的期望值。在本文中,我们通过开发通用方法,将生存数据的 EVSI 数据生成步骤标准化并减轻计算负担,从而解决了在假设治疗效果减弱或使用灵活的生存模型时计算 EVSI 的问题。我们开发了两种从离散时间单位的生存概率概率样本中模拟生存数据的方法,一种是离散抽样方法,另一种是插值反变换抽样方法,这两种方法可以与最近提出的非参数 EVSI 方法相结合,准确估计收集生存数据的 EVSI。在所有可能的生存模型中,我们的数据模拟方法的实现都是相同的,因此可以很容易地从标准概率决策分析中实现自动化。
{"title":"General-Purpose Methods for Simulating Survival Data for Expected Value of Sample Information Calculations.","authors":"Mathyn Vervaart, Eline Aas, Karl P Claxton, Mark Strong, Nicky J Welton, Torbjørn Wisløff, Anna Heath","doi":"10.1177/0272989X231162069","DOIUrl":"10.1177/0272989X231162069","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Expected value of sample information (EVSI) quantifies the expected value to a decision maker of reducing uncertainty by collecting additional data. EVSI calculations require simulating plausible data sets, typically achieved by evaluating quantile functions at random uniform numbers using standard inverse transform sampling (ITS). This is straightforward when closed-form expressions for the quantile function are available, such as for standard parametric survival models, but these are often unavailable when assuming treatment effect waning and for flexible survival models. In these circumstances, the standard ITS method could be implemented by numerically evaluating the quantile functions at each iteration in a probabilistic analysis, but this greatly increases the computational burden. Thus, our study aims to develop general-purpose methods that standardize and reduce the computational burden of the EVSI data-simulation step for survival data.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We developed a discrete sampling method and an interpolated ITS method for simulating survival data from a probabilistic sample of survival probabilities over discrete time units. We compared the general-purpose and standard ITS methods using an illustrative partitioned survival model with and without adjustment for treatment effect waning.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;The discrete sampling and interpolated ITS methods agree closely with the standard ITS method, with the added benefit of a greatly reduced computational cost in the scenario with adjustment for treatment effect waning.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;We present general-purpose methods for simulating survival data from a probabilistic sample of survival probabilities that greatly reduce the computational burden of the EVSI data-simulation step when we assume treatment effect waning or use flexible survival models. The implementation of our data-simulation methods is identical across all possible survival models and can easily be automated from standard probabilistic decision analyses.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Highlights: &lt;/strong&gt;Expected value of sample information (EVSI) quantifies the expected value to a decision maker of reducing uncertainty through a given data collection exercise, such as a randomized clinical trial. In this article, we address the problem of computing EVSI when we assume treatment effect waning or use flexible survival models, by developing general-purpose methods that standardize and reduce the computational burden of the EVSI data-generation step for survival data.We developed 2 methods for simulating survival data from a probabilistic sample of survival probabilities over discrete time units, a discrete sampling method and an interpolated inverse transform sampling method, which can be combined with a recently proposed nonparametric EVSI method to accurately estimate EVSI for collecting survival data.Our general-purpose data-simulation methods greatly redu","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 5","pages":"595-609"},"PeriodicalIF":3.6,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336715/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10147991","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Bayesian Evidence Synthesis Methods to Incorporate Real-World Evidence in Surrogate Endpoint Evaluation. 使用贝叶斯证据综合方法将真实世界的证据纳入替代终点评价。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-07-01 DOI: 10.1177/0272989X231162852
Lorna Wheaton, Anastasios Papanikos, Anne Thomas, Sylwia Bujkiewicz

Objective: Traditionally, validation of surrogate endpoints has been carried out using randomized controlled trial (RCT) data. However, RCT data may be too limited to validate surrogate endpoints. In this article, we sought to improve the validation of surrogate endpoints with the inclusion of real-world evidence (RWE).

Methods: We use data from comparative RWE (cRWE) and single-arm RWE (sRWE) to supplement RCT evidence for the evaluation of progression-free survival (PFS) as a surrogate endpoint to overall survival (OS) in metastatic colorectal cancer (mCRC). Treatment effect estimates from RCTs, cRWE, and matched sRWE, comparing antiangiogenic treatments with chemotherapy, were used to inform surrogacy patterns and predictions of the treatment effect on OS from the treatment effect on PFS.

Results: Seven RCTs, 4 cRWE studies, and 2 matched sRWE studies were identified. The addition of RWE to RCTs reduced the uncertainty around the estimates of the parameters for the surrogate relationship. The addition of RWE to RCTs also improved the accuracy and precision of predictions of the treatment effect on OS obtained using data on the observed effect on PFS.

Conclusion: The addition of RWE to RCT data improved the precision of the parameters describing the surrogate relationship between treatment effects on PFS and OS and the predicted clinical benefit of antiangiogenic therapies in mCRC.

Highlights: Regulatory agencies increasingly rely on surrogate endpoints when making licensing decisions, and for the decisions to be robust, surrogate endpoints need to be validated. In the era of precision medicine, when surrogacy patterns may depend on the drug's mechanism of action and trials of targeted therapies may be small, data from randomized controlled trials may be limited.Real-world evidence (RWE) is increasingly used at different stages of the drug development process. When used to enhance the evidence base for surrogate endpoint evaluation, RWE can improve inferences about the strength of surrogate relationships and the precision of predicted treatment effect on the final clinical outcome based on the observed effect on the surrogate endpoint in a new trial.Careful selection of RWE is needed to reduce risk of bias.

目的:传统上,替代终点的验证是使用随机对照试验(RCT)数据进行的。然而,RCT数据可能过于有限,无法验证替代终点。在本文中,我们试图通过纳入真实世界证据(RWE)来改进替代终点的验证。方法:我们使用比较RWE (cRWE)和单臂RWE (sRWE)的数据来补充RCT证据,以评估转移性结直肠癌(mCRC)的无进展生存期(PFS)作为总生存期(OS)的替代终点。来自rct、cRWE和匹配sRWE的治疗效果估计,比较抗血管生成治疗与化疗,用于告知代孕模式,并从治疗对PFS的影响中预测治疗对OS的影响。结果:7项rct、4项cRWE研究和2项匹配的sRWE研究被确定。在随机对照试验中加入RWE减少了对替代关系参数估计的不确定性。在rct中加入RWE还提高了根据观察到的PFS效果数据预测治疗对OS效果的准确性和精确性。结论:RWE加入RCT数据提高了描述mCRC中PFS和OS治疗效果与抗血管生成治疗预测临床获益之间替代关系参数的准确性。重点:监管机构在做出许可决策时越来越依赖代理端点,为了使决策可靠,代理端点需要得到验证。在精准医疗时代,代孕模式可能取决于药物的作用机制,靶向治疗的试验可能很小,随机对照试验的数据可能有限。真实世界证据(RWE)越来越多地用于药物开发过程的不同阶段。当用于增强替代终点评价的证据基础时,RWE可以根据新试验中观察到的替代终点效应,提高对替代关系强度的推断和预测治疗效果对最终临床结局的准确性。需要仔细选择RWE以减少偏倚风险。
{"title":"Using Bayesian Evidence Synthesis Methods to Incorporate Real-World Evidence in Surrogate Endpoint Evaluation.","authors":"Lorna Wheaton,&nbsp;Anastasios Papanikos,&nbsp;Anne Thomas,&nbsp;Sylwia Bujkiewicz","doi":"10.1177/0272989X231162852","DOIUrl":"https://doi.org/10.1177/0272989X231162852","url":null,"abstract":"<p><strong>Objective: </strong>Traditionally, validation of surrogate endpoints has been carried out using randomized controlled trial (RCT) data. However, RCT data may be too limited to validate surrogate endpoints. In this article, we sought to improve the validation of surrogate endpoints with the inclusion of real-world evidence (RWE).</p><p><strong>Methods: </strong>We use data from comparative RWE (cRWE) and single-arm RWE (sRWE) to supplement RCT evidence for the evaluation of progression-free survival (PFS) as a surrogate endpoint to overall survival (OS) in metastatic colorectal cancer (mCRC). Treatment effect estimates from RCTs, cRWE, and matched sRWE, comparing antiangiogenic treatments with chemotherapy, were used to inform surrogacy patterns and predictions of the treatment effect on OS from the treatment effect on PFS.</p><p><strong>Results: </strong>Seven RCTs, 4 cRWE studies, and 2 matched sRWE studies were identified. The addition of RWE to RCTs reduced the uncertainty around the estimates of the parameters for the surrogate relationship. The addition of RWE to RCTs also improved the accuracy and precision of predictions of the treatment effect on OS obtained using data on the observed effect on PFS.</p><p><strong>Conclusion: </strong>The addition of RWE to RCT data improved the precision of the parameters describing the surrogate relationship between treatment effects on PFS and OS and the predicted clinical benefit of antiangiogenic therapies in mCRC.</p><p><strong>Highlights: </strong>Regulatory agencies increasingly rely on surrogate endpoints when making licensing decisions, and for the decisions to be robust, surrogate endpoints need to be validated. In the era of precision medicine, when surrogacy patterns may depend on the drug's mechanism of action and trials of targeted therapies may be small, data from randomized controlled trials may be limited.Real-world evidence (RWE) is increasingly used at different stages of the drug development process. When used to enhance the evidence base for surrogate endpoint evaluation, RWE can improve inferences about the strength of surrogate relationships and the precision of predicted treatment effect on the final clinical outcome based on the observed effect on the surrogate endpoint in a new trial.Careful selection of RWE is needed to reduce risk of bias.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 5","pages":"539-552"},"PeriodicalIF":3.6,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336701/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9787076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
US and Dutch Perspectives on the Use of COVID-19 Clinical Prediction Models: Findings from a Qualitative Analysis. 美国和荷兰对COVID-19临床预测模型使用的看法:来自定性分析的结果。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X231152852
Melissa J Basile, I R A Retel Helmrich, Jinny G Park, Jennifer Polo, Judith A C Rietjens, David van Klaveren, Theodoros P Zanos, Jason Nelson, Hester F Lingsma, David M Kent, Jelmer Alsma, R J C G Verdonschot, Negin Hajizadeh

Introduction: Clinical prediction models (CPMs) for coronavirus disease 2019 (COVID-19) may support clinical decision making, treatment, and communication. However, attitudes about using CPMs for COVID-19 decision making are unknown.

Methods: Online focus groups and interviews were conducted among health care providers, survivors of COVID-19, and surrogates (i.e., loved ones/surrogate decision makers) in the United States and the Netherlands. Semistructured questions explored experiences about clinical decision making in COVID-19 care and facilitators and barriers for implementing CPMs.

Results: In the United States, we conducted 4 online focus groups with 1) providers and 2) surrogates and survivors of COVID-19 between January 2021 and July 2021. In the Netherlands, we conducted 3 focus groups and 4 individual interviews with 1) providers and 2) surrogates and survivors of COVID-19 between May 2021 and July 2021. Providers expressed concern about CPM validity and the belief that patients may interpret CPM predictions as absolute. They described CPMs as potentially useful for resource allocation, triaging, education, and research. Several surrogates and people who had COVID-19 were not given prognostic estimates but believed this information would have supported and influenced their decision making. A limited number of participants felt the data would not have applied to them and that they or their loved ones may not have survived, as poor prognosis may have suggested withdrawal of treatment.

Conclusions: Many providers had reservations about using CPMs for people with COVID-19 due to concerns about CPM validity and patient-level interpretation of the outcome predictions. However, several people who survived COVID-19 and their surrogates indicated that they would have found this information useful for decision making. Therefore, information provision may be needed to improve provider-level comfort and patient and surrogate understanding of CPMs.

Highlights: While clinical prediction models (CPMs) may provide an objective means of assessing COVID-19 prognosis, provider concerns about CPM validity and the interpretation of CPM predictions may limit their clinical use.Providers felt that CPMs may be most useful for resource allocation, triage, research, or educational purposes for COVID-19.Several survivors of COVID-19 and their surrogates felt that CPMs would have been informative and may have aided them in making COVID-19 treatment decisions, while others felt the data would not have applied to them.

2019冠状病毒病(COVID-19)的临床预测模型(cpm)可以支持临床决策、治疗和交流。然而,人们对在COVID-19决策中使用cpm的态度尚不清楚。方法:对美国和荷兰的医疗服务提供者、COVID-19幸存者和代孕者(即亲人/代孕决策者)进行在线焦点小组和访谈。半结构化问题探讨了COVID-19护理的临床决策经验以及实施cpm的促进因素和障碍。结果:在美国,我们在2021年1月至2021年7月期间进行了4个在线焦点小组,包括1)提供者和2)代理和COVID-19幸存者。在荷兰,我们在2021年5月至2021年7月期间对1)提供者和2)COVID-19的代理人和幸存者进行了3个焦点小组和4次个人访谈。提供者表达了对CPM有效性的担忧,并相信患者可能会将CPM预测解释为绝对的。他们认为cpm在资源分配、分类、教育和研究方面具有潜在的用处。几名代孕母亲和感染COVID-19的人没有得到预后估计,但他们认为这些信息会支持和影响他们的决策。有限数量的参与者认为这些数据不适用于他们,他们或他们的亲人可能无法幸存,因为预后不佳可能意味着放弃治疗。结论:由于担心CPM的有效性和患者对结果预测的解释,许多提供者对对COVID-19患者使用CPM持保留态度。然而,一些在COVID-19中幸存下来的人和他们的代理人表示,他们会发现这些信息对决策有用。因此,可能需要提供信息来提高提供者水平的舒适度以及患者和代理对cpm的理解。虽然临床预测模型(CPM)可以提供评估COVID-19预后的客观手段,但提供者对CPM有效性和CPM预测解释的担忧可能会限制其临床应用。供应商认为cpm可能对COVID-19的资源分配、分类、研究或教育目的最有用。一些COVID-19的幸存者和他们的代理人认为cpm本可以提供信息,并可能帮助他们做出COVID-19治疗决策,而其他人则认为这些数据不适用于他们。
{"title":"US and Dutch Perspectives on the Use of COVID-19 Clinical Prediction Models: Findings from a Qualitative Analysis.","authors":"Melissa J Basile,&nbsp;I R A Retel Helmrich,&nbsp;Jinny G Park,&nbsp;Jennifer Polo,&nbsp;Judith A C Rietjens,&nbsp;David van Klaveren,&nbsp;Theodoros P Zanos,&nbsp;Jason Nelson,&nbsp;Hester F Lingsma,&nbsp;David M Kent,&nbsp;Jelmer Alsma,&nbsp;R J C G Verdonschot,&nbsp;Negin Hajizadeh","doi":"10.1177/0272989X231152852","DOIUrl":"https://doi.org/10.1177/0272989X231152852","url":null,"abstract":"<p><strong>Introduction: </strong>Clinical prediction models (CPMs) for coronavirus disease 2019 (COVID-19) may support clinical decision making, treatment, and communication. However, attitudes about using CPMs for COVID-19 decision making are unknown.</p><p><strong>Methods: </strong>Online focus groups and interviews were conducted among health care providers, survivors of COVID-19, and surrogates (i.e., loved ones/surrogate decision makers) in the United States and the Netherlands. Semistructured questions explored experiences about clinical decision making in COVID-19 care and facilitators and barriers for implementing CPMs.</p><p><strong>Results: </strong>In the United States, we conducted 4 online focus groups with 1) providers and 2) surrogates and survivors of COVID-19 between January 2021 and July 2021. In the Netherlands, we conducted 3 focus groups and 4 individual interviews with 1) providers and 2) surrogates and survivors of COVID-19 between May 2021 and July 2021. Providers expressed concern about CPM validity and the belief that patients may interpret CPM predictions as absolute. They described CPMs as potentially useful for resource allocation, triaging, education, and research. Several surrogates and people who had COVID-19 were not given prognostic estimates but believed this information would have supported and influenced their decision making. A limited number of participants felt the data would not have applied to them and that they or their loved ones may not have survived, as poor prognosis may have suggested withdrawal of treatment.</p><p><strong>Conclusions: </strong>Many providers had reservations about using CPMs for people with COVID-19 due to concerns about CPM validity and patient-level interpretation of the outcome predictions. However, several people who survived COVID-19 and their surrogates indicated that they would have found this information useful for decision making. Therefore, information provision may be needed to improve provider-level comfort and patient and surrogate understanding of CPMs.</p><p><strong>Highlights: </strong>While clinical prediction models (CPMs) may provide an objective means of assessing COVID-19 prognosis, provider concerns about CPM validity and the interpretation of CPM predictions may limit their clinical use.Providers felt that CPMs may be most useful for resource allocation, triage, research, or educational purposes for COVID-19.Several survivors of COVID-19 and their surrogates felt that CPMs would have been informative and may have aided them in making COVID-19 treatment decisions, while others felt the data would not have applied to them.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"445-460"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9922652/pdf/10.1177_0272989X231152852.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9490327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Filter Questions in Symptom Assessment Affect the Prevalence of (A)Symptomatic COVID-19 Cases. 症状评估中的过滤问题影响(A)类症状性COVID-19病例的流行
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X231158380
Robert Böhm, Philipp Sprengholz, Cornelia Betsch, Julia Partheymüller

Background: It has been reported that a substantial number of COVID-19 infections are asymptomatic, with both symptomatic and asymptomatic infections contributing to transmission dynamics. Yet, the share of asymptomatic cases varies greatly across studies. One reason for this could be the measurement of symptoms in medical studies and surveys.

Design: In 2 experimental survey studies (total N > 3,000) with participants from Germany and the United Kingdom, respectively, we varied the inclusion of a filter question on whether participants who tested positive for COVID-19 had experienced symptoms prior to presenting a checklist of symptoms. We measured the reporting of asymptomatic (versus symptomatic) COVID-19 infections.

Results: The inclusion of a filter question increased the reporting of asymptomatic (versus symptomatic) COVID-19 infections. Particularly mild symptoms were underreported when using a filter question.

Conclusions and implications: Filter questions affect the reporting of (a)symptomatic COVID-19 cases. To account for such differences in the estimation of population infection rates, future studies should transparently report the applied question format.

Highlights: Both symptomatic and asymptomatic infections are important for COVID-19 transmission dynamics.In previous research, symptoms have been assessed either with or without a filter question prior to presenting a symptom list.We show that filter questions reduce the reporting of asymptomatic infections.Particularly mild symptoms are underreported when using a filter question.

背景:据报道,大量COVID-19感染者为无症状感染者,有症状感染和无症状感染共同构成了传播动态。然而,在不同的研究中,无症状病例的比例差异很大。其中一个原因可能是医学研究和调查中症状的测量。设计:在两项实验调查研究中(总N > 3000),分别有来自德国和英国的参与者,我们改变了筛选问题的内容,即COVID-19检测呈阳性的参与者在提交症状清单之前是否经历过症状。我们测量了无症状(与有症状)COVID-19感染的报告。结果:纳入筛选问题增加了无症状(与有症状)COVID-19感染的报告。当使用过滤器问题时,特别轻微的症状被低估了。结论和意义:筛选问题影响(a)有症状的COVID-19病例的报告。为了解释在估计人群感染率方面的这种差异,未来的研究应透明地报告所应用的问题格式。重点:有症状感染和无症状感染对COVID-19传播动态都很重要。在以前的研究中,在提出症状列表之前,对症状进行了评估,有或没有过滤问题。我们表明,过滤问题减少了无症状感染的报告。当使用过滤器问题时,特别轻微的症状被低估了。
{"title":"Filter Questions in Symptom Assessment Affect the Prevalence of (A)Symptomatic COVID-19 Cases.","authors":"Robert Böhm,&nbsp;Philipp Sprengholz,&nbsp;Cornelia Betsch,&nbsp;Julia Partheymüller","doi":"10.1177/0272989X231158380","DOIUrl":"https://doi.org/10.1177/0272989X231158380","url":null,"abstract":"<p><strong>Background: </strong>It has been reported that a substantial number of COVID-19 infections are asymptomatic, with both symptomatic and asymptomatic infections contributing to transmission dynamics. Yet, the share of asymptomatic cases varies greatly across studies. One reason for this could be the measurement of symptoms in medical studies and surveys.</p><p><strong>Design: </strong>In 2 experimental survey studies (total <i>N</i> > 3,000) with participants from Germany and the United Kingdom, respectively, we varied the inclusion of a filter question on whether participants who tested positive for COVID-19 had experienced symptoms prior to presenting a checklist of symptoms. We measured the reporting of asymptomatic (versus symptomatic) COVID-19 infections.</p><p><strong>Results: </strong>The inclusion of a filter question increased the reporting of asymptomatic (versus symptomatic) COVID-19 infections. Particularly mild symptoms were underreported when using a filter question.</p><p><strong>Conclusions and implications: </strong>Filter questions affect the reporting of (a)symptomatic COVID-19 cases. To account for such differences in the estimation of population infection rates, future studies should transparently report the applied question format.</p><p><strong>Highlights: </strong>Both symptomatic and asymptomatic infections are important for COVID-19 transmission dynamics.In previous research, symptoms have been assessed either with or without a filter question prior to presenting a symptom list.We show that filter questions reduce the reporting of asymptomatic infections.Particularly mild symptoms are underreported when using a filter question.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"530-534"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/5a/6a/10.1177_0272989X231158380.PMC9971704.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9435343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How Values Are Discussed, Reflected Upon, and Acted On by Patients and Family Caregivers in the Context of Heart Failure: A Scoping Review. 在心力衰竭的背景下,患者和家庭照顾者如何讨论、反思和采取行动的价值观:范围审查。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X231165958
Avery C Bechthold, Christopher E Knoepke, Deborah B Ejem, Colleen K McIlvennan, Rachel D Wells, Daniel D Matlock, Marie A Bakitas, J Nicholas Dionne-Odom

Purpose: Values are critical to how individuals make decisions and cope, yet the values of heart failure (HF) patients and their family caregivers (FCGs) remain understudied. We sought to report the state of the science on how values are discussed, reflected upon, and acted on by patients with HF, their FCGs, or both related to health-related decision making and coping.

Method: A scoping review was conducted of empirical studies using the following keywords: "heart failure," "values," "decision-making," and "coping." PubMed, PsycINFO, and Scopus were searched from inception to June 2022 in English. Included articles reported values as a key finding (outcome/theme) in their abstract.

Results: Of 448 articles screened for eligibility, 16 met the inclusion criteria. Twelve articles reported findings addressing patient values, 3 addressed patient and FCG values, and 1 addressed FCG values. Values were reported to influence patient self-care behaviors and left ventricular assist device (LVAD) implantation decisions, although their prioritization varied across time and contexts. When prioritized values conflicted with recommended self-care activities, some patients modified their approach to achieving the value. Others modified or abandoned tasks in favor of the value and accompanying goals. Low motivation and alignment between unhealthy behaviors and values often led to nonadherent decisions. Five of 8 articles focusing on cardiac devices reported patient survival as the most prioritized value during implantation decisions. FCG values were rarely reported or evaluated separately from patient values. Patients leveraged several coping strategies, although the processes through which values affected coping was not described.

Conclusions: Prioritized values influenced HF-related decisions, including self-care and LVAD implantation. While several articles reported on coping and values, none described processes through which values affect coping, which highlights a research gap.

Highlights: Family caregiver values were rarely reported or evaluated separately from patient values, highlighting a gap in the literature.

目的:价值观对个体如何做出决定和应对至关重要,但心力衰竭(HF)患者及其家庭照顾者(FCGs)的价值观仍未得到充分研究。我们试图报告HF患者及其FCGs如何讨论、反思和采取与健康相关的决策和应对相关的价值观的科学现状。方法:采用“心力衰竭”、“价值观”、“决策”、“应对”等关键词对实证研究进行范围综述。PubMed, PsycINFO和Scopus从成立到2022年6月的英文检索。纳入的文章在其摘要中将价值报告为关键发现(结果/主题)。结果:在筛选的448篇文章中,有16篇符合纳入标准。12篇文章报道了患者值,3篇报道了患者和FCG值,1篇报道了FCG值。据报道,价值观会影响患者的自我保健行为和左心室辅助装置(LVAD)植入决策,尽管它们的优先级随时间和环境而变化。当优先价值与推荐的自我保健活动相冲突时,一些患者修改了他们实现价值的方法。其他人修改或放弃任务,以支持价值和伴随的目标。不健康的行为和价值观之间缺乏动力和一致性往往会导致不坚持的决定。8篇关于心脏装置的文章中有5篇报道患者的生存是植入决定中最优先考虑的价值。FCG值很少与患者值分开报道或评估。患者利用了几种应对策略,尽管没有描述价值观影响应对的过程。结论:优先价值影响hf相关决策,包括自我保健和LVAD植入。虽然有几篇文章报道了应对和价值观,但没有一篇文章描述了价值观影响应对的过程,这凸显了研究的空白。亮点:家庭照顾者的价值很少与患者的价值分开报道或评估,突出了文献中的差距。
{"title":"How Values Are Discussed, Reflected Upon, and Acted On by Patients and Family Caregivers in the Context of Heart Failure: A Scoping Review.","authors":"Avery C Bechthold,&nbsp;Christopher E Knoepke,&nbsp;Deborah B Ejem,&nbsp;Colleen K McIlvennan,&nbsp;Rachel D Wells,&nbsp;Daniel D Matlock,&nbsp;Marie A Bakitas,&nbsp;J Nicholas Dionne-Odom","doi":"10.1177/0272989X231165958","DOIUrl":"https://doi.org/10.1177/0272989X231165958","url":null,"abstract":"<p><strong>Purpose: </strong>Values are critical to how individuals make decisions and cope, yet the values of heart failure (HF) patients and their family caregivers (FCGs) remain understudied. We sought to report the state of the science on how values are discussed, reflected upon, and acted on by patients with HF, their FCGs, or both related to health-related decision making and coping.</p><p><strong>Method: </strong>A scoping review was conducted of empirical studies using the following keywords: \"heart failure,\" \"values,\" \"decision-making,\" and \"coping.\" PubMed, PsycINFO, and Scopus were searched from inception to June 2022 in English. Included articles reported values as a key finding (outcome/theme) in their abstract.</p><p><strong>Results: </strong>Of 448 articles screened for eligibility, 16 met the inclusion criteria. Twelve articles reported findings addressing patient values, 3 addressed patient and FCG values, and 1 addressed FCG values. Values were reported to influence patient self-care behaviors and left ventricular assist device (LVAD) implantation decisions, although their prioritization varied across time and contexts. When prioritized values conflicted with recommended self-care activities, some patients modified their approach to achieving the value. Others modified or abandoned tasks in favor of the value and accompanying goals. Low motivation and alignment between unhealthy behaviors and values often led to nonadherent decisions. Five of 8 articles focusing on cardiac devices reported patient survival as the most prioritized value during implantation decisions. FCG values were rarely reported or evaluated separately from patient values. Patients leveraged several coping strategies, although the processes through which values affected coping was not described.</p><p><strong>Conclusions: </strong>Prioritized values influenced HF-related decisions, including self-care and LVAD implantation. While several articles reported on coping and values, none described processes through which values affect coping, which highlights a research gap.</p><p><strong>Highlights: </strong>Family caregiver values were rarely reported or evaluated separately from patient values, highlighting a gap in the literature.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"508-520"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9430196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Testing Explanations for Skepticism of Personalized Risk Information. 个性化风险信息怀疑论的检验解释。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X231162824
Erika A Waters, Jennifer M Taber, Nicole Ackermann, Julia Maki, Amy M McQueen, Laura D Scherer

Background: The promise of precision medicine could be stymied if people do not accept the legitimacy of personalized risk information. We tested 4 explanations for skepticism of personalized diabetes risk information.

Method: We recruited participants (N = 356; Mage = 48.6 [s = 9.8], 85.1% women, 59.0% non-Hispanic white) from community locations (e.g., barbershops, churches) for a risk communication intervention. Participants received personalized information about their risk of developing diabetes and heart disease, stroke, colon cancer, and/or breast cancer (women). Then they completed survey items. We combined 2 items (recalled risk, perceived risk) to create a trichotomous risk skepticism variable (acceptance, overestimation, underestimation). Additional items assessed possible explanations for risk skepticism: 1) information evaluation skills (education, graph literacy, numeracy), 2) motivated reasoning (negative affect toward the information, spontaneous self-affirmation, information avoidance); 3) Bayesian updating (surprise), and 4) personal relevance (racial/ethnic identity). We used multinomial logistic regression for data analysis.

Results: Of the participants, 18% believed that their diabetes risk was lower than the information provided, 40% believed their risk was higher, and 42% accepted the information. Information evaluation skills were not supported as a risk skepticism explanation. Motivated reasoning received some support; higher diabetes risk and more negative affect toward the information were associated with risk underestimation, but spontaneous self-affirmation and information avoidance were not moderators. For Bayesian updating, more surprise was associated with overestimation. For personal relevance, belonging to a marginalized racial/ethnic group was associated with underestimation.

Conclusion: There are likely multiple cognitive, affective, and motivational explanations for risk skepticism. Understanding these explanations and developing interventions that address them will increase the effectiveness of precision medicine and facilitate its widespread implementation.

背景:如果人们不接受个性化风险信息的合法性,精准医疗的前景可能会受到阻碍。我们测试了对个性化糖尿病风险信息持怀疑态度的4种解释。方法:我们招募参与者(N = 356;法师= 48.6 [s = 9.8], 85.1%女性,59.0%非西班牙裔白人)来自社区场所(如理发店、教堂)进行风险沟通干预。参与者收到了关于他们患糖尿病、心脏病、中风、结肠癌和/或乳腺癌(女性)风险的个性化信息。然后他们完成调查项目。我们将两个项目(回忆风险,感知风险)结合起来,创造了一个三分法风险怀疑变量(接受,高估,低估)。附加项目评估了风险怀疑的可能解释:1)信息评估技能(教育,图形素养,计算能力),2)动机推理(对信息的负面影响,自发的自我肯定,信息回避);3)贝叶斯更新(惊喜)和4)个人相关性(种族/民族身份)。我们使用多项逻辑回归进行数据分析。结果:在参与者中,18%的人认为他们的糖尿病风险低于所提供的信息,40%的人认为他们的风险高于所提供的信息,42%的人接受了所提供的信息。信息评估技能不支持作为风险怀疑主义的解释。动机推理得到了一些支持;较高的糖尿病风险和对信息的负面影响与风险低估有关,但自发的自我肯定和信息回避不是调节因素。对于贝叶斯更新,更多的惊喜与高估有关。就个人而言,属于被边缘化的种族/族裔群体与被低估有关。结论:风险怀疑可能有多种认知、情感和动机解释。了解这些解释并制定解决这些问题的干预措施将提高精准医疗的有效性,并促进其广泛实施。
{"title":"Testing Explanations for Skepticism of Personalized Risk Information.","authors":"Erika A Waters,&nbsp;Jennifer M Taber,&nbsp;Nicole Ackermann,&nbsp;Julia Maki,&nbsp;Amy M McQueen,&nbsp;Laura D Scherer","doi":"10.1177/0272989X231162824","DOIUrl":"https://doi.org/10.1177/0272989X231162824","url":null,"abstract":"<p><strong>Background: </strong>The promise of precision medicine could be stymied if people do not accept the legitimacy of personalized risk information. We tested 4 explanations for skepticism of personalized diabetes risk information.</p><p><strong>Method: </strong>We recruited participants (<i>N</i> = 356; <i>M</i><sub>age</sub> = 48.6 [<i>s</i> = 9.8], 85.1% women, 59.0% non-Hispanic white) from community locations (e.g., barbershops, churches) for a risk communication intervention. Participants received personalized information about their risk of developing diabetes and heart disease, stroke, colon cancer, and/or breast cancer (women). Then they completed survey items. We combined 2 items (recalled risk, perceived risk) to create a trichotomous risk skepticism variable (acceptance, overestimation, underestimation). Additional items assessed possible explanations for risk skepticism: 1) <i>information evaluation skills</i> (education, graph literacy, numeracy), 2<i>) motivated reasoning</i> (negative affect toward the information, spontaneous self-affirmation, information avoidance); 3) <i>Bayesian updating</i> (surprise), and 4) <i>personal relevance</i> (racial/ethnic identity). We used multinomial logistic regression for data analysis.</p><p><strong>Results: </strong>Of the participants, 18% believed that their diabetes risk was lower than the information provided, 40% believed their risk was higher, and 42% accepted the information. Information evaluation skills were not supported as a risk skepticism explanation. Motivated reasoning received some support; higher diabetes risk and more negative affect toward the information were associated with risk underestimation, but spontaneous self-affirmation and information avoidance were not moderators. For Bayesian updating, more surprise was associated with overestimation. For personal relevance, belonging to a marginalized racial/ethnic group was associated with underestimation.</p><p><strong>Conclusion: </strong>There are likely multiple cognitive, affective, and motivational explanations for risk skepticism. Understanding these explanations and developing interventions that address them will increase the effectiveness of precision medicine and facilitate its widespread implementation.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"430-444"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164692/pdf/nihms-1877515.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9470812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Role of Confidence and Knowledge in Intentions to (Not) Seek Care for Hypertension: Evidence From a National Survey. 信心和知识在有意(不)寻求高血压护理中的作用:来自全国调查的证据。
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X221148196
Wändi Bruine de Bruin, Yasmina Okan, Tamar Krishnamurti, Mark D Huffman

Background: Hypertension (high blood pressure) is a modifiable risk factor for cardiovascular disease. However, patients may lack confidence in their understanding of what constitutes normal/healthy blood pressure, potentially affecting intentions to seek necessary care. The American Heart Association defines normal/healthy blood pressure as <120/80 mm Hg, with a 130/80 mm Hg threshold for hypertension diagnosis.

Methods: Our US sample (N = 6,592) included 1,342 adults with hypertension alone and 795 with hypertension and relevant comorbidities (heart disease, kidney disease, and diabetes mellitus). We assessed confidence in understanding blood pressure numbers, knowledge of thresholds for normal/healthy blood pressure ("normal or healthy blood pressure is below . . ."; counting 120-130/80 mm Hg as correct), and intentions to seek care for randomly assigned blood pressure readings of 142/91 (stage 2 hypertension), 132/69 (stage 1 hypertension), or 118/78 mm Hg (normal/healthy blood pressure).

Results: Among nonhypertensive participants, 55% expressed confidence in their understanding of blood pressure numbers, but only 36% knew the upper thresholds for normal/healthy blood pressure. Among participants with hypertension alone, 78% were confident while 47% were knowledgeable. Among participants with hypertension and comorbidities, 81% were confident and 40% were knowledgeable. Participants who were confident (v. not) were more likely to express intentions to act on stage 2 hypertension readings but less likely to express intentions to act on stage 1 readings, even after adjustment for knowledge, hypertension diagnosis, and sociodemographics.

Limitations: Confidence, knowledge, and intentions were each measured with 1 question.

Conclusions: Independent of knowledge, confidence was associated with greater willingness to act on stage 2 hypertension readings but reduced willingness to act on stage 1 hypertension readings. Interventions aiming to improve hypertension care-seeking behavior should improve confidence in accurate knowledge.

Highlights: Hypertension or high blood pressure is a major risk factor for heart disease.Most Americans do not know that normal/healthy blood pressure levels are ≤120/80 mm Hg, yet they are confident that they know this information.Inappropriate confidence in understanding of blood pressure numbers undermines intentions to seek care for stage 1 hypertension blood pressure readings.

背景:高血压是一种可改变的心血管疾病危险因素。然而,患者可能对正常/健康血压的理解缺乏信心,这可能会影响他们寻求必要护理的意愿。美国心脏协会将正常/健康血压定义为:方法:我们的美国样本(N = 6592)包括1342名单独患有高血压的成年人和795名高血压及相关合并症(心脏病、肾病和糖尿病)的成年人。我们评估了对血压数字的理解信心,对正常/健康血压阈值的认识(“正常或健康血压低于……”;将120-130/80毫米汞柱计算为正确),并在随机分配的血压读数为142/91(2期高血压)、132/69(1期高血压)或118/78毫米汞柱(正常/健康血压)时寻求护理。结果:在非高血压参与者中,55%的人对自己的血压数字表示有信心,但只有36%的人知道正常/健康血压的上限。在单独患有高血压的参与者中,78%的人有信心,47%的人有知识。在有高血压和合并症的参与者中,81%的人有信心,40%的人有知识。即使在调整了知识、高血压诊断和社会人口统计数据后,自信(或不自信)的参与者更有可能表达对第2阶段高血压读数采取行动的意愿,但对第1阶段读数采取行动的意愿较少。局限性:信心、知识和意图各用一个问题来衡量。结论:独立于知识之外,信心与更大的意愿对2期高血压读数采取行动相关,但降低了对1期高血压读数采取行动的意愿。旨在改善高血压求诊行为的干预措施应提高对准确知识的信心。重点:高血压是心脏病的主要危险因素。大多数美国人不知道正常/健康的血压水平是≤120/80毫米汞柱,但他们有信心知道这个信息。对血压数字理解的不适当的信心破坏了寻求1期高血压读数护理的意图。
{"title":"The Role of Confidence and Knowledge in Intentions to (Not) Seek Care for Hypertension: Evidence From a National Survey.","authors":"Wändi Bruine de Bruin,&nbsp;Yasmina Okan,&nbsp;Tamar Krishnamurti,&nbsp;Mark D Huffman","doi":"10.1177/0272989X221148196","DOIUrl":"https://doi.org/10.1177/0272989X221148196","url":null,"abstract":"<p><strong>Background: </strong>Hypertension (high blood pressure) is a modifiable risk factor for cardiovascular disease. However, patients may lack confidence in their understanding of what constitutes normal/healthy blood pressure, potentially affecting intentions to seek necessary care. The American Heart Association defines normal/healthy blood pressure as <120/80 mm Hg, with a 130/80 mm Hg threshold for hypertension diagnosis.</p><p><strong>Methods: </strong>Our US sample (<i>N</i> = 6,592) included 1,342 adults with hypertension alone and 795 with hypertension and relevant comorbidities (heart disease, kidney disease, and diabetes mellitus). We assessed confidence in understanding blood pressure numbers, knowledge of thresholds for normal/healthy blood pressure (\"normal or healthy blood pressure is below . . .\"; counting 120-130/80 mm Hg as correct), and intentions to seek care for randomly assigned blood pressure readings of 142/91 (stage 2 hypertension), 132/69 (stage 1 hypertension), or 118/78 mm Hg (normal/healthy blood pressure).</p><p><strong>Results: </strong>Among nonhypertensive participants, 55% expressed confidence in their understanding of blood pressure numbers, but only 36% knew the upper thresholds for normal/healthy blood pressure. Among participants with hypertension alone, 78% were confident while 47% were knowledgeable. Among participants with hypertension and comorbidities, 81% were confident and 40% were knowledgeable. Participants who were confident (v. not) were more likely to express intentions to act on stage 2 hypertension readings but less likely to express intentions to act on stage 1 readings, even after adjustment for knowledge, hypertension diagnosis, and sociodemographics.</p><p><strong>Limitations: </strong>Confidence, knowledge, and intentions were each measured with 1 question.</p><p><strong>Conclusions: </strong>Independent of knowledge, confidence was associated with greater willingness to act on stage 2 hypertension readings but reduced willingness to act on stage 1 hypertension readings. Interventions aiming to improve hypertension care-seeking behavior should improve confidence in accurate knowledge.</p><p><strong>Highlights: </strong>Hypertension or high blood pressure is a major risk factor for heart disease.Most Americans do not know that normal/healthy blood pressure levels are ≤120/80 mm Hg, yet they are confident that they know this information.Inappropriate confidence in understanding of blood pressure numbers undermines intentions to seek care for stage 1 hypertension blood pressure readings.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"461-477"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164674/pdf/nihms-1857886.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9489823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Qualitative Exploration of General Practitioners' Treatment Decision-Making for Depressive Symptoms. 全科医生抑郁症状治疗决策的定性探讨
IF 3.6 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1177/0272989X231166009
Alex Stallman, Nicola Sheeran, Mark Boschen

Background: General practitioners (GPs) provide the most antidepressant prescriptions and psychologist referrals in Australia, yet little is known about how they decide between treatments for depressive symptoms.

Aims: This study examined the decision cues that GPs use when deciding how to treat depressive symptoms and the meaning they attribute to these associations.

Methods: Structured interviews were conducted with 16 Australian GPs in a "think-aloud" verbal protocol analysis format. The transcripts were analyzed using content coding and thematic analysis, informed by the dual processes model of decision making.

Results: Participants associated prescribing antidepressants with severe depressive symptoms, and psychologist referrals were the preferred initial treatment provided patients were willing to engage. Four main themes emerged from the thematic analysis: 1) psychologist as default, 2) the risk is just too high, 3) medication as supplement, and 4) drivers of antidepressants. Contrary to previous findings, participants identified a strong heuristic association between depressive symptoms and psychologist referral. Antidepressant prescription was associated with severe symptoms, higher risk, and a cluster of cues that lead them away from psychologist referral.

Conclusions: Participants demonstrated an oversensitivity to depressive symptom severity, associating psychologist referrals with subclinical depressive symptoms, and starting antidepressants for suicidal ideation and significant functional decline.

Highlights: Psychologist referrals were the default preference for GPs when treating depressive symptoms, whereas antidepressants were reserved for patients with elevated risk from severe depressive symptoms and suicidal ideation.Participants' conceptualization of depression severity was oversensitive compared with treatment guidelines.Contrary to treatment guidelines, GPs in this study demonstrated their discomfort for referring patients with suicidal ideation to a psychologist without initiating antidepressants.GPs should consider whether patients within their mild to moderate assessment range can be treated exclusively with more cost-effective means than psychological therapy such as e-mental health programs, guided self-help, and lifestyle changes alone.

背景:在澳大利亚,全科医生(gp)提供了最多的抗抑郁药物处方和心理学家推荐,但他们如何决定治疗抑郁症状的方法却鲜为人知。目的:本研究考察了全科医生在决定如何治疗抑郁症状时使用的决策线索,以及他们赋予这些关联的意义。方法:以“有声思考”口头协议分析格式对16名澳大利亚全科医生进行结构化访谈。在决策的双重过程模型的指导下,使用内容编码和主题分析对转录本进行分析。结果:参与者将处方抗抑郁药与严重抑郁症状联系起来,如果患者愿意参与,心理学家推荐是首选的初始治疗。从主题分析中出现了四个主要主题:1)心理学家默认,2)风险太高,3)药物作为补充,4)抗抑郁药的驱动因素。与先前的研究结果相反,参与者发现抑郁症状与心理医生转诊之间存在强烈的启发式关联。抗抑郁药处方与严重的症状、更高的风险以及一系列导致他们不去看心理医生的线索有关。结论:参与者表现出对抑郁症状严重程度的过度敏感,将心理医生转诊与亚临床抑郁症状联系起来,并因自杀意念和显著的功能衰退而开始服用抗抑郁药物。重点:心理医生是全科医生在治疗抑郁症状时的默认首选,而抗抑郁药是为严重抑郁症状和自杀意念风险升高的患者保留的。与治疗指南相比,参与者对抑郁严重程度的概念化过于敏感。与治疗指南相反,在这项研究中,全科医生对将有自杀念头的患者转介给心理学家而不开始服用抗抑郁药表示不舒服。全科医生应考虑在轻度至中度评估范围内的患者是否可以采用比心理治疗(如电子心理健康项目、指导自助和单独改变生活方式)更具成本效益的方法进行治疗。
{"title":"A Qualitative Exploration of General Practitioners' Treatment Decision-Making for Depressive Symptoms.","authors":"Alex Stallman,&nbsp;Nicola Sheeran,&nbsp;Mark Boschen","doi":"10.1177/0272989X231166009","DOIUrl":"https://doi.org/10.1177/0272989X231166009","url":null,"abstract":"<p><strong>Background: </strong>General practitioners (GPs) provide the most antidepressant prescriptions and psychologist referrals in Australia, yet little is known about how they decide between treatments for depressive symptoms.</p><p><strong>Aims: </strong>This study examined the decision cues that GPs use when deciding how to treat depressive symptoms and the meaning they attribute to these associations.</p><p><strong>Methods: </strong>Structured interviews were conducted with 16 Australian GPs in a \"think-aloud\" verbal protocol analysis format. The transcripts were analyzed using content coding and thematic analysis, informed by the dual processes model of decision making.</p><p><strong>Results: </strong>Participants associated prescribing antidepressants with severe depressive symptoms, and psychologist referrals were the preferred initial treatment provided patients were willing to engage. Four main themes emerged from the thematic analysis: 1) psychologist as default, 2) the risk is just too high, 3) medication as supplement, and 4) drivers of antidepressants. Contrary to previous findings, participants identified a strong heuristic association between depressive symptoms and psychologist referral. Antidepressant prescription was associated with severe symptoms, higher risk, and a cluster of cues that lead them away from psychologist referral.</p><p><strong>Conclusions: </strong>Participants demonstrated an oversensitivity to depressive symptom severity, associating psychologist referrals with subclinical depressive symptoms, and starting antidepressants for suicidal ideation and significant functional decline.</p><p><strong>Highlights: </strong>Psychologist referrals were the default preference for GPs when treating depressive symptoms, whereas antidepressants were reserved for patients with elevated risk from severe depressive symptoms and suicidal ideation.Participants' conceptualization of depression severity was oversensitive compared with treatment guidelines.Contrary to treatment guidelines, GPs in this study demonstrated their discomfort for referring patients with suicidal ideation to a psychologist without initiating antidepressants.GPs should consider whether patients within their mild to moderate assessment range can be treated exclusively with more cost-effective means than psychological therapy such as e-mental health programs, guided self-help, and lifestyle changes alone.</p>","PeriodicalId":49839,"journal":{"name":"Medical Decision Making","volume":"43 4","pages":"498-507"},"PeriodicalIF":3.6,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164610/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9430194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Medical Decision Making
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1