首页 > 最新文献

Epidemiologic Reviews最新文献

英文 中文
Randomized Trials With Repeatedly Measured Outcomes: Handling Irregular and Potentially Informative Assessment Times. 重复测量结果的随机试验:处理不规则和潜在的信息评估时间。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac010
Eleanor M Pullenayegum, Daniel O Scharfstein

Randomized trials are often designed to collect outcomes at fixed points in time after randomization. In practice, the number and timing of outcome assessments can vary among participants (i.e., irregular assessment). In fact, the timing of assessments may be associated with the outcome of interest (i.e., informative assessment). For example, in a trial evaluating the effectiveness of treatments for major depressive disorder, not only did the timings of outcome assessments vary among participants but symptom scores were associated with assessment frequency. This type of informative observation requires appropriate statistical analysis. Although analytic methods have been developed, they are rarely used. In this article, we review the literature on irregular assessments with a view toward developing recommendations for analyzing trials with irregular and potentially informative assessment times. We show how the choice of analytic approach hinges on assumptions about the relationship between the assessment and outcome processes. We argue that irregular assessment should be treated with the same care as missing data, and we propose that trialists adopt strategies to minimize the extent of irregularity; describe the extent of irregularity in assessment times; make their assumptions about the relationships between assessment times and outcomes explicit; adopt analytic techniques that are appropriate to their assumptions; and assess the sensitivity of trial results to their assumptions.

随机化试验通常被设计为在随机化后的固定时间点收集结果。在实践中,结果评估的数量和时间可能因参与者而异(即不定期评估)。事实上,评估的时间可能与感兴趣的结果(即信息性评估)有关。例如,在一项评估重度抑郁障碍治疗有效性的试验中,参与者之间不仅结果评估的时间不同,而且症状评分与评估频率相关。这种类型的信息性观察需要适当的统计分析。尽管分析方法已经发展起来,但很少使用。在这篇文章中,我们回顾了关于不规则评估的文献,以期为分析具有不规则和潜在信息评估时间的试验制定建议。我们展示了分析方法的选择如何取决于对评估和结果过程之间关系的假设。我们认为,应该像对待缺失数据一样谨慎对待不规则评估,我们建议试验人员采取策略,最大限度地减少不规则的程度;描述评估时间的不规则程度;明确他们对评估时间和结果之间关系的假设;采用适合其假设的分析技术;并评估试验结果对其假设的敏感性。
{"title":"Randomized Trials With Repeatedly Measured Outcomes: Handling Irregular and Potentially Informative Assessment Times.","authors":"Eleanor M Pullenayegum,&nbsp;Daniel O Scharfstein","doi":"10.1093/epirev/mxac010","DOIUrl":"10.1093/epirev/mxac010","url":null,"abstract":"<p><p>Randomized trials are often designed to collect outcomes at fixed points in time after randomization. In practice, the number and timing of outcome assessments can vary among participants (i.e., irregular assessment). In fact, the timing of assessments may be associated with the outcome of interest (i.e., informative assessment). For example, in a trial evaluating the effectiveness of treatments for major depressive disorder, not only did the timings of outcome assessments vary among participants but symptom scores were associated with assessment frequency. This type of informative observation requires appropriate statistical analysis. Although analytic methods have been developed, they are rarely used. In this article, we review the literature on irregular assessments with a view toward developing recommendations for analyzing trials with irregular and potentially informative assessment times. We show how the choice of analytic approach hinges on assumptions about the relationship between the assessment and outcome processes. We argue that irregular assessment should be treated with the same care as missing data, and we propose that trialists adopt strategies to minimize the extent of irregularity; describe the extent of irregularity in assessment times; make their assumptions about the relationships between assessment times and outcomes explicit; adopt analytic techniques that are appropriate to their assumptions; and assess the sensitivity of trial results to their assumptions.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"121-137"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362939/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9854724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Comparing the Value of Data Visualization Methods for Communicating Harms in Clinical Trials. 比较数据可视化方法在临床试验中危害沟通中的价值。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac005
Riaz Qureshi, Xiwei Chen, Carsten Goerg, Evan Mayo-Wilson, Stephanie Dickinson, Lilian Golzarri-Arroyo, Hwanhee Hong, Rachel Phillips, Victoria Cornelius, Mara Mc Adams DeMarco, Eliseo Guallar, Tianjing Li

In clinical trials, harms (i.e., adverse events) are often reported by simply counting the number of people who experienced each event. Reporting only frequencies ignores other dimensions of the data that are important for stakeholders, including severity, seriousness, rate (recurrence), timing, and groups of related harms. Additionally, application of selection criteria to harms prevents most from being reported. Visualization of data could improve communication of multidimensional data. We replicated and compared the characteristics of 6 different approaches for visualizing harms: dot plot, stacked bar chart, volcano plot, heat map, treemap, and tendril plot. We considered binary events using individual participant data from a randomized trial of gabapentin for neuropathic pain. We assessed their value using a heuristic approach and a group of content experts. We produced all figures using R and share the open-source code on GitHub. Most original visualizations propose presenting individual harms (e.g., dizziness, somnolence) alone or alongside higher level (e.g., by body systems) summaries of harms, although they could be applied at either level. Visualizations can present different dimensions of all harms observed in trials. Except for the tendril plot, all other plots do not require individual participant data. The dot plot and volcano plot are favored as visualization approaches to present an overall summary of harms data. Our value assessment found the dot plot and volcano plot were favored by content experts. Using visualizations to report harms could improve communication. Trialists can use our provided code to easily implement these approaches.

在临床试验中,危害(即不良事件)通常通过简单地计算经历每种事件的人数来报告。仅报告频率忽略了对利益相关者很重要的数据的其他维度,包括严重程度、严重性、发生率(复发)、时间和相关危害的群体。此外,选择标准对危害的应用阻止了大多数被报告。数据的可视化可以改善多维数据的交流。我们复制并比较了6种不同的危害可视化方法的特点:点图、堆叠条形图、火山图、热图、树状图和卷尾图。我们使用加巴喷丁治疗神经性疼痛的随机试验的个体参与者数据来考虑二元事件。我们使用启发式方法和一组内容专家来评估它们的价值。我们使用R生成了所有的图形,并在GitHub上分享了开源代码。大多数原始的可视化建议单独呈现个体危害(例如,头晕,嗜睡)或与更高层次(例如,身体系统)危害摘要一起,尽管它们可以在任何一个层次上应用。可视化可以呈现试验中观察到的所有危害的不同维度。除卷须图外,其他图均不需要参与者的个人数据。点阵图和火山图是最受欢迎的可视化方法,以呈现危害数据的总体总结。我们的价值评估发现,点图和火山图受到内容专家的青睐。使用可视化报告危害可以改善沟通。试用者可以使用我们提供的代码轻松实现这些方法。
{"title":"Comparing the Value of Data Visualization Methods for Communicating Harms in Clinical Trials.","authors":"Riaz Qureshi,&nbsp;Xiwei Chen,&nbsp;Carsten Goerg,&nbsp;Evan Mayo-Wilson,&nbsp;Stephanie Dickinson,&nbsp;Lilian Golzarri-Arroyo,&nbsp;Hwanhee Hong,&nbsp;Rachel Phillips,&nbsp;Victoria Cornelius,&nbsp;Mara Mc Adams DeMarco,&nbsp;Eliseo Guallar,&nbsp;Tianjing Li","doi":"10.1093/epirev/mxac005","DOIUrl":"https://doi.org/10.1093/epirev/mxac005","url":null,"abstract":"<p><p>In clinical trials, harms (i.e., adverse events) are often reported by simply counting the number of people who experienced each event. Reporting only frequencies ignores other dimensions of the data that are important for stakeholders, including severity, seriousness, rate (recurrence), timing, and groups of related harms. Additionally, application of selection criteria to harms prevents most from being reported. Visualization of data could improve communication of multidimensional data. We replicated and compared the characteristics of 6 different approaches for visualizing harms: dot plot, stacked bar chart, volcano plot, heat map, treemap, and tendril plot. We considered binary events using individual participant data from a randomized trial of gabapentin for neuropathic pain. We assessed their value using a heuristic approach and a group of content experts. We produced all figures using R and share the open-source code on GitHub. Most original visualizations propose presenting individual harms (e.g., dizziness, somnolence) alone or alongside higher level (e.g., by body systems) summaries of harms, although they could be applied at either level. Visualizations can present different dimensions of all harms observed in trials. Except for the tendril plot, all other plots do not require individual participant data. The dot plot and volcano plot are favored as visualization approaches to present an overall summary of harms data. Our value assessment found the dot plot and volcano plot were favored by content experts. Using visualizations to report harms could improve communication. Trialists can use our provided code to easily implement these approaches.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"55-66"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/b8/d7/mxac005.PMC9780120.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10442120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Qualitative Scoping Review of Early-Terminated Clinical Trials Sponsored by the Department of Veterans Affairs Cooperative Studies Program From 2010 to 2020. 2010年至2020年退伍军人事务部合作研究项目赞助的早期终止临床试验的定性范围审查。
IF 5.2 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac009
Alexa Goldberg, Ludmila N Bakhireva, Kimberly Page, Adam M Henrie

Increasing attention has been paid to the risks and benefits of terminating large clinical trials before reaching prespecified targets, because such decisions can greatly affect the implementation of findings. The Department of Veterans Affairs (VA) Cooperative Studies Program (CSP) is a research infrastructure dedicated to conducting high-quality clinical research. A scoping review was performed to characterize barriers preventing the attainment of prespecified recruitment, statistical power, or sample-size targets in VA CSP trials. A trial was eligible for inclusion if the trial was sponsored by the VA CSP, primary findings were published within the last 10 years, and a decision was made to terminate enrollment or follow-up before meeting a priori recruitment or endpoint targets. In 11 of 29 included trials (37.9%), a decision was made to terminate the trial early. The most common reason for early termination was related to under-recruitment (n = 5). Other reasons included early detection of safety signals (n = 2), futility (n = 1), and benefit (n = 1). This review highlights recruitment as a critical facet of trial conduct that may hinder the production of high-quality data and thus warrant additional attention. Solutions to enhance recruitment now implemented by the VA CSP, including dedicated enrollment infrastructure and screening facilitated by informatics approaches, show promise in reducing this cause for early termination.

人们越来越关注在达到预先指定的目标之前终止大型临床试验的风险和益处,因为这样的决定会极大地影响研究结果的实施。退伍军人事务部(VA)合作研究计划(CSP)是一个致力于进行高质量临床研究的研究基础设施。进行了范围界定审查,以确定在VA CSP试验中阻碍实现预先指定的招募、统计能力或样本量目标的障碍。如果试验由VA CSP赞助,主要研究结果在过去10年内公布,并且在达到先验招募或终点目标之前决定终止招募或随访,则该试验有资格入选。在29项纳入的试验中,有11项(37.9%)决定提前终止试验。提前终止合同的最常见原因与招聘不足有关(n=5)。其他原因包括早期检测到安全信号(n=2)、无效性(n=1)和益处(n=1)。这项审查强调,招聘是审判行为的一个关键方面,可能会阻碍高质量数据的产生,因此需要更多关注。VA CSP目前实施的加强招聘的解决方案,包括专门的招生基础设施和信息学方法促进的筛查,有望减少提前终止的原因。
{"title":"A Qualitative Scoping Review of Early-Terminated Clinical Trials Sponsored by the Department of Veterans Affairs Cooperative Studies Program From 2010 to 2020.","authors":"Alexa Goldberg, Ludmila N Bakhireva, Kimberly Page, Adam M Henrie","doi":"10.1093/epirev/mxac009","DOIUrl":"10.1093/epirev/mxac009","url":null,"abstract":"<p><p>Increasing attention has been paid to the risks and benefits of terminating large clinical trials before reaching prespecified targets, because such decisions can greatly affect the implementation of findings. The Department of Veterans Affairs (VA) Cooperative Studies Program (CSP) is a research infrastructure dedicated to conducting high-quality clinical research. A scoping review was performed to characterize barriers preventing the attainment of prespecified recruitment, statistical power, or sample-size targets in VA CSP trials. A trial was eligible for inclusion if the trial was sponsored by the VA CSP, primary findings were published within the last 10 years, and a decision was made to terminate enrollment or follow-up before meeting a priori recruitment or endpoint targets. In 11 of 29 included trials (37.9%), a decision was made to terminate the trial early. The most common reason for early termination was related to under-recruitment (n = 5). Other reasons included early detection of safety signals (n = 2), futility (n = 1), and benefit (n = 1). This review highlights recruitment as a critical facet of trial conduct that may hinder the production of high-quality data and thus warrant additional attention. Solutions to enhance recruitment now implemented by the VA CSP, including dedicated enrollment infrastructure and screening facilitated by informatics approaches, show promise in reducing this cause for early termination.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"110-120"},"PeriodicalIF":5.2,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362930/pdf/mxac009.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10211471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Review of the Ring Trial Design for Evaluating Ring Interventions for Infectious Diseases. 传染病环形干预措施评价的环形试验设计综述
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac003
Zachary Butzin-Dozier, Tejas S Athni, Jade Benjamin-Chung

In trials of infectious disease interventions, rare outcomes and unpredictable spatiotemporal variation can introduce bias, reduce statistical power, and prevent conclusive inferences. Spillover effects can complicate inference if individual randomization is used to gain efficiency. Ring trials are a type of cluster-randomized trial that may increase efficiency and minimize bias, particularly in emergency and elimination settings with strong clustering of infection. They can be used to evaluate ring interventions, which are delivered to individuals in proximity to or contact with index cases. We conducted a systematic review of ring trials, compare them with other trial designs for evaluating ring interventions, and describe strengths and weaknesses of each design. Of 849 articles and 322 protocols screened, we identified 26 ring trials, 15 cluster-randomized trials, 5 trials that randomized households or individuals within rings, and 1 individually randomized trial. The most common interventions were postexposure prophylaxis (n = 23) and focal mass drug administration and screening and treatment (n = 7). Ring trials require robust surveillance systems and contact tracing for directly transmitted diseases. For rare diseases with strong spatiotemporal clustering, they may have higher efficiency and internal validity than cluster-randomized designs, in part because they ensure that no clusters are excluded from analysis due to zero cluster incidence. Though more research is needed to compare them with other types of trials, ring trials hold promise as a design that can increase trial speed and efficiency while reducing bias.

在传染病干预试验中,罕见的结果和不可预测的时空变化可能导致偏差,降低统计效力,并阻止结论性推论。如果使用个体随机化来提高效率,溢出效应会使推理复杂化。环形试验是一种群集随机试验,可提高效率并最大限度地减少偏差,特别是在感染聚集性强的紧急和消除环境中。它们可用于评估向接近或接触指示病例的个人提供的环形干预措施。我们对环形试验进行了系统回顾,将其与其他试验设计进行比较,以评估环形干预措施,并描述每种设计的优点和缺点。在筛选的849篇文章和322个方案中,我们确定了26个环形试验,15个集群随机试验,5个随机分组试验和1个单独随机试验。最常见的干预措施是暴露后预防(n = 23)和局点群体给药以及筛查和治疗(n = 7)。环形试验需要强有力的监测系统和直接传播疾病的接触者追踪。对于具有较强时空聚类的罕见病,它们可能比聚类随机设计具有更高的效率和内部效度,部分原因是它们确保没有因聚类发生率为零而被排除在分析之外的聚类。虽然需要更多的研究来将它们与其他类型的试验进行比较,但环形试验有望成为一种可以提高试验速度和效率,同时减少偏倚的设计。
{"title":"A Review of the Ring Trial Design for Evaluating Ring Interventions for Infectious Diseases.","authors":"Zachary Butzin-Dozier,&nbsp;Tejas S Athni,&nbsp;Jade Benjamin-Chung","doi":"10.1093/epirev/mxac003","DOIUrl":"https://doi.org/10.1093/epirev/mxac003","url":null,"abstract":"<p><p>In trials of infectious disease interventions, rare outcomes and unpredictable spatiotemporal variation can introduce bias, reduce statistical power, and prevent conclusive inferences. Spillover effects can complicate inference if individual randomization is used to gain efficiency. Ring trials are a type of cluster-randomized trial that may increase efficiency and minimize bias, particularly in emergency and elimination settings with strong clustering of infection. They can be used to evaluate ring interventions, which are delivered to individuals in proximity to or contact with index cases. We conducted a systematic review of ring trials, compare them with other trial designs for evaluating ring interventions, and describe strengths and weaknesses of each design. Of 849 articles and 322 protocols screened, we identified 26 ring trials, 15 cluster-randomized trials, 5 trials that randomized households or individuals within rings, and 1 individually randomized trial. The most common interventions were postexposure prophylaxis (n = 23) and focal mass drug administration and screening and treatment (n = 7). Ring trials require robust surveillance systems and contact tracing for directly transmitted diseases. For rare diseases with strong spatiotemporal clustering, they may have higher efficiency and internal validity than cluster-randomized designs, in part because they ensure that no clusters are excluded from analysis due to zero cluster incidence. Though more research is needed to compare them with other types of trials, ring trials hold promise as a design that can increase trial speed and efficiency while reducing bias.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"29-54"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362935/pdf/mxac003.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9856188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Addressing Health Inequities in Digital Clinical Trials: A Review of Challenges and Solutions From the Field of HIV Research. 解决数字临床试验中的卫生不公平:艾滋病毒研究领域的挑战和解决方案综述。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac008
Andrea L Wirtz, Carmen H Logie, Lawrence Mbuagbaw

Clinical trials are considered the gold standard for establishing efficacy of health interventions, thus determining which interventions are brought to scale in health care and public health programs. Digital clinical trials, broadly defined as trials that have partial to full integration of technology across implementation, interventions, and/or data collection, are valued for increased efficiencies as well as testing of digitally delivered interventions. Although recent reviews have described the advantages and disadvantages of and provided recommendations for improving scientific rigor in the conduct of digital clinical trials, few to none have investigated how digital clinical trials address the digital divide, whether they are equitably accessible, and if trial outcomes are potentially beneficial only to those with optimal and consistent access to technology. Human immunodeficiency virus (HIV), among other health conditions, disproportionately affects socially and economically marginalized populations, raising questions of whether interventions found to be efficacious in digital clinical trials and subsequently brought to scale will sufficiently and consistently reach and provide benefit to these populations. We reviewed examples from HIV research from across geographic settings to describe how digital clinical trials can either reproduce or mitigate health inequities via the design and implementation of the digital clinical trials and, ultimately, the programs that result. We discuss how digital clinical trials can be intentionally designed to prevent inequities, monitor ongoing access and utilization, and assess for differential impacts among subgroups with diverse technology access and use. These findings can be generalized to many other health fields and are practical considerations for donors, investigators, reviewers, and ethics committees engaged in digital clinical trials.

临床试验被认为是确定卫生干预措施有效性的黄金标准,从而确定哪些干预措施在卫生保健和公共卫生计划中具有规模。数字化临床试验被广泛定义为在实施、干预和/或数据收集过程中部分或完全整合技术的试验,其价值在于提高效率以及测试数字化交付的干预措施。尽管最近的评论描述了数字临床试验的优点和缺点,并为提高进行数字临床试验的科学严谨性提供了建议,但很少或根本没有调查数字临床试验如何解决数字鸿沟,它们是否公平可及,以及试验结果是否只对那些具有最佳和持续获取技术的人有益。除其他健康状况外,人类免疫缺陷病毒(艾滋病毒)对社会和经济边缘化人群的影响尤为严重,这就提出了以下问题:在数字临床试验中发现的有效干预措施并随后大规模推广,是否能够充分和持续地惠及这些人群并为其带来益处。我们回顾了来自不同地理环境的艾滋病毒研究的例子,以描述数字临床试验如何通过数字临床试验的设计和实施以及最终产生的项目来再现或减轻健康不平等。我们讨论了如何有意识地设计数字临床试验,以防止不公平,监测正在进行的获取和利用,并评估不同技术获取和使用的亚组之间的差异影响。这些发现可以推广到许多其他健康领域,并且是从事数字临床试验的捐助者、研究者、审稿人和伦理委员会的实际考虑因素。
{"title":"Addressing Health Inequities in Digital Clinical Trials: A Review of Challenges and Solutions From the Field of HIV Research.","authors":"Andrea L Wirtz,&nbsp;Carmen H Logie,&nbsp;Lawrence Mbuagbaw","doi":"10.1093/epirev/mxac008","DOIUrl":"https://doi.org/10.1093/epirev/mxac008","url":null,"abstract":"<p><p>Clinical trials are considered the gold standard for establishing efficacy of health interventions, thus determining which interventions are brought to scale in health care and public health programs. Digital clinical trials, broadly defined as trials that have partial to full integration of technology across implementation, interventions, and/or data collection, are valued for increased efficiencies as well as testing of digitally delivered interventions. Although recent reviews have described the advantages and disadvantages of and provided recommendations for improving scientific rigor in the conduct of digital clinical trials, few to none have investigated how digital clinical trials address the digital divide, whether they are equitably accessible, and if trial outcomes are potentially beneficial only to those with optimal and consistent access to technology. Human immunodeficiency virus (HIV), among other health conditions, disproportionately affects socially and economically marginalized populations, raising questions of whether interventions found to be efficacious in digital clinical trials and subsequently brought to scale will sufficiently and consistently reach and provide benefit to these populations. We reviewed examples from HIV research from across geographic settings to describe how digital clinical trials can either reproduce or mitigate health inequities via the design and implementation of the digital clinical trials and, ultimately, the programs that result. We discuss how digital clinical trials can be intentionally designed to prevent inequities, monitor ongoing access and utilization, and assess for differential impacts among subgroups with diverse technology access and use. These findings can be generalized to many other health fields and are practical considerations for donors, investigators, reviewers, and ethics committees engaged in digital clinical trials.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"87-109"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362940/pdf/mxac008.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10632611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Econometric Issues in Prospective Economic Evaluations Alongside Clinical Trials: Combining the Nonparametric Bootstrap With Methods That Address Missing Data. 与临床试验一起的前瞻性经济评估中的计量经济学问题:结合非参数Bootstrap与解决缺失数据的方法。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac006
Ali Jalali, Rulla M Tamimi, Sterling M McPherson, Sean M Murphy

Prospective economic evaluations conducted alongside clinical trials have become an increasingly popular approach in evaluating the cost-effectiveness of a public health initiative or treatment intervention. These types of economic studies provide improved internal validity and accuracy of cost and effectiveness estimates of health interventions and, compared with simulation or decision-analytic models, have the advantage of jointly observing health and economics outcomes of trial participants. However, missing data due to incomplete response or patient attrition, and sampling uncertainty are common concerns in econometric analysis of clinical trials. Missing data are a particular problem for comparative effectiveness trials of substance use disorder interventions. Multiple imputation and inverse probability weighting are 2 widely recommended methods to address missing data bias, and the nonparametric bootstrap is recommended to address uncertainty in predicted mean cost and effectiveness between trial interventions. Although these methods have been studied extensively by themselves, little is known about how to appropriately combine them and about the potential pitfalls and advantages of different approaches. We provide a review of statistical methods used in 29 economic evaluations of substance use disorder intervention identified from 4 published systematic reviews and a targeted search of the literature. We evaluate how each study addressed missing data bias, whether the recommended nonparametric bootstrap was used, how these 2 methods were combined, and conclude with recommendations for future research.

与临床试验同时进行的前瞻性经济评估已成为评估公共卫生倡议或治疗干预措施成本效益的一种日益流行的方法。这些类型的经济研究提高了卫生干预措施成本和有效性估计的内部有效性和准确性,与模拟或决策分析模型相比,具有联合观察试验参与者的健康和经济结果的优势。然而,在临床试验的计量经济学分析中,由于反应不完全或患者流失而导致的数据缺失和抽样不确定性是常见的问题。缺少数据是物质使用障碍干预的比较有效性试验的一个特殊问题。多重插值和逆概率加权是解决缺失数据偏差的两种广泛推荐的方法,而非参数自举被推荐用于解决试验干预之间预测平均成本和有效性的不确定性。虽然这些方法本身已被广泛研究,但人们对如何适当地将它们结合起来以及不同方法的潜在缺陷和优势知之甚少。我们回顾了从4篇已发表的系统综述和有针对性的文献检索中确定的29项物质使用障碍干预经济评估中使用的统计方法。我们评估了每项研究是如何解决缺失数据偏差的,是否使用了推荐的非参数bootstrap,这两种方法是如何结合的,并总结了对未来研究的建议。
{"title":"Econometric Issues in Prospective Economic Evaluations Alongside Clinical Trials: Combining the Nonparametric Bootstrap With Methods That Address Missing Data.","authors":"Ali Jalali,&nbsp;Rulla M Tamimi,&nbsp;Sterling M McPherson,&nbsp;Sean M Murphy","doi":"10.1093/epirev/mxac006","DOIUrl":"https://doi.org/10.1093/epirev/mxac006","url":null,"abstract":"<p><p>Prospective economic evaluations conducted alongside clinical trials have become an increasingly popular approach in evaluating the cost-effectiveness of a public health initiative or treatment intervention. These types of economic studies provide improved internal validity and accuracy of cost and effectiveness estimates of health interventions and, compared with simulation or decision-analytic models, have the advantage of jointly observing health and economics outcomes of trial participants. However, missing data due to incomplete response or patient attrition, and sampling uncertainty are common concerns in econometric analysis of clinical trials. Missing data are a particular problem for comparative effectiveness trials of substance use disorder interventions. Multiple imputation and inverse probability weighting are 2 widely recommended methods to address missing data bias, and the nonparametric bootstrap is recommended to address uncertainty in predicted mean cost and effectiveness between trial interventions. Although these methods have been studied extensively by themselves, little is known about how to appropriately combine them and about the potential pitfalls and advantages of different approaches. We provide a review of statistical methods used in 29 economic evaluations of substance use disorder intervention identified from 4 published systematic reviews and a targeted search of the literature. We evaluate how each study addressed missing data bias, whether the recommended nonparametric bootstrap was used, how these 2 methods were combined, and conclude with recommendations for future research.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"67-77"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362933/pdf/mxac006.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10600730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Inclusionary Trials: A Review of Lessons Not Learned. 纳入试验:回顾未吸取的教训。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac007
Paris B Adkins-Jackson, Nancy J Burke, Patricia Rodriguez Espinosa, Juliana M Ison, Susan D Goold, Lisa G Rosas, Chyke A Doubeni, The Stop Covid-California Alliance Trial Participation And Vaccine Hesitancy Working Groups, Arleen F Brown

The COVID-19 pandemic revealed weaknesses in the public health infrastructure of the United States, including persistent barriers to engaging marginalized communities toward inclusion in clinical research, including trials. Inclusive participation in clinical trials is crucial for promoting vaccine confidence, public trust, and addressing disparate health outcomes. A long-standing body of literature describes the value of community-based participatory research in increasing marginalized community participation in research. Community-based participatory research emphasizes shared leadership with community members in all phases of the research process, including in the planning and implementation, interpretation, and dissemination. Shared leadership between academic and industry with marginalized communities can assist with inclusive participation in vaccine trials and increase public trust in the development of the vaccines and other therapies used during public emergencies. Nevertheless, epidemiologic and clinical research do not yet have a strong culture of community partnership in the scientific process, which takes time to build and therefore may be difficult to develop and rapidly scale to respond to the pandemic. We outline practices that contribute to a lack of inclusive participation and suggest steps that trialists and other researchers can take to increase marginalized communities' participation in research. Practices include planning for community engagement during the planning and recruitment phases, having regular dialogues with communities about their priorities, supporting them throughout a study, and navigating complex structural determinants of health. Additionally, we discuss how research institutions can support inclusive practices by reexamining their policies to increase participation in clinical trials and instilling institutional trustworthiness.

2019冠状病毒病大流行暴露了美国公共卫生基础设施的弱点,包括在让边缘化社区参与包括试验在内的临床研究方面存在持续障碍。临床试验的包容性参与对于促进疫苗信心、公众信任和解决不同的健康结果至关重要。长期存在的文献描述了社区参与性研究在增加边缘化社区参与研究方面的价值。基于社区的参与性研究强调在研究过程的所有阶段,包括在规划和执行、解释和传播方面,与社区成员共同领导。学术界和产业界与边缘化社区共同发挥领导作用,有助于包容性地参与疫苗试验,并增加公众对开发在突发公共事件期间使用的疫苗和其他疗法的信任。然而,流行病学和临床研究在科学进程中尚未形成强有力的社区伙伴关系文化,这种文化需要时间来建立,因此可能难以发展和迅速扩大规模,以应对这一流行病。我们概述了导致缺乏包容性参与的做法,并提出了试验人员和其他研究人员可以采取的步骤,以增加边缘化社区对研究的参与。实践包括在规划和招聘阶段规划社区参与,定期与社区就其优先事项进行对话,在整个研究过程中为社区提供支持,以及处理复杂的健康结构性决定因素。此外,我们讨论了研究机构如何通过重新审视他们的政策来增加临床试验的参与和灌输机构的可信度来支持包容性实践。
{"title":"Inclusionary Trials: A Review of Lessons Not Learned.","authors":"Paris B Adkins-Jackson,&nbsp;Nancy J Burke,&nbsp;Patricia Rodriguez Espinosa,&nbsp;Juliana M Ison,&nbsp;Susan D Goold,&nbsp;Lisa G Rosas,&nbsp;Chyke A Doubeni,&nbsp;The Stop Covid-California Alliance Trial Participation And Vaccine Hesitancy Working Groups,&nbsp;Arleen F Brown","doi":"10.1093/epirev/mxac007","DOIUrl":"https://doi.org/10.1093/epirev/mxac007","url":null,"abstract":"<p><p>The COVID-19 pandemic revealed weaknesses in the public health infrastructure of the United States, including persistent barriers to engaging marginalized communities toward inclusion in clinical research, including trials. Inclusive participation in clinical trials is crucial for promoting vaccine confidence, public trust, and addressing disparate health outcomes. A long-standing body of literature describes the value of community-based participatory research in increasing marginalized community participation in research. Community-based participatory research emphasizes shared leadership with community members in all phases of the research process, including in the planning and implementation, interpretation, and dissemination. Shared leadership between academic and industry with marginalized communities can assist with inclusive participation in vaccine trials and increase public trust in the development of the vaccines and other therapies used during public emergencies. Nevertheless, epidemiologic and clinical research do not yet have a strong culture of community partnership in the scientific process, which takes time to build and therefore may be difficult to develop and rapidly scale to respond to the pandemic. We outline practices that contribute to a lack of inclusive participation and suggest steps that trialists and other researchers can take to increase marginalized communities' participation in research. Practices include planning for community engagement during the planning and recruitment phases, having regular dialogues with communities about their priorities, supporting them throughout a study, and navigating complex structural determinants of health. Additionally, we discuss how research institutions can support inclusive practices by reexamining their policies to increase participation in clinical trials and instilling institutional trustworthiness.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"78-86"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/7c/75/mxac007.PMC9494445.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9334315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
CORRECTION TO "THE REVOLUTION WILL BE HARD TO EVALUATE: HOW CO-OCCURRING POLICY CHANGES AFFECT RESEARCH ON THE HEALTH EFFECTS OF SOCIAL POLICIES". 对"革命将难以评估:同时发生的政策变化如何影响社会政策对健康影响的研究"的更正。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac004
{"title":"CORRECTION TO \"THE REVOLUTION WILL BE HARD TO EVALUATE: HOW CO-OCCURRING POLICY CHANGES AFFECT RESEARCH ON THE HEALTH EFFECTS OF SOCIAL POLICIES\".","authors":"","doi":"10.1093/epirev/mxac004","DOIUrl":"https://doi.org/10.1093/epirev/mxac004","url":null,"abstract":"","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"138"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/4e/fd/mxac004.PMC9780117.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10751603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Note from the Editor. 编辑的注释。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac012
David D Celentano
{"title":"A Note from the Editor.","authors":"David D Celentano","doi":"10.1093/epirev/mxac012","DOIUrl":"https://doi.org/10.1093/epirev/mxac012","url":null,"abstract":"","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"1"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10435922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Conundrum of Clinical Trials for the Uveitides: Appropriate Outcome Measures for One Treatment Used in Several Diseases. uvetides临床试验的难题:对几种疾病使用的一种治疗方法的适当结果测量。
IF 5.5 2区 医学 Q1 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Pub Date : 2022-12-21 DOI: 10.1093/epirev/mxac001
Douglas A Jabs, Meghan K Berkenstock, Michael M Altawee, Janet T Holbrook, Elizabeth A Sugar

The uveitides consist of >30 diseases characterized by intraocular inflammation. Noninfectious intermediate, posterior, and panuveitides typically are treated with oral corticosteroids and immunosuppression, with a similar treatment approach for most diseases. Because these uveitides collectively are considered a rare disease, single-disease trials are difficult to impractical to recruit for, and most trials have included several different diseases for a given protocol treatment. However, measures of uveitis activity are disease specific, resulting in challenges for trial outcome measures. Several trials of investigational immunosuppressive drugs or biologic drugs have not demonstrated efficacy, but design problems with the outcome measures have limited the ability to interpret the results. Successful trials have included diseases for which a single uveitis activity measure suffices or a composite measure of uveitis activity is used. One potential solution to this problem is the use of a single, clinically relevant outcome, successful corticosteroid sparing, defined as inactive uveitis with a prednisone dose ≤7.5 mg/day coupled with disease-specific guidelines for determining inactive disease. The clinical relevance of this outcome is that active uveitis is associated with increased risks of visual impairment and blindness, and that prednisone doses ≤7.5 mg/day have a minimal risk of corticosteroid side effects. The consequence of this approach is that trial visits require a core set of measures for all participants and a disease-specific set of measures, both clinical and imaging, to assess uveitis activity. This approach is being used in the Adalimumab Versus Conventional Immunosuppression (ADVISE) Trial.

以眼内炎症为特征的疾病有30多种。非感染性中、后、全葡萄膜炎通常用口服皮质类固醇和免疫抑制治疗,对大多数疾病采用类似的治疗方法。因为这些葡萄球菌被认为是一种罕见的疾病,单一疾病的试验很难招募,而且大多数试验在给定的方案治疗中包括几种不同的疾病。然而,葡萄膜炎活动的测量是疾病特异性的,导致试验结果测量的挑战。一些研究性免疫抑制药物或生物药物的试验没有显示出疗效,但结果测量的设计问题限制了对结果的解释能力。成功的试验包括单一葡萄膜炎活动性测量或使用葡萄膜炎活动性综合测量的疾病。这个问题的一个潜在解决方案是使用一个单一的,临床相关的结果,成功的皮质类固醇保留,定义为非活动性葡萄膜炎,强的松剂量≤7.5 mg/天,加上确定非活动性疾病的疾病特异性指南。这一结果的临床相关性是,活动性葡萄膜炎与视力损害和失明的风险增加有关,并且泼尼松剂量≤7.5 mg/天具有最小的皮质类固醇副作用风险。这种方法的结果是,临床访问需要一套针对所有参与者的核心措施和一套针对疾病的措施,包括临床和影像学措施,以评估葡萄膜炎活动。该方法正在阿达木单抗与常规免疫抑制(ADVISE)试验中使用。
{"title":"The Conundrum of Clinical Trials for the Uveitides: Appropriate Outcome Measures for One Treatment Used in Several Diseases.","authors":"Douglas A Jabs,&nbsp;Meghan K Berkenstock,&nbsp;Michael M Altawee,&nbsp;Janet T Holbrook,&nbsp;Elizabeth A Sugar","doi":"10.1093/epirev/mxac001","DOIUrl":"https://doi.org/10.1093/epirev/mxac001","url":null,"abstract":"<p><p>The uveitides consist of >30 diseases characterized by intraocular inflammation. Noninfectious intermediate, posterior, and panuveitides typically are treated with oral corticosteroids and immunosuppression, with a similar treatment approach for most diseases. Because these uveitides collectively are considered a rare disease, single-disease trials are difficult to impractical to recruit for, and most trials have included several different diseases for a given protocol treatment. However, measures of uveitis activity are disease specific, resulting in challenges for trial outcome measures. Several trials of investigational immunosuppressive drugs or biologic drugs have not demonstrated efficacy, but design problems with the outcome measures have limited the ability to interpret the results. Successful trials have included diseases for which a single uveitis activity measure suffices or a composite measure of uveitis activity is used. One potential solution to this problem is the use of a single, clinically relevant outcome, successful corticosteroid sparing, defined as inactive uveitis with a prednisone dose ≤7.5 mg/day coupled with disease-specific guidelines for determining inactive disease. The clinical relevance of this outcome is that active uveitis is associated with increased risks of visual impairment and blindness, and that prednisone doses ≤7.5 mg/day have a minimal risk of corticosteroid side effects. The consequence of this approach is that trial visits require a core set of measures for all participants and a disease-specific set of measures, both clinical and imaging, to assess uveitis activity. This approach is being used in the Adalimumab Versus Conventional Immunosuppression (ADVISE) Trial.</p>","PeriodicalId":50510,"journal":{"name":"Epidemiologic Reviews","volume":"44 1","pages":"2-16"},"PeriodicalIF":5.5,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10362938/pdf/mxac001.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9907472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Epidemiologic Reviews
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1