首页 > 最新文献

Observational studies最新文献

英文 中文
A Bureaucratic Theory of Statistics. 统计的官僚理论。
Pub Date : 2025-04-11 eCollection Date: 2025-01-01 DOI: 10.1353/obs.2025.a956843
Benjamin Recht

This commentary proposes a framework for understanding the role of statistics in policymaking, regulation, and bureaucratic systems. I introduce the concept of "ex ante policy," describing statistical rules and procedures designed before data collection to govern future actions. Through examining examples, particularly clinical trials, I explore how ex ante policy serves as a calculus of bureaucracy, providing numerical foundations for governance through clear, transparent rules. The ex ante frame obviates heated debates about inferential interpretations of probability and statistical tests, p-values, and rituals. I conclude by calling for a deeper appreciation of statistics' bureaucratic function and suggesting new directions for research in policy-oriented statistical methodology.

这篇评论提出了一个理解统计在政策制定、监管和官僚体系中的作用的框架。我介绍了“事前政策”的概念,描述了在数据收集之前设计的统计规则和程序,以管理未来的行动。通过研究实例,特别是临床试验,我探讨了事前政策如何作为官僚主义的演算,通过清晰、透明的规则为治理提供数字基础。事前框架避免了关于概率和统计检验、p值和仪式的推理解释的激烈辩论。最后,我呼吁更深入地了解统计的官僚功能,并为政策导向统计方法的研究提出新的方向。
{"title":"A Bureaucratic Theory of Statistics.","authors":"Benjamin Recht","doi":"10.1353/obs.2025.a956843","DOIUrl":"10.1353/obs.2025.a956843","url":null,"abstract":"<p><p>This commentary proposes a framework for understanding the role of statistics in policymaking, regulation, and bureaucratic systems. I introduce the concept of \"ex ante policy,\" describing statistical rules and procedures designed before data collection to govern future actions. Through examining examples, particularly clinical trials, I explore how ex ante policy serves as a calculus of bureaucracy, providing numerical foundations for governance through clear, transparent rules. The ex ante frame obviates heated debates about inferential interpretations of probability and statistical tests, p-values, and rituals. I conclude by calling for a deeper appreciation of statistics' bureaucratic function and suggesting new directions for research in policy-oriented statistical methodology.</p>","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"11 1","pages":"77-84"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12139714/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144251199","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Priors and Propensity Scores in Bayesian Causal Inference. 贝叶斯因果推理中的先验和倾向得分。
Pub Date : 2025-04-11 eCollection Date: 2025-01-01 DOI: 10.1353/obs.2025.a956841
Arman Oganisian, Antonio Linero

Aronow et al. (2025) provide a convincing case for the special status of randomized controlled trials (RCTs) in which the propensity scores are known and can be used to make causal inferences. Here we provide a Bayesian perspective on their work by summarizing recent developments in the Bayesian literature on the topic. Whether the propensity score should play a role in Bayesian causal inference - and what that role(s) should be - has been a controversial topic for some time. We begin by describing Bayesian inference for population-level estimands and show that under commonly made (but not necessarily required) assumptions, the propensity score model has no role to play in Bayesian causal inference from a purist perspective. We discuss recent work on why these assumptions can be problematic - particularly in high-dimensional models - and discuss several Bayesian motivations for relaxing them. We describe out recent approaches for incorporating the propensity score correspond to di erent ways of relaxing these assumptions. Given these considerations, we illustrate how a Bayesian might approach the synethic examples of Aronow et al. (2025).

Aronow等人(2025)为随机对照试验(rct)的特殊地位提供了一个令人信服的案例,在随机对照试验中,倾向得分是已知的,可以用来进行因果推断。在这里,我们通过总结关于该主题的贝叶斯文献的最新发展,提供了他们工作的贝叶斯观点。倾向得分是否应该在贝叶斯因果推理中发挥作用——以及应该发挥什么样的作用——一直是一个有争议的话题。我们首先描述总体水平估计的贝叶斯推断,并表明在通常做出的(但不一定是必需的)假设下,从纯粹主义的角度来看,倾向得分模型在贝叶斯因果推断中没有作用。我们讨论了最近关于为什么这些假设会有问题的研究——特别是在高维模型中——并讨论了放松这些假设的几个贝叶斯动机。我们描述了最近合并倾向得分的方法,这些方法对应于放松这些假设的不同方式。考虑到这些因素,我们说明了贝叶斯如何接近Aronow等人(2025)的综合例子。
{"title":"Priors and Propensity Scores in Bayesian Causal Inference.","authors":"Arman Oganisian, Antonio Linero","doi":"10.1353/obs.2025.a956841","DOIUrl":"10.1353/obs.2025.a956841","url":null,"abstract":"<p><p>Aronow et al. (2025) provide a convincing case for the special status of randomized controlled trials (RCTs) in which the propensity scores are known and can be used to make causal inferences. Here we provide a Bayesian perspective on their work by summarizing recent developments in the Bayesian literature on the topic. Whether the propensity score should play a role in Bayesian causal inference - and what that role(s) should be - has been a controversial topic for some time. We begin by describing Bayesian inference for population-level estimands and show that under commonly made (but not necessarily required) assumptions, the propensity score model has no role to play in Bayesian causal inference from a purist perspective. We discuss recent work on why these assumptions can be problematic - particularly in high-dimensional models - and discuss several Bayesian motivations for relaxing them. We describe out recent approaches for incorporating the propensity score correspond to di erent ways of relaxing these assumptions. Given these considerations, we illustrate how a Bayesian might approach the synethic examples of Aronow et al. (2025).</p>","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"11 1","pages":"47-60"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12139722/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144251203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What randomization can and cannot guarantee. 随机化能保证什么,不能保证什么。
Pub Date : 2025-04-11 eCollection Date: 2025-01-01 DOI: 10.1353/obs.2025.a956839
Peng Ding

Aronow et al. (2024) provide a great service to the causal inference community by delineating the key results in Robins and Ritov (1997). They show that randomized controlled trials (RCTs) ensure much stronger statistical inference than unconfounded observational studies even though nonparametric identification is identical in both settings. These results are in sharp contrast to the claim in Pearl and Mackenzie (2018) that RCTs are not the gold standard of causal analysis. Pearl and Mackenzie's (2018) claim is false and misleading for empirical researchers who want to infer causal effects based on data with finite sample sizes. I will further review what randomization can and cannot guarantee more broadly. In particular, I will highlight the value of randomization-based inference in RCTs, the limit of randomization alone for more complicated causal inference questions, and the importance of sensitivity analysis in observational studies.

Aronow等人(2024)通过描述Robins和Ritov(1997)的关键结果,为因果推理界提供了很大的服务。他们表明,随机对照试验(rct)确保比非混杂观察性研究更强的统计推断,即使在两种情况下非参数识别是相同的。这些结果与Pearl和Mackenzie(2018)的说法形成鲜明对比,后者认为随机对照试验不是因果分析的黄金标准。Pearl和Mackenzie(2018)的说法是错误的,对于那些想要根据有限样本量的数据推断因果关系的实证研究人员来说是误导的。我将进一步更广泛地回顾随机化能保证什么和不能保证什么。特别是,我将强调随机化推理在随机对照试验中的价值,随机化在更复杂的因果推理问题中的局限性,以及敏感性分析在观察性研究中的重要性。
{"title":"What randomization can and cannot guarantee.","authors":"Peng Ding","doi":"10.1353/obs.2025.a956839","DOIUrl":"10.1353/obs.2025.a956839","url":null,"abstract":"<p><p>Aronow et al. (2024) provide a great service to the causal inference community by delineating the key results in Robins and Ritov (1997). They show that randomized controlled trials (RCTs) ensure much stronger statistical inference than unconfounded observational studies even though nonparametric identification is identical in both settings. These results are in sharp contrast to the claim in Pearl and Mackenzie (2018) that RCTs are not the gold standard of causal analysis. Pearl and Mackenzie's (2018) claim is false and misleading for empirical researchers who want to infer causal effects based on data with finite sample sizes. I will further review what randomization can and cannot guarantee more broadly. In particular, I will highlight the value of randomization-based inference in RCTs, the limit of randomization alone for more complicated causal inference questions, and the importance of sensitivity analysis in observational studies.</p>","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"11 1","pages":"27-40"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12139720/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144251205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Does matching introduce confounding or selection bias into the matched case-control design? 匹配病例对照设计是否会引入混杂或选择偏差?
Pub Date : 2024-06-06 DOI: 10.1353/obs.2024.a929114
Fei Wan, S. Sutcliffe, Jeffrey Zhang, Dylan Small
Abstract:The impact of matching on confounding control in case-control studies remains a subject of ongoing debate, with varying perspectives among researchers. While matching is a well-established method for controlling confounding in cohort studies, its effectiveness in mitigating confounding in case-control studies has long been questioned. Recent studies have determined that matching doesn't eliminate confounding but, instead, introduces a selection bias on top of the initial confounding, as indicated by causal diagram analysis. This conclusion suggests that the control of initial confounding through matching is either only partial or non-existent. However, this conclusion may not be accurate in exactly matched design because causal diagram cannot always reveal precisely the interplay between the initial confounding and the matching induced selection effect. In this paper, we employ analytical results in conjunction with causal diagrams to demonstrate that the cancellation of the initial confounding by the selection effect is complete in exact individually matched case-control studies. Nevertheless, this cancellation results in a residual selection effect that establishes a backdoor connection between the matching factors and the outcome in the matched design. Failure to adjust for this residual selection effect leads to biased estimates of the exposure effect. Furthermore, this backdoor connection causes matching factors to act like confounding factors in the matched case-control design, which complicates the interpretation of the bias introduced by matching in current literature.
摘要:在病例对照研究中,配对对混杂控制的影响一直是一个争论不休的话题,研究人员的观点也不尽相同。在队列研究中,配对是一种行之有效的混杂控制方法,但在病例对照研究中,配对在减少混杂方面的效果却一直受到质疑。最近的研究发现,匹配并不能消除混杂,反而会在初始混杂的基础上引入选择偏倚,因果图分析表明了这一点。这一结论表明,通过配对对初始混杂的控制要么只是部分的,要么根本不存在。然而,这一结论在完全匹配的设计中可能并不准确,因为因果图并不能总是精确地揭示初始混杂和匹配诱导的选择效应之间的相互作用。在本文中,我们将分析结果与因果图结合起来,证明在精确个体匹配的病例对照研究中,选择效应对初始混杂的抵消是完全的。然而,这种抵消会导致残余选择效应,在匹配设计中建立起匹配因素与结果之间的后门联系。如果不对这种残余选择效应进行调整,就会导致对暴露效应的估计出现偏差。此外,这种后门联系会使匹配因素在匹配病例对照设计中起到类似混杂因素的作用,从而使目前文献中对匹配所带来的偏差的解释变得复杂。
{"title":"Does matching introduce confounding or selection bias into the matched case-control design?","authors":"Fei Wan, S. Sutcliffe, Jeffrey Zhang, Dylan Small","doi":"10.1353/obs.2024.a929114","DOIUrl":"https://doi.org/10.1353/obs.2024.a929114","url":null,"abstract":"Abstract:The impact of matching on confounding control in case-control studies remains a subject of ongoing debate, with varying perspectives among researchers. While matching is a well-established method for controlling confounding in cohort studies, its effectiveness in mitigating confounding in case-control studies has long been questioned. Recent studies have determined that matching doesn't eliminate confounding but, instead, introduces a selection bias on top of the initial confounding, as indicated by causal diagram analysis. This conclusion suggests that the control of initial confounding through matching is either only partial or non-existent. However, this conclusion may not be accurate in exactly matched design because causal diagram cannot always reveal precisely the interplay between the initial confounding and the matching induced selection effect. In this paper, we employ analytical results in conjunction with causal diagrams to demonstrate that the cancellation of the initial confounding by the selection effect is complete in exact individually matched case-control studies. Nevertheless, this cancellation results in a residual selection effect that establishes a backdoor connection between the matching factors and the outcome in the matched design. Failure to adjust for this residual selection effect leads to biased estimates of the exposure effect. Furthermore, this backdoor connection causes matching factors to act like confounding factors in the matched case-control design, which complicates the interpretation of the bias introduced by matching in current literature.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"321 4","pages":"1 - 9"},"PeriodicalIF":0.0,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141381359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using a difference-in-difference control trial to test an intervention aimed at increasing the take-up of a welfare payment in New Zealand 使用差异中差异对照试验来测试旨在增加新西兰福利支付的干预措施
Pub Date : 2023-09-07 DOI: 10.1353/obs.2023.a906626
David Rea, Dean R. Hyslop
Abstract:This paper describes a difference-in-difference control trial (DDCT) of an intervention designed to increase the take-up of an income support payment in the New Zealand welfare system. The intervention used a microsimulation model to identify potential claimants who were then contacted by either phone, email, or letter. The trial was designed as a DDCT because of ethical concerns associated with a fully randomized approach. The trial provided convincing evidence that the intervention would increase the take-up of the payment and a modified version was then implemented as an ongoing business process by the New Zealand Ministry of Social Development (MSD). The findings from the trial contribute to the literature about how best to increase the take-up of welfare payments. The study also demonstrates the value of using a difference-in-difference control trial.
摘要:本文描述了一项干预措施的差异控制试验(DDCT),旨在提高新西兰福利系统中收入支持支付的接受率。干预使用微观模拟模型来识别潜在的索赔人,然后通过电话、电子邮件或信件联系他们。由于与完全随机方法相关的伦理问题,该试验被设计为DDCT。该试验提供了令人信服的证据,表明干预措施将增加付款的接受率,新西兰社会发展部随后将修改后的版本作为一项持续的业务流程实施。该试验的结果为如何最好地提高福利金的使用率的文献做出了贡献。该研究还证明了使用差异对照试验的价值。
{"title":"Using a difference-in-difference control trial to test an intervention aimed at increasing the take-up of a welfare payment in New Zealand","authors":"David Rea, Dean R. Hyslop","doi":"10.1353/obs.2023.a906626","DOIUrl":"https://doi.org/10.1353/obs.2023.a906626","url":null,"abstract":"Abstract:This paper describes a difference-in-difference control trial (DDCT) of an intervention designed to increase the take-up of an income support payment in the New Zealand welfare system. The intervention used a microsimulation model to identify potential claimants who were then contacted by either phone, email, or letter. The trial was designed as a DDCT because of ethical concerns associated with a fully randomized approach. The trial provided convincing evidence that the intervention would increase the take-up of the payment and a modified version was then implemented as an ongoing business process by the New Zealand Ministry of Social Development (MSD). The findings from the trial contribute to the literature about how best to increase the take-up of welfare payments. The study also demonstrates the value of using a difference-in-difference control trial.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"9 1","pages":"49 - 72"},"PeriodicalIF":0.0,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46729290","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Size-biased sensitivity analysis for matched pairs design to assess the impact of healthcare-associated infections 对配对设计进行大小偏倚敏感性分析,以评估医疗保健相关感染的影响
Pub Date : 2023-09-07 DOI: 10.1353/obs.2023.a906628
David Watson
Abstract:Healthcare-associated infections are serious adverse events that occur during a hospital admission. Quantifying the impact of these infections on inpatient length of stay and cost has important policy implications due to the Hospital-Acquired Conditions Reduction Program in the United States. However, most studies on this topic are flawed because they do not account for when a healthcare-associated infection occurred during a hospital admission. Such an approach leads to selection bias because patients with longer hospital stays are more likely to experience an infection due to their increased exposure time. Time of infection is often not incorporated into the estimation strategy because this information is unknown, yet there are no methods that account for the selection bias in this scenario. To address this problem, we propose a sensitivity analysis for matched pairs designs for assessing the effect of healthcare-associated infections on length of stay and cost when time of infection is unknown. The approach models the probability of infection, or the assignment mechanism, as proportional to a power function of the uninfected length of stay, where the sensitivity parameter is the value of the power. The general idea is to incorporate the degree of exposure into the probability of an infection occurring. Under this size-biased assignment mechanism, we develop hypothesis tests under a sharp null hypothesis of constant multiplicative effects. The approach is demonstrated on a pediatric cohort of inpatient encounters and compared to benchmark estimates that properly account for time of infection. The results reaffirm the severe degree of bias when not accounting for time of infection and also show that the proposed sensitivity analysis captures the benchmark estimates for plausible and theoretically justified values of the sensitivity parameter.
摘要:医疗保健相关感染是在入院期间发生的严重不良事件。由于美国的医院获得性疾病减少计划,量化这些感染对住院时间和费用的影响具有重要的政策意义。然而,大多数关于这一主题的研究都有缺陷,因为它们没有说明住院期间何时发生与医疗保健相关的感染。这种方法会导致选择偏差,因为住院时间较长的患者因暴露时间增加而更有可能感染。感染时间通常不包含在估计策略中,因为这些信息是未知的,但在这种情况下,没有任何方法可以解释选择偏差。为了解决这个问题,我们提出了配对设计的敏感性分析,以评估在感染时间未知的情况下,医疗保健相关感染对住院时间和费用的影响。该方法将感染概率或分配机制建模为与未感染停留时间的幂函数成比例,其中敏感性参数是幂的值。一般的想法是将暴露程度纳入感染发生的概率中。在这种大小有偏的分配机制下,我们在常数乘法效应的尖锐零假设下进行假设检验。该方法在儿科住院患者队列中得到了验证,并与正确考虑感染时间的基准估计值进行了比较。结果重申了在不考虑感染时间的情况下的严重偏差程度,并表明所提出的敏感性分析捕捉了敏感性参数的合理和理论上合理值的基准估计。
{"title":"Size-biased sensitivity analysis for matched pairs design to assess the impact of healthcare-associated infections","authors":"David Watson","doi":"10.1353/obs.2023.a906628","DOIUrl":"https://doi.org/10.1353/obs.2023.a906628","url":null,"abstract":"Abstract:Healthcare-associated infections are serious adverse events that occur during a hospital admission. Quantifying the impact of these infections on inpatient length of stay and cost has important policy implications due to the Hospital-Acquired Conditions Reduction Program in the United States. However, most studies on this topic are flawed because they do not account for when a healthcare-associated infection occurred during a hospital admission. Such an approach leads to selection bias because patients with longer hospital stays are more likely to experience an infection due to their increased exposure time. Time of infection is often not incorporated into the estimation strategy because this information is unknown, yet there are no methods that account for the selection bias in this scenario. To address this problem, we propose a sensitivity analysis for matched pairs designs for assessing the effect of healthcare-associated infections on length of stay and cost when time of infection is unknown. The approach models the probability of infection, or the assignment mechanism, as proportional to a power function of the uninfected length of stay, where the sensitivity parameter is the value of the power. The general idea is to incorporate the degree of exposure into the probability of an infection occurring. Under this size-biased assignment mechanism, we develop hypothesis tests under a sharp null hypothesis of constant multiplicative effects. The approach is demonstrated on a pediatric cohort of inpatient encounters and compared to benchmark estimates that properly account for time of infection. The results reaffirm the severe degree of bias when not accounting for time of infection and also show that the proposed sensitivity analysis captures the benchmark estimates for plausible and theoretically justified values of the sensitivity parameter.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"9 1","pages":"1 - 24"},"PeriodicalIF":0.0,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42324694","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Software Tutorial for Matching in Clustered Observational Studies 集群观测研究中的匹配软件教程
Pub Date : 2023-09-07 DOI: 10.1353/obs.2023.a906624
Luke Keele, Matthew Lenard, Luke Miratrix, Lindsay Page
Abstract:Many interventions occur in settings where treatments are applied to groups. For example, a math intervention may be implemented for all students in some schools and withheld from students in other schools. When such treatments are non-randomly allocated, researchers can use statistical adjustment to make treated and control groups similar in terms of observed characteristics. Recent work in statistics has developed a form of matching, known as multilevel matching, that is designed for contexts where treatments are clustered. In this article, we provide a tutorial on how to analyze clustered treatment using multilevel matching. We use a real data application to explain the full set of steps for the analysis of a clustered observational study.
摘要:许多干预措施发生在治疗适用于群体的环境中。例如,数学干预可能对某些学校的所有学生实施,而对其他学校的学生不实施。当这些治疗是非随机分配时,研究人员可以使用统计调整使治疗组和对照组在观察到的特征方面相似。最近在统计学方面的工作已经发展出一种匹配形式,称为多层次匹配,它是为治疗聚集的环境而设计的。在本文中,我们提供了一个关于如何使用多级匹配分析聚类处理的教程。我们使用一个真实的数据应用程序来解释群集观察性研究分析的全套步骤。
{"title":"A Software Tutorial for Matching in Clustered Observational Studies","authors":"Luke Keele, Matthew Lenard, Luke Miratrix, Lindsay Page","doi":"10.1353/obs.2023.a906624","DOIUrl":"https://doi.org/10.1353/obs.2023.a906624","url":null,"abstract":"Abstract:Many interventions occur in settings where treatments are applied to groups. For example, a math intervention may be implemented for all students in some schools and withheld from students in other schools. When such treatments are non-randomly allocated, researchers can use statistical adjustment to make treated and control groups similar in terms of observed characteristics. Recent work in statistics has developed a form of matching, known as multilevel matching, that is designed for contexts where treatments are clustered. In this article, we provide a tutorial on how to analyze clustered treatment using multilevel matching. We use a real data application to explain the full set of steps for the analysis of a clustered observational study.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"9 1","pages":"73 - 96"},"PeriodicalIF":0.0,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45559753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Doubly Robust Estimation of Average Treatment Effects on the Treated through Marginal Structural Models 通过边际结构模型的平均治疗效果的双稳健估计
Pub Date : 2023-05-11 DOI: 10.1353/obs.2023.0025
M. Schomaker, Philipp F. M. Baumann
Abstract:Some causal parameters are defined on subgroups of the observed data, such as the average treatment effect on the treated and variations thereof. We explain how such parameters can be defined through parameters in a marginal structural (working) model. We illustrate how existing software can be used for doubly robust effect estimation of those parameters. Our proposal for confidence interval estimation is based on the delta method. All concepts are illustrated by estimands and data from the data challenge of the 2022 American Causal Inference Conference.
摘要:在观测数据的子组上定义了一些因果参数,如平均治疗效应对被治疗者的影响及其变化。我们解释了如何通过边际结构(工作)模型中的参数来定义这些参数。我们说明了现有的软件如何用于这些参数的双鲁棒效应估计。我们提出的置信区间估计是基于delta方法的。所有概念都由来自2022年美国因果推理会议数据挑战的估计和数据来说明。
{"title":"Doubly Robust Estimation of Average Treatment Effects on the Treated through Marginal Structural Models","authors":"M. Schomaker, Philipp F. M. Baumann","doi":"10.1353/obs.2023.0025","DOIUrl":"https://doi.org/10.1353/obs.2023.0025","url":null,"abstract":"Abstract:Some causal parameters are defined on subgroups of the observed data, such as the average treatment effect on the treated and variations thereof. We explain how such parameters can be defined through parameters in a marginal structural (working) model. We illustrate how existing software can be used for doubly robust effect estimation of those parameters. Our proposal for confidence interval estimation is based on the delta method. All concepts are illustrated by estimands and data from the data challenge of the 2022 American Causal Inference Conference.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"9 1","pages":"43 - 57"},"PeriodicalIF":0.0,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41487639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Causal Methods Madness: Lessons Learned from the 2022 ACIC Competition to Estimate Health Policy Impacts 因果方法疯狂:从2022年ACIC竞赛中获得的经验教训,以评估卫生政策的影响
Pub Date : 2023-05-11 DOI: 10.1353/obs.2023.0023
Daniel Thal, M. Finucane
Abstract:Introducing novel causal estimators usually involves simulation studies run by the statistician developing the estimator, but this traditional approach can be fraught: simulation design is often favorable to the new method, unfavorable results might never be published, and comparison across estimators is difficult. The American Causal Inference Conference (ACIC) data challenges offer an alternative. As organizers of the 2022 challenge, we generated thousands of data sets similar to real-world policy evaluations and baked in true causal impacts unknown to participants. Participating teams then competed on an even playing field, using their cutting-edge methods to estimate those effects. In total, 20 teams submitted results from 58 estimators that used a range of approaches. We found several important factors driving performance that are not commonly used in business-as-usual applied policy evaluations, pointing to ways future evaluations could achieve more precise and nuanced estimates of policy impacts. Top-performing methods used flexible modeling of outcome-covariate and outcome-participation relationships as well as regularization of subgroup estimates. Furthermore, we found that model-based uncertainty intervals tended to outperform bootstrap-based ones. Lastly, and counter to our expectations, we found that analyzing large-n patient-level data does not improve performance relative to analyzing smaller-n data aggregated to the primary care practice level, given that in our simulated data sets practices (not individual patients) decided whether to join the intervention. Ultimately, we hope this competition helped identify methods that are best suited for evaluating which social policies move the needle for the individuals and communities they serve.
摘要:引入新的因果估计量通常涉及由开发估计量的统计学家进行的模拟研究,但这种传统方法可能会令人担忧:模拟设计通常对新方法有利,不利的结果可能永远不会公布,并且估计量之间的比较很困难。美国因果推理会议(ACIC)的数据挑战提供了一种替代方案。作为2022年挑战赛的组织者,我们生成了数千个类似于现实世界政策评估的数据集,并烘焙出参与者未知的真实因果影响。参赛队伍随后在一个公平的场地上进行比赛,使用他们的尖端方法来估计这些影响。总共有20个小组提交了58个估计量的结果,这些估计量使用了一系列方法。我们发现了几个驱动绩效的重要因素,这些因素在照常应用的政策评估中并不常用,指出了未来评估可以实现对政策影响更精确、更细致的估计的方法。表现最好的方法使用了结果协变量和结果参与关系的灵活建模,以及子群估计的正则化。此外,我们发现基于模型的不确定性区间往往优于基于自举的区间。最后,与我们的预期相反,我们发现,与分析汇总到初级保健实践层面的小n数据相比,分析大n患者层面的数据并不能提高性能,因为在我们的模拟数据集中,实践(而不是个体患者)决定是否加入干预。最终,我们希望这场比赛有助于确定最适合评估哪些社会政策为他们所服务的个人和社区牵线搭桥的方法。
{"title":"Causal Methods Madness: Lessons Learned from the 2022 ACIC Competition to Estimate Health Policy Impacts","authors":"Daniel Thal, M. Finucane","doi":"10.1353/obs.2023.0023","DOIUrl":"https://doi.org/10.1353/obs.2023.0023","url":null,"abstract":"Abstract:Introducing novel causal estimators usually involves simulation studies run by the statistician developing the estimator, but this traditional approach can be fraught: simulation design is often favorable to the new method, unfavorable results might never be published, and comparison across estimators is difficult. The American Causal Inference Conference (ACIC) data challenges offer an alternative. As organizers of the 2022 challenge, we generated thousands of data sets similar to real-world policy evaluations and baked in true causal impacts unknown to participants. Participating teams then competed on an even playing field, using their cutting-edge methods to estimate those effects. In total, 20 teams submitted results from 58 estimators that used a range of approaches. We found several important factors driving performance that are not commonly used in business-as-usual applied policy evaluations, pointing to ways future evaluations could achieve more precise and nuanced estimates of policy impacts. Top-performing methods used flexible modeling of outcome-covariate and outcome-participation relationships as well as regularization of subgroup estimates. Furthermore, we found that model-based uncertainty intervals tended to outperform bootstrap-based ones. Lastly, and counter to our expectations, we found that analyzing large-n patient-level data does not improve performance relative to analyzing smaller-n data aggregated to the primary care practice level, given that in our simulated data sets practices (not individual patients) decided whether to join the intervention. Ultimately, we hope this competition helped identify methods that are best suited for evaluating which social policies move the needle for the individuals and communities they serve.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"9 1","pages":"27 - 3"},"PeriodicalIF":0.0,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44338192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimating Treatment Effect with Propensity Score Weighted Regression and Double Machine Learning 用倾向评分加权回归和双机器学习估计治疗效果
Pub Date : 2023-05-11 DOI: 10.1353/obs.2023.0028
Jun Xue, Wei Zhong Goh, Dana Rotz
Abstract:We applied propensity score weighted regression and double machine learning in the 2022 American Causal Inference Conference Data Challenge. Our double machine learning method achieved the second lowest overall RMSE among all official submissions, but performed less well on heterogeneous treatment effect estimation due to lack of regularization.
摘要:我们在2022年美国因果推理会议数据挑战赛中应用了倾向得分加权回归和双机器学习。我们的双机器学习方法在所有官方提交的报告中获得了第二低的总体RMSE,但由于缺乏正则化,在异构治疗效果估计上表现不佳。
{"title":"Estimating Treatment Effect with Propensity Score Weighted Regression and Double Machine Learning","authors":"Jun Xue, Wei Zhong Goh, Dana Rotz","doi":"10.1353/obs.2023.0028","DOIUrl":"https://doi.org/10.1353/obs.2023.0028","url":null,"abstract":"Abstract:We applied propensity score weighted regression and double machine learning in the 2022 American Causal Inference Conference Data Challenge. Our double machine learning method achieved the second lowest overall RMSE among all official submissions, but performed less well on heterogeneous treatment effect estimation due to lack of regularization.","PeriodicalId":74335,"journal":{"name":"Observational studies","volume":"10 6","pages":"83 - 90"},"PeriodicalIF":0.0,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41291815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Observational studies
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1