首页 > 最新文献

Biometrika最新文献

英文 中文
On inference in high-dimensional logistic regression models with separated data 分离数据的高维逻辑回归模型的推理
2区 数学 Q1 Mathematics Pub Date : 2023-11-02 DOI: 10.1093/biomet/asad065
R M Lewis, H S Battey
Abstract Direct use of the likelihood function typically produces severely biased estimates when the dimension of the parameter vector is large relative to the effective sample size. With linearly separable data generated from a logistic regression model, the loglikelihood function asymptotes and the maximum likelihood estimator does not exist. We show that an exact analysis for each regression coefficient produces half-infinite confidence sets for some parameters when the data are separable. Such conclusions are not vacuous, but an honest portrayal of the limitations of the data. Finite confidence sets are only achievable when additional, perhaps implicit, assumptions are made. Under a notional double-asymptotic regime in which the dimension of the logistic coefficient vector increases with the sample size, the present paper considers the implications of enforcing a natural constraint on the vector of logistic-transformed probabilities. We derive a relationship between the logistic coefficients and a notional parameter obtained as a probability limit of an ordinary least squares estimator. The latter exists even when the data are separable. Consistency is ascertained under weak conditions on the design matrix.
当参数向量的维数相对于有效样本量较大时,直接使用似然函数通常会产生严重的偏估计。对于由逻辑回归模型产生的线性可分数据,对数似然函数渐近且最大似然估计量不存在。我们表明,当数据可分离时,对每个回归系数的精确分析对某些参数产生半无限置信集。这样的结论不是空洞的,而是对数据局限性的诚实描述。有限的置信集只有在做出额外的(可能是隐含的)假设时才能实现。在逻辑系数向量的维数随样本量的增加而增加的概念双渐近状态下,本文考虑了对逻辑变换概率向量施加自然约束的含义。我们推导了逻辑系数与作为普通最小二乘估计的概率极限的一个概念参数之间的关系。即使数据是可分离的,后者也存在。在弱条件下确定了设计矩阵的一致性。
{"title":"On inference in high-dimensional logistic regression models with separated data","authors":"R M Lewis, H S Battey","doi":"10.1093/biomet/asad065","DOIUrl":"https://doi.org/10.1093/biomet/asad065","url":null,"abstract":"Abstract Direct use of the likelihood function typically produces severely biased estimates when the dimension of the parameter vector is large relative to the effective sample size. With linearly separable data generated from a logistic regression model, the loglikelihood function asymptotes and the maximum likelihood estimator does not exist. We show that an exact analysis for each regression coefficient produces half-infinite confidence sets for some parameters when the data are separable. Such conclusions are not vacuous, but an honest portrayal of the limitations of the data. Finite confidence sets are only achievable when additional, perhaps implicit, assumptions are made. Under a notional double-asymptotic regime in which the dimension of the logistic coefficient vector increases with the sample size, the present paper considers the implications of enforcing a natural constraint on the vector of logistic-transformed probabilities. We derive a relationship between the logistic coefficients and a notional parameter obtained as a probability limit of an ordinary least squares estimator. The latter exists even when the data are separable. Consistency is ascertained under weak conditions on the design matrix.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135975796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Nonparametric priors with full-range borrowing of information 具有全范围信息借用的非参数先验
2区 数学 Q1 Mathematics Pub Date : 2023-10-19 DOI: 10.1093/biomet/asad063
F Ascolani, B Franzolini, A Lijoi, I Prünster
Summary Modelling of the dependence structure across heterogeneous data is crucial for Bayesian inference since it directly impacts the borrowing of information. Despite the extensive advances over the last two decades, most available proposals only allow for nonnegative correlations. We derive a new class of dependent nonparametric priors that can induce correlations of any sign, thus introducing a new and more flexible idea of borrowing of information. This is achieved thanks to a novel concept, which we term hyper-tie, and represents a direct and simple measure of dependence. We investigate prior and posterior distributional properties of the model and develop algorithms to perform posterior inference. Illustrative examples on simulated and real data show that our proposal outperforms alternatives in terms of prediction and clustering.
跨异构数据的依赖结构建模对贝叶斯推理至关重要,因为它直接影响信息的借用。尽管在过去二十年中取得了广泛的进展,但大多数可用的建议只允许非负相关。我们导出了一类新的非参数依赖先验,它可以诱导任何符号的相关性,从而引入了一种新的更灵活的信息借用思想。这要归功于一个新颖的概念,我们称之为“超联系”,它代表了一种直接而简单的依赖度量。我们研究了模型的先验和后验分布特性,并开发了执行后验推理的算法。在模拟和真实数据上的示例表明,我们的建议在预测和聚类方面优于其他方案。
{"title":"Nonparametric priors with full-range borrowing of information","authors":"F Ascolani, B Franzolini, A Lijoi, I Prünster","doi":"10.1093/biomet/asad063","DOIUrl":"https://doi.org/10.1093/biomet/asad063","url":null,"abstract":"Summary Modelling of the dependence structure across heterogeneous data is crucial for Bayesian inference since it directly impacts the borrowing of information. Despite the extensive advances over the last two decades, most available proposals only allow for nonnegative correlations. We derive a new class of dependent nonparametric priors that can induce correlations of any sign, thus introducing a new and more flexible idea of borrowing of information. This is achieved thanks to a novel concept, which we term hyper-tie, and represents a direct and simple measure of dependence. We investigate prior and posterior distributional properties of the model and develop algorithms to perform posterior inference. Illustrative examples on simulated and real data show that our proposal outperforms alternatives in terms of prediction and clustering.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Likelihood-based Inference under Non-Convex Boundary Constraints 非凸边界约束下基于似然的推理
2区 数学 Q1 Mathematics Pub Date : 2023-10-19 DOI: 10.1093/biomet/asad062
J Y Wang, Z S YE, Y Chen
Summary Likelihood-based inference under nonconvex constraints on model parameters has become increasingly common in biomedical research. In this paper, we establish large-sample properties of the maximum likelihood estimator when the true parameter value lies at the boundary of a nonconvex parameter space. We further derive the asymptotic distribution of the likelihood ratio test statistic under nonconvex constraints on model parameters. A general Monte Carlo procedure for generating the limiting distribution is provided. The theoretical results are demonstrated by five examples in Anderson’s stereotype logistic regression model, genetic association studies, gene-environment interaction tests, cost-constrained linear regression and fairness-constrained linear regression.
基于模型参数非凸约束的似然推理在生物医学研究中越来越普遍。本文建立了真参数值位于非凸参数空间边界时最大似然估计量的大样本性质。进一步推导了模型参数非凸约束下似然比检验统计量的渐近分布。给出了生成极限分布的一般蒙特卡罗程序。通过安德森的刻板印象逻辑回归模型、遗传关联研究、基因-环境交互作用检验、成本约束线性回归和公平约束线性回归五个实例验证了理论结果。
{"title":"Likelihood-based Inference under Non-Convex Boundary Constraints","authors":"J Y Wang, Z S YE, Y Chen","doi":"10.1093/biomet/asad062","DOIUrl":"https://doi.org/10.1093/biomet/asad062","url":null,"abstract":"Summary Likelihood-based inference under nonconvex constraints on model parameters has become increasingly common in biomedical research. In this paper, we establish large-sample properties of the maximum likelihood estimator when the true parameter value lies at the boundary of a nonconvex parameter space. We further derive the asymptotic distribution of the likelihood ratio test statistic under nonconvex constraints on model parameters. A general Monte Carlo procedure for generating the limiting distribution is provided. The theoretical results are demonstrated by five examples in Anderson’s stereotype logistic regression model, genetic association studies, gene-environment interaction tests, cost-constrained linear regression and fairness-constrained linear regression.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135729962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On geometric convergence for MALA under simple conditions 简单条件下MALA的几何收敛性
2区 数学 Q1 Mathematics Pub Date : 2023-10-03 DOI: 10.1093/biomet/asad060
Alain Oliviero-Durmus, Éric Moulines
Summary While the Metropolis Adjusted Langevin Algorithm (MALA) is a popular and widely used Markov chain Monte Carlo method, very few papers derive conditions that ensure its convergence. In particular, to the authors' knowledge, assumptions that are both easy to verify and guarantee geometric convergence, are still missing. In this work, we establish V-uniformly geometric convergence for MALA under mild assumptions about the target distribution. Unlike previous work, we only consider tail and smoothness conditions for the potential associated with the target distribution. These conditions are quite common in the MCMC literature. Finally, we pay special attention to the dependence of the bounds we derive on the step size of the Euler-Maruyama discretization, which corresponds to the proposal Markov kernel of MALA.
Metropolis Adjusted Langevin Algorithm (MALA)是一种广泛应用的马尔可夫链蒙特卡罗算法,但很少有论文给出保证其收敛性的条件。特别是,据作者所知,那些既容易验证又保证几何收敛的假设仍然缺失。在对目标分布的温和假设下,我们建立了MALA的v -均匀几何收敛性。与以前的工作不同,我们只考虑与目标分布相关的势的尾部和平滑条件。这些情况在MCMC文献中很常见。最后,我们特别注意了我们得到的边界与Euler-Maruyama离散化的步长的依赖关系,这对应于MALA的建议马尔可夫核。
{"title":"On geometric convergence for MALA under simple conditions","authors":"Alain Oliviero-Durmus, Éric Moulines","doi":"10.1093/biomet/asad060","DOIUrl":"https://doi.org/10.1093/biomet/asad060","url":null,"abstract":"Summary While the Metropolis Adjusted Langevin Algorithm (MALA) is a popular and widely used Markov chain Monte Carlo method, very few papers derive conditions that ensure its convergence. In particular, to the authors' knowledge, assumptions that are both easy to verify and guarantee geometric convergence, are still missing. In this work, we establish V-uniformly geometric convergence for MALA under mild assumptions about the target distribution. Unlike previous work, we only consider tail and smoothness conditions for the potential associated with the target distribution. These conditions are quite common in the MCMC literature. Finally, we pay special attention to the dependence of the bounds we derive on the step size of the Euler-Maruyama discretization, which corresponds to the proposal Markov kernel of MALA.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient Evaluation of Natural Stochastic Policies in Offline Reinforcement Learning 离线强化学习中自然随机策略的有效评价
2区 数学 Q1 Mathematics Pub Date : 2023-09-27 DOI: 10.1093/biomet/asad059
Nathan Kallus, Masatoshi Uehara
We study the efficient off-policy evaluation of natural stochastic policies, which are defined in terms of deviations from the behavior policy. This is a departure from the literature on off-policy evaluation where most work consider the evaluation of explicitly specified policies. Crucially, offline reinforcement learning with natural stochastic policies can help alleviate issues of weak overlap, lead to policies that build upon current practice, and improve policies' implementability in practice. Compared with the classic case of a pre-specified evaluation policy, when evaluating natural stochastic policies, the efficiency bound, which measures the best-achievable estimation error, is inflated since the evaluation policy itself is unknown. In this paper, we derive the efficiency bounds of two major types of natural stochastic policies: tilting policies and modified treatment policies. We then propose efficient nonparametric estimators that attain the efficiency bounds under very lax conditions. These also enjoy a (partial) double robustness property.
我们研究了自然随机策略的有效离政策评估,自然随机策略是根据偏离行为策略来定义的。这与非政策评估的文献不同,在非政策评估中,大多数工作都考虑对明确规定的政策进行评估。至关重要的是,使用自然随机策略的离线强化学习可以帮助缓解弱重叠问题,产生基于当前实践的策略,并提高策略在实践中的可实施性。与经典的预先设定评估策略相比,在评估自然随机策略时,由于评估策略本身是未知的,衡量最佳可实现估计误差的效率界被夸大了。本文导出了两大类自然随机策略的效率界:倾斜策略和修正处理策略。然后我们提出有效的非参数估计,在非常宽松的条件下达到效率界。它们还具有(部分)双重鲁棒性。
{"title":"Efficient Evaluation of Natural Stochastic Policies in Offline Reinforcement Learning","authors":"Nathan Kallus, Masatoshi Uehara","doi":"10.1093/biomet/asad059","DOIUrl":"https://doi.org/10.1093/biomet/asad059","url":null,"abstract":"We study the efficient off-policy evaluation of natural stochastic policies, which are defined in terms of deviations from the behavior policy. This is a departure from the literature on off-policy evaluation where most work consider the evaluation of explicitly specified policies. Crucially, offline reinforcement learning with natural stochastic policies can help alleviate issues of weak overlap, lead to policies that build upon current practice, and improve policies' implementability in practice. Compared with the classic case of a pre-specified evaluation policy, when evaluating natural stochastic policies, the efficiency bound, which measures the best-achievable estimation error, is inflated since the evaluation policy itself is unknown. In this paper, we derive the efficiency bounds of two major types of natural stochastic policies: tilting policies and modified treatment policies. We then propose efficient nonparametric estimators that attain the efficiency bounds under very lax conditions. These also enjoy a (partial) double robustness property.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135471800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Selective machine learning of doubly robust functionals 双鲁棒函数的选择性机器学习
2区 数学 Q1 Mathematics Pub Date : 2023-09-26 DOI: 10.1093/biomet/asad055
Y Cui, E Tchetgen Tchetgen
Abstract While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we propose a selective machine learning framework for making inferences about a finite-dimensional functional defined on a semiparametric model, when the latter admits a doubly robust estimating function and several candidate machine learning algorithms are available for estimating the nuisance parameters. We introduce a new selection criterion aimed at bias reduction in estimating the functional of interest based on a novel definition of pseudo-risk inspired by the double robustness property. Intuitively, the proposed criterion selects a pair of learners with the smallest pseudo-risk, so that the estimated functional is least sensitive to perturbations of a nuisance parameter. We establish an oracle property for a multi-fold cross-validation version of the new selection criterion which states that our empirical criterion performs nearly as well as an oracle with a priori knowledge of the pseudo-risk for each pair of candidate learners. Finally, we apply the approach to model selection of a semiparametric estimator of average treatment effect given an ensemble of candidate machine learners to account for confounding in an observational study which we illustrate in simulations and a data application.
虽然模型选择是参数和非参数回归或密度估计中一个研究得很好的主题,但半参数问题中可能高维干扰参数的选择却远远不够发达。在本文中,我们提出了一种选择性机器学习框架,用于对半参数模型上定义的有限维泛函进行推断,当后者允许双鲁棒估计函数和几种候选机器学习算法可用于估计干扰参数。基于双重鲁棒性所启发的伪风险的新定义,我们引入了一种新的选择准则,目的是在估计利息泛函时减少偏差。直观地,该准则选择了一对伪风险最小的学习器,使得估计函数对干扰参数的扰动最不敏感。我们为新选择标准的多重交叉验证版本建立了一个oracle属性,该属性表明我们的经验标准几乎与每对候选学习者的伪风险先验知识的oracle一样好。最后,我们将该方法应用于给定候选机器学习者集合的平均治疗效果的半参数估计量的模型选择,以解释我们在模拟和数据应用中说明的观察性研究中的混淆。
{"title":"Selective machine learning of doubly robust functionals","authors":"Y Cui, E Tchetgen Tchetgen","doi":"10.1093/biomet/asad055","DOIUrl":"https://doi.org/10.1093/biomet/asad055","url":null,"abstract":"Abstract While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we propose a selective machine learning framework for making inferences about a finite-dimensional functional defined on a semiparametric model, when the latter admits a doubly robust estimating function and several candidate machine learning algorithms are available for estimating the nuisance parameters. We introduce a new selection criterion aimed at bias reduction in estimating the functional of interest based on a novel definition of pseudo-risk inspired by the double robustness property. Intuitively, the proposed criterion selects a pair of learners with the smallest pseudo-risk, so that the estimated functional is least sensitive to perturbations of a nuisance parameter. We establish an oracle property for a multi-fold cross-validation version of the new selection criterion which states that our empirical criterion performs nearly as well as an oracle with a priori knowledge of the pseudo-risk for each pair of candidate learners. Finally, we apply the approach to model selection of a semiparametric estimator of average treatment effect given an ensemble of candidate machine learners to account for confounding in an observational study which we illustrate in simulations and a data application.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134960403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An eigenvector-assisted estimation framework for signal-plus-noise matrix models 信号加噪声矩阵模型的特征向量辅助估计框架
2区 数学 Q1 Mathematics Pub Date : 2023-09-19 DOI: 10.1093/biomet/asad058
Fangzheng Xie, Dingbo Wu
Summary In this paper, we develop an eigenvector-assisted estimation framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon a novel asymptotically unbiased estimating equation using the leading eigenvectors of the data matrix. However, the estimator obtained by directly solving the estimating equation could be numerically unstable in practice and lacks robustness against model misspecification. We propose to use the quasi-posterior distribution by exponentiating a criterion function whose maximizer coincides with the estimating equation estimator. The proposed framework can incorporate heteroskedastic variance information but does not require the complete specification of the sampling distribution and is also robust to the potential misspecification of the distribution of the noise matrix. Computationally, the quasi-posterior distribution can be obtained via a Markov Chain Monte Carlo sampler, which exhibits superior numerical stability than some of the existing optimization-based estimators and is straightforward for uncertainty quantification. Under mild regularity conditions, we establish the large sample properties of the quasi-posterior distributions. In particular, the quasi-posterior credible sets have the correct frequentist nominal coverage probability provided that the criterion function is carefully selected. The validity and usefulness of the proposed framework are demonstrated through the analysis of synthetic datasets and the real-world ENZYMES network datasets.
在本文中,我们开发了一个特征向量辅助估计框架,用于高维统计和许多应用中的信号加噪声矩阵模型集合。该框架是建立在一个新的渐近无偏估计方程上,使用数据矩阵的首特征向量。然而,在实际应用中,直接求解估计方程得到的估计量在数值上是不稳定的,并且缺乏对模型错规范的鲁棒性。我们提出利用准后验分布,对一个准则函数取幂,该准则函数的最大值与估计方程估计量重合。所提出的框架可以包含异方差信息,但不需要完全规范采样分布,并且对噪声矩阵分布的潜在错误规范也具有鲁棒性。计算上,拟后验分布可以通过马尔可夫链蒙特卡罗采样器获得,与现有的一些基于优化的估计器相比,它具有更好的数值稳定性,并且可以直接用于不确定性量化。在温和的正则性条件下,我们建立了准后验分布的大样本性质。特别是,准后验可信集具有正确的频率论名义覆盖概率,前提是仔细选择准则函数。通过对合成数据集和实际酶网络数据集的分析,证明了所提出框架的有效性和实用性。
{"title":"An eigenvector-assisted estimation framework for signal-plus-noise matrix models","authors":"Fangzheng Xie, Dingbo Wu","doi":"10.1093/biomet/asad058","DOIUrl":"https://doi.org/10.1093/biomet/asad058","url":null,"abstract":"Summary In this paper, we develop an eigenvector-assisted estimation framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon a novel asymptotically unbiased estimating equation using the leading eigenvectors of the data matrix. However, the estimator obtained by directly solving the estimating equation could be numerically unstable in practice and lacks robustness against model misspecification. We propose to use the quasi-posterior distribution by exponentiating a criterion function whose maximizer coincides with the estimating equation estimator. The proposed framework can incorporate heteroskedastic variance information but does not require the complete specification of the sampling distribution and is also robust to the potential misspecification of the distribution of the noise matrix. Computationally, the quasi-posterior distribution can be obtained via a Markov Chain Monte Carlo sampler, which exhibits superior numerical stability than some of the existing optimization-based estimators and is straightforward for uncertainty quantification. Under mild regularity conditions, we establish the large sample properties of the quasi-posterior distributions. In particular, the quasi-posterior credible sets have the correct frequentist nominal coverage probability provided that the criterion function is carefully selected. The validity and usefulness of the proposed framework are demonstrated through the analysis of synthetic datasets and the real-world ENZYMES network datasets.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135060566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
E-values as unnormalized weights in multiple testing 在多重测试中,e值为非归一化权重
2区 数学 Q1 Mathematics Pub Date : 2023-09-15 DOI: 10.1093/biomet/asad057
Nikolaos Ignatiadis, Ruodu Wang, Aaditya Ramdas
Summary We study how to combine p-values and e-values, and design multiple testing procedures where both p-values and e-values are available for every hypothesis. Our results provide a new perspective on multiple testing with data-driven weights: while standard weighted multiple testing methods require the weights to deterministically add up to the number of hypotheses being tested, we show that this normalization is not required when the weights are e-values that are independent of the p-values. Such e-values can be obtained in meta-analysis where a primary dataset is used to compute p-values, and an independent secondary dataset is used to compute e-values. Going beyond meta-analysis, we showcase settings wherein independent e-values and p-values can be constructed on a single dataset itself. Our procedures can result in a substantial increase in power, especially if the non-null hypotheses have e-values much larger than one.
我们研究了如何结合p值和e值,并设计了多个检验程序,其中p值和e值对于每个假设都是可用的。我们的结果为使用数据驱动的权重进行多重测试提供了一个新的视角:虽然标准加权多重测试方法要求权重确定性地与被测试的假设数量相加,但我们表明,当权重是独立于p值的e值时,不需要这种归一化。这样的e值可以在meta分析中获得,其中使用主数据集计算p值,使用独立的辅助数据集计算e值。在meta分析之外,我们展示了可以在单个数据集本身上构建独立e值和p值的设置。我们的程序可以导致功率的大幅增加,特别是如果非零假设的e值远大于1。
{"title":"E-values as unnormalized weights in multiple testing","authors":"Nikolaos Ignatiadis, Ruodu Wang, Aaditya Ramdas","doi":"10.1093/biomet/asad057","DOIUrl":"https://doi.org/10.1093/biomet/asad057","url":null,"abstract":"Summary We study how to combine p-values and e-values, and design multiple testing procedures where both p-values and e-values are available for every hypothesis. Our results provide a new perspective on multiple testing with data-driven weights: while standard weighted multiple testing methods require the weights to deterministically add up to the number of hypotheses being tested, we show that this normalization is not required when the weights are e-values that are independent of the p-values. Such e-values can be obtained in meta-analysis where a primary dataset is used to compute p-values, and an independent secondary dataset is used to compute e-values. Going beyond meta-analysis, we showcase settings wherein independent e-values and p-values can be constructed on a single dataset itself. Our procedures can result in a substantial increase in power, especially if the non-null hypotheses have e-values much larger than one.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135436744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Retrospective causal inference with multiple effect variables 多效应变量的回顾性因果推理
2区 数学 Q1 Mathematics Pub Date : 2023-09-14 DOI: 10.1093/biomet/asad056
Wei Li, Zitong Lu, Jinzhu Jia, Min Xie, Zhi Geng
Summary As highlighted in Dawid (2000) and Pearl & Mackenzie (2018), deducing the causes of given effects is a more challenging problem than evaluating the effects of causes in causal inference. Lu et al. (2023) proposed an approach for deducing causes of a single effect variable based on posterior causal effects. In many applications, there are multiple effect variables, and thus they can be used simultaneously to more accurately deduce the causes. To retrospectively deduce causes from multiple effects, we propose multivariate posterior total, intervention and direct causal effects conditional on the observed evidence. We describe the assumptions of no-confounding and monotonicity, under which we prove identifiability of the multivariate posterior causal effects and provide their identification equations. The proposed approach can be applied for causal attributions, medical diagnosis, blame and responsibility in various studies with multiple effect or outcome variables. Two examples are used to illustrate the proposed approach.
david(2000)和Pearl &Mackenzie(2018)认为,在因果推理中,推断给定结果的原因比评估原因的影响更具挑战性。Lu等人(2023)提出了一种基于后验因果效应的方法来推断单个效应变量的原因。在许多应用中,有多个影响变量,因此可以同时使用它们来更准确地推断原因。为了从多重影响中回顾性地推断原因,我们提出了基于观察证据的多元后验效应、干预效应和直接因果效应。在无混杂和单调的假设下,我们证明了多元后验因果效应的可辨识性,并给出了它们的辨识方程。所提出的方法可以应用于各种具有多效果或结果变量的研究中的因果归因、医学诊断、责备和责任。用两个例子来说明所提出的方法。
{"title":"Retrospective causal inference with multiple effect variables","authors":"Wei Li, Zitong Lu, Jinzhu Jia, Min Xie, Zhi Geng","doi":"10.1093/biomet/asad056","DOIUrl":"https://doi.org/10.1093/biomet/asad056","url":null,"abstract":"Summary As highlighted in Dawid (2000) and Pearl & Mackenzie (2018), deducing the causes of given effects is a more challenging problem than evaluating the effects of causes in causal inference. Lu et al. (2023) proposed an approach for deducing causes of a single effect variable based on posterior causal effects. In many applications, there are multiple effect variables, and thus they can be used simultaneously to more accurately deduce the causes. To retrospectively deduce causes from multiple effects, we propose multivariate posterior total, intervention and direct causal effects conditional on the observed evidence. We describe the assumptions of no-confounding and monotonicity, under which we prove identifiability of the multivariate posterior causal effects and provide their identification equations. The proposed approach can be applied for causal attributions, medical diagnosis, blame and responsibility in various studies with multiple effect or outcome variables. Two examples are used to illustrate the proposed approach.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135552839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of prediction error in time series 时间序列预测误差的估计
2区 数学 Q1 Mathematics Pub Date : 2023-09-09 DOI: 10.1093/biomet/asad053
Alexander Aue, Prabir Burman
Summary The accurate estimation of prediction errors in time series is an important problem, which has immediate implications for the accuracy of prediction intervals as well as the quality of a number of widely used time series model selection criteria such as the Akaike information criterion. Except for simple cases, however, it is difficult or even impossible to obtain exact analytical expressions for one-step and multi-step predictions. This may be one of the reasons that, unlike in the independent case (see Efron, 2004), up to now there has been no fully established methodology for time series prediction error estimation. Starting from an approximation to the bias-variance decomposition of the squared prediction error, a method for accurate estimation of prediction errors in both univariate and multivariate stationary time series is developed in this article. In particular, several estimates are derived for a general class of predictors that includes most of the popular linear, nonlinear, parametric and nonparametric time series models used in practice, with causal invertible autoregressive moving average and nonparametric autoregressive processes discussed as lead examples. Simulations demonstrate that the proposed estimators perform quite well in finite samples. The estimates may also be used for model selection when the purpose of modelling is prediction.
时间序列预测误差的准确估计是一个重要的问题,它直接关系到预测区间的准确性以及一些广泛使用的时间序列模型选择准则(如赤池信息准则)的质量。然而,除了简单的情况外,很难甚至不可能获得一步和多步预测的精确解析表达式。这可能是原因之一,不像在独立的情况下(见Efron, 2004),到目前为止,还没有完全建立的方法来估计时间序列预测误差。本文从对预测误差平方的偏方差分解的近似出发,提出了一种单变量和多变量平稳时间序列预测误差的精确估计方法。特别是,对一般类型的预测器进行了一些估计,其中包括大多数流行的线性,非线性,参数和非参数时间序列模型,在实践中使用,因果可逆自回归移动平均和非参数自回归过程作为主要例子讨论。仿真结果表明,所提出的估计器在有限样本下具有良好的性能。当建模的目的是预测时,估计也可用于模型选择。
{"title":"Estimation of prediction error in time series","authors":"Alexander Aue, Prabir Burman","doi":"10.1093/biomet/asad053","DOIUrl":"https://doi.org/10.1093/biomet/asad053","url":null,"abstract":"Summary The accurate estimation of prediction errors in time series is an important problem, which has immediate implications for the accuracy of prediction intervals as well as the quality of a number of widely used time series model selection criteria such as the Akaike information criterion. Except for simple cases, however, it is difficult or even impossible to obtain exact analytical expressions for one-step and multi-step predictions. This may be one of the reasons that, unlike in the independent case (see Efron, 2004), up to now there has been no fully established methodology for time series prediction error estimation. Starting from an approximation to the bias-variance decomposition of the squared prediction error, a method for accurate estimation of prediction errors in both univariate and multivariate stationary time series is developed in this article. In particular, several estimates are derived for a general class of predictors that includes most of the popular linear, nonlinear, parametric and nonparametric time series models used in practice, with causal invertible autoregressive moving average and nonparametric autoregressive processes discussed as lead examples. Simulations demonstrate that the proposed estimators perform quite well in finite samples. The estimates may also be used for model selection when the purpose of modelling is prediction.","PeriodicalId":9001,"journal":{"name":"Biometrika","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136108242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Biometrika
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1