首页 > 最新文献

Annals of the Institute of Statistical Mathematics最新文献

英文 中文
Non-explicit formula of boundary crossing probabilities by the Girsanov theorem 用格萨诺夫定理求边界穿越概率的非显式公式
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-11-05 DOI: 10.1007/s10463-024-00917-6
Yoann Potiron

This paper derives several formulae for the probability that a Wiener process, which has a stochastic drift and random variance, crosses a one-sided stochastic boundary within a finite time interval. A non-explicit formula is first obtained by the Girsanov theorem when considering an equivalent probability measure in which the boundary is constant and equal to its starting value. A more explicit formula is then achieved by decomposing the Radon–Nikodym derivative inverse. This decomposition expresses it as the product of a random variable, which is measurable with respect to the Wiener process’s final value, and an independent random variable. We also provide an explicit formula based on a strong theoretical assumption. To apply the Girsanov theorem, we assume that the difference between the drift increment and the boundary increment, divided by the standard deviation, is absolutely continuous. Additionally, we assume that its derivative satisfies Novikov’s condition.

本文导出了具有随机漂移和随机方差的Wiener过程在有限时间间隔内越过单侧随机边界的概率的几个公式。在考虑边界为常数且等于其起始值的等效概率测度时,首先由Girsanov定理得到一个非显式公式。然后通过分解Radon-Nikodym导数逆得到一个更明确的公式。这种分解将其表示为一个随机变量(相对于维纳过程的最终值可测量)和一个独立随机变量的乘积。我们还提供了一个基于强有力的理论假设的明确公式。为了应用Girsanov定理,我们假设漂移增量和边界增量之间的差除以标准差是绝对连续的。另外,我们假定它的导数满足Novikov条件。
{"title":"Non-explicit formula of boundary crossing probabilities by the Girsanov theorem","authors":"Yoann Potiron","doi":"10.1007/s10463-024-00917-6","DOIUrl":"10.1007/s10463-024-00917-6","url":null,"abstract":"<div><p>This paper derives several formulae for the probability that a Wiener process, which has a stochastic drift and random variance, crosses a one-sided stochastic boundary within a finite time interval. A non-explicit formula is first obtained by the Girsanov theorem when considering an equivalent probability measure in which the boundary is constant and equal to its starting value. A more explicit formula is then achieved by decomposing the Radon–Nikodym derivative inverse. This decomposition expresses it as the product of a random variable, which is measurable with respect to the Wiener process’s final value, and an independent random variable. We also provide an explicit formula based on a strong theoretical assumption. To apply the Girsanov theorem, we assume that the difference between the drift increment and the boundary increment, divided by the standard deviation, is absolutely continuous. Additionally, we assume that its derivative satisfies Novikov’s condition.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 3","pages":"353 - 385"},"PeriodicalIF":0.8,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143879622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Model free feature screening for large scale and ultrahigh dimensional survival data 大规模和超高维生存数据的无模型特征筛选
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-10-19 DOI: 10.1007/s10463-024-00912-x
Yingli Pan, Haoyu Wang, Zhan Liu

This paper provides a novel perspective on feature screening in the analysis of high-dimensional right-censored large-p-large-N survival data. The research introduces a distributed feature screening method known as Aggregated Distance Correlation Screening (ADCS). The proposed screening framework involves expressing the distance correlation measure as a function of multiple component parameters, each of which can be estimated in a distributed manner using a natural U-statistic from data segments. By aggregating the component estimates, a final correlation estimate is obtained, facilitating feature screening. Importantly, this approach does not necessitate any specific model specification for responses or predictors and is effective with heavy-tailed data. The study establishes the consistency of the proposed aggregated correlation estimator (widetilde{omega }_{j}) under mild conditions and demonstrates the sure screening property of the ADCS. Empirical results from both simulated and real datasets confirm the efficacy and practicality of the ADCS approach proposed in this paper.

本文为高维右删大p-大n存活数据分析中的特征筛选提供了一个新的视角。本研究引入了一种分布式特征筛选方法——聚合距离相关筛选(ADCS)。提出的筛选框架包括将距离相关度量表示为多个组件参数的函数,每个组件参数都可以使用数据段的自然u统计量以分布式方式进行估计。通过汇总分量估计,得到最终的相关性估计,便于特征筛选。重要的是,这种方法不需要任何特定的模型规范来响应或预测,并且对重尾数据有效。研究建立了所提出的聚合相关估计器(widetilde{omega }_{j})在温和条件下的一致性,证明了ADCS具有可靠的筛选性能。模拟和真实数据集的实证结果证实了本文提出的ADCS方法的有效性和实用性。
{"title":"Model free feature screening for large scale and ultrahigh dimensional survival data","authors":"Yingli Pan,&nbsp;Haoyu Wang,&nbsp;Zhan Liu","doi":"10.1007/s10463-024-00912-x","DOIUrl":"10.1007/s10463-024-00912-x","url":null,"abstract":"<div><p>This paper provides a novel perspective on feature screening in the analysis of high-dimensional right-censored large-<i>p</i>-large-<i>N</i> survival data. The research introduces a distributed feature screening method known as Aggregated Distance Correlation Screening (ADCS). The proposed screening framework involves expressing the distance correlation measure as a function of multiple component parameters, each of which can be estimated in a distributed manner using a natural U-statistic from data segments. By aggregating the component estimates, a final correlation estimate is obtained, facilitating feature screening. Importantly, this approach does not necessitate any specific model specification for responses or predictors and is effective with heavy-tailed data. The study establishes the consistency of the proposed aggregated correlation estimator <span>(widetilde{omega }_{j})</span> under mild conditions and demonstrates the sure screening property of the ADCS. Empirical results from both simulated and real datasets confirm the efficacy and practicality of the ADCS approach proposed in this paper.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"155 - 190"},"PeriodicalIF":0.8,"publicationDate":"2024-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142912884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improved confidence intervals for nonlinear mixed-effects and nonparametric regression models 改进的非线性混合效应和非参数回归模型的置信区间
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-09-24 DOI: 10.1007/s10463-024-00909-6
Nan Zheng, Noel Cadigan

Statistical inference for high-dimensional parameters (HDPs) can leverage their intrinsic correlations, as spatially or temporally close parameters tend to have similar values. This is why nonlinear mixed-effects models (NMMs) are commonly used for HDPs. Conversely, in many practical applications, the random effects (REs) in NMMs are correlated HDPs that should remain constant during repeated sampling for frequentist inference. In both scenarios, the inference should be conditional on REs, instead of marginal inference by integrating out REs. We summarize recent theory of conditional inference for NMM, and then propose a bias-corrected RE predictor and confidence interval (CI). We also extend this methodology to accommodate the case where some REs are not associated with data. Simulation studies indicate our new approach leads to substantial improvement in the conditional coverage rate of RE CIs, including CIs for smooth functions in generalized additive models, compared to the existing method based on marginal inference.

高维参数(hdp)的统计推断可以利用它们的内在相关性,因为在空间或时间上接近的参数往往具有相似的值。这就是为什么非线性混合效果模型(nmm)通常用于高清图像。相反,在许多实际应用中,nmm中的随机效应(REs)是相关的hdp,在进行频率推断的重复采样期间应该保持恒定。在这两种情况下,推断都应该以REs为条件,而不是通过积分REs进行边际推断。我们总结了NMM条件推断的最新理论,然后提出了一个偏差校正的RE预测器和置信区间(CI)。我们还扩展了这种方法,以适应某些REs与数据不关联的情况。仿真研究表明,与基于边际推理的现有方法相比,我们的新方法大大提高了RE ci的条件覆盖率,包括广义加性模型中光滑函数的ci。
{"title":"Improved confidence intervals for nonlinear mixed-effects and nonparametric regression models","authors":"Nan Zheng,&nbsp;Noel Cadigan","doi":"10.1007/s10463-024-00909-6","DOIUrl":"10.1007/s10463-024-00909-6","url":null,"abstract":"<div><p>Statistical inference for high-dimensional parameters (HDPs) can leverage their intrinsic correlations, as spatially or temporally close parameters tend to have similar values. This is why nonlinear mixed-effects models (NMMs) are commonly used for HDPs. Conversely, in many practical applications, the random effects (REs) in NMMs are correlated HDPs that should remain constant during repeated sampling for frequentist inference. In both scenarios, the inference should be conditional on REs, instead of marginal inference by integrating out REs. We summarize recent theory of conditional inference for NMM, and then propose a bias-corrected RE predictor and confidence interval (CI). We also extend this methodology to accommodate the case where some REs are not associated with data. Simulation studies indicate our new approach leads to substantial improvement in the conditional coverage rate of RE CIs, including CIs for smooth functions in generalized additive models, compared to the existing method based on marginal inference.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"105 - 126"},"PeriodicalIF":0.8,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142912885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Information projection approach to smoothed propensity score weighting for handling selection bias under missing at random 信息投影法平滑倾向得分加权处理随机缺失下的选择偏差
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-09-21 DOI: 10.1007/s10463-024-00913-w
Hengfang Wang, Jae Kwang Kim

Propensity score weighting is widely used to correct the selection bias in the sample with missing data. The propensity score function is often developed using a model for the response probability, which completely ignores the outcome regression model. In this paper, we explore an alternative approach by developing smoothed propensity score weights that provide a more efficient estimation by removing unnecessary auxiliary variables in the propensity score model. The smoothed propensity score function is obtained by applying the information projection of the original propensity score function to the space that satisfies the moment conditions on the balancing scores obtained from the outcome regression model. By including the covariates for the outcome regression models only in the density ratio model, we can achieve an efficiency gain. Penalized regression is used to identify important covariates. Some limited simulation studies are presented to compare with the existing methods.

倾向得分加权被广泛用于修正缺失数据样本中的选择偏差。倾向得分函数通常采用响应概率模型,完全忽略了结果回归模型。在本文中,我们通过开发平滑倾向得分权重来探索一种替代方法,该方法通过去除倾向得分模型中不必要的辅助变量来提供更有效的估计。将原倾向得分函数的信息投影到结果回归模型得到的平衡得分满足矩条件的空间,得到平滑倾向得分函数。通过只在密度比模型中包含结果回归模型的协变量,我们可以获得效率增益。惩罚回归用于识别重要的协变量。提出了一些有限的仿真研究,与现有方法进行了比较。
{"title":"Information projection approach to smoothed propensity score weighting for handling selection bias under missing at random","authors":"Hengfang Wang,&nbsp;Jae Kwang Kim","doi":"10.1007/s10463-024-00913-w","DOIUrl":"10.1007/s10463-024-00913-w","url":null,"abstract":"<div><p>Propensity score weighting is widely used to correct the selection bias in the sample with missing data. The propensity score function is often developed using a model for the response probability, which completely ignores the outcome regression model. In this paper, we explore an alternative approach by developing smoothed propensity score weights that provide a more efficient estimation by removing unnecessary auxiliary variables in the propensity score model. The smoothed propensity score function is obtained by applying the information projection of the original propensity score function to the space that satisfies the moment conditions on the balancing scores obtained from the outcome regression model. By including the covariates for the outcome regression models only in the density ratio model, we can achieve an efficiency gain. Penalized regression is used to identify important covariates. Some limited simulation studies are presented to compare with the existing methods.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"127 - 153"},"PeriodicalIF":0.8,"publicationDate":"2024-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142913066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of value-at-risk by (L^{p}) quantile regression 用 $$L^{p}$$ 量化回归估算风险价值
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-09-19 DOI: 10.1007/s10463-024-00911-y
Peng Sun, Fuming Lin, Haiyang Xu, Kaizhi Yu

Exploring more accurate estimates of financial value at risk (VaR) has always been an important issue in applied statistics. To this end either quantile or expectile regression methods are widely employed at present, but an accumulating body of research indicates that (L^{p}) quantile regression outweighs both quantile and expectile regression in many aspects. In view of this, the paper extends (L^{p}) quantile regression to a general classical nonlinear conditional autoregressive model and proposes a new model called the conditional (L^{p}) quantile nonlinear autoregressive regression model (CAR-(L^{p})-quantile model for short). Limit theorems for regression estimators are proved in mild conditions, and algorithms are provided for obtaining parameter estimates and the optimal value of p. Simulation study of estimation’s quality is given. Then, a CLVaR method calculating VaR based on the CAR-(L^{p})-quantile model is elaborated. Finally, a real data analysis is conducted to illustrate virtues of our proposed methods.

探索更准确的金融风险价值(VaR)估计值一直是应用统计中的一个重要问题。为此,目前广泛采用的是量化回归法或期望回归法,但不断积累的研究表明,(L^{p}) 量化回归法在很多方面优于量化回归法和期望回归法。有鉴于此,本文将 (L^{p}) 量化回归扩展到一般的经典非线性条件自回归模型,并提出了一种新的模型,即条件 (L^{p}) 量化非线性自回归模型(简称 CAR-(L^{p})-quantile 模型)。在温和条件下证明了回归估计器的极限定理,并提供了获得参数估计和 p 最佳值的算法。然后,阐述了基于 CAR-(L^{p})-quantile 模型计算风险价值的 CLVaR 方法。最后,通过实际数据分析来说明我们提出的方法的优点。
{"title":"Estimation of value-at-risk by (L^{p}) quantile regression","authors":"Peng Sun,&nbsp;Fuming Lin,&nbsp;Haiyang Xu,&nbsp;Kaizhi Yu","doi":"10.1007/s10463-024-00911-y","DOIUrl":"10.1007/s10463-024-00911-y","url":null,"abstract":"<div><p>Exploring more accurate estimates of financial value at risk (VaR) has always been an important issue in applied statistics. To this end either quantile or expectile regression methods are widely employed at present, but an accumulating body of research indicates that <span>(L^{p})</span> quantile regression outweighs both quantile and expectile regression in many aspects. In view of this, the paper extends <span>(L^{p})</span> quantile regression to a general classical nonlinear conditional autoregressive model and proposes a new model called the conditional <span>(L^{p})</span> quantile nonlinear autoregressive regression model (CAR-<span>(L^{p})</span>-quantile model for short). Limit theorems for regression estimators are proved in mild conditions, and algorithms are provided for obtaining parameter estimates and the optimal value of <i>p</i>. Simulation study of estimation’s quality is given. Then, a CLVaR method calculating VaR based on the CAR-<span>(L^{p})</span>-quantile model is elaborated. Finally, a real data analysis is conducted to illustrate virtues of our proposed methods.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"25 - 59"},"PeriodicalIF":0.8,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simplified quasi-likelihood analysis for a locally asymptotically quadratic random field 局部渐近二次随机场的简化准概率分析
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-09-14 DOI: 10.1007/s10463-024-00907-8
Nakahiro Yoshida

The IHK program is a general framework in asymptotic decision theory, introduced by Ibragimov and Hasminskii and extended to semimartingales by Kutoyants. The quasi-likelihood analysis (QLA) asserts that a polynomial type large deviation inequality is always valid if the quasi-likelihood random field is asymptotically quadratic and if a key index reflecting the identifiability is non-degenerate. As a result, following the IHK program, the QLA gives a way to inference for various nonlinear stochastic processes. This paper provides a reformed and simplified version of the QLA and improves accessibility to the theory. As an example of the advantages of the scheme, the user can obtain asymptotic properties of the quasi-Bayesian estimator by only verifying non-degeneracy of the key index.

IHK 程序是渐近决策理论的一般框架,由 Ibragimov 和 Hasminskii 提出,并由 Kutoyants 扩展到半马尔廷态。准概率分析(QLA)认为,如果准概率随机场是渐近二次型的,而且反映可识别性的关键指数是非退化的,那么多项式类型的大偏差不等式总是有效的。因此,按照 IHK 程序,QLA 为各种非线性随机过程提供了推理方法。本文对 QLA 进行了改革和简化,提高了理论的可及性。作为该方案优势的一个例子,用户只需验证关键指数的非退化性,就能获得准贝叶斯估计器的渐近特性。
{"title":"Simplified quasi-likelihood analysis for a locally asymptotically quadratic random field","authors":"Nakahiro Yoshida","doi":"10.1007/s10463-024-00907-8","DOIUrl":"10.1007/s10463-024-00907-8","url":null,"abstract":"<div><p>The IHK program is a general framework in asymptotic decision theory, introduced by Ibragimov and Hasminskii and extended to semimartingales by Kutoyants. The quasi-likelihood analysis (QLA) asserts that a polynomial type large deviation inequality is always valid if the quasi-likelihood random field is asymptotically quadratic and if a key index reflecting the identifiability is non-degenerate. As a result, following the IHK program, the QLA gives a way to inference for various nonlinear stochastic processes. This paper provides a reformed and simplified version of the QLA and improves accessibility to the theory. As an example of the advantages of the scheme, the user can obtain asymptotic properties of the quasi-Bayesian estimator by only verifying non-degeneracy of the key index.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"1 - 24"},"PeriodicalIF":0.8,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142254403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Asymptotic expected sensitivity function and its applications to measures of monotone association 渐近预期灵敏度函数及其在单调关联测量中的应用
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-08-17 DOI: 10.1007/s10463-024-00910-z
Qingyang Zhang

We introduce a new type of influence function, the asymptotic expected sensitivity function, which is often equivalent to but mathematically more tractable than the traditional one based on the Gâteaux derivative. To illustrate, we study the robustness of some important measures of association, including Spearman’s rank correlation and Kendall’s concordance measure, and the recently developed Chatterjee’s correlation.

我们引入了一种新型的影响函数--渐近预期灵敏度函数,它通常等同于传统的基于 Gâteaux 导数的影响函数,但在数学上比它更容易理解。为了说明这一点,我们研究了一些重要关联测量的稳健性,包括斯皮尔曼等级相关性和肯德尔一致性测量,以及最近开发的查特吉相关性。
{"title":"Asymptotic expected sensitivity function and its applications to measures of monotone association","authors":"Qingyang Zhang","doi":"10.1007/s10463-024-00910-z","DOIUrl":"10.1007/s10463-024-00910-z","url":null,"abstract":"<div><p>We introduce a new type of influence function, the asymptotic expected sensitivity function, which is often equivalent to but mathematically more tractable than the traditional one based on the Gâteaux derivative. To illustrate, we study the robustness of some important measures of association, including Spearman’s rank correlation and Kendall’s concordance measure, and the recently developed Chatterjee’s correlation.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"76 5","pages":"877 - 896"},"PeriodicalIF":0.8,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Penalized estimation for non-identifiable models 不可识别模式的惩罚性估计
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-08-01 DOI: 10.1007/s10463-024-00905-w
Junichiro Yoshida, Nakahiro Yoshida

We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also validated. The problem that the true values lie on the boundary is solved by our previous results applicable to singular models, besides, penalized estimation and non-ergodic statistics. To overcome non-identifiability, we consider a suitable penalty such as the non-convex Bridge and the adaptive Lasso that stabilize the asymptotic behavior of the estimator and shrink inactive parameters. Then the estimator converges to one of the most parsimonious values among all the true values. The oracle property can also be obtained even if likelihood ratio tests for model selection are labor intensive due to singularity of models. Examples are: a superposition of parametric proportional hazard models and a counting process having intensity with multicollinear covariates.

我们推导了奇异模型的惩罚估计子的渐近特性,这些奇异模型的可识别性可能被破坏,真实参数值可能位于参数空间的边界上。我们还验证了估计器的选择一致性。除了惩罚估计和非啮合统计之外,我们以前适用于奇异模型的结果也解决了真值位于边界上的问题。为了克服不可识别性,我们考虑了合适的惩罚,如非凸桥和自适应拉索,它们能稳定估计器的渐近行为并缩小非活动参数。然后,估计器会收敛到所有真实值中最合理的一个值。即使由于模型的奇异性而导致模型选择的似然比检验耗费大量人力,也能获得神谕特性。例如:参数比例危险模型的叠加和具有多共线协变量强度的计数过程。
{"title":"Penalized estimation for non-identifiable models","authors":"Junichiro Yoshida,&nbsp;Nakahiro Yoshida","doi":"10.1007/s10463-024-00905-w","DOIUrl":"10.1007/s10463-024-00905-w","url":null,"abstract":"<div><p>We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also validated. The problem that the true values lie on the boundary is solved by our previous results applicable to singular models, besides, penalized estimation and non-ergodic statistics. To overcome non-identifiability, we consider a suitable penalty such as the non-convex Bridge and the adaptive Lasso that stabilize the asymptotic behavior of the estimator and shrink inactive parameters. Then the estimator converges to one of the most parsimonious values among all the true values. The oracle property can also be obtained even if likelihood ratio tests for model selection are labor intensive due to singularity of models. Examples are: a superposition of parametric proportional hazard models and a counting process having intensity with multicollinear covariates.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"76 5","pages":"765 - 796"},"PeriodicalIF":0.8,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141871728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hidden AR process and adaptive Kalman filter 隐藏的 AR 过程和自适应卡尔曼滤波器
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-07-25 DOI: 10.1007/s10463-024-00908-7
Yury A. Kutoyants

This work discusses a model of a partially observed linear system that depends on some unknown parameters. An approximation of the unobserved component is proposed, which involves three steps. First, a method of moment estimator of unknown parameters is constructed, and second, this estimator is used to define the one-step MLE-process. Finally, the last estimator is substituted into the equations of the Kalman filter. The solution of obtained equations provides us with the desired approximation (adaptive Kalman filter). The asymptotic properties of all the mentioned estimators and both maximum likelihood and Bayesian estimators of the unknown parameters are detailed. The asymptotic efficiency of adaptive filtering is discussed.

这项工作讨论的是一个部分观测到的线性系统模型,它取决于一些未知参数。本文提出了对未观测部分的近似方法,包括三个步骤。首先,构建未知参数的矩估计方法;其次,使用该估计方法定义一步 MLE 过程。最后,将最后一个估计器代入卡尔曼滤波方程。方程的求解为我们提供了所需的近似值(自适应卡尔曼滤波器)。本文详细介绍了所有上述估计器的渐近特性,以及未知参数的最大似然估计器和贝叶斯估计器。讨论了自适应滤波的渐近效率。
{"title":"Hidden AR process and adaptive Kalman filter","authors":"Yury A. Kutoyants","doi":"10.1007/s10463-024-00908-7","DOIUrl":"10.1007/s10463-024-00908-7","url":null,"abstract":"<div><p>This work discusses a model of a partially observed linear system that depends on some unknown parameters. An approximation of the unobserved component is proposed, which involves three steps. First, a method of moment estimator of unknown parameters is constructed, and second, this estimator is used to define the one-step MLE-process. Finally, the last estimator is substituted into the equations of the Kalman filter. The solution of obtained equations provides us with the desired approximation (adaptive Kalman filter). The asymptotic properties of all the mentioned estimators and both maximum likelihood and Bayesian estimators of the unknown parameters are detailed. The asymptotic efficiency of adaptive filtering is discussed.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"77 1","pages":"61 - 103"},"PeriodicalIF":0.8,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141774532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Minimizing robust density power-based divergences for general parametric density models 最小化一般参数密度模型的稳健密度幂基发散
IF 0.8 4区 数学 Q3 STATISTICS & PROBABILITY Pub Date : 2024-05-02 DOI: 10.1007/s10463-024-00906-9
Akifumi Okuno

Density power divergence (DPD) is designed to robustly estimate the underlying distribution of observations, in the presence of outliers. However, DPD involves an integral of the power of the parametric density models to be estimated; the explicit form of the integral term can be derived only for specific densities, such as normal and exponential densities. While we may perform a numerical integration for each iteration of the optimization algorithms, the computational complexity has hindered the practical application of DPD-based estimation to more general parametric densities. To address the issue, this study introduces a stochastic approach to minimize DPD for general parametric density models. The proposed approach can also be employed to minimize other density power-based (gamma)-divergences, by leveraging unnormalized models. We provide R package for implementation of the proposed approach in https://github.com/oknakfm/sgdpd.

密度幂发散(DPD)的目的是在存在异常值的情况下,稳健地估计观测数据的基本分布。然而,DPD 涉及待估算参数密度模型的幂积分;积分项的明确形式只能针对特定密度(如正态密度和指数密度)进行推导。虽然我们可以对优化算法的每次迭代进行数值积分,但计算复杂性阻碍了基于 DPD 的估计方法在更一般的参数密度中的实际应用。为了解决这个问题,本研究引入了一种随机方法,以最小化一般参数密度模型的 DPD。通过利用非规范化模型,所提出的方法也可用于最小化其他基于密度幂次的(gamma)-差分。我们提供了 R 软件包,用于在 https://github.com/oknakfm/sgdpd 中实现所提出的方法。
{"title":"Minimizing robust density power-based divergences for general parametric density models","authors":"Akifumi Okuno","doi":"10.1007/s10463-024-00906-9","DOIUrl":"10.1007/s10463-024-00906-9","url":null,"abstract":"<div><p>Density power divergence (DPD) is designed to robustly estimate the underlying distribution of observations, in the presence of outliers. However, DPD involves an integral of the power of the parametric density models to be estimated; the explicit form of the integral term can be derived only for specific densities, such as normal and exponential densities. While we may perform a numerical integration for each iteration of the optimization algorithms, the computational complexity has hindered the practical application of DPD-based estimation to more general parametric densities. To address the issue, this study introduces a stochastic approach to minimize DPD for general parametric density models. The proposed approach can also be employed to minimize other density power-based <span>(gamma)</span>-divergences, by leveraging unnormalized models. We provide <span>R</span> package for implementation of the proposed approach in https://github.com/oknakfm/sgdpd.</p></div>","PeriodicalId":55511,"journal":{"name":"Annals of the Institute of Statistical Mathematics","volume":"76 5","pages":"851 - 875"},"PeriodicalIF":0.8,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140888409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Annals of the Institute of Statistical Mathematics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1