首页 > 最新文献

Journal of Multivariate Analysis最新文献

英文 中文
Online stochastic Newton methods for estimating the geometric median and applications 估计几何中值的在线随机牛顿方法及其应用
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-03-19 DOI: 10.1016/j.jmva.2024.105313
Antoine Godichon-Baggioni , Wei Lu

In the context of large samples, a small number of individuals might spoil basic statistical indicators like the mean. It is difficult to detect automatically these atypical individuals, and an alternative strategy is using robust approaches. This paper focuses on estimating the geometric median of a random variable, which is a robust indicator of central tendency. In order to deal with large samples of data arriving sequentially, online stochastic Newton algorithms for estimating the geometric median are introduced and we give their rates of convergence. Since estimates of the median and those of the Hessian matrix can be recursively updated, we also determine confidences intervals of the median in any designated direction and perform online statistical tests.

在大量样本中,少数个体可能会破坏基本的统计指标,如平均值。要自动检测出这些非典型个体是很困难的,另一种策略是使用稳健方法。本文的重点是估计随机变量的几何中值,它是中心倾向的稳健指标。为了处理连续到达的大量数据样本,本文介绍了估算几何中值的在线随机牛顿算法,并给出了其收敛率。由于中位数和黑森矩阵的估计值可以递归更新,我们还确定了中位数在任意指定方向上的置信区间,并进行了在线统计检验。
{"title":"Online stochastic Newton methods for estimating the geometric median and applications","authors":"Antoine Godichon-Baggioni ,&nbsp;Wei Lu","doi":"10.1016/j.jmva.2024.105313","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105313","url":null,"abstract":"<div><p>In the context of large samples, a small number of individuals might spoil basic statistical indicators like the mean. It is difficult to detect automatically these atypical individuals, and an alternative strategy is using robust approaches. This paper focuses on estimating the geometric median of a random variable, which is a robust indicator of central tendency. In order to deal with large samples of data arriving sequentially, online stochastic Newton algorithms for estimating the geometric median are introduced and we give their rates of convergence. Since estimates of the median and those of the Hessian matrix can be recursively updated, we also determine confidences intervals of the median in any designated direction and perform online statistical tests.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140191763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A consistent test of equality of distributions for Hilbert-valued random elements 希尔伯特值随机元素分布相等的一致性检验
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-03-15 DOI: 10.1016/j.jmva.2024.105312
Gil González–Rodríguez , Ana Colubi , Wenceslao González–Manteiga , Manuel Febrero–Bande

Two independent random elements taking values in a separable Hilbert space are considered. The aim is to develop a test with bootstrap calibration to check whether they have the same distribution or not. A transformation of both random elements into a new separable Hilbert space is considered so that the equality of expectations of the transformed random elements is equivalent to the equality of distributions. Thus, a bootstrap test procedure to check the equality of means can be used in order to solve the original problem. It will be shown that both the asymptotic and bootstrap approaches proposed are asymptotically correct and consistent. The results can be applied, for example, in functional data analysis. In practice, the test can be solved with simple operations in the original space without applying the mentioned transformation, which is used only to guarantee the theoretical results. Empirical results and comparisons with related methods support and complement the theory.

研究考虑了在可分离的希尔伯特空间取值的两个独立随机元素。目的是开发一种自举校准检验方法,以检查它们是否具有相同的分布。考虑将两个随机元素变换到一个新的可分离的希尔伯特空间,这样变换后的随机元素的期望相等就等同于分布相等。因此,可以使用自举检验程序来检查均值是否相等,从而解决原始问题。我们将证明所提出的渐进方法和引导方法在渐进上都是正确和一致的。这些结果可用于函数数据分析等。在实践中,只需在原始空间中进行简单的操作就能解决测试问题,而无需应用上述转换,因为转换只是为了保证理论结果。经验结果以及与相关方法的比较支持并补充了理论。
{"title":"A consistent test of equality of distributions for Hilbert-valued random elements","authors":"Gil González–Rodríguez ,&nbsp;Ana Colubi ,&nbsp;Wenceslao González–Manteiga ,&nbsp;Manuel Febrero–Bande","doi":"10.1016/j.jmva.2024.105312","DOIUrl":"10.1016/j.jmva.2024.105312","url":null,"abstract":"<div><p>Two independent random elements taking values in a separable Hilbert space are considered. The aim is to develop a test with bootstrap calibration to check whether they have the same distribution or not. A transformation of both random elements into a new separable Hilbert space is considered so that the equality of expectations of the transformed random elements is equivalent to the equality of distributions. Thus, a bootstrap test procedure to check the equality of means can be used in order to solve the original problem. It will be shown that both the asymptotic and bootstrap approaches proposed are asymptotically correct and consistent. The results can be applied, for example, in functional data analysis. In practice, the test can be solved with simple operations in the original space without applying the mentioned transformation, which is used only to guarantee the theoretical results. Empirical results and comparisons with related methods support and complement the theory.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0047259X24000198/pdfft?md5=6bc123f9555c6b95bcd432fc26329ddb&pid=1-s2.0-S0047259X24000198-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140152986","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Change point analysis of functional variance function with stationary error 具有静态误差的函数方差函数的变化点分析
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-03-11 DOI: 10.1016/j.jmva.2024.105311
Qirui Hu

An asymptotically correct test for an abrupt break in functional variance function of measurement error in the functional sequence and the confidence interval of change point is constructed. Under general assumptions, the test and detection procedure conducted by Spline-backfitted kernel smoothing, i.e., recovering trajectories with B-spline and estimating variance function with kernel regression, enjoy oracle efficiency, namely, the proposed procedure is asymptotically indistinguishable from that with accurate trajectories. Furthermore, a consistent algorithm for multiple change points based on the binary segment is derived. Extensive simulation studies reveal a positive confirmation of the asymptotic theory. The proposed method is applied to analyze EEG data.

构建了一个渐近正确的函数序列中测量误差的函数方差函数突然中断的检验方法和变化点的置信区间。在一般假设条件下,用 B-样条曲线恢复轨迹和核回归估计方差函数的 Spline-backfitted 核平滑法进行的检验和检测程序具有 Oracle 效率,即所提出的程序与使用精确轨迹的程序在渐近上没有区别。此外,还推导出一种基于二元段的多变化点一致算法。广泛的模拟研究表明,渐近理论得到了积极的证实。所提出的方法被应用于分析脑电图数据。
{"title":"Change point analysis of functional variance function with stationary error","authors":"Qirui Hu","doi":"10.1016/j.jmva.2024.105311","DOIUrl":"10.1016/j.jmva.2024.105311","url":null,"abstract":"<div><p>An asymptotically correct test for an abrupt break in functional variance function of measurement error in the functional sequence and the confidence interval of change point is constructed. Under general assumptions, the test and detection procedure conducted by Spline-backfitted kernel smoothing, i.e., recovering trajectories with B-spline and estimating variance function with kernel regression, enjoy oracle efficiency, namely, the proposed procedure is asymptotically indistinguishable from that with accurate trajectories. Furthermore, a consistent algorithm for multiple change points based on the binary segment is derived. Extensive simulation studies reveal a positive confirmation of the asymptotic theory. The proposed method is applied to analyze EEG data.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140152987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On heavy-tailed risks under Gaussian copula: The effects of marginal transformation 高斯共轭下的重尾风险:边际转换的影响
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-03-01 DOI: 10.1016/j.jmva.2024.105310
Bikramjit Das , Vicky Fasen-Hartmann

In this paper, we compute multivariate tail risk probabilities where the marginal risks are heavy-tailed and the dependence structure is a Gaussian copula. The marginal heavy-tailed risks are modeled using regular variation which leads to a few interesting consequences. First, as the threshold increases, we note that the rate of decay of probabilities of tail sets varies depending on the type of tail sets considered and the Gaussian correlation matrix. Second, we discover that although any multivariate model with a Gaussian copula admits the so-called asymptotic tail independence property, the joint tail behavior under heavier tailed marginal variables is structurally distinct from that under Gaussian marginal variables. The results obtained are illustrated using examples and simulations.

在本文中,我们计算了边际风险为重尾且依赖结构为高斯共轭的多元尾部风险概率。边际重尾风险采用正则变异建模,这会带来一些有趣的结果。首先,随着阈值的增加,我们注意到尾集概率的衰减率会随着所考虑的尾集类型和高斯相关矩阵的不同而变化。其次,我们发现尽管任何具有高斯共轭的多元模型都具有所谓的渐近尾部独立性,但在重尾边际变量下的联合尾部行为与高斯边际变量下的联合尾部行为在结构上是不同的。我们将通过实例和模拟来说明所获得的结果。
{"title":"On heavy-tailed risks under Gaussian copula: The effects of marginal transformation","authors":"Bikramjit Das ,&nbsp;Vicky Fasen-Hartmann","doi":"10.1016/j.jmva.2024.105310","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105310","url":null,"abstract":"<div><p>In this paper, we compute multivariate tail risk probabilities where the marginal risks are heavy-tailed and the dependence structure is a Gaussian copula. The marginal heavy-tailed risks are modeled using regular variation which leads to a few interesting consequences. First, as the threshold increases, we note that the rate of decay of probabilities of tail sets varies depending on the type of tail sets considered and the Gaussian correlation matrix. Second, we discover that although any multivariate model with a Gaussian copula admits the so-called asymptotic tail independence property, the joint tail behavior under heavier tailed marginal variables is structurally distinct from that under Gaussian marginal variables. The results obtained are illustrated using examples and simulations.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140031062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
High-dimensional nonconvex LASSO-type M-estimators 高维非凸 LASSO 型 M 估计器
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-27 DOI: 10.1016/j.jmva.2024.105303
Jad Beyhum , François Portier

A theory is developed to examine the convergence properties of 1-norm penalized high-dimensional M-estimators, with nonconvex risk and unrestricted domain. Under high-level conditions, the estimators are shown to attain the rate of convergence s0log(nd)/n, where s0 is the number of nonzero coefficients of the parameter of interest. Sufficient conditions for our main assumptions are then developed and finally used in several examples including robust linear regression, binary classification and nonlinear least squares.

本文提出了一种理论来研究具有非凸风险和非限制域的ℓ1-norm 惩罚高维 M-估计子的收敛特性。在高层条件下,估计器的收敛速率为 s0log(nd)/n,其中 s0 为相关参数的非零系数数。然后,我们提出了主要假设的充分条件,并最终将其用于几个例子中,包括稳健线性回归、二元分类和非线性最小二乘法。
{"title":"High-dimensional nonconvex LASSO-type M-estimators","authors":"Jad Beyhum ,&nbsp;François Portier","doi":"10.1016/j.jmva.2024.105303","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105303","url":null,"abstract":"<div><p>A theory is developed to examine the convergence properties of <span><math><msub><mrow><mi>ℓ</mi></mrow><mrow><mn>1</mn></mrow></msub></math></span>-norm penalized high-dimensional <span><math><mi>M</mi></math></span>-estimators, with nonconvex risk and unrestricted domain. Under high-level conditions, the estimators are shown to attain the rate of convergence <span><math><mrow><msub><mrow><mi>s</mi></mrow><mrow><mn>0</mn></mrow></msub><msqrt><mrow><mo>log</mo><mrow><mo>(</mo><mi>n</mi><mi>d</mi><mo>)</mo></mrow><mo>/</mo><mi>n</mi></mrow></msqrt></mrow></math></span>, where <span><math><msub><mrow><mi>s</mi></mrow><mrow><mn>0</mn></mrow></msub></math></span> is the number of nonzero coefficients of the parameter of interest. Sufficient conditions for our main assumptions are then developed and finally used in several examples including robust linear regression, binary classification and nonlinear least squares.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139986808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Nonlinear sufficient dimension reduction for distribution-on-distribution regression 分布对分布回归的非线性充分降维
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-27 DOI: 10.1016/j.jmva.2024.105302
Qi Zhang, Bing Li, Lingzhou Xue

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels (cc-universal) on the metric spaces, which results in reproducing kernel Hilbert spaces for the predictor and response that are rich enough to characterize the conditional independence that determines sufficient dimension reduction. For univariate distributions, we construct the universal kernel using the Wasserstein distance, while for multivariate distributions, we resort to the sliced Wasserstein distance. The sliced Wasserstein distance ensures that the metric space possesses similar topological properties to the Wasserstein space, while also offering significant computation benefits. Numerical results based on synthetic data show that our method outperforms possible competing methods. The method is also applied to several data sets, including fertility and mortality data and Calgary temperature data.

在预测因子和响应因子都是分布数据的情况下,我们引入了一种新的非线性充分降维方法。我们的关键步骤是在度量空间上建立通用核(cc-universal),从而为预测因子和响应再现核希尔伯特空间,这些空间的丰富程度足以描述决定充分降维的条件独立性。对于单变量分布,我们使用 Wasserstein 距离构建通用核,而对于多变量分布,我们则使用切分 Wasserstein 距离。切片瓦瑟斯坦距离可确保度量空间具有与瓦瑟斯坦空间相似的拓扑特性,同时还具有显著的计算优势。基于合成数据的数值结果表明,我们的方法优于可能的竞争方法。该方法还应用于多个数据集,包括生育率和死亡率数据以及卡尔加里温度数据。
{"title":"Nonlinear sufficient dimension reduction for distribution-on-distribution regression","authors":"Qi Zhang,&nbsp;Bing Li,&nbsp;Lingzhou Xue","doi":"10.1016/j.jmva.2024.105302","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105302","url":null,"abstract":"<div><p>We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels (cc-universal) on the metric spaces, which results in reproducing kernel Hilbert spaces for the predictor and response that are rich enough to characterize the conditional independence that determines sufficient dimension reduction. For univariate distributions, we construct the universal kernel using the Wasserstein distance, while for multivariate distributions, we resort to the sliced Wasserstein distance. The sliced Wasserstein distance ensures that the metric space possesses similar topological properties to the Wasserstein space, while also offering significant computation benefits. Numerical results based on synthetic data show that our method outperforms possible competing methods. The method is also applied to several data sets, including fertility and mortality data and Calgary temperature data.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139986807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Linearized maximum rank correlation estimation when covariates are functional 协变量为函数时的线性化最大秩相关估计
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-24 DOI: 10.1016/j.jmva.2024.105301
Wenchao Xu , Xinyu Zhang , Hua Liang

This paper extends the linearized maximum rank correlation (LMRC) estimation proposed by Shen et al. (2023) to the setting where the covariate is a function. However, this extension is nontrivial due to the difficulty of inverting the covariance operator, which may raise the ill-posed inverse problem, for which we integrate the functional principal component analysis to the LMRC procedure. The proposed estimator is robust to outliers in response and computationally efficient. We establish the rate of convergence of the proposed estimator, which is minimax optimal under certain smoothness assumptions. Furthermore, we extend the proposed estimation procedure to handle discretely observed functional covariates, including both sparse and dense sampling designs, and establish the corresponding rate of convergence. Simulation studies demonstrate that the proposed estimators outperform the other existing methods for some examples. Finally, we apply our method to a real data to illustrate its usefulness.

本文将 Shen 等人(2023 年)提出的线性化最大秩相关(LMRC)估计扩展到协方差是函数的情况。然而,由于难以反演协方差算子,这一扩展并非易事,这可能会引起难以解决的逆问题,为此我们将函数主成分分析整合到 LMRC 程序中。所提出的估计器对响应中的异常值具有鲁棒性,而且计算效率高。我们确定了所提估计器的收敛率,在某些平稳性假设条件下,它是最小最优的。此外,我们还扩展了提议的估计程序,以处理离散观测的函数协变量,包括稀疏和密集采样设计,并确定了相应的收敛率。模拟研究表明,在某些例子中,所提出的估计方法优于其他现有方法。最后,我们将我们的方法应用于真实数据,以说明其实用性。
{"title":"Linearized maximum rank correlation estimation when covariates are functional","authors":"Wenchao Xu ,&nbsp;Xinyu Zhang ,&nbsp;Hua Liang","doi":"10.1016/j.jmva.2024.105301","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105301","url":null,"abstract":"<div><p>This paper extends the linearized maximum rank correlation (LMRC) estimation proposed by Shen et al. (2023) to the setting where the covariate is a function. However, this extension is nontrivial due to the difficulty of inverting the covariance operator, which may raise the ill-posed inverse problem, for which we integrate the functional principal component analysis to the LMRC procedure. The proposed estimator is robust to outliers in response and computationally efficient. We establish the rate of convergence of the proposed estimator, which is minimax optimal under certain smoothness assumptions. Furthermore, we extend the proposed estimation procedure to handle discretely observed functional covariates, including both sparse and dense sampling designs, and establish the corresponding rate of convergence. Simulation studies demonstrate that the proposed estimators outperform the other existing methods for some examples. Finally, we apply our method to a real data to illustrate its usefulness.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139975931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Variable selection in multivariate regression models with measurement error in covariates 具有协变量测量误差的多元回归模型中的变量选择
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-17 DOI: 10.1016/j.jmva.2024.105299
Jingyu Cui , Grace Y. Yi

Multivariate regression models have been broadly used in analyzing data having multi-dimensional response variables. The use of such models is, however, impeded by the presence of measurement error and spurious variables. While data with such features are common in applications, there has been little work available concerning these features jointly. In this article, we consider variable selection under multivariate regression models with covariates subject to measurement error. To gain flexibility, we allow the dimensions of the covariate and response variables to be either fixed or diverging as the sample size increases. A new regularized method is proposed to handle both variable selection and measurement error effects for error-contaminated data. Our proposed penalized bias-corrected least squares method offers flexibility in selecting the penalty function from a class of functions with different features. Importantly, our method does not require full distributional assumptions for the associated variables, thereby broadening its applicability. We rigorously establish theoretical results and describe a computationally efficient procedure for the proposed method. Numerical studies confirm the satisfactory performance of the proposed method under finite settings, and also demonstrate deleterious effects of ignoring measurement error in inferential procedures.

多变量回归模型被广泛用于分析具有多维响应变量的数据。然而,测量误差和虚假变量的存在阻碍了此类模型的使用。虽然具有这些特征的数据在应用中很常见,但有关这些特征的研究却很少。在本文中,我们考虑了具有测量误差协变量的多元回归模型下的变量选择问题。为了获得灵活性,我们允许协变量和响应变量的维度是固定的,或者随着样本量的增加而发散。我们提出了一种新的正则化方法来处理误差污染数据的变量选择和测量误差效应。我们提出的惩罚偏差校正最小二乘法可以灵活地从一类具有不同特征的函数中选择惩罚函数。重要的是,我们的方法不需要相关变量的完全分布假设,从而扩大了其适用范围。我们为所提出的方法建立了严谨的理论结果,并描述了计算效率高的程序。数值研究证实了所提方法在有限设置下的令人满意的性能,同时也证明了在推断程序中忽略测量误差的有害影响。
{"title":"Variable selection in multivariate regression models with measurement error in covariates","authors":"Jingyu Cui ,&nbsp;Grace Y. Yi","doi":"10.1016/j.jmva.2024.105299","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105299","url":null,"abstract":"<div><p>Multivariate regression models have been broadly used in analyzing data having multi-dimensional response variables. The use of such models is, however, impeded by the presence of measurement error and spurious variables. While data with such features are common in applications, there has been little work available concerning these features jointly. In this article, we consider variable selection under multivariate regression models with covariates subject to measurement error. To gain flexibility, we allow the dimensions of the covariate and response variables to be either fixed or diverging as the sample size increases. A new regularized method is proposed to handle both variable selection and measurement error effects for error-contaminated data. Our proposed penalized bias-corrected least squares method offers flexibility in selecting the penalty function from a class of functions with different features. Importantly, our method does not require full distributional assumptions for the associated variables, thereby broadening its applicability. We rigorously establish theoretical results and describe a computationally efficient procedure for the proposed method. Numerical studies confirm the satisfactory performance of the proposed method under finite settings, and also demonstrate deleterious effects of ignoring measurement error in inferential procedures.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139998890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Latent model extreme value index estimation 潜在模型极值指数估算
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-15 DOI: 10.1016/j.jmva.2024.105300
Joni Virta , Niko Lietzén , Lauri Viitasaari , Pauliina Ilmonen

We propose a novel strategy for multivariate extreme value index estimation. In applications such as finance, volatility and risk of multivariate time series are often driven by the same underlying factors. To estimate the latent risks, we apply a two-stage procedure. First, a set of independent latent series is estimated using a method of latent variable analysis. Then, univariate risk measures are estimated individually for the latent series. We provide conditions under which the effect of the latent model estimation to the asymptotic behavior of the risk estimators is negligible. Simulations illustrate the theory under both i.i.d. and dependent data, and an application into currency exchange rate data shows that the method is able to discover extreme behavior not found by component-wise analysis of the original series.

我们提出了一种新的多元极值指数估算策略。在金融等应用中,多元时间序列的波动性和风险通常由相同的潜在因素驱动。为了估计潜在风险,我们采用了两阶段程序。首先,使用潜在变量分析方法估计一组独立的潜在序列。然后,对潜在序列分别估算单变量风险度量。我们提供了一些条件,在这些条件下,潜在模型估计对风险估计器渐近行为的影响可以忽略不计。模拟说明了 i.i.d. 数据和依赖数据下的理论,货币汇率数据的应用表明,该方法能够发现对原始序列进行分量分析所无法发现的极端行为。
{"title":"Latent model extreme value index estimation","authors":"Joni Virta ,&nbsp;Niko Lietzén ,&nbsp;Lauri Viitasaari ,&nbsp;Pauliina Ilmonen","doi":"10.1016/j.jmva.2024.105300","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105300","url":null,"abstract":"<div><p>We propose a novel strategy for multivariate extreme value index estimation. In applications such as finance, volatility and risk of multivariate time series are often driven by the same underlying factors. To estimate the latent risks, we apply a two-stage procedure. First, a set of independent latent series is estimated using a method of latent variable analysis. Then, univariate risk measures are estimated individually for the latent series. We provide conditions under which the effect of the latent model estimation to the asymptotic behavior of the risk estimators is negligible. Simulations illustrate the theory under both i.i.d. and dependent data, and an application into currency exchange rate data shows that the method is able to discover extreme behavior not found by component-wise analysis of the original series.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0047259X24000071/pdfft?md5=ce435e68e1036f63dbf20ffeb86fc426&pid=1-s2.0-S0047259X24000071-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139743276","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of multiple networks with common structures in heterogeneous subgroups 估计异质分组中具有共同结构的多个网络
IF 1.6 3区 数学 Q2 Mathematics Pub Date : 2024-02-13 DOI: 10.1016/j.jmva.2024.105298
Xing Qin , Jianhua Hu , Shuangge Ma , Mengyun Wu

Network estimation has been a critical component of high-dimensional data analysis and can provide an understanding of the underlying complex dependence structures. Among the existing studies, Gaussian graphical models have been highly popular. However, they still have limitations due to the homogeneous distribution assumption and the fact that they are only applicable to small-scale data. For example, cancers have various levels of unknown heterogeneity, and biological networks, which include thousands of molecular components, often differ across subgroups while also sharing some commonalities. In this article, we propose a new joint estimation approach for multiple networks with unknown sample heterogeneity, by decomposing the Gaussian graphical model (GGM) into a collection of sparse regression problems. A reparameterization technique and a composite minimax concave penalty are introduced to effectively accommodate the specific and common information across the networks of multiple subgroups, making the proposed estimator significantly advancing from the existing heterogeneity network analysis based on the regularized likelihood of GGM directly and enjoying scale-invariant, tuning-insensitive, and optimization convexity properties. The proposed analysis can be effectively realized using parallel computing. The estimation and selection consistency properties are rigorously established. The proposed approach allows the theoretical studies to focus on independent network estimation only and has the significant advantage of being both theoretically and computationally applicable to large-scale data. Extensive numerical experiments with simulated data and the TCGA breast cancer data demonstrate the prominent performance of the proposed approach in both subgroup and network identifications.

网络估算一直是高维数据分析的重要组成部分,可以帮助人们了解潜在的复杂依赖结构。在现有的研究中,高斯图形模型一直很受欢迎。然而,由于存在均匀分布假设,而且只适用于小规模数据,因此它们仍然存在局限性。例如,癌症具有不同程度的未知异质性,而生物网络包括成千上万的分子成分,在不同亚组之间往往存在差异,同时也有一些共性。在本文中,我们将高斯图形模型(GGM)分解为一系列稀疏回归问题,从而为具有未知样本异质性的多个网络提出了一种新的联合估计方法。本文引入了重参数化技术和复合 minimax 凹惩罚,有效地兼顾了多个子群网络的特殊信息和共性信息,使得所提出的估计方法明显优于现有的直接基于 GGM 正则化似然的异质性网络分析方法,并具有规模不变性、调谐不敏感性和优化凸性等特性。利用并行计算可以有效地实现所提出的分析。估算和选择的一致性得到了严格确立。所提出的方法使理论研究只关注独立网络的估计,并具有理论上和计算上都适用于大规模数据的显著优势。利用模拟数据和 TCGA 乳腺癌数据进行的大量数值实验证明了所提方法在亚组和网络识别方面的突出性能。
{"title":"Estimation of multiple networks with common structures in heterogeneous subgroups","authors":"Xing Qin ,&nbsp;Jianhua Hu ,&nbsp;Shuangge Ma ,&nbsp;Mengyun Wu","doi":"10.1016/j.jmva.2024.105298","DOIUrl":"https://doi.org/10.1016/j.jmva.2024.105298","url":null,"abstract":"<div><p>Network estimation has been a critical component of high-dimensional data analysis and can provide an understanding of the underlying complex dependence structures. Among the existing studies, Gaussian graphical models have been highly popular. However, they still have limitations due to the homogeneous distribution assumption and the fact that they are only applicable to small-scale data. For example, cancers have various levels of unknown heterogeneity, and biological networks, which include thousands of molecular components, often differ across subgroups while also sharing some commonalities. In this article, we propose a new joint estimation approach for multiple networks with unknown sample heterogeneity, by decomposing the Gaussian graphical model (GGM) into a collection of sparse regression problems. A reparameterization technique and a composite minimax concave penalty are introduced to effectively accommodate the specific and common information across the networks of multiple subgroups, making the proposed estimator significantly advancing from the existing heterogeneity network analysis based on the regularized likelihood of GGM directly and enjoying scale-invariant, tuning-insensitive, and optimization convexity properties. The proposed analysis can be effectively realized using parallel computing. The estimation and selection consistency properties are rigorously established. The proposed approach allows the theoretical studies to focus on independent network estimation only and has the significant advantage of being both theoretically and computationally applicable to large-scale data. Extensive numerical experiments with simulated data and the TCGA breast cancer data demonstrate the prominent performance of the proposed approach in both subgroup and network identifications.</p></div>","PeriodicalId":16431,"journal":{"name":"Journal of Multivariate Analysis","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139749242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Multivariate Analysis
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1