{"title":"Nuclear norm regularized estimation of panel regression models","authors":"M. Weidner, H. Moon","doi":"10.1920/WP.CEM.2019.1419","DOIUrl":null,"url":null,"abstract":"In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The fi rst method minimizes the sum of squared residuals with a nuclear (trace) norm regularization. The second method minimizes the nuclear norm of the residuals. We establish the consistency of the two resulting estimators. Those estimators have a very important computational advantage compared to the existing least squares (LS) estimator, in that they are de fined as minimizers of a convex objective function. In addition, the nuclear norm penalization helps to resolve a potential identifi cation problem for interactive fixed effect models, in particular when the regressors are low-rank and the number of the factors is unknown. We also show how to construct estimators that are asymptotically equivalent to the least squares (LS) estimator in Bai (2009) and Moon and Weidner (2017) by using our nuclear norm regularized or minimized estimators as initial values for a nite number of LS minimizing iteration steps. This iteration avoids any non-convex minimization, while the original LS estimation problem is generally non-convex, and can have multiple local minima.","PeriodicalId":8448,"journal":{"name":"arXiv: Econometrics","volume":"51 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2018-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"43","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv: Econometrics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1920/WP.CEM.2019.1419","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 43
Abstract
In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The fi rst method minimizes the sum of squared residuals with a nuclear (trace) norm regularization. The second method minimizes the nuclear norm of the residuals. We establish the consistency of the two resulting estimators. Those estimators have a very important computational advantage compared to the existing least squares (LS) estimator, in that they are de fined as minimizers of a convex objective function. In addition, the nuclear norm penalization helps to resolve a potential identifi cation problem for interactive fixed effect models, in particular when the regressors are low-rank and the number of the factors is unknown. We also show how to construct estimators that are asymptotically equivalent to the least squares (LS) estimator in Bai (2009) and Moon and Weidner (2017) by using our nuclear norm regularized or minimized estimators as initial values for a nite number of LS minimizing iteration steps. This iteration avoids any non-convex minimization, while the original LS estimation problem is generally non-convex, and can have multiple local minima.
本文研究了具有交互固定效应的面板回归模型。提出了两种基于凸目标函数最小化的估计方法。第一种方法通过核(迹)范数正则化最小化残差平方和。第二种方法最小化残差的核范数。我们建立了两个估计量的相合性。与现有的最小二乘(LS)估计器相比,这些估计器具有非常重要的计算优势,因为它们被定义为凸目标函数的最小化。此外,核规范惩罚有助于解决交互式固定效应模型的潜在识别问题,特别是当回归量是低秩的和因素数量未知时。我们还展示了如何构建渐近等效于Bai(2009)和Moon and Weidner(2017)中的最小二乘(LS)估计量的估计量,方法是使用我们的核范数正则化或最小化估计量作为最小二乘迭代步骤的初始值。这种迭代避免了任何非凸最小化,而原始LS估计问题通常是非凸的,并且可以有多个局部最小值。