Muhammad Jaffri Mohd Nasir, Ramzan Nazim Khan, Gopalan Nair, Darfiana Nur
{"title":"自激阈值自回归模型组 LASSO 中基于主动集的块坐标下降算法","authors":"Muhammad Jaffri Mohd Nasir, Ramzan Nazim Khan, Gopalan Nair, Darfiana Nur","doi":"10.1007/s00362-023-01472-7","DOIUrl":null,"url":null,"abstract":"<p>Group LASSO (gLASSO) estimator has been recently proposed to estimate thresholds for the <i>self-exciting</i> threshold autoregressive model, and a group least angle regression (<i>gLAR</i>) algorithm has been applied to obtain an approximate solution to the optimization problem. Although <i>gLAR</i> algorithm is computationally fast, it has been reported that the algorithm tends to estimate too many irrelevant thresholds along with the relevant ones. This paper develops an <i>active-set</i> based block coordinate descent (<i>aBCD</i>) algorithm as an exact optimization method for gLASSO to improve the performance of estimating relevant thresholds. Methods and strategy for choosing the appropriate values of shrinkage parameter for gLASSO are also discussed. To consistently estimate relevant thresholds from the threshold set obtained by the gLASSO, the backward elimination algorithm (<i>BEA</i>) is utilized. We evaluate numerical efficiency of the proposed algorithms, along with the Single-Line-Search (<i>SLS</i>) and the <i>gLAR</i> algorithms through simulated data and real data sets. Simulation studies show that the <i>SLS</i> and <i>aBCD</i> algorithms have similar performance in estimating thresholds although the latter method is much faster. In addition, the <i>aBCD-BEA</i> can sometimes outperform <i>gLAR-BEA</i> in terms of estimating the correct number of thresholds under certain conditions. The results from case studies have also shown that <i>aBCD-BEA</i> performs better in identifying important thresholds.</p>","PeriodicalId":51166,"journal":{"name":"Statistical Papers","volume":"1 1","pages":""},"PeriodicalIF":1.2000,"publicationDate":"2023-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Active-set based block coordinate descent algorithm in group LASSO for self-exciting threshold autoregressive model\",\"authors\":\"Muhammad Jaffri Mohd Nasir, Ramzan Nazim Khan, Gopalan Nair, Darfiana Nur\",\"doi\":\"10.1007/s00362-023-01472-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Group LASSO (gLASSO) estimator has been recently proposed to estimate thresholds for the <i>self-exciting</i> threshold autoregressive model, and a group least angle regression (<i>gLAR</i>) algorithm has been applied to obtain an approximate solution to the optimization problem. Although <i>gLAR</i> algorithm is computationally fast, it has been reported that the algorithm tends to estimate too many irrelevant thresholds along with the relevant ones. This paper develops an <i>active-set</i> based block coordinate descent (<i>aBCD</i>) algorithm as an exact optimization method for gLASSO to improve the performance of estimating relevant thresholds. Methods and strategy for choosing the appropriate values of shrinkage parameter for gLASSO are also discussed. To consistently estimate relevant thresholds from the threshold set obtained by the gLASSO, the backward elimination algorithm (<i>BEA</i>) is utilized. We evaluate numerical efficiency of the proposed algorithms, along with the Single-Line-Search (<i>SLS</i>) and the <i>gLAR</i> algorithms through simulated data and real data sets. Simulation studies show that the <i>SLS</i> and <i>aBCD</i> algorithms have similar performance in estimating thresholds although the latter method is much faster. In addition, the <i>aBCD-BEA</i> can sometimes outperform <i>gLAR-BEA</i> in terms of estimating the correct number of thresholds under certain conditions. The results from case studies have also shown that <i>aBCD-BEA</i> performs better in identifying important thresholds.</p>\",\"PeriodicalId\":51166,\"journal\":{\"name\":\"Statistical Papers\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2023-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Statistical Papers\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1007/s00362-023-01472-7\",\"RegionNum\":3,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"STATISTICS & PROBABILITY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Statistical Papers","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1007/s00362-023-01472-7","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
Active-set based block coordinate descent algorithm in group LASSO for self-exciting threshold autoregressive model
Group LASSO (gLASSO) estimator has been recently proposed to estimate thresholds for the self-exciting threshold autoregressive model, and a group least angle regression (gLAR) algorithm has been applied to obtain an approximate solution to the optimization problem. Although gLAR algorithm is computationally fast, it has been reported that the algorithm tends to estimate too many irrelevant thresholds along with the relevant ones. This paper develops an active-set based block coordinate descent (aBCD) algorithm as an exact optimization method for gLASSO to improve the performance of estimating relevant thresholds. Methods and strategy for choosing the appropriate values of shrinkage parameter for gLASSO are also discussed. To consistently estimate relevant thresholds from the threshold set obtained by the gLASSO, the backward elimination algorithm (BEA) is utilized. We evaluate numerical efficiency of the proposed algorithms, along with the Single-Line-Search (SLS) and the gLAR algorithms through simulated data and real data sets. Simulation studies show that the SLS and aBCD algorithms have similar performance in estimating thresholds although the latter method is much faster. In addition, the aBCD-BEA can sometimes outperform gLAR-BEA in terms of estimating the correct number of thresholds under certain conditions. The results from case studies have also shown that aBCD-BEA performs better in identifying important thresholds.
期刊介绍:
The journal Statistical Papers addresses itself to all persons and organizations that have to deal with statistical methods in their own field of work. It attempts to provide a forum for the presentation and critical assessment of statistical methods, in particular for the discussion of their methodological foundations as well as their potential applications. Methods that have broad applications will be preferred. However, special attention is given to those statistical methods which are relevant to the economic and social sciences. In addition to original research papers, readers will find survey articles, short notes, reports on statistical software, problem section, and book reviews.