{"title":"Simulation Study for Penalized Bayesian Elastic Net Quantile Regression","authors":"Muntadher Almusaedi, A. Flaih","doi":"10.29350/qjps.2021.26.3.1306","DOIUrl":null,"url":null,"abstract":"Bayesian regression analysis has great importance in recent years, especially in the Regularization method, Such as ridge, Lasso, adaptive lasso, elastic net methods, where choosing the prior distribution of the interested parameter is the main idea in the Bayesian regression analysis. By penalizing the Bayesian regression model, the variance of the estimators are reduced notable and the bias is getting smaller. The tradeoff between the bias and variance of the penalized Bayesian regression estimator consequently produce more interpretable model with more prediction accuracy. In this paper, we proposed new hierarchical model for the Bayesian quantile regression by employing the scale mixture of normals mixing with truncated gamma distribution that stated by (Li and Lin, 2010) as Laplace prior distribution. Therefore, new Gibbs sampling algorithms are introduced. A comparison has made with classical quantile regression model and with lasso quantile regression model by conducting simulations studies. Our model is comparable and gives better results.","PeriodicalId":7856,"journal":{"name":"Al-Qadisiyah Journal Of Pure Science","volume":"12 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2021-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Al-Qadisiyah Journal Of Pure Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.29350/qjps.2021.26.3.1306","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Bayesian regression analysis has great importance in recent years, especially in the Regularization method, Such as ridge, Lasso, adaptive lasso, elastic net methods, where choosing the prior distribution of the interested parameter is the main idea in the Bayesian regression analysis. By penalizing the Bayesian regression model, the variance of the estimators are reduced notable and the bias is getting smaller. The tradeoff between the bias and variance of the penalized Bayesian regression estimator consequently produce more interpretable model with more prediction accuracy. In this paper, we proposed new hierarchical model for the Bayesian quantile regression by employing the scale mixture of normals mixing with truncated gamma distribution that stated by (Li and Lin, 2010) as Laplace prior distribution. Therefore, new Gibbs sampling algorithms are introduced. A comparison has made with classical quantile regression model and with lasso quantile regression model by conducting simulations studies. Our model is comparable and gives better results.
贝叶斯回归分析近年来得到了很大的重视,特别是正则化方法,如ridge、Lasso、自适应Lasso、弹性网等方法,在这些方法中,选择感兴趣参数的先验分布是贝叶斯回归分析的主要思想。通过惩罚贝叶斯回归模型,估计量的方差显著减小,偏差越来越小。惩罚贝叶斯回归估计器的偏差和方差之间的权衡,从而产生更具可解释性的模型和更高的预测精度。在本文中,我们采用(Li and Lin, 2010)称为拉普拉斯先验分布的正态混合截断伽马分布的尺度混合,提出了新的贝叶斯分位数回归层次模型。因此,引入了新的Gibbs采样算法。通过仿真研究,与经典分位数回归模型和lasso分位数回归模型进行了比较。我们的模型具有可比性,并给出了更好的结果。