非线性分布参数估计的迭代加权最小二乘算法

F. Zama
{"title":"非线性分布参数估计的迭代加权最小二乘算法","authors":"F. Zama","doi":"10.19080/arr.2019.05.555656","DOIUrl":null,"url":null,"abstract":"In the treatment of distributed parameters estimation, the usual choice is that of minimizing the error norm using the least squares distance. This paper considers the problem of estimating distributed parameters representing properties of material that change over the spatial domain. In this case the parameters are represented by non-smooth functions. Moreover, the data may be affected by noise containing outliers that cannot be easily removed. In all these cases a great improvement in the solution can be obtained by solving a minimization problem in the $p$ norm where 0 p < < ∞ . When the norm $p=2$ is used, then the regularized nonlinear least squares problem can be efficiently solved by the Iterative Gauss Newton (IRGN) method as reported in [1,2] and references therein. The case 1 p < < ∞ is efficiently treated by the Iterative Reweighted Algorithm IRLS proposed in [3] for linear problems. We propose here a direct extension of such algorithm to the solution of non linear problems where 0 p < < ∞ . The non linear least squares and possibly non convex problem is substituted by a sequence of weighted least squares approximations which efficiently solve the non linear identification problem. The algorithm, named NL-LM-IRLS, is presented as an extension of the IRLS applied to the non linear minimization problem. Some preliminary results on one dimension identification problems are reported confirming the validity of this approach. In section 2 we explain the details of the iterative method and report the numerical experiments in section 3. ( ) ( ) 0 0 r F q y = − for k=0 , 1 , ..... r0 = F(q(0)) y for k = 0, 2,... D(k) = diag(|rk| + 100) qk+1 = argmin ||D(k)(F(q) y)||2 r(k+1) = F(q(k+1)) y","PeriodicalId":93074,"journal":{"name":"Annals of reviews and research","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2019-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Iteratively Reweighted Least Squares Algorithm for Nonlinear Distributed Parameter Estimation\",\"authors\":\"F. Zama\",\"doi\":\"10.19080/arr.2019.05.555656\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the treatment of distributed parameters estimation, the usual choice is that of minimizing the error norm using the least squares distance. This paper considers the problem of estimating distributed parameters representing properties of material that change over the spatial domain. In this case the parameters are represented by non-smooth functions. Moreover, the data may be affected by noise containing outliers that cannot be easily removed. In all these cases a great improvement in the solution can be obtained by solving a minimization problem in the $p$ norm where 0 p < < ∞ . When the norm $p=2$ is used, then the regularized nonlinear least squares problem can be efficiently solved by the Iterative Gauss Newton (IRGN) method as reported in [1,2] and references therein. The case 1 p < < ∞ is efficiently treated by the Iterative Reweighted Algorithm IRLS proposed in [3] for linear problems. We propose here a direct extension of such algorithm to the solution of non linear problems where 0 p < < ∞ . The non linear least squares and possibly non convex problem is substituted by a sequence of weighted least squares approximations which efficiently solve the non linear identification problem. The algorithm, named NL-LM-IRLS, is presented as an extension of the IRLS applied to the non linear minimization problem. Some preliminary results on one dimension identification problems are reported confirming the validity of this approach. In section 2 we explain the details of the iterative method and report the numerical experiments in section 3. ( ) ( ) 0 0 r F q y = − for k=0 , 1 , ..... r0 = F(q(0)) y for k = 0, 2,... D(k) = diag(|rk| + 100) qk+1 = argmin ||D(k)(F(q) y)||2 r(k+1) = F(q(k+1)) y\",\"PeriodicalId\":93074,\"journal\":{\"name\":\"Annals of reviews and research\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-08-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of reviews and research\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.19080/arr.2019.05.555656\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of reviews and research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.19080/arr.2019.05.555656","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在处理分布参数估计时,通常的选择是使用最小二乘距离最小化误差范数。本文考虑了表示材料在空间域上变化的特性的分布参数的估计问题。在这种情况下,参数由非光滑函数表示。此外,数据可能受到包含无法轻易去除的异常值的噪声的影响。在所有这些情况下,通过求解$p$范数中的最小化问题(其中0p<<∞),可以获得解的极大改进。当使用范数$p=2$时,正则化非线性最小二乘问题可以通过[1,2]中报道的迭代高斯-牛顿(IRGN)方法和其中的参考文献有效地求解。[3]中提出的迭代加权算法IRLS有效地处理了线性问题的情况1p<<∞。我们在这里提出了这样的算法的一个直接扩展到非线性问题的解,其中0p<<∞。用一系列加权最小二乘近似代替非线性最小二乘和可能的非凸问题,有效地解决了非线性辨识问题。该算法名为NL-LM-IRLS,是应用于非线性最小化问题的IRLS的扩展。一些关于一维识别问题的初步结果证实了该方法的有效性。在第2节中,我们解释了迭代方法的细节,并在第3节中报告了数值实验。()()0 0 r F q y=−对于k=0,1。。。。。对于k=0,2,…,r0=F(q(0))y,。。。D(k)=diag(|rk|+100)qk+1=argmin||D(k
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Iteratively Reweighted Least Squares Algorithm for Nonlinear Distributed Parameter Estimation
In the treatment of distributed parameters estimation, the usual choice is that of minimizing the error norm using the least squares distance. This paper considers the problem of estimating distributed parameters representing properties of material that change over the spatial domain. In this case the parameters are represented by non-smooth functions. Moreover, the data may be affected by noise containing outliers that cannot be easily removed. In all these cases a great improvement in the solution can be obtained by solving a minimization problem in the $p$ norm where 0 p < < ∞ . When the norm $p=2$ is used, then the regularized nonlinear least squares problem can be efficiently solved by the Iterative Gauss Newton (IRGN) method as reported in [1,2] and references therein. The case 1 p < < ∞ is efficiently treated by the Iterative Reweighted Algorithm IRLS proposed in [3] for linear problems. We propose here a direct extension of such algorithm to the solution of non linear problems where 0 p < < ∞ . The non linear least squares and possibly non convex problem is substituted by a sequence of weighted least squares approximations which efficiently solve the non linear identification problem. The algorithm, named NL-LM-IRLS, is presented as an extension of the IRLS applied to the non linear minimization problem. Some preliminary results on one dimension identification problems are reported confirming the validity of this approach. In section 2 we explain the details of the iterative method and report the numerical experiments in section 3. ( ) ( ) 0 0 r F q y = − for k=0 , 1 , ..... r0 = F(q(0)) y for k = 0, 2,... D(k) = diag(|rk| + 100) qk+1 = argmin ||D(k)(F(q) y)||2 r(k+1) = F(q(k+1)) y
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Carcinoid Syndrome: Overview and Clinical Approach Bio Actives from Albizia Lebbeck on Acute Lung Injury/ Acute Respiratory Distress Syndrome Molecular Targets: In-Silico Study "Protecting the Frontline: An Assessment on the Occupational Factors Contributing to Covid-19 Nosocomial Infections at Levy Mwanawasa University Teaching Hospital, Zambia" "A Phytonutrient Based Brain Activation Complex and Short-Term Brain Function Changes: An Initial Investigation" Professional Development Needs in a Virtual Teaching and Learning Environment
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1