{"title":"Backpropagation based on the logarithmic error function and elimination of local minima","authors":"K. Matsuoka, J. Yi","doi":"10.1109/IJCNN.1991.170546","DOIUrl":null,"url":null,"abstract":"It is has previously been pointed out that, in backpropagation learning of neural networks, using a logarithmic error function instead of the familiar quadratic error function yields remarkable reductions in learning times. In the present work, it is shown theoretically and experimentally that learning based on the logarithmic error function has the effect of reducing the density of local minima. It is proved mathematically that, in a particular sense, the logarithmic error function provides a lower (at most equal) density of local minima in any network. the logarithmic error function also alleviates the problem of getting stuck in local minima.<<ETX>>","PeriodicalId":211135,"journal":{"name":"[Proceedings] 1991 IEEE International Joint Conference on Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"1991-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"30","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"[Proceedings] 1991 IEEE International Joint Conference on Neural Networks","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IJCNN.1991.170546","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 30
Abstract
It is has previously been pointed out that, in backpropagation learning of neural networks, using a logarithmic error function instead of the familiar quadratic error function yields remarkable reductions in learning times. In the present work, it is shown theoretically and experimentally that learning based on the logarithmic error function has the effect of reducing the density of local minima. It is proved mathematically that, in a particular sense, the logarithmic error function provides a lower (at most equal) density of local minima in any network. the logarithmic error function also alleviates the problem of getting stuck in local minima.<>