Notice of RetractionA new neural network algorithm based on conjugate gradient and output weight optimization

Abstract

On the foundation of the three layers fully connected neural network model, this paper proposed a new algorithm which called output weight optimization-conjugate gradient algorithm (OWO-CG) based on the combination of the output weight optimization algorithm (OWO) and conjugate gradient algorithm (CG). Every time of the learning process is divided into two steps: the first step, use conjugate gradient optimization method to calculate learning factor, and then only modify the weights of input layer to hidden layer; the second step, use the output of hidden layer units to construct and solve linear equations to calculate the weights of output layer. Experimental results show that the new algorithm has greatly improved the training speed compared to the gradient descent algorithms, conjugate gradient algorithm and output weight optimization.