General nonlinear function neural network fitting algorithm based on CNN

Abstract

This paper proposes a generic neural network fitting algorithm based on CNN for nonlinear functions that overcomes the challenges of a large number of nonlinear functions in terms of hardware deployment and computing circuit generality in diverse neural network models. The model takes advantage of the principle that functions have varying degrees of difficulty fitting in different spaces, mapping the input to high-dimensional space with 1x1 convolution, and utilizing CNN to extract features of nonlinear functions with its strong feature extraction ability in high-dimensional space. Furthermore, MaxPool and ReLU improve the ability of nonlinear fitting. When fitting Tanh, Sigmoid, and ELU activation functions with 16bit accuracy, the proposed algorithm has an average error of less than 0.0006, with a parameter size of 5.793 k.