Simulation Approximators Using Linear and Nonlinear Integration Neural Networks

The construction of approximators for simulations, such as the finite element method using machine learning, has the problem of both reducing training data generation time and achieving approximation accuracy. Hybrid neural networks have been proposed to solve this problem as a fast approximator for simulation. Even if built with a simple perceptron with a linear activation function created based on deductive knowledge using conventional approximation techniques such as multiple regression analysis, the number of phenomena that can be modeled by deductive knowledge is limited in simulations of complex structures. As a result, there will be errors in the predictions of the approximators. In contrast, hybrid neural networks allow neural networks to learn errors in predictions to create correction approximators, allowing approximators to account for effects that cannot be expressed by multiple regression analysis. This paper proposes a neural network with a structure that integrates these approximators. The first proposed Hybrid Neural Network (HNN) approximator trains a linear approximator, and then a nonlinear approximator learns the error part. In contrast, the Integration Neural Network (INN) simultaneously learns the linear and nonlinear approximators to optimize the learning ratio by training. This method allows INNs to improve the accuracy of approximators and reduce the conflict between the number of training data and accuracy.