Factors controlling generalization ability of MLP networks

Abstract

Multilayer perceptron (MLP) network has been successfully applied to many practical problems because of its nonlinear mapping ability. However, there are many factors, which may affect the generalization ability of MLP networks, such as the number of hidden units, the initial values of weights and the stopping rules. These factors, if improperly chosen, may result in poor generalization ability of MLP networks. It is important to identify, these factors and their interaction in order to control effectively the generalization ability of MLP network. In this paper, we have empirically identified the factors that affect the generalization ability of MLP network, and compared their relative effect on the generalization performance.