Information representation analysis in a neural network

The authors study the mathematical behavior of the hidden layer of a generalized delta rule type neural network (GDR) by analyzing the weights and thresholds in the network, when it learned and didn't learn, in a typical situation in neurocomputation. The GDR was used in a C language program. There are three representation hypotheses: (a) the local, which states that information encoding takes place in local parts of the network; (b) the generalized, which states that information is located in extended areas in the network; and (c) the global, which states that total behavior represents the information in the networks. Several intensive computations were carried out to analyze the neural network internal behavior in situations where it did and didn't learn. The information shows clearly that representation as a global behavior in the hidden layer is responsible for learning, and not local behavior situations.<>