Learning rule for associative memory in recurrent neural networks

Abstract

We present a new learning rule for intralayer connections in neural networks. The rule is based on Hebbian learning principles and is derived from information theoretic considerations. A simple network trained using the rule is shown to have associative memory like properties. The network acts by building connections between correlated data points, under constraints.