Pattern classification using trainable logic networks

Abstract

The author describes a new pattern classification algorithm which has the simplicity of the well-known multilinear classifier but is capable of learning patterns through supervised training. This is achieved by replacing the discretely valued logic functions employed in the conventional classifier with continuous extensions. The resulting differentiable relationship between network parameters and outputs permits the use of gradient descent methods to select optimal classifier parameters. This classifier can be implemented as a network whose structure is well suited to highly parallel hardware implementation. Essentially, the same network can be used both to compute weight adjustments and perform classifications, so that the same hardware could be used for both rapid training and classification. The author has applied this classifier to a noisy parity detection problem. The classification error frequency obtained in this example compares favourably with the theoretical lower bound.<>