Deep learning on Sleptsov nets

Abstract

Sleptsov nets are applied as a uniform language to specify models of unconventional computations and artificial intelligence systems. A technique for specification of neural networks, including multidimensional and multilayer networks of deep learning approach, using Sleptsov nets, is shown; the ways of specifying basic activation functions by Sleptsov net are discussed, the threshold and sigmoid functions implemented. A methodology of training neural networks is presented with the loss function minimisation, based on a run of a pair of interacting Sleptsov nets, the first net implementing the neural network based on data flow approach, while the second net solves the optimisation task by adjusting the weights of the first net by the gradient descend method. The optimising net uses the earlier developed technology of programming in Sleptsov nets with reverse control flow and the subnet call technique. Real numbers and arrays are represented as markings of a single place of a Sleptsov net. Hyperperformance is achieved because of the possibility of implementing mass parallel computations.