Pruning Deep Feature Networks Using Channel Importance Propagation

Abstract

Deep convolutional neural networks use their powerful feature representation capability to extract deep information of the targets, which is conducive to the improvement of model accuracy. However, its model is more complex, with a heavier computational burden and greater demand on computational and memory resources, which affects the real-time performance and lightness of the model. To address the above limitations of deep convolutional neural networks, we define a new metric for measuring the importance of convolutional kernels in conjunction with feature maps, introduce a non-linear mapping function that maps feature maps to important convolutional kernels, propose a continuous and smooth pruning strategy for deep convolutional neural networks, and obtain the Pruning deep feature networks using channel importance propagation model to reduce the complexity of the network and reduce the computational burden, and improve the accuracy and training efficiency of the model, while ensuring the feature network representation capability and the system performance loss is small. Our proposed model was tested on three datasets, CIFAR-10, CIFAR-100 and SVHN, and the test results demonstrated the validity of the model.