{"title":"基于结构相似度指标的深度卷积神经网络加速滤波器剪枝","authors":"Jihong Zhu, J. Pei","doi":"10.1109/ISKE47853.2019.9170362","DOIUrl":null,"url":null,"abstract":"Pruning can reduce the size of the model without reducing its performance. After pruning, the model can run in a small terminal flexibly. This paper proposes a new filter pruning method that uses soft filter pruning via a structural similarity index(FPSSI) to compress and prune the network. FPSSI uses the structural similarity index to measuring the difference between different filters, the filters with similar structures are pruned to achieve the purpose of compressing the Deep Convolutional Neural Networks(DNN) model. Compared to the norm-based approach to remove ”relatively low” importance filters, the proposed method takes into account the structure between the filters. When applied to the different classification benchmarks, our method validates its usefulness and advantages. In CIFAR10, the ResNet network uses the SFP-SSIM method to reduce 52% of FLOPs and has better accuracy.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Filter Pruning via Structural Similarity Index for Deep Convolutional Neural Networks Acceleration\",\"authors\":\"Jihong Zhu, J. Pei\",\"doi\":\"10.1109/ISKE47853.2019.9170362\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Pruning can reduce the size of the model without reducing its performance. After pruning, the model can run in a small terminal flexibly. This paper proposes a new filter pruning method that uses soft filter pruning via a structural similarity index(FPSSI) to compress and prune the network. FPSSI uses the structural similarity index to measuring the difference between different filters, the filters with similar structures are pruned to achieve the purpose of compressing the Deep Convolutional Neural Networks(DNN) model. Compared to the norm-based approach to remove ”relatively low” importance filters, the proposed method takes into account the structure between the filters. When applied to the different classification benchmarks, our method validates its usefulness and advantages. In CIFAR10, the ResNet network uses the SFP-SSIM method to reduce 52% of FLOPs and has better accuracy.\",\"PeriodicalId\":399084,\"journal\":{\"name\":\"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISKE47853.2019.9170362\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISKE47853.2019.9170362","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Filter Pruning via Structural Similarity Index for Deep Convolutional Neural Networks Acceleration
Pruning can reduce the size of the model without reducing its performance. After pruning, the model can run in a small terminal flexibly. This paper proposes a new filter pruning method that uses soft filter pruning via a structural similarity index(FPSSI) to compress and prune the network. FPSSI uses the structural similarity index to measuring the difference between different filters, the filters with similar structures are pruned to achieve the purpose of compressing the Deep Convolutional Neural Networks(DNN) model. Compared to the norm-based approach to remove ”relatively low” importance filters, the proposed method takes into account the structure between the filters. When applied to the different classification benchmarks, our method validates its usefulness and advantages. In CIFAR10, the ResNet network uses the SFP-SSIM method to reduce 52% of FLOPs and has better accuracy.