Mohamed Aboukhair, Abdelrahim Koura, Mohammed Kayed
{"title":"新型多滤波器CNN层的初步研究。","authors":"Mohamed Aboukhair, Abdelrahim Koura, Mohammed Kayed","doi":"10.1080/0954898X.2024.2434487","DOIUrl":null,"url":null,"abstract":"<p><p>Convolutional neural networks (CNNs) have reached their peak of complex structures, but until now, few researchers have addressed the problem of relying on one filter size. Mainly a 3 × 3 filter is the most common one used in any structure. Only at the first layers of the CNN model, filters bigger than 3 × 3 could be partially used. Most researchers work with filters (size, values, etc.) as a black box. To the best of our knowledge, this research is the first pilot study that proposes a new multi-filter layer in which different filters with variant sizes are used to replace the 3 × 3 filter layers. Our proposed multi-filter layer has yielded encouraging results, demonstrating notable improvements ranging from 1% to 5% in performance. This achievement was realized by developing two innovative structures, namely the fixed structure and the decreasing structure. Both of them leverage the multi-filter layer. Although the two structures exhibit promising outcomes, the later structure offers the additional advantages of reduced computational requirements and enhanced learner strength.</p>","PeriodicalId":54735,"journal":{"name":"Network-Computation in Neural Systems","volume":" ","pages":"1-22"},"PeriodicalIF":1.1000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A pilot study of novel multi-filter CNN layer.\",\"authors\":\"Mohamed Aboukhair, Abdelrahim Koura, Mohammed Kayed\",\"doi\":\"10.1080/0954898X.2024.2434487\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Convolutional neural networks (CNNs) have reached their peak of complex structures, but until now, few researchers have addressed the problem of relying on one filter size. Mainly a 3 × 3 filter is the most common one used in any structure. Only at the first layers of the CNN model, filters bigger than 3 × 3 could be partially used. Most researchers work with filters (size, values, etc.) as a black box. To the best of our knowledge, this research is the first pilot study that proposes a new multi-filter layer in which different filters with variant sizes are used to replace the 3 × 3 filter layers. Our proposed multi-filter layer has yielded encouraging results, demonstrating notable improvements ranging from 1% to 5% in performance. This achievement was realized by developing two innovative structures, namely the fixed structure and the decreasing structure. Both of them leverage the multi-filter layer. Although the two structures exhibit promising outcomes, the later structure offers the additional advantages of reduced computational requirements and enhanced learner strength.</p>\",\"PeriodicalId\":54735,\"journal\":{\"name\":\"Network-Computation in Neural Systems\",\"volume\":\" \",\"pages\":\"1-22\"},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2024-11-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Network-Computation in Neural Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1080/0954898X.2024.2434487\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Network-Computation in Neural Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1080/0954898X.2024.2434487","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Convolutional neural networks (CNNs) have reached their peak of complex structures, but until now, few researchers have addressed the problem of relying on one filter size. Mainly a 3 × 3 filter is the most common one used in any structure. Only at the first layers of the CNN model, filters bigger than 3 × 3 could be partially used. Most researchers work with filters (size, values, etc.) as a black box. To the best of our knowledge, this research is the first pilot study that proposes a new multi-filter layer in which different filters with variant sizes are used to replace the 3 × 3 filter layers. Our proposed multi-filter layer has yielded encouraging results, demonstrating notable improvements ranging from 1% to 5% in performance. This achievement was realized by developing two innovative structures, namely the fixed structure and the decreasing structure. Both of them leverage the multi-filter layer. Although the two structures exhibit promising outcomes, the later structure offers the additional advantages of reduced computational requirements and enhanced learner strength.
期刊介绍:
Network: Computation in Neural Systems welcomes submissions of research papers that integrate theoretical neuroscience with experimental data, emphasizing the utilization of cutting-edge technologies. We invite authors and researchers to contribute their work in the following areas:
Theoretical Neuroscience: This section encompasses neural network modeling approaches that elucidate brain function.
Neural Networks in Data Analysis and Pattern Recognition: We encourage submissions exploring the use of neural networks for data analysis and pattern recognition, including but not limited to image analysis and speech processing applications.
Neural Networks in Control Systems: This category encompasses the utilization of neural networks in control systems, including robotics, state estimation, fault detection, and diagnosis.
Analysis of Neurophysiological Data: We invite submissions focusing on the analysis of neurophysiology data obtained from experimental studies involving animals.
Analysis of Experimental Data on the Human Brain: This section includes papers analyzing experimental data from studies on the human brain, utilizing imaging techniques such as MRI, fMRI, EEG, and PET.
Neurobiological Foundations of Consciousness: We encourage submissions exploring the neural bases of consciousness in the brain and its simulation in machines.