{"title":"MATLAB环境下基于多核CPU和GPU的多层感知器训练加速","authors":"Shefa A. Dawwd, Noor M. AL Layla","doi":"10.33899/rengj.2015.101566","DOIUrl":null,"url":null,"abstract":"Shefa A. Dawwd / Assist. Prof. Noor M. AL Layla shefa.dawwd.2014@ieee.org aneng.noor@gmail.com Computer Engineering Department College of Engineering, University of Mosul, Mosul-Iraq Abstract Training of Artificial Neural Networks (ANNs) for large data sets is a time consuming mission. In this paper, accelerating the training of artificial neural network is achieved by a parallel training using either Multicore Central Processing Unit (CPU) or General Purpose Graphics Processing Unit (GPGPU). The training is implemented using five datasets with diverse amounts of patterns and with different neural network parameters in Multilayer Perceptron (MLP). The results show a significant increase in computation speed, which is increased nearly linear with the number of cores in multicore processor for problems with medium and large training datasets. Also, a considerable speed up is achieved when the GPU is used to train the MLP with the large training datasets. While a single core processor is a better choice when the data set size is small. The optimal number of cores or the type of the parallel platform should be employed according to the load of computation.","PeriodicalId":339890,"journal":{"name":"AL Rafdain Engineering Journal","volume":"60 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Training Acceleration of Multi-Layer Perceptron using Multicore CPU and GPU under MATLAB Environment\",\"authors\":\"Shefa A. Dawwd, Noor M. AL Layla\",\"doi\":\"10.33899/rengj.2015.101566\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Shefa A. Dawwd / Assist. Prof. Noor M. AL Layla shefa.dawwd.2014@ieee.org aneng.noor@gmail.com Computer Engineering Department College of Engineering, University of Mosul, Mosul-Iraq Abstract Training of Artificial Neural Networks (ANNs) for large data sets is a time consuming mission. In this paper, accelerating the training of artificial neural network is achieved by a parallel training using either Multicore Central Processing Unit (CPU) or General Purpose Graphics Processing Unit (GPGPU). The training is implemented using five datasets with diverse amounts of patterns and with different neural network parameters in Multilayer Perceptron (MLP). The results show a significant increase in computation speed, which is increased nearly linear with the number of cores in multicore processor for problems with medium and large training datasets. Also, a considerable speed up is achieved when the GPU is used to train the MLP with the large training datasets. While a single core processor is a better choice when the data set size is small. The optimal number of cores or the type of the parallel platform should be employed according to the load of computation.\",\"PeriodicalId\":339890,\"journal\":{\"name\":\"AL Rafdain Engineering Journal\",\"volume\":\"60 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AL Rafdain Engineering Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.33899/rengj.2015.101566\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AL Rafdain Engineering Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.33899/rengj.2015.101566","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
Shefa . Dawwd / Assist。Noor M. AL Layla教授shefa.dawwd.2014@ieee.org aneng.noor@gmail.com计算机工程系摩苏尔大学工程学院大型数据集人工神经网络(ann)的训练是一项耗时的任务。本文通过使用多核中央处理器(CPU)或通用图形处理器(GPGPU)进行并行训练来加快人工神经网络的训练速度。在多层感知器(Multilayer Perceptron, MLP)中,使用五个具有不同模式数量和不同神经网络参数的数据集来实现训练。结果表明,对于大中型训练数据集的问题,计算速度与多核处理器的核数呈近似线性增长。此外,当使用GPU使用大型训练数据集训练MLP时,可以实现相当大的速度提升。而单核处理器在数据集较小时是更好的选择。应根据计算负荷选择最优核数或并行平台类型。
Training Acceleration of Multi-Layer Perceptron using Multicore CPU and GPU under MATLAB Environment
Shefa A. Dawwd / Assist. Prof. Noor M. AL Layla shefa.dawwd.2014@ieee.org aneng.noor@gmail.com Computer Engineering Department College of Engineering, University of Mosul, Mosul-Iraq Abstract Training of Artificial Neural Networks (ANNs) for large data sets is a time consuming mission. In this paper, accelerating the training of artificial neural network is achieved by a parallel training using either Multicore Central Processing Unit (CPU) or General Purpose Graphics Processing Unit (GPGPU). The training is implemented using five datasets with diverse amounts of patterns and with different neural network parameters in Multilayer Perceptron (MLP). The results show a significant increase in computation speed, which is increased nearly linear with the number of cores in multicore processor for problems with medium and large training datasets. Also, a considerable speed up is achieved when the GPU is used to train the MLP with the large training datasets. While a single core processor is a better choice when the data set size is small. The optimal number of cores or the type of the parallel platform should be employed according to the load of computation.