Essam H. Houssein , Mosa E. Hosney , Marwa M. Emam , Diego Oliva , Eman M.G. Younis , Abdelmgeid A. Ali , Waleed M. Mohamed
{"title":"Optimizing feedforward neural networks using a modified weighted mean of vectors: Case study chemical datasets","authors":"Essam H. Houssein , Mosa E. Hosney , Marwa M. Emam , Diego Oliva , Eman M.G. Younis , Abdelmgeid A. Ali , Waleed M. Mohamed","doi":"10.1016/j.swevo.2024.101656","DOIUrl":null,"url":null,"abstract":"<div><p>This paper proposes a modified version of the weighted mean of vectors algorithm (mINFO), which combines the strengths of the INFO algorithm with the Enhanced Solution Quality Operator (ESQ). The ESQ boosts the quality of the solutions by avoiding optimal local values, verifying that each solution moves towards a better position, and increasing the convergence speed. Furthermore, we employ the mINFO algorithm to optimize the connection weights and biases of feedforward neural networks (FNNs) to improve their accuracy. The efficacy of FNNs for classification tasks is mainly dependent on hyperparameter tuning, such as the number of layers and nodes. The mINFO was evaluated using the IEEE Congress on Evolutionary Computation held in 2020 (CEC’2020) for optimization tests, and ten chemical data sets were applied to validate the performance of the FNNs classifier. The proposed algorithm’s results have been evaluated with those of other well-known optimization methods, including Runge Kutta optimizer’s (RUN), particle swarm optimization (PSO), grey wolf optimization (GWO), Harris hawks optimization (HHO), whale optimization algorithm (WOA), slime mould algorithm (SMA) and the standard weighted mean of vectors (INFO). In addition, some improved metaheuristic algorithms. The experimental results indicate that the proposed mINFO algorithm can improve the convergence speed and generate effective search results without increasing computational costs. In addition, it has improved the FNN’s classification efficiency.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2000,"publicationDate":"2024-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swarm and Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2210650224001949","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
This paper proposes a modified version of the weighted mean of vectors algorithm (mINFO), which combines the strengths of the INFO algorithm with the Enhanced Solution Quality Operator (ESQ). The ESQ boosts the quality of the solutions by avoiding optimal local values, verifying that each solution moves towards a better position, and increasing the convergence speed. Furthermore, we employ the mINFO algorithm to optimize the connection weights and biases of feedforward neural networks (FNNs) to improve their accuracy. The efficacy of FNNs for classification tasks is mainly dependent on hyperparameter tuning, such as the number of layers and nodes. The mINFO was evaluated using the IEEE Congress on Evolutionary Computation held in 2020 (CEC’2020) for optimization tests, and ten chemical data sets were applied to validate the performance of the FNNs classifier. The proposed algorithm’s results have been evaluated with those of other well-known optimization methods, including Runge Kutta optimizer’s (RUN), particle swarm optimization (PSO), grey wolf optimization (GWO), Harris hawks optimization (HHO), whale optimization algorithm (WOA), slime mould algorithm (SMA) and the standard weighted mean of vectors (INFO). In addition, some improved metaheuristic algorithms. The experimental results indicate that the proposed mINFO algorithm can improve the convergence speed and generate effective search results without increasing computational costs. In addition, it has improved the FNN’s classification efficiency.
期刊介绍:
Swarm and Evolutionary Computation is a pioneering peer-reviewed journal focused on the latest research and advancements in nature-inspired intelligent computation using swarm and evolutionary algorithms. It covers theoretical, experimental, and practical aspects of these paradigms and their hybrids, promoting interdisciplinary research. The journal prioritizes the publication of high-quality, original articles that push the boundaries of evolutionary computation and swarm intelligence. Additionally, it welcomes survey papers on current topics and novel applications. Topics of interest include but are not limited to: Genetic Algorithms, and Genetic Programming, Evolution Strategies, and Evolutionary Programming, Differential Evolution, Artificial Immune Systems, Particle Swarms, Ant Colony, Bacterial Foraging, Artificial Bees, Fireflies Algorithm, Harmony Search, Artificial Life, Digital Organisms, Estimation of Distribution Algorithms, Stochastic Diffusion Search, Quantum Computing, Nano Computing, Membrane Computing, Human-centric Computing, Hybridization of Algorithms, Memetic Computing, Autonomic Computing, Self-organizing systems, Combinatorial, Discrete, Binary, Constrained, Multi-objective, Multi-modal, Dynamic, and Large-scale Optimization.