Zhenxing Yu , Qinwei Fan , Jacek M. Zurada , Jigen Peng , Haiyang Li , Jian Wang
{"title":"Solving sparse multi-objective optimization problems via dynamic adaptive grouping and reward-penalty sparse strategies","authors":"Zhenxing Yu , Qinwei Fan , Jacek M. Zurada , Jigen Peng , Haiyang Li , Jian Wang","doi":"10.1016/j.swevo.2025.101881","DOIUrl":null,"url":null,"abstract":"<div><div>Sparse Multi-Objective Optimization Problems (SMOPs) are commonly encountered in various fields such as machine learning, signal processing, and data mining. While evolutionary algorithms have shown good performance in tackling complex problems, many algorithms tend to exhibit performance degradation when dealing with SMOPs. The primary reasons for this performance decline are the curse of dimensionality and the inability to effectively leverage the sparsity of Pareto-optimal solutions. To address this issue, this paper proposes a model method to solve sparse multi-objective optimization problems through dynamic adaptive grouping and reward-penalty sparse strategies. Specifically, to obtain more effective prior information, a sparse initialization strategy is proposed in the initialization phase. This strategy aims to incorporate more prior knowledge and information about the sparsity of Pareto-optimal solutions. In the evolutionary phase, a decision variable dynamic adaptive grouping strategy is introduced. This strategy, combined with crossover and mutation operators, guides the population towards effective sparse directions. Furthermore, to further identify zero-value decision variables in Pareto-optimal solutions, a reward-penalty mechanism is designed to update the scores of decision variables. By combining this mechanism with the adaptive grouping strategy, this method can effectively flip low-scoring decision variables to zero with a higher probability. To validate the advantages of the proposed algorithm, experiments were conducted on eight benchmark problems, with comparative experiments conducted for different initialization methods. The results indicate that our algorithm exhibits significant advantages in solving SMOPs.</div></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":"94 ","pages":"Article 101881"},"PeriodicalIF":8.2000,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swarm and Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2210650225000392","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Sparse Multi-Objective Optimization Problems (SMOPs) are commonly encountered in various fields such as machine learning, signal processing, and data mining. While evolutionary algorithms have shown good performance in tackling complex problems, many algorithms tend to exhibit performance degradation when dealing with SMOPs. The primary reasons for this performance decline are the curse of dimensionality and the inability to effectively leverage the sparsity of Pareto-optimal solutions. To address this issue, this paper proposes a model method to solve sparse multi-objective optimization problems through dynamic adaptive grouping and reward-penalty sparse strategies. Specifically, to obtain more effective prior information, a sparse initialization strategy is proposed in the initialization phase. This strategy aims to incorporate more prior knowledge and information about the sparsity of Pareto-optimal solutions. In the evolutionary phase, a decision variable dynamic adaptive grouping strategy is introduced. This strategy, combined with crossover and mutation operators, guides the population towards effective sparse directions. Furthermore, to further identify zero-value decision variables in Pareto-optimal solutions, a reward-penalty mechanism is designed to update the scores of decision variables. By combining this mechanism with the adaptive grouping strategy, this method can effectively flip low-scoring decision variables to zero with a higher probability. To validate the advantages of the proposed algorithm, experiments were conducted on eight benchmark problems, with comparative experiments conducted for different initialization methods. The results indicate that our algorithm exhibits significant advantages in solving SMOPs.
期刊介绍:
Swarm and Evolutionary Computation is a pioneering peer-reviewed journal focused on the latest research and advancements in nature-inspired intelligent computation using swarm and evolutionary algorithms. It covers theoretical, experimental, and practical aspects of these paradigms and their hybrids, promoting interdisciplinary research. The journal prioritizes the publication of high-quality, original articles that push the boundaries of evolutionary computation and swarm intelligence. Additionally, it welcomes survey papers on current topics and novel applications. Topics of interest include but are not limited to: Genetic Algorithms, and Genetic Programming, Evolution Strategies, and Evolutionary Programming, Differential Evolution, Artificial Immune Systems, Particle Swarms, Ant Colony, Bacterial Foraging, Artificial Bees, Fireflies Algorithm, Harmony Search, Artificial Life, Digital Organisms, Estimation of Distribution Algorithms, Stochastic Diffusion Search, Quantum Computing, Nano Computing, Membrane Computing, Human-centric Computing, Hybridization of Algorithms, Memetic Computing, Autonomic Computing, Self-organizing systems, Combinatorial, Discrete, Binary, Constrained, Multi-objective, Multi-modal, Dynamic, and Large-scale Optimization.