首页 > 最新文献

Swarm and Evolutionary Computation最新文献

英文 中文
A many-objective evolutionary algorithm based on interaction force and hybrid optimization mechanism 基于相互作用力和混合优化机制的多目标进化算法
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-25 DOI: 10.1016/j.swevo.2024.101667

In many-objective optimization, both convergence and diversity are equally important. However, in high-dimensional spaces, traditional decomposition-based many-objective evolutionary algorithms struggle to ensure population diversity. Conversely, traditional Pareto dominance-based many-objective evolutionary algorithms face challenges in ensuring population convergence. In this paper, we propose a novel many-objective evolutionary algorithm based on interaction force and hybrid optimization mechanism (MaOEAIH) for effectively addressing the difficulty in balancing convergence and diversity. First, we use the concept of interaction force to simulate the convergence (akin to gravity) and diversity (repulsion) of the population. Subsequently, we design an optimization mechanism that combines decomposition and Pareto dominance to enhance the convergence and diversity of the population separately. Simultaneously, to eliminate dominance resistance solutions, we propose a quartile method based on boundary solutions. Additionally, Random perturbations are also introduced to certain individuals within the population to facilitate their escape from local optima. MaOEAIH is compared with some state-of-the-art algorithms on 31 well-known test problems with 3-15 objectives. The experimental results show that, compared to other algorithms, MaOEAIH not only obtains solution sets of higher quality when dealing with different types of many-objective optimization problems, but also effectively addresses key challenges including insufficient selection pressure, difficulty balancing convergence and diversity, and susceptibility to population entrapment in local optima within many-objective optimization scenarios.

在多目标优化中,收敛性和多样性同等重要。然而,在高维空间中,传统的基于分解的多目标进化算法很难确保群体的多样性。相反,传统的基于帕累托优势的多目标进化算法在确保群体收敛性方面也面临挑战。本文提出了一种基于交互力和混合优化机制的新型多目标进化算法(MaOEAIH),以有效解决收敛性和多样性难以兼顾的问题。首先,我们利用相互作用力的概念来模拟种群的收敛性(类似重力)和多样性(排斥力)。随后,我们设计了一种结合分解和帕累托优势的优化机制,分别增强种群的收敛性和多样性。同时,为了消除优势抵抗解,我们提出了一种基于边界解的四分法。此外,我们还为群体中的某些个体引入了随机扰动,以帮助它们摆脱局部最优状态。我们将 MaOEAIH 与一些最先进的算法在 31 个著名的 3-15 目标测试问题上进行了比较。实验结果表明,与其他算法相比,在处理不同类型的多目标优化问题时,MaOEAIH 不仅能获得质量更高的解集,还能有效解决多目标优化场景中存在的选择压力不足、收敛性和多样性难以平衡、种群易陷入局部最优等关键挑战。
{"title":"A many-objective evolutionary algorithm based on interaction force and hybrid optimization mechanism","authors":"","doi":"10.1016/j.swevo.2024.101667","DOIUrl":"10.1016/j.swevo.2024.101667","url":null,"abstract":"<div><p>In many-objective optimization, both convergence and diversity are equally important. However, in high-dimensional spaces, traditional decomposition-based many-objective evolutionary algorithms struggle to ensure population diversity. Conversely, traditional Pareto dominance-based many-objective evolutionary algorithms face challenges in ensuring population convergence. In this paper, we propose a novel many-objective evolutionary algorithm based on interaction force and hybrid optimization mechanism (MaOEAIH) for effectively addressing the difficulty in balancing convergence and diversity. First, we use the concept of interaction force to simulate the convergence (akin to gravity) and diversity (repulsion) of the population. Subsequently, we design an optimization mechanism that combines decomposition and Pareto dominance to enhance the convergence and diversity of the population separately. Simultaneously, to eliminate dominance resistance solutions, we propose a quartile method based on boundary solutions. Additionally, Random perturbations are also introduced to certain individuals within the population to facilitate their escape from local optima. MaOEAIH is compared with some state-of-the-art algorithms on 31 well-known test problems with 3-15 objectives. The experimental results show that, compared to other algorithms, MaOEAIH not only obtains solution sets of higher quality when dealing with different types of many-objective optimization problems, but also effectively addresses key challenges including insufficient selection pressure, difficulty balancing convergence and diversity, and susceptibility to population entrapment in local optima within many-objective optimization scenarios.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141776941","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Two-sided resource-constrained assembly line balancing problem: a new mathematical model and an improved genetic algorithm 双面资源受限的装配线平衡问题:一种新的数学模型和改进的遗传算法
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-25 DOI: 10.1016/j.swevo.2024.101662

Two-sided assembly lines are typically employed in the production of medium and large-sized products with the aim of reducing the length of the assembly line, enhancing assembly efficiency and consequently reducing the time required for product assembly. However, traditional Two-sided assembly lines lack effective resource scheduling management methods in production scheduling, which results in low productivity and high resource costs. In order to address this issue, we propose a new two-sided resource-constrained assembly line balancing problem (TRCLBP) model. The model takes the minimum number of workstations and the minimum assembly cost as its objective function and proposes an improved genetic algorithm (I-GA) to solve it. A three-layer chromosome initialization method is proposed for the assembly tasks and resource decisions, which effectively improves the diversity and quality of the initial population. Furthermore, the algorithm employs strategies such as matching crossover and redistributing variants to ensure rapid convergence of the populations and to prevent them from falling into local optimums. Finally, the efficacy of the model and algorithm proposed in this paper is validated through a comprehensive analysis of arithmetic case studies and enterprise engineering examples. This analysis reveals a reduction of approximately 18 % in the total cost of assembly. Furthermore, the model enables enterprises to make informed decisions regarding the optimal allocation of resources, thereby reducing production costs and improving the efficiency of assembly operations during periods of expansion.

双面装配线通常用于大中型产品的生产,目的是缩短装配线的长度,提高装配效率,从而缩短产品装配所需的时间。然而,传统的双面装配线在生产调度中缺乏有效的资源调度管理方法,导致生产率低、资源成本高。针对这一问题,我们提出了一种新的双面资源受限装配线平衡问题(TRCLBP)模型。该模型以最小工作站数量和最小装配成本为目标函数,并提出了一种改进的遗传算法(I-GA)来解决该问题。针对装配任务和资源决策提出了三层染色体初始化方法,有效提高了初始种群的多样性和质量。此外,该算法还采用了匹配交叉和重新分配变体等策略,以确保种群的快速收敛,并防止其陷入局部最优。最后,通过对算术案例研究和企业工程实例的综合分析,本文提出的模型和算法的有效性得到了验证。分析结果显示,装配总成本降低了约 18%。此外,该模型还能使企业在资源优化配置方面做出明智决策,从而在扩张期降低生产成本,提高装配作业效率。
{"title":"Two-sided resource-constrained assembly line balancing problem: a new mathematical model and an improved genetic algorithm","authors":"","doi":"10.1016/j.swevo.2024.101662","DOIUrl":"10.1016/j.swevo.2024.101662","url":null,"abstract":"<div><p>Two-sided assembly lines are typically employed in the production of medium and large-sized products with the aim of reducing the length of the assembly line, enhancing assembly efficiency and consequently reducing the time required for product assembly. However, traditional Two-sided assembly lines lack effective resource scheduling management methods in production scheduling, which results in low productivity and high resource costs. In order to address this issue, we propose a new two-sided resource-constrained assembly line balancing problem (TRCLBP) model. The model takes the minimum number of workstations and the minimum assembly cost as its objective function and proposes an improved genetic algorithm (I-GA) to solve it. A three-layer chromosome initialization method is proposed for the assembly tasks and resource decisions, which effectively improves the diversity and quality of the initial population. Furthermore, the algorithm employs strategies such as matching crossover and redistributing variants to ensure rapid convergence of the populations and to prevent them from falling into local optimums. Finally, the efficacy of the model and algorithm proposed in this paper is validated through a comprehensive analysis of arithmetic case studies and enterprise engineering examples. This analysis reveals a reduction of approximately 18 % in the total cost of assembly. Furthermore, the model enables enterprises to make informed decisions regarding the optimal allocation of resources, thereby reducing production costs and improving the efficiency of assembly operations during periods of expansion.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141776942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
RBSS: A fast subset selection strategy for multi-objective optimization RBSS:多目标优化的快速子集选择策略
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-25 DOI: 10.1016/j.swevo.2024.101659

Multi-objective optimization problems (MOPs) aim to obtain a set of Pareto-optimal solutions, and as the number of objectives increases, the quantity of these optimal solutions grows exponentially. However, a plethora of optimal solutions can impose significant decision stress on decision-makers. Subset selection, as the extension of a model, can extract a representative set of solutions, thereby alleviating the decision-makers’ choice pressure. In addition, extending a model undoubtedly incurs additional time costs. To cope with the foregoing issues, a fast subset selection method named ranking-based subset selection (RBSS) is proposed in this paper. It can efficiently select a small number of optimal solutions within an unbounded external archive and can be directly applied to any multi-objective evolutionary algorithm. This allows it to maintain good distribution and diversity with very little time investment. We employed a ranking-based approach to map the objective space to a ranking space (an integer space) defined by us and then selected the corresponding subset in the ranking space. The well-behaved mathematical properties of the ranking space and the advantages of using integer calculations accelerated the subset selection process. Experimental results indicate that compared to several state-of-the-art subset selection methods, RBSS is capable of selecting a set of representative and diverse solutions across different types of MOPs, while consuming significantly less time. Specifically, for problems where the Pareto front is a two-dimensional manifold and a one-dimensional manifold, the time consumption of RBSS is approximately only 0.028% to 27.5% and 4.6e−4% to 0.15% of that required by other algorithms, respectively.

多目标优化问题(MOPs)旨在获得一组帕累托最优解,随着目标数量的增加,这些最优解的数量也会呈指数级增长。然而,过多的最优解会给决策者带来巨大的决策压力。子集选择作为模型的扩展,可以提取具有代表性的解集,从而减轻决策者的选择压力。此外,扩展模型无疑会产生额外的时间成本。针对上述问题,本文提出了一种名为基于排序的子集选择(RBSS)的快速子集选择方法。它能在无限制的外部档案中有效地选择少量最优解,并可直接应用于任何多目标进化算法。这使得它能以极少的时间投入保持良好的分布和多样性。我们采用了基于排序的方法,将目标空间映射到我们定义的排序空间(整数空间),然后在排序空间中选择相应的子集。排序空间良好的数学特性和使用整数计算的优势加速了子集选择过程。实验结果表明,与几种最先进的子集选择方法相比,RBSS 能够在不同类型的澳门威尼斯人官网程中选择出一组具有代表性的多样化解决方案,同时耗时大大减少。具体来说,对于帕累托前沿是二维流形和一维流形的问题,RBSS 的耗时分别仅为其他算法的 0.028% 到 27.5% 和 4.6e-4% 到 0.15%。
{"title":"RBSS: A fast subset selection strategy for multi-objective optimization","authors":"","doi":"10.1016/j.swevo.2024.101659","DOIUrl":"10.1016/j.swevo.2024.101659","url":null,"abstract":"<div><p>Multi-objective optimization problems (MOPs) aim to obtain a set of Pareto-optimal solutions, and as the number of objectives increases, the quantity of these optimal solutions grows exponentially. However, a plethora of optimal solutions can impose significant decision stress on decision-makers. Subset selection, as the extension of a model, can extract a representative set of solutions, thereby alleviating the decision-makers’ choice pressure. In addition, extending a model undoubtedly incurs additional time costs. To cope with the foregoing issues, a fast subset selection method named ranking-based subset selection (RBSS) is proposed in this paper. It can efficiently select a small number of optimal solutions within an unbounded external archive and can be directly applied to any multi-objective evolutionary algorithm. This allows it to maintain good distribution and diversity with very little time investment. We employed a ranking-based approach to map the objective space to a ranking space (an integer space) defined by us and then selected the corresponding subset in the ranking space. The well-behaved mathematical properties of the ranking space and the advantages of using integer calculations accelerated the subset selection process. Experimental results indicate that compared to several state-of-the-art subset selection methods, RBSS is capable of selecting a set of representative and diverse solutions across different types of MOPs, while consuming significantly less time. Specifically, for problems where the Pareto front is a two-dimensional manifold and a one-dimensional manifold, the time consumption of RBSS is approximately only 0.028% to 27.5% and 4.6e−4% to 0.15% of that required by other algorithms, respectively.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141776943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Q-learning-based biology migration algorithm for energy-saving flexible job shop scheduling with speed adjustable machines and transporters 基于 Q 学习的生物迁移算法,适用于具有速度可调机器和运输机的节能型灵活作业车间调度
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-25 DOI: 10.1016/j.swevo.2024.101655

Due to the increasing demand for green manufacturing, energy-saving scheduling problems have garnered significant attention. These problems aim to reduce energy consumption at the production system level within workshops. To simulate a realistic production environment, this study addresses an energy-saving flexible job shop scheduling problem that considers two types of speed-adjustable resources, namely machines and transporters. The optimization objective is to minimize the comprehensive energy consumption of the workshop. A novel mathematical model is initially constructed based on the specific characteristics of the problem at hand. Given its NP-hard nature, a new Q-learning-based biology migration algorithm (QBMA) is proposed, which encompasses diverse search strategies and employs a Q-learning algorithm to dynamically select search strategies, thereby preventing blind search during the evolutionary process. The experimental results of our study demonstrate the promising efficacy of QBMA in effectively addressing the aforementioned problem, while also highlighting the positive impact of considering resources with adjustable speed.

由于对绿色制造的需求日益增长,节能调度问题备受关注。这些问题旨在降低车间内生产系统层面的能耗。为了模拟真实的生产环境,本研究探讨了一个节能灵活作业车间调度问题,该问题考虑了两类速度可调的资源,即机器和运输机。优化目标是最大限度地降低车间的综合能耗。根据当前问题的具体特点,我们初步构建了一个新颖的数学模型。该算法包含多种搜索策略,并采用 Q-learning 算法动态选择搜索策略,从而避免了进化过程中的盲目搜索。我们的研究实验结果表明,QBMA 在有效解决上述问题方面具有良好的效果,同时也凸显了考虑可调节速度的资源所带来的积极影响。
{"title":"A Q-learning-based biology migration algorithm for energy-saving flexible job shop scheduling with speed adjustable machines and transporters","authors":"","doi":"10.1016/j.swevo.2024.101655","DOIUrl":"10.1016/j.swevo.2024.101655","url":null,"abstract":"<div><p>Due to the increasing demand for green manufacturing, energy-saving scheduling problems have garnered significant attention. These problems aim to reduce energy consumption at the production system level within workshops. To simulate a realistic production environment, this study addresses an energy-saving flexible job shop scheduling problem that considers two types of speed-adjustable resources, namely machines and transporters. The optimization objective is to minimize the comprehensive energy consumption of the workshop. A novel mathematical model is initially constructed based on the specific characteristics of the problem at hand. Given its NP-hard nature, a new Q-learning-based biology migration algorithm (QBMA) is proposed, which encompasses diverse search strategies and employs a Q-learning algorithm to dynamically select search strategies, thereby preventing blind search during the evolutionary process. The experimental results of our study demonstrate the promising efficacy of QBMA in effectively addressing the aforementioned problem, while also highlighting the positive impact of considering resources with adjustable speed.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Co-evolution genetic programming-based hyper-heuristics for the stochastic project scheduling problem with resource transfer and idle costs 基于协同进化遗传编程的超启发式算法,用于具有资源转移和闲置成本的随机项目调度问题
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1016/j.swevo.2024.101678

In this paper, we study the stochastic resource-constrained project scheduling problem with transfer and idle costs (SRCPSP-TIC) under uncertain environments, where the resource transfer and idle take time and costs. Priority rule (PR) based heuristics are the most commonly used approaches for project scheduling under uncertain environments due to their simplicity and efficiency. For PR-based heuristics of the SRCPSP-TIC, activity priority rules (APRs) and transfer priority rules (TPRs) are necessary to decide the activity sequence and resource transfer. Traditionally, APRs and TPRs need to be manually designed, which is time-consuming and difficult to adapt to different scheduling scenarios. Therefore, based on two individual representation methods, we propose two co-evolution genetic programming (CGP) based hyper-heuristics to evolve APRs and TPRs automatically. Furthermore, a fitness function surrogate-assisted method and a transfer learning mechanism are designed to improve the efficiency and solution quality of the CGP. Based on the instances with different stochastic activity duration distributions, we test the performance of different CGP-based hyper-heuristics and compare the evolved PRs with the classical PRs to demonstrate the effectiveness of evolved PRs. Experimental results show that the proposed algorithms can automatically evolve efficient PRs for the SRCPSP-TIC.

本文研究了不确定环境下带有转移和闲置成本的随机资源受限项目调度问题(SRCPSP-TIC),其中资源的转移和闲置需要时间和成本。基于优先级规则(PR)的启发式方法因其简单高效而成为不确定环境下最常用的项目调度方法。对于基于 PR 的 SRCPSP-TIC 启发式算法,活动优先规则(APR)和资源转移优先规则(TPR)是决定活动顺序和资源转移的必要条件。传统上,活动优先规则和转移优先规则需要人工设计,既费时又难以适应不同的调度场景。因此,我们在两种单独表示方法的基础上,提出了两种基于共同进化遗传编程(CGP)的超启发式方法,以自动演化 APR 和 TPR。此外,为了提高 CGP 的效率和求解质量,我们还设计了一种适合度函数辅助方法和一种迁移学习机制。基于不同随机活动持续时间分布的实例,我们测试了不同基于 CGP 的超启发式算法的性能,并将进化 PR 与经典 PR 进行了比较,以证明进化 PR 的有效性。实验结果表明,所提出的算法可以自动为 SRCPSP-TIC 演化出高效的 PR。
{"title":"Co-evolution genetic programming-based hyper-heuristics for the stochastic project scheduling problem with resource transfer and idle costs","authors":"","doi":"10.1016/j.swevo.2024.101678","DOIUrl":"10.1016/j.swevo.2024.101678","url":null,"abstract":"<div><p>In this paper, we study the stochastic resource-constrained project scheduling problem with transfer and idle costs (SRCPSP-TIC) under uncertain environments, where the resource transfer and idle take time and costs. Priority rule (PR) based heuristics are the most commonly used approaches for project scheduling under uncertain environments due to their simplicity and efficiency. For PR-based heuristics of the SRCPSP-TIC, activity priority rules (APRs) and transfer priority rules (TPRs) are necessary to decide the activity sequence and resource transfer. Traditionally, APRs and TPRs need to be manually designed, which is time-consuming and difficult to adapt to different scheduling scenarios. Therefore, based on two individual representation methods, we propose two co-evolution genetic programming (CGP) based hyper-heuristics to evolve APRs and TPRs automatically. Furthermore, a fitness function surrogate-assisted method and a transfer learning mechanism are designed to improve the efficiency and solution quality of the CGP. Based on the instances with different stochastic activity duration distributions, we test the performance of different CGP-based hyper-heuristics and compare the evolved PRs with the classical PRs to demonstrate the effectiveness of evolved PRs. Experimental results show that the proposed algorithms can automatically evolve efficient PRs for the SRCPSP-TIC.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
When large language model meets optimization 当大型语言模型遇到优化
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1016/j.swevo.2024.101663

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent modeling and strategic decision-making in optimization, while optimization algorithms refine LLM architectures and output quality. This synergy offers novel approaches for advancing general AI, addressing both the computational challenges of complex problems and the application of LLMs in practical scenarios. This review outlines the progress and potential of combining LLMs with optimization algorithms, providing insights for future research directions.

优化算法和大型语言模型(LLM)通过将人工智能与传统技术相结合,增强了动态环境中的决策能力。LLM 具有广泛的领域知识,可促进优化过程中的智能建模和战略决策,而优化算法则可完善 LLM 架构和提高输出质量。这种协同作用为推进通用人工智能提供了新方法,既能解决复杂问题的计算挑战,又能将 LLM 应用于实际场景。本综述概述了 LLM 与优化算法相结合的进展和潜力,为未来的研究方向提供了启示。
{"title":"When large language model meets optimization","authors":"","doi":"10.1016/j.swevo.2024.101663","DOIUrl":"10.1016/j.swevo.2024.101663","url":null,"abstract":"<div><p>Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent modeling and strategic decision-making in optimization, while optimization algorithms refine LLM architectures and output quality. This synergy offers novel approaches for advancing general AI, addressing both the computational challenges of complex problems and the application of LLMs in practical scenarios. This review outlines the progress and potential of combining LLMs with optimization algorithms, providing insights for future research directions.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Adaptive Multi-Meme Memetic Algorithm for the prize-collecting generalized minimum spanning tree problem 奖品收集广义最小生成树问题的自适应多主题记忆算法
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1016/j.swevo.2024.101664

In this paper, we address the prize-collecting generalized minimum spanning tree problem (PC-GMSTP) which aims to find a minimum spanning tree to connect a network of clusters using exactly one vertex per cluster, minimizing the total cost of connecting the clusters while considering both the costs of edges and the prizes offered by the vertices. An Adaptive Multi-meme Memetic Algorithm (AMMA) is proposed to tackle PC-GMSTP, which combines an adaptive reproduction procedure and a collaborated local search procedure. The adaptive reproduction procedure uses either crossover or mutation to produce offspring to maintain a good balance between exploration and exploitation of the search space, and the probability to use crossover or mutation is adaptively adjusted based on the diversity of population. The collaborated local search procedure, which includes two efficient local search operators, can effectively enhance the intensification ability of AMMA due to their complementary features. Extensive computational experiments on 126 challenging instances demonstrate the superiority of AMMA, outperforming 23 best-known solutions from existing literature while achieving similar solutions for the remaining 103 instances. Wilcoxon’s signed rank test confirms that the performance of AMMA is significantly better than the state-of-the-art algorithms.

本文探讨了奖金收集广义最小生成树问题(PC-GMSTP),该问题旨在找到一棵最小生成树来连接一个簇网络,每个簇使用一个顶点,在考虑边的成本和顶点提供的奖金的同时,使连接簇的总成本最小。为解决 PC-GMSTP 问题,提出了一种自适应多主题记忆算法(AMMA),它结合了自适应复制程序和协作局部搜索程序。自适应繁殖过程使用交叉或突变来产生后代,以保持搜索空间的探索和开发之间的良好平衡,并根据种群的多样性自适应地调整使用交叉或突变的概率。协同局部搜索程序包括两个高效的局部搜索算子,由于它们的互补性,可以有效提高 AMMA 的强化能力。在 126 个具有挑战性的实例上进行的大量计算实验证明了 AMMA 的优越性,其性能优于现有文献中最著名的 23 种解决方案,同时在其余 103 个实例上也取得了类似的解决方案。Wilcoxon 符号秩检验证实,AMMA 的性能明显优于最先进的算法。
{"title":"An Adaptive Multi-Meme Memetic Algorithm for the prize-collecting generalized minimum spanning tree problem","authors":"","doi":"10.1016/j.swevo.2024.101664","DOIUrl":"10.1016/j.swevo.2024.101664","url":null,"abstract":"<div><p>In this paper, we address the prize-collecting generalized minimum spanning tree problem (PC-GMSTP) which aims to find a minimum spanning tree to connect a network of clusters using exactly one vertex per cluster, minimizing the total cost of connecting the clusters while considering both the costs of edges and the prizes offered by the vertices. An Adaptive Multi-meme Memetic Algorithm (AMMA) is proposed to tackle PC-GMSTP, which combines an adaptive reproduction procedure and a collaborated local search procedure. The adaptive reproduction procedure uses either crossover or mutation to produce offspring to maintain a good balance between exploration and exploitation of the search space, and the probability to use crossover or mutation is adaptively adjusted based on the diversity of population. The collaborated local search procedure, which includes two efficient local search operators, can effectively enhance the intensification ability of AMMA due to their complementary features. Extensive computational experiments on 126 challenging instances demonstrate the superiority of AMMA, outperforming 23 best-known solutions from existing literature while achieving similar solutions for the remaining 103 instances. Wilcoxon’s signed rank test confirms that the performance of AMMA is significantly better than the state-of-the-art algorithms.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Formulating approximation error as noise in surrogate-assisted multi-objective evolutionary algorithm 将近似误差表述为代理辅助多目标进化算法中的噪声
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-24 DOI: 10.1016/j.swevo.2024.101666

Many real multi-objective optimization problems with 20-50 decision variables often have only a small number of function evaluations available, because of their heavy time/money burden. Therefore, surrogate models are often utilized as alternatives for expensive function evaluations. However, the approximation error of the surrogate model is inevitable compared to the real function evaluation. The approximation error has a similar impact on the algorithm as noise, i.e., different optimization stages suffer from various impacts. Therefore, the current optimization stage can be indirectly detected via measuring the impact of the noise formulated by the approximation error. In addition, the rising dimension of the search space leads to an increase in the approximation errors of the surrogate models, which poses a huge challenge for existing surrogate-assisted multi-objective evolutionary algorithms. In this work, we propose a stage-adaptive surrogate-assisted multi-objective evolutionary algorithm to solve the medium-scale optimization problems. In the proposed algorithm, the ensemble model consisting of the latest and historical models is used as the surrogate model, on the basis of which a set of potential candidates can be discovered. Then, a stage-adaptive infill sampling strategy selects the most suitable sampling strategy by analyzing the demand of the current optimization stage on convergence, diversity, model accuracy to sample from the candidates. As for the current optimization stage, it is detected by a noise impact indicator, where the approximation errors of surrogate models are formulated as noise. The experimental results on a series of medium-scale expensive test problems demonstrate the superiority of the proposed algorithm over six state-of-the-art compared algorithms.

许多包含 20-50 个决策变量的实际多目标优化问题,由于时间/金钱负担沉重,往往只有少量的函数评估可用。因此,代用模型常常被用来替代昂贵的函数评估。然而,与实际函数评估相比,代用模型的近似误差是不可避免的。近似误差对算法的影响类似于噪声,即不同的优化阶段会受到不同的影响。因此,可以通过测量由近似误差形成的噪声的影响来间接检测当前的优化阶段。此外,搜索空间维度的增加导致代用模型的近似误差增大,这对现有的代用辅助多目标进化算法提出了巨大挑战。在这项工作中,我们提出了一种阶段自适应的代型辅助多目标进化算法来解决中等规模的优化问题。在所提出的算法中,由最新模型和历史模型组成的集合模型被用作代用模型,在此基础上可以发现一组潜在的候选模型。然后,阶段自适应填充采样策略通过分析当前优化阶段对收敛性、多样性、模型精度的需求,选择最合适的采样策略,从候选模型中进行采样。至于当前优化阶段,则通过噪声影响指标来检测,将代用模型的近似误差作为噪声。在一系列中等规模的昂贵测试问题上的实验结果表明,所提出的算法优于六种最先进的比较算法。
{"title":"Formulating approximation error as noise in surrogate-assisted multi-objective evolutionary algorithm","authors":"","doi":"10.1016/j.swevo.2024.101666","DOIUrl":"10.1016/j.swevo.2024.101666","url":null,"abstract":"<div><p>Many real multi-objective optimization problems with 20-50 decision variables often have only a small number of function evaluations available, because of their heavy time/money burden. Therefore, surrogate models are often utilized as alternatives for expensive function evaluations. However, the approximation error of the surrogate model is inevitable compared to the real function evaluation. The approximation error has a similar impact on the algorithm as noise, i.e., different optimization stages suffer from various impacts. Therefore, the current optimization stage can be indirectly detected via measuring the impact of the noise formulated by the approximation error. In addition, the rising dimension of the search space leads to an increase in the approximation errors of the surrogate models, which poses a huge challenge for existing surrogate-assisted multi-objective evolutionary algorithms. In this work, we propose a stage-adaptive surrogate-assisted multi-objective evolutionary algorithm to solve the medium-scale optimization problems. In the proposed algorithm, the ensemble model consisting of the latest and historical models is used as the surrogate model, on the basis of which a set of potential candidates can be discovered. Then, a stage-adaptive infill sampling strategy selects the most suitable sampling strategy by analyzing the demand of the current optimization stage on convergence, diversity, model accuracy to sample from the candidates. As for the current optimization stage, it is detected by a noise impact indicator, where the approximation errors of surrogate models are formulated as noise. The experimental results on a series of medium-scale expensive test problems demonstrate the superiority of the proposed algorithm over six state-of-the-art compared algorithms.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evolutionary computation for feature selection in classification: A comprehensive survey of solutions, applications and challenges 用于分类中特征选择的进化计算:关于解决方案、应用和挑战的全面调查
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-22 DOI: 10.1016/j.swevo.2024.101661

Feature selection (FS), as one of the most significant preprocessing techniques in the fields of machine learning and pattern recognition, has received great attention. In recent years, evolutionary computation has become a popular technique for handling FS problems due to its superior global search performance. In this paper, a comprehensive review of evolutionary computation research on the FS problems is presented. Firstly, a new taxonomy for the basic components of evolutionary feature selection algorithms (EFSs) is proposed, including encoding strategy, population initialization, population updating, local search, multi-FS hybrid and ensemble. Secondly, we summarize the latest research progress of EFSs on some new and complex scenarios, including large-scale high-dimensional data, multi-objective/metric scenario, multi-label data, distributed storage data, multi-task scenario, multi-modal scenario, interpretable FS and stable FS, etc. Moreover, this survey provides also an in-depth analysis of real-world applications of EFSs, such as hyperspectral band selection, bioinformatics gene selection, text classification and fault detection, etc. Finally, several opportunities for future work are pointed out.

特征选择(FS)作为机器学习和模式识别领域最重要的预处理技术之一,受到了广泛关注。近年来,进化计算以其优越的全局搜索性能成为处理 FS 问题的热门技术。本文全面回顾了进化计算在金融服务问题上的研究。首先,本文提出了进化特征选择算法(EFS)基本组成部分的新分类法,包括编码策略、种群初始化、种群更新、局部搜索、多 FS 混合和集合。其次,总结了进化特征选择算法在一些新的复杂场景下的最新研究进展,包括大规模高维数据、多目标/度量场景、多标签数据、分布式存储数据、多任务场景、多模态场景、可解释特征选择算法和稳定特征选择算法等。此外,本研究还深入分析了 EFS 在现实世界中的应用,如高光谱波段选择、生物信息学基因选择、文本分类和故障检测等。最后,还指出了未来工作的几个机会。
{"title":"Evolutionary computation for feature selection in classification: A comprehensive survey of solutions, applications and challenges","authors":"","doi":"10.1016/j.swevo.2024.101661","DOIUrl":"10.1016/j.swevo.2024.101661","url":null,"abstract":"<div><p>Feature selection (FS), as one of the most significant preprocessing techniques in the fields of machine learning and pattern recognition, has received great attention. In recent years, evolutionary computation has become a popular technique for handling FS problems due to its superior global search performance. In this paper, a comprehensive review of evolutionary computation research on the FS problems is presented. Firstly, a new taxonomy for the basic components of evolutionary feature selection algorithms (EFSs) is proposed, including encoding strategy, population initialization, population updating, local search, multi-FS hybrid and ensemble. Secondly, we summarize the latest research progress of EFSs on some new and complex scenarios, including large-scale high-dimensional data, multi-objective/metric scenario, multi-label data, distributed storage data, multi-task scenario, multi-modal scenario, interpretable FS and stable FS, etc. Moreover, this survey provides also an in-depth analysis of real-world applications of EFSs, such as hyperspectral band selection, bioinformatics gene selection, text classification and fault detection, etc. Finally, several opportunities for future work are pointed out.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141777044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic variable analysis guided adaptive evolutionary multi-objective scheduling for large-scale workflows in cloud computing 动态变量分析引导的自适应进化多目标调度,适用于云计算中的大规模工作流
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-07-20 DOI: 10.1016/j.swevo.2024.101654

Energy consumption and makespan of workflow execution are two core performance indicators in operating cloud platforms. But, simultaneously optimizing these two indicators encounters various challenges, such as elastic resources, large-scale decision variables, and sophisticated workflow structures. To handle these challenges, we design an adaptive evolutionary scheduling algorithm, namely AESA, with three innovative strategies. First, a heuristic population initialization strategy is devised to gather workflow tasks onto limited potential resources, thereby alleviating the negative impact of redundant cloud resources on evolutionary search efficiency. Then, a variable analysis strategy is designed to dynamically measure the contribution of each decision variable in pushing the population towards Pareto-optimal fronts. Moreover, AESA embraces an adaptive strategy to reward more evolutionary opportunities for decision variables with higher contributions to handle large-scale decision variables in a targeted manner, further improving the efficiency of evolutionary search. Finally, extensive experiments are performed based on real-world cloud platforms and workflow traces to verify the effectiveness of the proposed AESA. The comparison results validate its superior performance by significantly outperforming five representative baselines in optimizing makespan and energy consumption. Also, the results of ablation experiments demonstrate that all three components contribute to AESA’s overall performance, with the adaptive reward mechanism being the most significant.

工作流执行的能耗和时间跨度是云平台运行的两个核心性能指标。但是,同时优化这两个指标会遇到各种挑战,如弹性资源、大规模决策变量和复杂的工作流结构。为了应对这些挑战,我们设计了一种自适应进化调度算法,即AESA,其中包含三种创新策略。首先,设计了启发式种群初始化策略,将工作流任务聚集到有限的潜在资源上,从而减轻冗余云资源对进化搜索效率的负面影响。然后,设计了一种变量分析策略,用于动态测量每个决策变量在推动群体实现帕累托最优前沿方面的贡献。此外,AESA 还采用自适应策略,为贡献度较高的决策变量提供更多的进化机会,从而有针对性地处理大规模决策变量,进一步提高进化搜索的效率。最后,我们基于真实的云平台和工作流痕迹进行了大量实验,以验证所提出的 AESA 的有效性。对比结果验证了其优越性能,在优化时间跨度和能源消耗方面明显优于五种代表性基线。此外,消融实验结果表明,所有三个组件都对 AESA 的整体性能做出了贡献,其中自适应奖励机制的作用最大。
{"title":"Dynamic variable analysis guided adaptive evolutionary multi-objective scheduling for large-scale workflows in cloud computing","authors":"","doi":"10.1016/j.swevo.2024.101654","DOIUrl":"10.1016/j.swevo.2024.101654","url":null,"abstract":"<div><p>Energy consumption and makespan of workflow execution are two core performance indicators in operating cloud platforms. But, simultaneously optimizing these two indicators encounters various challenges, such as elastic resources, large-scale decision variables, and sophisticated workflow structures. To handle these challenges, we design an adaptive evolutionary scheduling algorithm, namely AESA, with three innovative strategies. First, a heuristic population initialization strategy is devised to gather workflow tasks onto limited potential resources, thereby alleviating the negative impact of redundant cloud resources on evolutionary search efficiency. Then, a variable analysis strategy is designed to dynamically measure the contribution of each decision variable in pushing the population towards Pareto-optimal fronts. Moreover, AESA embraces an adaptive strategy to reward more evolutionary opportunities for decision variables with higher contributions to handle large-scale decision variables in a targeted manner, further improving the efficiency of evolutionary search. Finally, extensive experiments are performed based on real-world cloud platforms and workflow traces to verify the effectiveness of the proposed AESA. The comparison results validate its superior performance by significantly outperforming five representative baselines in optimizing makespan and energy consumption. Also, the results of ablation experiments demonstrate that all three components contribute to AESA’s overall performance, with the adaptive reward mechanism being the most significant.</p></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141732136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Swarm and Evolutionary Computation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1