首页 > 最新文献

Evolutionary Computation最新文献

英文 中文
Personal Reflections on Some Early Work in Evolving Strategies in the Iterated Prisoner's Dilemma 对囚徒困境演化策略早期研究的个人思考
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-06-01 DOI: 10.1162/evco_a_00322
David B. Fogel
On the occasion of the 30-year anniversary of the Evolutionary Computation journal, I was invited by Professor Hart to offer some reflections on the article on evolving behaviors in the iterated prisoner's dilemma that I contributed to its first issue in 1993. It's an honor to do so. I would like to thank Professor Ken De Jong, the journal's first editor-in-chief, for his vision in creating the journal, and the editors who have followed and maintained that vision. This article contains some personal reflections on the topic and the field as a whole.
在《进化计算》杂志创刊30周年之际,Hart教授邀请我就我在1993年创刊的那篇关于反复囚徒困境中的进化行为的文章发表一些感想。我很荣幸能这样做。我要感谢该杂志的首任主编Ken De Jong教授,感谢他在创办该杂志时的远见卓识,以及追随并保持这一远见卓识的编辑们。这篇文章包含了对这个话题和整个领域的一些个人思考。
{"title":"Personal Reflections on Some Early Work in Evolving Strategies in the Iterated Prisoner's Dilemma","authors":"David B. Fogel","doi":"10.1162/evco_a_00322","DOIUrl":"10.1162/evco_a_00322","url":null,"abstract":"On the occasion of the 30-year anniversary of the Evolutionary Computation journal, I was invited by Professor Hart to offer some reflections on the article on evolving behaviors in the iterated prisoner's dilemma that I contributed to its first issue in 1993. It's an honor to do so. I would like to thank Professor Ken De Jong, the journal's first editor-in-chief, for his vision in creating the journal, and the editors who have followed and maintained that vision. This article contains some personal reflections on the topic and the field as a whole.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"31 2","pages":"157-161"},"PeriodicalIF":6.8,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9670243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Stagnation Detection with Randomized Local Search* 基于随机局部搜索的停滞检测*
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-01 DOI: 10.1162/evco_a_00313
Amirhossein Rajabi;Carsten Witt
Recently a mechanism called stagnation detection was proposed that automatically adjusts the mutation rate of evolutionary algorithms when they encounter local optima. The so-called SD-(1+1) EA introduced by Rajabi and Witt (2022) adds stagnation detection to the classical (1+1) EA with standard bit mutation. This algorithm flips each bit independently with some mutation rate, and stagnation detection raises the rate when the algorithm is likely to have encountered a local optimum. In this article, we investigate stagnation detection in the context of the k-bit flip operator of randomized local search that flips k bits chosen uniformly at random and let stagnation detection adjust the parameter k. We obtain improved runtime results compared with the SD-(1+1) EA amounting to a speedup of at least (1-o(1))2πm, where m is the so-called gap size, that is, the distance to the next improvement. Moreover, we propose additional schemes that prevent infinite optimization times even if the algorithm misses a working choice of k due to unlucky events. Finally, we present an example where standard bit mutation still outperforms the k-bit flip operator with stagnation detection.
最近提出了一种称为停滞检测的机制,当进化算法遇到局部最优时,它会自动调整突变率。Rajabi和Witt(2022)引入的所谓SD-(1+1) EA在具有标准位突变的经典(1+1)EA的基础上增加了停滞检测。该算法以一定的突变率独立翻转每个比特,当算法可能遇到局部最优时,停滞检测提高了速率。在本文中,我们研究了随机局部搜索的k位翻转算子的停滞检测,该算子随机选择k位均匀翻转,并让停滞检测调整参数k。与SD-(1+1) EA相比,我们获得了改进的运行结果,相当于至少(1-o(1))2πm,其中m是所谓的间隙大小,即到下一个改进的距离。此外,我们提出了额外的方案,即使算法由于不幸事件而错过k的工作选择,也可以防止无限的优化时间。最后,我们给出了一个例子,其中标准位突变仍然优于具有停滞检测的k位翻转算子。
{"title":"Stagnation Detection with Randomized Local Search*","authors":"Amirhossein Rajabi;Carsten Witt","doi":"10.1162/evco_a_00313","DOIUrl":"10.1162/evco_a_00313","url":null,"abstract":"Recently a mechanism called stagnation detection was proposed that automatically adjusts the mutation rate of evolutionary algorithms when they encounter local optima. The so-called SD-(1+1) EA introduced by Rajabi and Witt (2022) adds stagnation detection to the classical (1+1) EA with standard bit mutation. This algorithm flips each bit independently with some mutation rate, and stagnation detection raises the rate when the algorithm is likely to have encountered a local optimum. In this article, we investigate stagnation detection in the context of the k-bit flip operator of randomized local search that flips k bits chosen uniformly at random and let stagnation detection adjust the parameter k. We obtain improved runtime results compared with the SD-(1+1) EA amounting to a speedup of at least (1-o(1))2πm, where m is the so-called gap size, that is, the distance to the next improvement. Moreover, we propose additional schemes that prevent infinite optimization times even if the algorithm misses a working choice of k due to unlucky events. Finally, we present an example where standard bit mutation still outperforms the k-bit flip operator with stagnation detection.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"31 1","pages":"1-29"},"PeriodicalIF":6.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9359552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
An Uncertainty Measure for Prediction of Non-Gaussian Process Surrogates 非高斯过程替代物预测的不确定度度量
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-01 DOI: 10.1162/evco_a_00316
Caie Hu;Sanyou Zeng;Changhe Li
Model management is an essential component in data-driven surrogate-assisted evolutionary optimization. In model management, the solutions with a large degree of uncertainty in approximation play an important role. They can strengthen the exploration ability of algorithms and improve the accuracy of surrogates. However, there is no theoretical method to measure the uncertainty of prediction of Non-Gaussian process surrogates. To address this issue, this article proposes a method to measure the uncertainty. In this method, a stationary random field with a known zero mean is used to measure the uncertainty of prediction of Non-Gaussian process surrogates. Based on experimental analyses, this method is able to measure the uncertainty of prediction of Non-Gaussian process surrogates. The method's effectiveness is demonstrated on a set of benchmark problems in single surrogate and ensemble surrogates cases.
模型管理是数据驱动的代理辅助进化优化的重要组成部分。在模型管理中,具有较大近似不确定性的解起着重要的作用。它们可以增强算法的探索能力,提高代理的准确性。然而,目前尚无理论方法来测量非高斯过程的预测不确定度。为了解决这一问题,本文提出了一种测量不确定度的方法。该方法利用一个已知均值为零的平稳随机场来测量非高斯过程替代物预测的不确定性。实验分析表明,该方法能够测量非高斯过程的预测不确定度。在单代理和集成代理两种情况下的一组基准问题上验证了该方法的有效性。
{"title":"An Uncertainty Measure for Prediction of Non-Gaussian Process Surrogates","authors":"Caie Hu;Sanyou Zeng;Changhe Li","doi":"10.1162/evco_a_00316","DOIUrl":"10.1162/evco_a_00316","url":null,"abstract":"Model management is an essential component in data-driven surrogate-assisted evolutionary optimization. In model management, the solutions with a large degree of uncertainty in approximation play an important role. They can strengthen the exploration ability of algorithms and improve the accuracy of surrogates. However, there is no theoretical method to measure the uncertainty of prediction of Non-Gaussian process surrogates. To address this issue, this article proposes a method to measure the uncertainty. In this method, a stationary random field with a known zero mean is used to measure the uncertainty of prediction of Non-Gaussian process surrogates. Based on experimental analyses, this method is able to measure the uncertainty of prediction of Non-Gaussian process surrogates. The method's effectiveness is demonstrated on a set of benchmark problems in single surrogate and ensemble surrogates cases.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"31 1","pages":"53-71"},"PeriodicalIF":6.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10801408","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Hybridization of Evolutionary Operators with Elitist Iterated Racing for the Simulation Optimization of Traffic Lights Programs 混合进化算子与精英迭代竞速的交通信号灯仿真优化
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-01 DOI: 10.1162/evco_a_00314
Christian Cintrano;Javier Ferrer;Manuel López-Ibáñez;Enrique Alba
In the traffic light scheduling problem, the evaluation of candidate solutions requires the simulation of a process under various (traffic) scenarios. Thus, good solutions should not only achieve good objective function values, but they must be robust (low variance) across all different scenarios. Previous work has shown that combining IRACE with evolutionary operators is effective for this task due to the power of evolutionary operators in numerical optimization. In this article, we further explore the hybridization of evolutionary operators and the elitist iterated racing of IRACE for the simulation–optimization of traffic light programs. We review previous works from the literature to find the evolutionary operators performing the best when facing this problem to propose new hybrid algorithms. We evaluate our approach over a realistic case study derived from the traffic network of Málaga (Spain) with 275 traffic lights that should be scheduled optimally. The experimental analysis reveals that the hybrid algorithm comprising IRACE plus differential evolution offers statistically better results than the other algorithms when the budget of simulations is low. In contrast, IRACE performs better than the hybrids for a high simulations budget, although the optimization time is much longer.
在交通灯调度问题中,候选方案的评价需要模拟各种交通场景下的过程。因此,好的解决方案不仅应该实现好的目标函数值,而且必须在所有不同的场景中都具有鲁棒性(低方差)。先前的研究表明,由于进化算子在数值优化中的强大功能,将IRACE与进化算子相结合是有效的。在本文中,我们进一步探讨了进化算子和IRACE的精英迭代赛车的杂交,用于红绿灯程序的模拟优化。我们回顾了以往的文献,找到了在面对这一问题时表现最好的进化算子,并提出了新的混合算法。我们通过一个现实的案例研究来评估我们的方法,该案例研究来源于Málaga(西班牙)的交通网络,其中有275个交通信号灯应该被优化安排。实验分析表明,当模拟预算较低时,由IRACE和差分进化组成的混合算法在统计上优于其他算法。相比之下,尽管优化时间更长,但在高模拟预算下,IRACE的性能优于混合动力车。
{"title":"Hybridization of Evolutionary Operators with Elitist Iterated Racing for the Simulation Optimization of Traffic Lights Programs","authors":"Christian Cintrano;Javier Ferrer;Manuel López-Ibáñez;Enrique Alba","doi":"10.1162/evco_a_00314","DOIUrl":"10.1162/evco_a_00314","url":null,"abstract":"In the traffic light scheduling problem, the evaluation of candidate solutions requires the simulation of a process under various (traffic) scenarios. Thus, good solutions should not only achieve good objective function values, but they must be robust (low variance) across all different scenarios. Previous work has shown that combining IRACE with evolutionary operators is effective for this task due to the power of evolutionary operators in numerical optimization. In this article, we further explore the hybridization of evolutionary operators and the elitist iterated racing of IRACE for the simulation–optimization of traffic light programs. We review previous works from the literature to find the evolutionary operators performing the best when facing this problem to propose new hybrid algorithms. We evaluate our approach over a realistic case study derived from the traffic network of Málaga (Spain) with 275 traffic lights that should be scheduled optimally. The experimental analysis reveals that the hybrid algorithm comprising IRACE plus differential evolution offers statistically better results than the other algorithms when the budget of simulations is low. In contrast, IRACE performs better than the hybrids for a high simulations budget, although the optimization time is much longer.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"31 1","pages":"31-51"},"PeriodicalIF":6.8,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10814046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Active Sets for Explicitly Constrained Evolutionary Optimization 显约束进化优化的主动集
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-12-01 DOI: 10.1162/evco_a_00311
Patrick Spettel;Zehao Ba;Dirk V. Arnold
Active-set approaches are commonly used in algorithms for constrained numerical optimization. We propose that active-set techniques can beneficially be employed for evolutionary black-box optimization with explicit constraints and present an active-set evolution strategy. We experimentally evaluate its performance relative to those of several algorithms for constrained optimization and find that the active-set evolution strategy compares favourably for the problem set under consideration.
摘要主动集方法常用于约束数值优化算法中。我们提出,主动集技术可以有益地用于具有显式约束的进化黑箱优化,并提出了一种主动集进化策略。我们通过实验评估了它相对于几种约束优化算法的性能,发现主动集进化策略与所考虑的问题集相比是有利的。
{"title":"Active Sets for Explicitly Constrained Evolutionary Optimization","authors":"Patrick Spettel;Zehao Ba;Dirk V. Arnold","doi":"10.1162/evco_a_00311","DOIUrl":"10.1162/evco_a_00311","url":null,"abstract":"Active-set approaches are commonly used in algorithms for constrained numerical optimization. We propose that active-set techniques can beneficially be employed for evolutionary black-box optimization with explicit constraints and present an active-set evolution strategy. We experimentally evaluate its performance relative to those of several algorithms for constrained optimization and find that the active-set evolution strategy compares favourably for the problem set under consideration.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 4","pages":"531-553"},"PeriodicalIF":6.8,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41589162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards Intelligently Designed Evolvable Processors 面向智能设计的可进化处理器
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-12-01 DOI: 10.1162/evco_a_00309
Benedict A. H. Jones;John L. P. Chouard;Bianca C. C. Branco;Eléonore G. B. Vissol-Gaudin;Christopher Pearson;Michael C. Petty;Noura Al Moubayed;Dagou A. Zeze;Chris Groves
Evolution-in-Materio is a computational paradigm in which an algorithm reconfigures a material's properties to achieve a specific computational function. This article addresses the question of how successful and well performing Evolution-in-Materio processors can be designed through the selection of nanomaterials and an evolutionary algorithm for a target application. A physical model of a nanomaterial network is developed which allows for both randomness, and the possibility of Ohmic and non-Ohmic conduction, that are characteristic of such materials. These differing networks are then exploited by differential evolution, which optimises several configuration parameters (e.g., configuration voltages, weights, etc.), to solve different classification problems. We show that ideal nanomaterial choice depends upon problem complexity, with more complex problems being favoured by complex voltage dependence of conductivity and vice versa. Furthermore, we highlight how intrinsic nanomaterial electrical properties can be exploited by differing configuration parameters, clarifying the role and limitations of these techniques. These findings provide guidance for the rational design of nanomaterials and algorithms for future Evolution-in-Materio processors.
Materio中的抽象进化是一种计算范式,其中算法重新配置材料的特性以实现特定的计算功能。本文讨论了如何通过选择纳米材料和目标应用的进化算法来设计Materio处理器中成功且性能良好的进化。开发了一种纳米材料网络的物理模型,该模型考虑了随机性以及欧姆和非欧姆导电的可能性,这是此类材料的特征。然后通过差分进化来利用这些不同的网络,差分进化优化了几个配置参数(例如,配置电压、权重等),以解决不同的分类问题。我们表明,理想的纳米材料选择取决于问题的复杂性,电导率的复杂电压依赖性有利于更复杂的问题,反之亦然。此外,我们强调了如何通过不同的配置参数来利用本征纳米材料的电学特性,阐明了这些技术的作用和局限性。这些发现为Materio处理器中纳米材料和算法的合理设计提供了指导。
{"title":"Towards Intelligently Designed Evolvable Processors","authors":"Benedict A. H. Jones;John L. P. Chouard;Bianca C. C. Branco;Eléonore G. B. Vissol-Gaudin;Christopher Pearson;Michael C. Petty;Noura Al Moubayed;Dagou A. Zeze;Chris Groves","doi":"10.1162/evco_a_00309","DOIUrl":"10.1162/evco_a_00309","url":null,"abstract":"Evolution-in-Materio is a computational paradigm in which an algorithm reconfigures a material's properties to achieve a specific computational function. This article addresses the question of how successful and well performing Evolution-in-Materio processors can be designed through the selection of nanomaterials and an evolutionary algorithm for a target application. A physical model of a nanomaterial network is developed which allows for both randomness, and the possibility of Ohmic and non-Ohmic conduction, that are characteristic of such materials. These differing networks are then exploited by differential evolution, which optimises several configuration parameters (e.g., configuration voltages, weights, etc.), to solve different classification problems. We show that ideal nanomaterial choice depends upon problem complexity, with more complex problems being favoured by complex voltage dependence of conductivity and vice versa. Furthermore, we highlight how intrinsic nanomaterial electrical properties can be exploited by differing configuration parameters, clarifying the role and limitations of these techniques. These findings provide guidance for the rational design of nanomaterials and algorithms for future Evolution-in-Materio processors.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 4","pages":"479-501"},"PeriodicalIF":6.8,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48671640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
When Hillclimbers Beat Genetic Algorithms in Multimodal Optimization 当登山者在多模式优化中击败遗传算法时。
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-12-01 DOI: 10.1162/evco_a_00312
Fernando G. Lobo;Mosab Bazargani
This article investigates the performance of multistart next ascent hillclimbing and well-known evolutionary algorithms incorporating diversity preservation techniques on instances of the multimodal problem generator. This generator induces a class of problems in the bitstring domain which is interesting to study from a theoretical perspective in the context of multimodal optimization, as it is a generalization of the classical OneMax and TwoMax functions for an arbitrary number of peaks. An average-case runtime analysis for multistart next ascent hillclimbing is presented for uniformly distributed equal-height instances of this class of problems. It is shown empirically that conventional niching and mating restriction techniques incorporated in an evolutionary algorithm are not sufficient to make them competitive with the hillclimbing strategy. We conjecture the reason for this behavior is the lack of structure in the space of local optima on instances of this problem class, which makes an optimization algorithm unable to exploit information from one optimum to infer where another optimum might be. When no such structure exists, it seems that the best strategy for discovering all optima is a brute-force one. Overall, our study gives insights with respect to the adequacy of hillclimbers and evolutionary algorithms for multimodal optimization, depending on properties of the fitness landscape.
本文研究了多部分下一次爬坡和结合多样性保持技术的著名进化算法在多模式问题生成器实例中的性能。该生成器在比特串域中引发了一类问题,在多峰优化的背景下,从理论角度研究这类问题很有趣,因为它是对任意数量峰值的经典OneMax和TwoMax函数的推广。针对这类问题的均匀分布等高实例,给出了多部分下一次爬坡的平均情况运行时间分析。经验表明,传统的小生境和交配限制技术结合在进化算法中不足以使其与爬山策略相竞争。我们推测这种行为的原因是该问题类实例的局部最优空间中缺乏结构,这使得优化算法无法利用一个最优的信息来推断另一个最优可能在哪里。当不存在这样的结构时,发现所有最优的最佳策略似乎是暴力策略。总的来说,我们的研究根据适应度景观的特性,深入了解了登山者和进化算法在多模式优化中的充分性。
{"title":"When Hillclimbers Beat Genetic Algorithms in Multimodal Optimization","authors":"Fernando G. Lobo;Mosab Bazargani","doi":"10.1162/evco_a_00312","DOIUrl":"10.1162/evco_a_00312","url":null,"abstract":"This article investigates the performance of multistart next ascent hillclimbing and well-known evolutionary algorithms incorporating diversity preservation techniques on instances of the multimodal problem generator. This generator induces a class of problems in the bitstring domain which is interesting to study from a theoretical perspective in the context of multimodal optimization, as it is a generalization of the classical OneMax and TwoMax functions for an arbitrary number of peaks. An average-case runtime analysis for multistart next ascent hillclimbing is presented for uniformly distributed equal-height instances of this class of problems. It is shown empirically that conventional niching and mating restriction techniques incorporated in an evolutionary algorithm are not sufficient to make them competitive with the hillclimbing strategy. We conjecture the reason for this behavior is the lack of structure in the space of local optima on instances of this problem class, which makes an optimization algorithm unable to exploit information from one optimum to infer where another optimum might be. When no such structure exists, it seems that the best strategy for discovering all optima is a brute-force one. Overall, our study gives insights with respect to the adequacy of hillclimbers and evolutionary algorithms for multimodal optimization, depending on properties of the fitness landscape.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 4","pages":"535-559"},"PeriodicalIF":6.8,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41240529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Adaptive Ranking-Based Constraint Handling for Explicitly Constrained Black-Box Optimization 基于自适应排序的显式约束黑盒优化约束处理
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-12-01 DOI: 10.1162/evco_a_00310
Naoki Sakamoto;Youhei Akimoto
We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the explicit constraint is a constraint whereby the computational time for the constraint violation and its (numerical) gradient are negligible compared to that for the objective function. This method is designed to realize two invariance properties: invariance to the affine transformation of the search space, and invariance to the increasing transformation of the objective and constraint functions. The CMA-ES is designed to possess these properties for handling difficulties that appear in black-box optimization problems, such as non-separability, ill-conditioning, ruggedness, and the different orders of magnitude in the objective. The proposed constraint-handling technique (CHT), known as ARCH, modifies the underlying CMA-ES only in terms of the ranking of the candidate solutions. It employs a repair operator and an adaptive ranking aggregation strategy to compute the ranking. We developed test problems to evaluate the effects of the invariance properties, and performed experiments to empirically verify the invariance of the algorithm. We compared the proposed method with other CHTs on the CEC 2006 constrained optimization benchmark suite to demonstrate its efficacy. Empirical studies reveal that ARCH is able to exploit the explicitness of the constraint functions effectively, sometimes even more efficiently than an existing box-constraint handling technique on box-constrained problems, while exhibiting the invariance properties. Moreover, ARCH overwhelmingly outperforms CHTs by not exploiting the explicit constraints in terms of the number of objective function calls.
我们为协方差矩阵自适应进化策略(CMA-ES)提出了一种新的约束处理技术。所提出的技术旨在解决显式约束的黑盒连续优化问题,其中显式约束是一种约束,与目标函数相比,违反约束的计算时间及其(数值)梯度可以忽略不计。该方法旨在实现两个不变性:对搜索空间的仿射变换的不变性,以及对目标函数和约束函数的递增变换的不变性。CMA-ES被设计为具有这些特性,用于处理黑盒优化问题中出现的困难,如不可分性、不良条件、鲁棒性和目标中的不同数量级。所提出的约束处理技术(CHT),即ARCH,仅根据候选解决方案的排序来修改底层CMA-ES。它采用修复算子和自适应排名聚合策略来计算排名。我们开发了测试问题来评估不变性的影响,并进行了实验来实证验证算法的不变性。我们将所提出的方法与CEC 2006约束优化基准套件上的其他CHT进行了比较,以证明其有效性。实证研究表明,ARCH能够有效地利用约束函数的明确性,有时甚至比现有的盒约束处理技术更有效地处理盒约束问题,同时表现出不变性。此外,ARCH在目标函数调用数量方面没有利用显式约束,因此其性能远远优于CHT。
{"title":"Adaptive Ranking-Based Constraint Handling for Explicitly Constrained Black-Box Optimization","authors":"Naoki Sakamoto;Youhei Akimoto","doi":"10.1162/evco_a_00310","DOIUrl":"https://doi.org/10.1162/evco_a_00310","url":null,"abstract":"We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the explicit constraint is a constraint whereby the computational time for the constraint violation and its (numerical) gradient are negligible compared to that for the objective function. This method is designed to realize two invariance properties: invariance to the affine transformation of the search space, and invariance to the increasing transformation of the objective and constraint functions. The CMA-ES is designed to possess these properties for handling difficulties that appear in black-box optimization problems, such as non-separability, ill-conditioning, ruggedness, and the different orders of magnitude in the objective. The proposed constraint-handling technique (CHT), known as ARCH, modifies the underlying CMA-ES only in terms of the ranking of the candidate solutions. It employs a repair operator and an adaptive ranking aggregation strategy to compute the ranking. We developed test problems to evaluate the effects of the invariance properties, and performed experiments to empirically verify the invariance of the algorithm. We compared the proposed method with other CHTs on the CEC 2006 constrained optimization benchmark suite to demonstrate its efficacy. Empirical studies reveal that ARCH is able to exploit the explicitness of the constraint functions effectively, sometimes even more efficiently than an existing box-constraint handling technique on box-constrained problems, while exhibiting the invariance properties. Moreover, ARCH overwhelmingly outperforms CHTs by not exploiting the explicit constraints in terms of the number of objective function calls.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 4","pages":"503-529"},"PeriodicalIF":6.8,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71903200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynastic Potential Crossover Operator 动态势交叉算子
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-09-01 DOI: 10.1162/evco_a_00305
Francisco Chicano;Gabriela Ochoa;L. Darrell Whitley;Renato Tinós
An optimal recombination operator for two-parent solutions provides the best solution among those that take the value for each variable from one of the parents (gene transmission property). If the solutions are bit strings, the offspring of an optimal recombination operator is optimal in the smallest hyperplane containing the two parent solutions. Exploring this hyperplane is computationally costly, in general, requiring exponential time in the worst case. However, when the variable interaction graph of the objective function is sparse, exploration can be done in polynomial time. In this article, we present a recombination operator, called Dynastic Potential Crossover (DPX), that runs in polynomial time and behaves like an optimal recombination operator for low-epistasis combinatorial problems. We compare this operator, both theoretically and experimentally, with traditional crossover operators, like uniform crossover and network crossover, and with two recently defined efficient recombination operators: partition crossover and articulation points partition crossover. The empirical comparison uses NKQ Landscapes and MAX-SAT instances. DPX outperforms the other crossover operators in terms of quality of the offspring and provides better results included in a trajectory and a population-based metaheuristic, but it requires more time and memory to compute the offspring.
双亲解的最优重组算子提供了从其中一个亲本获得每个变量值的最优解(基因传递特性)。如果解是位串,则最优重组算子的子代在包含两个父解的最小超平面中是最优的。通常,探索这个超平面的计算成本很高,在最坏的情况下需要指数时间。然而,当目标函数的变量相互作用图是稀疏的时,可以在多项式时间内进行探索。在本文中,我们提出了一种重组算子,称为动态势交叉算子(DPX),它在多项式时间内运行,其行为类似于低上位性组合问题的最优重组算子。我们在理论和实验上将该算子与传统的交叉算子(如均匀交叉和网络交叉)以及最近定义的两种有效重组算子(分割交叉和连接点分割交叉)进行了比较。经验比较使用NKQ Landscapes和MAX-SAT实例。DPX在子代的质量方面优于其他交叉算子,并在轨迹和基于群体的元启发式中提供了更好的结果,但它需要更多的时间和内存来计算子代。
{"title":"Dynastic Potential Crossover Operator","authors":"Francisco Chicano;Gabriela Ochoa;L. Darrell Whitley;Renato Tinós","doi":"10.1162/evco_a_00305","DOIUrl":"10.1162/evco_a_00305","url":null,"abstract":"An optimal recombination operator for two-parent solutions provides the best solution among those that take the value for each variable from one of the parents (gene transmission property). If the solutions are bit strings, the offspring of an optimal recombination operator is optimal in the smallest hyperplane containing the two parent solutions. Exploring this hyperplane is computationally costly, in general, requiring exponential time in the worst case. However, when the variable interaction graph of the objective function is sparse, exploration can be done in polynomial time. In this article, we present a recombination operator, called Dynastic Potential Crossover (DPX), that runs in polynomial time and behaves like an optimal recombination operator for low-epistasis combinatorial problems. We compare this operator, both theoretically and experimentally, with traditional crossover operators, like uniform crossover and network crossover, and with two recently defined efficient recombination operators: partition crossover and articulation points partition crossover. The empirical comparison uses NKQ Landscapes and MAX-SAT instances. DPX outperforms the other crossover operators in terms of quality of the offspring and provides better results included in a trajectory and a population-based metaheuristic, but it requires more time and memory to compute the offspring.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 3","pages":"409-446"},"PeriodicalIF":6.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/6720222/9931026/09931097.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39583646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Uncrowded Hypervolume-Based Multiobjective Optimization with Gene-Pool Optimal Mixing 基于非拥挤超容量的基因库优化混合多目标优化
IF 6.8 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-09-01 DOI: 10.1162/evco_a_00303
S.C. Maree;T. Alderliesten;P.A.N. Bosman
Domination-based multiobjective (MO) evolutionary algorithms (EAs) are today arguably the most frequently used type of MOEA. These methods, however, stagnate when the majority of the population becomes nondominated, preventing further convergence to the Pareto set. Hypervolume-based MO optimization has shown promising results to overcome this. Direct use of the hypervolume, however, results in no selection pressure for dominated solutions. The recently introduced Sofomore framework overcomes this by solving multiple interleaved single-objective dynamic problems that iteratively improve a single approximation set, based on the uncrowded hypervolume improvement (UHVI). It thereby however loses many advantages of population-based MO optimization, such as handling multimodality. Here, we reformulate the UHVI as a quality measure for approximation sets, called the uncrowded hypervolume (UHV), which can be used to directly solve MO optimization problems with a single-objective optimizer. We use the state-of-the-art gene-pool optimal mixing evolutionary algorithm (GOMEA) that is capable of efficiently exploiting the intrinsically available grey-box properties of this problem. The resulting algorithm, UHV-GOMEA, is compared with Sofomore equipped with GOMEA, and the domination-based MO-GOMEA. In doing so, we investigate in which scenarios either domination-based or hypervolume-based methods are preferred. Finally, we construct a simple hybrid approach that combines MO-GOMEA with UHV-GOMEA and outperforms both.
基于支配的多目标(MO)进化算法(EA)可以说是当今最常用的MOEA类型。然而,当大多数人口成为非支配人口时,这些方法就会停滞不前,阻止了进一步收敛到帕累托集合。基于超卷的MO优化已经显示出克服这一问题的有希望的结果。然而,超体积的直接使用不会导致主导解决方案的选择压力。最近引入的Sofomore框架通过解决多个交织的单目标动态问题来克服这一点,这些问题基于非拥挤超体积改进(UHVI)迭代改进单个近似集。然而,它因此失去了基于人群的MO优化的许多优势,例如处理多模态。在这里,我们将UHVI重新表述为近似集的质量度量,称为非拥挤超体积(UHV),它可以用于使用单目标优化器直接解决MO优化问题。我们使用了最先进的基因库最优混合进化算法(GOMEA),该算法能够有效地利用该问题固有的可用灰盒特性。将得到的算法UHV-GOMEA与配备GOMEA的Sofomore以及基于支配的MO-GOMEA进行了比较。在这样做的过程中,我们研究了在哪些情况下,基于支配或基于超容量的方法是首选的。最后,我们构建了一种简单的混合方法,将MO-GOMEA与UHV-GOMEA相结合,并优于两者。
{"title":"Uncrowded Hypervolume-Based Multiobjective Optimization with Gene-Pool Optimal Mixing","authors":"S.C. Maree;T. Alderliesten;P.A.N. Bosman","doi":"10.1162/evco_a_00303","DOIUrl":"10.1162/evco_a_00303","url":null,"abstract":"Domination-based multiobjective (MO) evolutionary algorithms (EAs) are today arguably the most frequently used type of MOEA. These methods, however, stagnate when the majority of the population becomes nondominated, preventing further convergence to the Pareto set. Hypervolume-based MO optimization has shown promising results to overcome this. Direct use of the hypervolume, however, results in no selection pressure for dominated solutions. The recently introduced Sofomore framework overcomes this by solving multiple interleaved single-objective dynamic problems that iteratively improve a single approximation set, based on the uncrowded hypervolume improvement (UHVI). It thereby however loses many advantages of population-based MO optimization, such as handling multimodality. Here, we reformulate the UHVI as a quality measure for approximation sets, called the uncrowded hypervolume (UHV), which can be used to directly solve MO optimization problems with a single-objective optimizer. We use the state-of-the-art gene-pool optimal mixing evolutionary algorithm (GOMEA) that is capable of efficiently exploiting the intrinsically available grey-box properties of this problem. The resulting algorithm, UHV-GOMEA, is compared with Sofomore equipped with GOMEA, and the domination-based MO-GOMEA. In doing so, we investigate in which scenarios either domination-based or hypervolume-based methods are preferred. Finally, we construct a simple hybrid approach that combines MO-GOMEA with UHV-GOMEA and outperforms both.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"30 3","pages":"329-353"},"PeriodicalIF":6.8,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39702735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
Evolutionary Computation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1