首页 > 最新文献

Evolutionary Computation最新文献

英文 中文
BlindSMOTE: Synthetic minority oversampling based only on evolutionary computation. 盲击:仅基于进化计算的合成少数过采样。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-04-16 DOI: 10.1162/evco_a_00374
Nicolás E Garcí-Pedrajas, José M Cuevas-Muñoz, Aida de Haro-García

One of the most common problems in data mining applications is the uneven distribution of classes, which appears in many real-world scenarios. The class of interest is often highly underrepresented in the given dataset, which harms the performance of most classifiers. One of the most successful methods for addressing the class imbalance problem is to oversample the minority class using synthetic samples. Since the original algorithm, the synthetic minority oversampling technique (SMOTE), introduced this method, numerous versions have emerged, each of which is based on a specific hypothesis about where and how to generate new synthetic instances. In this paper, we propose a different approach based exclusively on evolutionary computation that imposes no constraints on the creation of new synthetic instances. Majority class undersampling is also incorporated into the evolutionary process. A thorough comparison involving three classification methods, 85 datasets, and more than 90 class-imbalance strategies shows the advantages of our proposal.

数据挖掘应用程序中最常见的问题之一是类的不均匀分布,这在许多实际场景中都会出现。在给定的数据集中,感兴趣的类通常高度未被充分表示,这损害了大多数分类器的性能。解决类失衡问题最成功的方法之一是使用合成样本对少数类进行过采样。自最初的算法——合成少数派过采样技术(SMOTE)引入该方法以来,出现了许多版本,每个版本都基于一个特定的假设,即在哪里以及如何生成新的合成实例。在本文中,我们提出了一种完全基于进化计算的不同方法,该方法对新合成实例的创建没有任何约束。多数类欠采样也被纳入进化过程。通过对三种分类方法、85个数据集和90多种类别失衡策略的全面比较,我们的建议具有优势。
{"title":"BlindSMOTE: Synthetic minority oversampling based only on evolutionary computation.","authors":"Nicolás E Garcí-Pedrajas, José M Cuevas-Muñoz, Aida de Haro-García","doi":"10.1162/evco_a_00374","DOIUrl":"https://doi.org/10.1162/evco_a_00374","url":null,"abstract":"<p><p>One of the most common problems in data mining applications is the uneven distribution of classes, which appears in many real-world scenarios. The class of interest is often highly underrepresented in the given dataset, which harms the performance of most classifiers. One of the most successful methods for addressing the class imbalance problem is to oversample the minority class using synthetic samples. Since the original algorithm, the synthetic minority oversampling technique (SMOTE), introduced this method, numerous versions have emerged, each of which is based on a specific hypothesis about where and how to generate new synthetic instances. In this paper, we propose a different approach based exclusively on evolutionary computation that imposes no constraints on the creation of new synthetic instances. Majority class undersampling is also incorporated into the evolutionary process. A thorough comparison involving three classification methods, 85 datasets, and more than 90 class-imbalance strategies shows the advantages of our proposal.</p>","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":" ","pages":"1-35"},"PeriodicalIF":4.6,"publicationDate":"2025-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144023903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
BUSTLE: A Versatile Tool for the Evolutionary Learning of STL Specifications from Data BUSTLE:从数据中进化学习 STL 规格的多功能工具。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-15 DOI: 10.1162/evco_a_00347
Federico Pigozzi;Laura Nenzi;Eric Medvet
Describing the properties of complex systems that evolve over time is a crucial requirement for monitoring and understanding them. Signal Temporal Logic (STL) is a framework that proved to be effective for this aim because it is expressive and allows state properties as human-readable formulae. Crafting STL formulae that fit a particular system is, however, a difficult task. For this reason, a few approaches have been proposed recently for the automatic learning of STL formulae starting from observations of the system. In this paper, we propose BUSTLE (Bi-level Universal STL Evolver), an approach based on evolutionary computation for learning STL formulae from data. BUSTLE advances the state of the art because it (i) applies to a broader class of problems, in terms of what is known about the state of the system during its observation, and (ii) generates both the structure and the values of the parameters of the formulae employing a bi-level search mechanism (global for the structure, local for the parameters). We consider two cases where (a) observations of the system in both anomalous and regular state are available, or (b) only observations of regular state are available. We experimentally evaluate BUSTLE on problem instances corresponding to the two cases and compare it against previous approaches. We show that the evolved STL formulae are effective and human-readable: the versatility of BUSTLE does not come at the cost of lower effectiveness.
描述随时间演变的复杂系统的属性是监测和理解这些系统的关键要求。信号时态逻辑(STL)是一个被证明能有效实现这一目标的框架,因为它具有很强的表现力,能将状态属性描述为人类可读的公式。然而,如何设计出适合特定系统的 STL 公式是一项艰巨的任务。因此,最近有人提出了一些从系统观测结果出发自动学习 STL 公式的方法。在本文中,我们提出了 BUSTLE(双级通用 STL 进化器),这是一种基于进化计算的方法,用于从数据中学习 STL 公式。BUSTLE 超越了最先进的技术水平,因为它(i)适用于更广泛的问题类别,即在观测过程中已知的系统状态;(ii)采用双层搜索机制(结构为全局搜索,参数为局部搜索)生成公式的结构和参数值。我们考虑了两种情况:(a) 可同时观测到系统的异常状态和正常状态,或 (b) 只能观测到正常状态。我们在对应这两种情况的问题实例上对 BUSTLE 进行了实验评估,并与之前的方法进行了比较。结果表明,演化出的 STL 公式既有效又便于人类阅读:BUSTLE 的多功能性并没有以降低有效性为代价。
{"title":"BUSTLE: A Versatile Tool for the Evolutionary Learning of STL Specifications from Data","authors":"Federico Pigozzi;Laura Nenzi;Eric Medvet","doi":"10.1162/evco_a_00347","DOIUrl":"10.1162/evco_a_00347","url":null,"abstract":"Describing the properties of complex systems that evolve over time is a crucial requirement for monitoring and understanding them. Signal Temporal Logic (STL) is a framework that proved to be effective for this aim because it is expressive and allows state properties as human-readable formulae. Crafting STL formulae that fit a particular system is, however, a difficult task. For this reason, a few approaches have been proposed recently for the automatic learning of STL formulae starting from observations of the system. In this paper, we propose BUSTLE (Bi-level Universal STL Evolver), an approach based on evolutionary computation for learning STL formulae from data. BUSTLE advances the state of the art because it (i) applies to a broader class of problems, in terms of what is known about the state of the system during its observation, and (ii) generates both the structure and the values of the parameters of the formulae employing a bi-level search mechanism (global for the structure, local for the parameters). We consider two cases where (a) observations of the system in both anomalous and regular state are available, or (b) only observations of regular state are available. We experimentally evaluate BUSTLE on problem instances corresponding to the two cases and compare it against previous approaches. We show that the evolved STL formulae are effective and human-readable: the versatility of BUSTLE does not come at the cost of lower effectiveness.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"33 1","pages":"91-114"},"PeriodicalIF":4.6,"publicationDate":"2025-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139913984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
OneMax Is Not the Easiest Function for Fitness Improvements OneMax 并非改善体能的最简单功能。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-15 DOI: 10.1162/evco_a_00348
Marc Kaufmann;Maxime Larcher;Johannes Lengler;Xun Zou
We study the (1:s+1) success rule for controlling the population size of the (1,λ)-EA. It was shown by Hevia Fajardo and Sudholt that this parameter control mechanism can run into problems for large s if the fitness landscape is too easy. They conjectured that this problem is worst for the OneMax benchmark, since in some well-established sense OneMax is known to be the easiest fitness landscape. In this paper, we disprove this conjecture. We show that there exist s and ɛ such that the self-adjusting (1,λ)-EA with the (1:s+1)-rule optimizes OneMax efficiently when started with ɛn zero-bits, but does not find the optimum in polynomial time on Dynamic BinVal. Hence, we show that there are landscapes where the problem of the (1:s+1)-rule for controlling the population size of the (1,λ)-EA is more severe than for OneMax. The key insight is that, while OneMax is the easiest function for decreasing the distance to the optimum, it is not the easiest fitness landscape with respect to finding fitness-improving steps.
我们研究了控制 (1,λ)- EA 种群规模的 (1:s+1) 成功规则。Hevia Fajardo 和 Sudholt 的研究表明,如果适配景观过于简单,这种参数控制机制在 s 较大时可能会出现问题。他们推测,这个问题在 ONEMAX 基准中最为严重,因为从某种既定的意义上讲,ONEMAX 是已知的最简单的适配景观。在本文中,我们推翻了这一猜想。我们证明,存在 s 和 ɛ 这样的情况:采用 (1:s+1) 规则的自调整 (1,λ)-EA 在从ɛn 个零位开始时能高效优化 ONEMAX,但在动态 BINVAL 上却不能在多项式时间内找到最优。因此,我们证明,在有些地形中,控制 (1,λ)-EA 种群规模的 (1:s+1)- 规则的问题比 ONEMAX 更严重。关键之处在于,虽然ONEMAX 是最容易减小与最优值距离的函数,但它并不是最容易找到改善适应性步骤的适应性景观。
{"title":"OneMax Is Not the Easiest Function for Fitness Improvements","authors":"Marc Kaufmann;Maxime Larcher;Johannes Lengler;Xun Zou","doi":"10.1162/evco_a_00348","DOIUrl":"10.1162/evco_a_00348","url":null,"abstract":"We study the (1:s+1) success rule for controlling the population size of the (1,λ)-EA. It was shown by Hevia Fajardo and Sudholt that this parameter control mechanism can run into problems for large s if the fitness landscape is too easy. They conjectured that this problem is worst for the OneMax benchmark, since in some well-established sense OneMax is known to be the easiest fitness landscape. In this paper, we disprove this conjecture. We show that there exist s and ɛ such that the self-adjusting (1,λ)-EA with the (1:s+1)-rule optimizes OneMax efficiently when started with ɛn zero-bits, but does not find the optimum in polynomial time on Dynamic BinVal. Hence, we show that there are landscapes where the problem of the (1:s+1)-rule for controlling the population size of the (1,λ)-EA is more severe than for OneMax. The key insight is that, while OneMax is the easiest function for decreasing the distance to the optimum, it is not the easiest fitness landscape with respect to finding fitness-improving steps.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"33 1","pages":"27-54"},"PeriodicalIF":4.6,"publicationDate":"2025-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140295208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Synthesising Diverse and Discriminatory Sets of Instances Using Novelty Search in Combinatorial Domains 在组合领域利用新颖性搜索合成多样化和辨别性实例集。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-15 DOI: 10.1162/evco_a_00350
Alejandro Marrero;Eduardo Segredo;Coromoto León;Emma Hart
Gathering sufficient instance data to either train algorithm-selection models or understand algorithm footprints within an instance space can be challenging. We propose an approach to generating synthetic instances that are tailored to perform well with respect to a target algorithm belonging to a predefined portfolio but are also diverse with respect to their features. Our approach uses a novelty search algorithm with a linearly weighted fitness function that balances novelty and performance to generate a large set of diverse and discriminatory instances in a single run of the algorithm. We consider two definitions of novelty: (1) with respect to discriminatory performance within a portfolio of solvers; (2) with respect to the features of the evolved instances. We evaluate the proposed method with respect to its ability to generate diverse and discriminatory instances in two domains (knapsack and bin-packing), comparing to another well-known quality diversity method, Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and an evolutionary algorithm that only evolves for discriminatory behaviour. The results demonstrate that the novelty search method outperforms its competitors in terms of coverage of the space and its ability to generate instances that are diverse regarding the relative size of the “performance gap” between the target solver and the remaining solvers in the portfolio. Moreover, for the Knapsack domain, we also show that we are able to generate novel instances in regions of an instance space not covered by existing benchmarks using a portfolio of state-of-the-art solvers. Finally, we demonstrate that the method is robust to different portfolios of solvers (stochastic approaches, deterministic heuristics, and state-of-the-art methods), thereby providing further evidence of its generality.
为训练算法选择模型或了解算法在实例空间中的足迹而收集足够的实例数据是一项挑战。我们提出了一种生成合成实例的方法,这些实例经过定制,在属于预定义组合的目标算法方面表现良好,但在特征方面也具有多样性。我们的方法使用一种新颖性搜索算法,其线性加权适配函数可在新颖性和性能之间取得平衡,从而在算法的单次运行中生成大量具有多样性和鉴别性的实例。我们考虑了新颖性的两种定义:(1) 与求解器组合中的判别性能有关;(2) 与演化实例的特征有关。我们评估了所提出的方法在两个领域(knapsack 和 bin-packing)中生成多样化和辨别性实例的能力,并将其与另一种著名的质量多样化方法--表型精英多维档案(MAP-Elites)和一种只为辨别行为而进化的进化算法进行了比较。结果表明,新颖性搜索方法在空间覆盖率和生成实例的能力方面优于其竞争对手,而在目标求解器与组合中其余求解器之间 "性能差距 "的相对大小方面,新颖性搜索方法也具有多样性。此外,对于 Knapsack 领域,我们还证明了我们能够使用最先进的求解器组合,在现有基准未覆盖的实例空间区域生成新实例。最后,我们证明了该方法对不同求解器组合(随机方法、确定性启发式方法和最先进方法)的鲁棒性,从而进一步证明了该方法的通用性。
{"title":"Synthesising Diverse and Discriminatory Sets of Instances Using Novelty Search in Combinatorial Domains","authors":"Alejandro Marrero;Eduardo Segredo;Coromoto León;Emma Hart","doi":"10.1162/evco_a_00350","DOIUrl":"10.1162/evco_a_00350","url":null,"abstract":"Gathering sufficient instance data to either train algorithm-selection models or understand algorithm footprints within an instance space can be challenging. We propose an approach to generating synthetic instances that are tailored to perform well with respect to a target algorithm belonging to a predefined portfolio but are also diverse with respect to their features. Our approach uses a novelty search algorithm with a linearly weighted fitness function that balances novelty and performance to generate a large set of diverse and discriminatory instances in a single run of the algorithm. We consider two definitions of novelty: (1) with respect to discriminatory performance within a portfolio of solvers; (2) with respect to the features of the evolved instances. We evaluate the proposed method with respect to its ability to generate diverse and discriminatory instances in two domains (knapsack and bin-packing), comparing to another well-known quality diversity method, Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and an evolutionary algorithm that only evolves for discriminatory behaviour. The results demonstrate that the novelty search method outperforms its competitors in terms of coverage of the space and its ability to generate instances that are diverse regarding the relative size of the “performance gap” between the target solver and the remaining solvers in the portfolio. Moreover, for the Knapsack domain, we also show that we are able to generate novel instances in regions of an instance space not covered by existing benchmarks using a portfolio of state-of-the-art solvers. Finally, we demonstrate that the method is robust to different portfolios of solvers (stochastic approaches, deterministic heuristics, and state-of-the-art methods), thereby providing further evidence of its generality.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"33 1","pages":"55-90"},"PeriodicalIF":4.6,"publicationDate":"2025-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140877841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Drift Analysis with Fitness Levels for Elitist Evolutionary Algorithms 精英进化算法的漂移分析与适合度分析
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-15 DOI: 10.1162/evco_a_00349
Jun He;Yuren Zhou
The fitness level method is a popular tool for analyzing the hitting time of elitist evolutionary algorithms. Its idea is to divide the search space into multiple fitness levels and estimate lower and upper bounds on the hitting time using transition probabilities between fitness levels. However, the lower bound generated by this method is often loose. An open question regarding the fitness level method is what are the tightest lower and upper time bounds that can be constructed based on transition probabilities between fitness levels. To answer this question, we combine drift analysis with fitness levels and define the tightest bound problem as a constrained multiobjective optimization problem subject to fitness levels. The tightest metric bounds by fitness levels are constructed and proven for the first time. Then linear bounds are derived from metric bounds and a framework is established that can be used to develop different fitness level methods for different types of linear bounds. The framework is generic and promising, as it can be used to draw tight time bounds on both fitness landscapes with and without shortcuts. This is demonstrated in the example of the (1+1) EA maximizing the TwoMax1 function.
适应度方法是分析精英进化算法命中时间的常用工具。其原理是将搜索空间划分为多个适合度等级,并利用适合度等级之间的过渡概率估算出命中时间的下限和上限。然而,这种方法产生的下限往往比较宽松。关于适合度方法的一个悬而未决的问题是,根据适合度之间的过渡概率,可以构建出最严格的时间下限和上限。为了回答这个问题,我们将漂移分析与适应度水平相结合,并将最严格约束问题定义为受限于适应度水平的多目标优化问题。我们首次构建并证明了适应度水平的最严格度量边界。然后,从度量约束推导出线性约束,并建立了一个框架,可用于为不同类型的线性约束开发不同的适度水平方法。该框架具有通用性和广阔前景,因为它既可以用于绘制有捷径的适度景观,也可以用于绘制无捷径的适度景观。(1+1) EA 最大化 TwoMax1 函数的例子就证明了这一点。
{"title":"Drift Analysis with Fitness Levels for Elitist Evolutionary Algorithms","authors":"Jun He;Yuren Zhou","doi":"10.1162/evco_a_00349","DOIUrl":"10.1162/evco_a_00349","url":null,"abstract":"The fitness level method is a popular tool for analyzing the hitting time of elitist evolutionary algorithms. Its idea is to divide the search space into multiple fitness levels and estimate lower and upper bounds on the hitting time using transition probabilities between fitness levels. However, the lower bound generated by this method is often loose. An open question regarding the fitness level method is what are the tightest lower and upper time bounds that can be constructed based on transition probabilities between fitness levels. To answer this question, we combine drift analysis with fitness levels and define the tightest bound problem as a constrained multiobjective optimization problem subject to fitness levels. The tightest metric bounds by fitness levels are constructed and proven for the first time. Then linear bounds are derived from metric bounds and a framework is established that can be used to develop different fitness level methods for different types of linear bounds. The framework is generic and promising, as it can be used to draw tight time bounds on both fitness landscapes with and without shortcuts. This is demonstrated in the example of the (1+1) EA maximizing the TwoMax1 function.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"33 1","pages":"1-25"},"PeriodicalIF":4.6,"publicationDate":"2025-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140295207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Layered Learning Approach to Scaling in Learning Classifier Systems for Boolean Problems 布尔问题分类器学习系统中的分层学习扩展方法。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-15 DOI: 10.1162/evco_a_00351
Isidro M. Alvarez;Trung B. Nguyen;Will N. Browne;Mengjie Zhang
Evolutionary Computation (EC) often throws away learned knowledge as it is reset for each new problem addressed. Conversely, humans can learn from small-scale problems, retain this knowledge (plus functionality), and then successfully reuse them in larger-scale and/or related problems. Linking solutions to problems has been achieved through layered learning, where an experimenter sets a series of simpler related problems to solve a more complex task. Recent works on Learning Classifier Systems (LCSs) has shown that knowledge reuse through the adoption of Code Fragments, GP-like tree-based programs, is plausible. However, random reuse is inefficient. Thus, the research question is how LCS can adopt a layered-learning framework, such that increasingly complex problems can be solved efficiently. An LCS (named XCSCF*) has been developed to include the required base axioms necessary for learning, refined methods for transfer learning and learning recast as a decomposition into a series of subordinate problems. These subordinate problems can be set as a curriculum by a teacher, but this does not mean that an agent can learn from it; especially if it only extracts over-fitted knowledge of each problem rather than the underlying scalable patterns and functions. Results show that from a conventional tabula rasa, with only a vague notion of which subordinate problems might be relevant, XCSCF* captures the general logic behind the tested domains and therefore can solve any n-bit Multiplexer, n-bit Carry-one, n-bit Majority-on, and n-bit Even-parity problems. This work demonstrates a step towards continual learning as learned knowledge is effectively reused in subsequent problems.
进化计算(EC)通常会丢弃已学知识,因为每解决一个新问题,都要重新设置这些知识。相反,人类可以从小规模的问题中学习,保留这些知识(以及功能),然后成功地在更大规模和/或相关的问题中重复使用。通过分层学习,实验者可以设置一系列较简单的相关问题来解决较复杂的任务,从而将问题的解决方案联系在一起。最近关于学习分类器系统(LCS)的研究表明,通过采用代码片段(类似于 GP 的树状程序)进行知识重用是可行的。然而,随机重用的效率很低。因此,研究的问题是学习分类系统如何采用分层学习框架,从而高效地解决日益复杂的问题?我们开发了一种 LCS(名为 XCSCF*),其中包括学习所需的基本公理、迁移学习的精炼方法以及分解为一系列下级问题的学习重构。这些下属问题可以由教师设置为课程,但这并不意味着代理可以从中学习。特别是如果它只是提取每个问题的过度拟合知识,而不是潜在的可扩展模式和函数。结果表明,XCSCF*能从传统的表格中捕捉到测试领域背后的一般逻辑,因此能解决任何n位多路复用器、n位携带一、n位多数开和n位偶奇偶问题。这项工作展示了向持续学习迈出的一步,因为学到的知识可以在后续问题中有效地重复使用。
{"title":"A Layered Learning Approach to Scaling in Learning Classifier Systems for Boolean Problems","authors":"Isidro M. Alvarez;Trung B. Nguyen;Will N. Browne;Mengjie Zhang","doi":"10.1162/evco_a_00351","DOIUrl":"10.1162/evco_a_00351","url":null,"abstract":"Evolutionary Computation (EC) often throws away learned knowledge as it is reset for each new problem addressed. Conversely, humans can learn from small-scale problems, retain this knowledge (plus functionality), and then successfully reuse them in larger-scale and/or related problems. Linking solutions to problems has been achieved through layered learning, where an experimenter sets a series of simpler related problems to solve a more complex task. Recent works on Learning Classifier Systems (LCSs) has shown that knowledge reuse through the adoption of Code Fragments, GP-like tree-based programs, is plausible. However, random reuse is inefficient. Thus, the research question is how LCS can adopt a layered-learning framework, such that increasingly complex problems can be solved efficiently. An LCS (named XCSCF*) has been developed to include the required base axioms necessary for learning, refined methods for transfer learning and learning recast as a decomposition into a series of subordinate problems. These subordinate problems can be set as a curriculum by a teacher, but this does not mean that an agent can learn from it; especially if it only extracts over-fitted knowledge of each problem rather than the underlying scalable patterns and functions. Results show that from a conventional tabula rasa, with only a vague notion of which subordinate problems might be relevant, XCSCF* captures the general logic behind the tested domains and therefore can solve any n-bit Multiplexer, n-bit Carry-one, n-bit Majority-on, and n-bit Even-parity problems. This work demonstrates a step towards continual learning as learned knowledge is effectively reused in subsequent problems.","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":"33 1","pages":"115-140"},"PeriodicalIF":4.6,"publicationDate":"2025-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140877840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Solving Many-objective Optimization Problems based on PF Shape Classification and Vector Angle Selection. 基于PF形状分类和矢量角度选择的多目标优化问题求解。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-10 DOI: 10.1162/evco_a_00373
Y T Wu, F Z Ge, D B Chen, L Shi

Most many-objective optimization algorithms (MaOEAs) adopt a pre-assumed Pareto front (PF) shape, instead of the true PF shape, to balance convergence and diversity in high-dimensional objective space, resulting in insufficient selection pressure and poor performance. To address these shortcomings, we propose MaOEA-PV based on PF shape classification and vector angle selection. The three innovation points of this paper are as follows: (I) a new method for PF classification; (II) a new fitness function that combines convergence and diversity indicators, thereby enhancing the quality of parents during mating selection; and (III) the selection of individuals exhibiting the best convergence to add to the population, overcoming the lack of selection pressure during environmental selection. Subsequently, the max-min vector angle strategy is employed. The solutions with the highest diversity and the least convergence are selected based on the max and min vector angles, respectively, which balances convergence and diversity. The performance of algorithm is compared with those of five state-of-the-art MaOEAs on 41 test problems and 5 real-world problems comprising as many 15 objectives. The experimental results demonstrate the competitive and effective nature of the proposed algorithm.

大多数多目标优化算法(maoea)采用预设的Pareto front形状,而不是真实的PF形状,以平衡高维目标空间的收敛性和多样性,导致选择压力不足,性能不佳。为了解决这些问题,我们提出了基于PF形状分类和矢量角度选择的maea - pv。本文的三个创新点是:(1)提出了一种新的PF分类方法;(2)结合收敛性指标和多样性指标的适应度函数,提高了亲本在择偶过程中的质量;(3)通过选择具有最佳收敛性的个体加入种群,克服环境选择过程中选择压力的不足。随后,采用最大-最小矢量角策略。分别根据最大矢量角和最小矢量角选择多样性最高和收敛性最低的解,平衡了收敛性和多样性。在41个测试问题和包含多达15个目标的5个现实问题上,将算法的性能与5个最先进的maoea进行了比较。实验结果证明了该算法的竞争性和有效性。
{"title":"Solving Many-objective Optimization Problems based on PF Shape Classification and Vector Angle Selection.","authors":"Y T Wu, F Z Ge, D B Chen, L Shi","doi":"10.1162/evco_a_00373","DOIUrl":"https://doi.org/10.1162/evco_a_00373","url":null,"abstract":"<p><p>Most many-objective optimization algorithms (MaOEAs) adopt a pre-assumed Pareto front (PF) shape, instead of the true PF shape, to balance convergence and diversity in high-dimensional objective space, resulting in insufficient selection pressure and poor performance. To address these shortcomings, we propose MaOEA-PV based on PF shape classification and vector angle selection. The three innovation points of this paper are as follows: (I) a new method for PF classification; (II) a new fitness function that combines convergence and diversity indicators, thereby enhancing the quality of parents during mating selection; and (III) the selection of individuals exhibiting the best convergence to add to the population, overcoming the lack of selection pressure during environmental selection. Subsequently, the max-min vector angle strategy is employed. The solutions with the highest diversity and the least convergence are selected based on the max and min vector angles, respectively, which balances convergence and diversity. The performance of algorithm is compared with those of five state-of-the-art MaOEAs on 41 test problems and 5 real-world problems comprising as many 15 objectives. The experimental results demonstrate the competitive and effective nature of the proposed algorithm.</p>","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":" ","pages":"1-42"},"PeriodicalIF":4.6,"publicationDate":"2025-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143651776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MO-SMAC: Multi-objective Sequential Model-based Algorithm Configuration. MO-SMAC:多目标序列模型算法配置。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-10 DOI: 10.1162/evco_a_00371
Jeroen G Rook, Carolin Benjamins, Jakob Bossek, Heike Trautmann, Holger H Hoos, Marius Lindauer

Automated algorithm configuration aims at finding well-performing parameter configurations for a given problem, and it has proven to be effective within many AI domains, including evolutionary computation. Initially, the focus was on excelling in one performance objective, but, in reality, most tasks have a variety of (conflicting) objectives. The surging demand for trustworthy and resource-efficient AI systems makes this multi-objective perspective even more prevalent. We propose a new general-purpose multi-objective automated algorithm configurator by extending the widely-used SMAC framework. Instead of finding a single configuration, we search for a non-dominated set that approximates the actual Pareto set. We propose a pure multi-objective Bayesian Optimisation approach for obtaining promising configurations by using the predicted hypervolume improvement as acquisition function. We also present a novel intensification procedure to efficiently handle the selection of configurations in a multi-objective context. Our approach is empirically validated and compared across various configuration scenarios in four AI domains, demonstrating superiority over baseline methods, competitiveness with MO-ParamILS on individual scenarios and an overall best performance.

自动算法配置旨在为给定问题找到性能良好的参数配置,并且已被证明在许多人工智能领域(包括进化计算)是有效的。最初,重点是在一个性能目标上取得优异成绩,但实际上,大多数任务都有各种各样的(相互冲突的)目标。对可信赖和资源高效的人工智能系统的需求激增,使得这种多目标视角更加普遍。我们通过扩展广泛使用的SMAC框架,提出了一种新的通用多目标自动算法配置器。我们不是寻找一个单一的配置,而是寻找一个近似于实际帕累托集的非支配集。我们提出了一种纯多目标贝叶斯优化方法,通过使用预测的超体积改进作为获取函数来获得有希望的配置。我们还提出了一种新的强化方法来有效地处理多目标环境下的配置选择。我们的方法经过了经验验证,并在四个人工智能领域的各种配置场景中进行了比较,证明了优于基线方法的优势,在个别场景中与MO-ParamILS的竞争力以及总体最佳性能。
{"title":"MO-SMAC: Multi-objective Sequential Model-based Algorithm Configuration.","authors":"Jeroen G Rook, Carolin Benjamins, Jakob Bossek, Heike Trautmann, Holger H Hoos, Marius Lindauer","doi":"10.1162/evco_a_00371","DOIUrl":"https://doi.org/10.1162/evco_a_00371","url":null,"abstract":"<p><p>Automated algorithm configuration aims at finding well-performing parameter configurations for a given problem, and it has proven to be effective within many AI domains, including evolutionary computation. Initially, the focus was on excelling in one performance objective, but, in reality, most tasks have a variety of (conflicting) objectives. The surging demand for trustworthy and resource-efficient AI systems makes this multi-objective perspective even more prevalent. We propose a new general-purpose multi-objective automated algorithm configurator by extending the widely-used SMAC framework. Instead of finding a single configuration, we search for a non-dominated set that approximates the actual Pareto set. We propose a pure multi-objective Bayesian Optimisation approach for obtaining promising configurations by using the predicted hypervolume improvement as acquisition function. We also present a novel intensification procedure to efficiently handle the selection of configurations in a multi-objective context. Our approach is empirically validated and compared across various configuration scenarios in four AI domains, demonstrating superiority over baseline methods, competitiveness with MO-ParamILS on individual scenarios and an overall best performance.</p>","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":" ","pages":"1-25"},"PeriodicalIF":4.6,"publicationDate":"2025-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143651775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond Landscape Analysis: DynamoRep Features For Capturing Algorithm-Problem Interaction In Single-Objective Continuous Optimization. 超越景观分析:单目标连续优化中捕捉算法问题交互的DynamoRep特征。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-03-07 DOI: 10.1162/evco_a_00370
Gjorgjina Cenikj, Gašper Petelin, Carola Doerr, Peter Korošec, Tome Eftimov

The representation of optimization problems and algorithms in terms of numerical features is a well-established tool for comparing optimization problem instances, for analyzing the behavior of optimization algorithms, and the quality of existing problem benchmarks, as well as for automated per-instance algorithm selection and configuration approaches. Extending purely problem-centered feature collections, our recently proposed DynamoRep features provide a simple and inexpensive representation of the algorithmproblem interaction during the optimization process. In this paper, we conduct a comprehensive analysis of the predictive power of the DynamoRep features for the problem classification, algorithm selection, and algorithm classification tasks. In particular, the features are evaluated for the classification of problem instances into problem classes from the BBOB (Black Box Optimization Benchmarking) suite, selecting the best algorithm to solve a given problem from a portfolio of three algorithms (Differential Evolution, Evolutionary Strategy, and Particle Swarm Optimization), as well as distinguishing these algorithms based on their trajectories. We show that, despite being much cheaper to compute, they can yield results comparable to those using state-ofthe-art Exploratory Landscape Analysis features.

优化问题和算法的数值特征表示是比较优化问题实例、分析优化算法的行为和现有问题基准的质量以及自动的每个实例算法选择和配置方法的成熟工具。扩展纯粹以问题为中心的特征集合,我们最近提出的DynamoRep特征提供了优化过程中算法与问题交互的简单而廉价的表示。在本文中,我们对DynamoRep特征在问题分类、算法选择和算法分类任务中的预测能力进行了全面的分析。特别是,这些特征被评估用于从BBOB(黑盒优化基准)套件中将问题实例分类为问题类别,从三种算法(差分进化,进化策略和粒子群优化)组合中选择最佳算法来解决给定问题,以及根据它们的轨迹区分这些算法。我们表明,尽管计算成本更低,但它们可以产生与使用最先进的探索性景观分析功能相当的结果。
{"title":"Beyond Landscape Analysis: DynamoRep Features For Capturing Algorithm-Problem Interaction In Single-Objective Continuous Optimization.","authors":"Gjorgjina Cenikj, Gašper Petelin, Carola Doerr, Peter Korošec, Tome Eftimov","doi":"10.1162/evco_a_00370","DOIUrl":"https://doi.org/10.1162/evco_a_00370","url":null,"abstract":"<p><p>The representation of optimization problems and algorithms in terms of numerical features is a well-established tool for comparing optimization problem instances, for analyzing the behavior of optimization algorithms, and the quality of existing problem benchmarks, as well as for automated per-instance algorithm selection and configuration approaches. Extending purely problem-centered feature collections, our recently proposed DynamoRep features provide a simple and inexpensive representation of the algorithmproblem interaction during the optimization process. In this paper, we conduct a comprehensive analysis of the predictive power of the DynamoRep features for the problem classification, algorithm selection, and algorithm classification tasks. In particular, the features are evaluated for the classification of problem instances into problem classes from the BBOB (Black Box Optimization Benchmarking) suite, selecting the best algorithm to solve a given problem from a portfolio of three algorithms (Differential Evolution, Evolutionary Strategy, and Particle Swarm Optimization), as well as distinguishing these algorithms based on their trajectories. We show that, despite being much cheaper to compute, they can yield results comparable to those using state-ofthe-art Exploratory Landscape Analysis features.</p>","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":" ","pages":"1-28"},"PeriodicalIF":4.6,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143575999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Survey of interactive evolutionary decomposition-based multiobjective optimization methods. 基于交互进化分解的多目标优化方法综述。
IF 4.6 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2025-01-14 DOI: 10.1162/evco_a_00366
Giomara Lárraga, Kaisa Miettinen

Interactive methods support decision-makers in finding the most preferred solution for multiobjective optimization problems, where multiple conflicting objective functions must be optimized simultaneously. These methods let a decision-maker provide preference information iteratively during the solution process to find solutions of interest, allowing them to learn about the trade-offs in the problem and the feasibility of the preferences. Several interactive evolutionary multiobjective optimization methods have been proposed in the literature. In the evolutionary computation community, the so-called decomposition-basedmethods have been increasingly popular because of their good performance in problems with many objective functions. They decompose the multiobjective optimization problem into multiple sub-problems to be solved collaboratively. Various interactive versions of decomposition-based methods have been proposed. However, most of them do not consider the desirable properties of real interactive solution processes, such as avoiding imposing a high cognitive burden on the decision-maker, allowing them to decide when to interact with the method, and supporting them in selecting a final solution. This paper reviews interactive evolutionary decomposition-based multiobjective optimization methods and different methodologies utilized to incorporate interactivity in them. Additionally, desirable properties of interactive decomposition-based multiobjective evolutionary optimization methods are identified, aiming to make them easier to be applied in real-world problems.

在多目标优化问题中,多个相互冲突的目标函数必须同时优化,交互式方法支持决策者找到最优解。这些方法允许决策者在求解过程中迭代地提供偏好信息,以找到感兴趣的解决方案,使他们能够了解问题中的权衡和偏好的可行性。文献中提出了几种交互式进化多目标优化方法。在进化计算界,所谓的基于分解的方法因其在具有许多目标函数的问题上的良好性能而越来越受欢迎。它们将多目标优化问题分解为多个子问题,并协同求解。已经提出了各种基于分解的交互式方法。然而,它们中的大多数都没有考虑到真正的交互式解决方案过程的理想特性,例如避免给决策者施加高认知负担,允许他们决定何时与方法交互,并支持他们选择最终解决方案。本文综述了基于交互进化分解的多目标优化方法,以及将交互性纳入其中的各种方法。此外,本文还确定了基于交互分解的多目标进化优化方法的理想特性,使其更容易应用于实际问题。
{"title":"Survey of interactive evolutionary decomposition-based multiobjective optimization methods.","authors":"Giomara Lárraga, Kaisa Miettinen","doi":"10.1162/evco_a_00366","DOIUrl":"https://doi.org/10.1162/evco_a_00366","url":null,"abstract":"<p><p>Interactive methods support decision-makers in finding the most preferred solution for multiobjective optimization problems, where multiple conflicting objective functions must be optimized simultaneously. These methods let a decision-maker provide preference information iteratively during the solution process to find solutions of interest, allowing them to learn about the trade-offs in the problem and the feasibility of the preferences. Several interactive evolutionary multiobjective optimization methods have been proposed in the literature. In the evolutionary computation community, the so-called decomposition-basedmethods have been increasingly popular because of their good performance in problems with many objective functions. They decompose the multiobjective optimization problem into multiple sub-problems to be solved collaboratively. Various interactive versions of decomposition-based methods have been proposed. However, most of them do not consider the desirable properties of real interactive solution processes, such as avoiding imposing a high cognitive burden on the decision-maker, allowing them to decide when to interact with the method, and supporting them in selecting a final solution. This paper reviews interactive evolutionary decomposition-based multiobjective optimization methods and different methodologies utilized to incorporate interactivity in them. Additionally, desirable properties of interactive decomposition-based multiobjective evolutionary optimization methods are identified, aiming to make them easier to be applied in real-world problems.</p>","PeriodicalId":50470,"journal":{"name":"Evolutionary Computation","volume":" ","pages":"1-39"},"PeriodicalIF":4.6,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143015551","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Evolutionary Computation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1