首页 > 最新文献

Proceedings of the 11th Annual conference on Genetic and evolutionary computation最新文献

英文 中文
Performance of evolutionary algorithms on NK landscapes with nearest neighbor interactions and tunable overlap 演化算法在具有最近邻相互作用和可调重叠的自然景观上的性能
M. Pelikán, K. Sastry, D. Goldberg, Martin Volker Butz, Mark Hauschild
This paper presents a class of NK landscapes with nearest-neighbor interactions and tunable overlap. The considered class of NK landscapes is solvable in polynomial time using dynamic programming; this allows us to generate a large number of random problem instances with known optima. Several genetic and evolutionary algorithms are then applied to the generated problem instances. The results are analyzed and related to scalability theory for genetic algorithms and estimation of distribution algorithms.
本文提出了一类具有最近邻相互作用和可调重叠的NK景观。所考虑的NK景观类可在多项式时间内使用动态规划求解;这使我们能够生成大量具有已知最优解的随机问题实例。然后将几种遗传和进化算法应用于生成的问题实例。对结果进行了分析,并将其与遗传算法的可扩展性理论和分布算法的估计联系起来。
{"title":"Performance of evolutionary algorithms on NK landscapes with nearest neighbor interactions and tunable overlap","authors":"M. Pelikán, K. Sastry, D. Goldberg, Martin Volker Butz, Mark Hauschild","doi":"10.1145/1569901.1570018","DOIUrl":"https://doi.org/10.1145/1569901.1570018","url":null,"abstract":"This paper presents a class of NK landscapes with nearest-neighbor interactions and tunable overlap. The considered class of NK landscapes is solvable in polynomial time using dynamic programming; this allows us to generate a large number of random problem instances with known optima. Several genetic and evolutionary algorithms are then applied to the generated problem instances. The results are analyzed and related to scalability theory for genetic algorithms and estimation of distribution algorithms.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123807342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Approximating geometric crossover in semantic space 语义空间中的近似几何交叉
K. Krawiec, Pawel Lichocki
We propose a crossover operator that works with genetic programming trees and is approximately geometric crossover in the semantic space. By defining semantic as program's evaluation profile with respect to a set of fitness cases and constraining to a specific class of metric-based fitness functions, we cause the fitness landscape in the semantic space to have perfect fitness-distance correlation. The proposed approximately geometric semantic crossover exploits this property of the semantic fitness landscape by an appropriate sampling. We demonstrate also how the proposed method may be conveniently combined with hill climbing. We discuss the properties of the methods, and describe an extensive computational experiment concerning logical function synthesis and symbolic regression.
我们提出了一种与遗传规划树一起工作的交叉算子,它是语义空间中的近似几何交叉算子。通过将语义定义为项目对一组适应度案例的评估概况,并将其约束为一类特定的基于度量的适应度函数,我们使语义空间中的适应度景观具有完美的适应度-距离相关性。所提出的近似几何语义交叉通过适当的采样利用了语义适应度景观的这一特性。我们还演示了所提出的方法如何方便地与爬山相结合。我们讨论了这些方法的性质,并描述了一个关于逻辑函数综合和符号回归的广泛计算实验。
{"title":"Approximating geometric crossover in semantic space","authors":"K. Krawiec, Pawel Lichocki","doi":"10.1145/1569901.1570036","DOIUrl":"https://doi.org/10.1145/1569901.1570036","url":null,"abstract":"We propose a crossover operator that works with genetic programming trees and is approximately geometric crossover in the semantic space. By defining semantic as program's evaluation profile with respect to a set of fitness cases and constraining to a specific class of metric-based fitness functions, we cause the fitness landscape in the semantic space to have perfect fitness-distance correlation. The proposed approximately geometric semantic crossover exploits this property of the semantic fitness landscape by an appropriate sampling. We demonstrate also how the proposed method may be conveniently combined with hill climbing. We discuss the properties of the methods, and describe an extensive computational experiment concerning logical function synthesis and symbolic regression.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126868654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 104
Session details: Track 13: real world application 会议细节:轨道13:真实世界的应用
M. O’Neill
{"title":"Session details: Track 13: real world application","authors":"M. O’Neill","doi":"10.1145/3257507","DOIUrl":"https://doi.org/10.1145/3257507","url":null,"abstract":"","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127959942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visualizing the search process of particle swarm optimization 粒子群优化的搜索过程可视化
Yong-Hyuk Kim, K. Lee, Yourim Yoon
It is a hard problem to understand the search process of particle swarm optimization over high-dimensional domain. The visualization depicts the total search process and then it will allow better understanding of how to tune the algorithm. For the investigation, we adopt Sammon's mapping, which is a well-known distance-preserving mapping. We demonstrate the usefulness of the proposed methodology by applying it to some function optimization problems.
粒子群优化算法在高维域上的搜索过程是一个难以理解的问题。可视化描述了整个搜索过程,然后它将允许更好地理解如何调整算法。在研究中,我们采用了Sammon映射,这是一种著名的距离保持映射。我们通过将所提出的方法应用于一些函数优化问题来证明其有效性。
{"title":"Visualizing the search process of particle swarm optimization","authors":"Yong-Hyuk Kim, K. Lee, Yourim Yoon","doi":"10.1145/1569901.1569909","DOIUrl":"https://doi.org/10.1145/1569901.1569909","url":null,"abstract":"It is a hard problem to understand the search process of particle swarm optimization over high-dimensional domain. The visualization depicts the total search process and then it will allow better understanding of how to tune the algorithm. For the investigation, we adopt Sammon's mapping, which is a well-known distance-preserving mapping. We demonstrate the usefulness of the proposed methodology by applying it to some function optimization problems.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128788201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Multi-objective optimization with an evolutionary artificial neural network for financial forecasting 基于进化人工神经网络的财务预测多目标优化
Matthew Butler, Ali Daniyal
In this paper, we attempt to make accurate predictions of the movement of the stock market with the aid of an evolutionary artificial neural network (EANN). To facilitate this objective we constructed an EANN for multi-objective optimization (MOO) that was trained with macro-economic data and its effect on market performance. Experiments were conducted with EANNs that updated connection weights through genetic operators (crossover and mutation) and/or with the aid of back-propagation. The results showed that the optimal performance was achieved under natural complexification of the EANN and that back-propagation tended to over fit the data. The results also suggested that EANNs trained with multi-objectives were more robust than that of a single optimization approach. The MOO approach produced superior investment returns during training and testing over a single objective optimization (SOO).
在本文中,我们试图借助进化人工神经网络(EANN)对股票市场的运动做出准确的预测。为了实现这一目标,我们构建了一个用于多目标优化(MOO)的EANN,该EANN使用宏观经济数据及其对市场表现的影响进行训练。通过遗传算子(交叉和突变)和/或借助反向传播更新连接权重的eann进行了实验。结果表明,在自然复化条件下,EANN的性能最优,反向传播倾向于过拟合数据。结果还表明,多目标训练的eann比单一优化方法具有更强的鲁棒性。在培训和测试期间,MOO方法比单一目标优化(SOO)产生了更高的投资回报。
{"title":"Multi-objective optimization with an evolutionary artificial neural network for financial forecasting","authors":"Matthew Butler, Ali Daniyal","doi":"10.1145/1569901.1570096","DOIUrl":"https://doi.org/10.1145/1569901.1570096","url":null,"abstract":"In this paper, we attempt to make accurate predictions of the movement of the stock market with the aid of an evolutionary artificial neural network (EANN). To facilitate this objective we constructed an EANN for multi-objective optimization (MOO) that was trained with macro-economic data and its effect on market performance. Experiments were conducted with EANNs that updated connection weights through genetic operators (crossover and mutation) and/or with the aid of back-propagation. The results showed that the optimal performance was achieved under natural complexification of the EANN and that back-propagation tended to over fit the data. The results also suggested that EANNs trained with multi-objectives were more robust than that of a single optimization approach. The MOO approach produced superior investment returns during training and testing over a single objective optimization (SOO).","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128945967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
A genetic algorithm for analyzing choice behavior with mixed decision strategies 混合决策策略下选择行为分析的遗传算法
Jella Pfeiffer, D. Duzevik, Franz Rothlauf, Koichi Yamamoto
In the field of decision-making a fundamental problem is how to uncover people's choice behavior. While choices them- selves are often observable, our underlying decision strategies determining these choices are not entirely understood. Previous research defined a number of decision strategies and conjectured that people do not apply only one strategy but switch strategies during the decision process. To the best of our knowledge, empirical evidence for the latter conjecture is missing. This is why we monitored the purchase decisions 624 consumers shopping online. We study how many of the observed choices can be explained by the existing strategies in their pure form, how many decisions can be explained if we account for switching behavior, and investigate switching behavior in detail. Since accounting for switching leads to a large search space of possible mixed decision strategies, we apply a genetic algorithm to find the set of mixed decision strategies which best explains the observed behavior. The results show that mixed strategies are used more often than pure ones and that a set of four mixed strategies is able to explain 93.9% of choices in a scenario with 4 alternatives and 75.4% of choices in a scenario with 7 alternatives.
在决策领域,如何揭示人的选择行为是一个基本问题。虽然选择本身通常是可以观察到的,但我们决定这些选择的潜在决策策略并没有完全被理解。以往的研究定义了许多决策策略,并推测人们在决策过程中不会只使用一种策略,而是会切换策略。据我们所知,后一种猜想缺乏经验证据。这就是为什么我们监控了624名在线购物消费者的购买决策。我们研究有多少观察到的选择可以用现有策略的纯粹形式来解释,有多少决定可以解释,如果我们考虑切换行为,并详细调查切换行为。由于考虑切换导致可能的混合决策策略的搜索空间很大,我们应用遗传算法来寻找最能解释观察到的行为的混合决策策略集。结果表明,混合策略的使用频率高于纯策略,四种混合策略可以解释4种选择情景下93.9%的选择,7种选择情景下75.4%的选择。
{"title":"A genetic algorithm for analyzing choice behavior with mixed decision strategies","authors":"Jella Pfeiffer, D. Duzevik, Franz Rothlauf, Koichi Yamamoto","doi":"10.1145/1569901.1570113","DOIUrl":"https://doi.org/10.1145/1569901.1570113","url":null,"abstract":"In the field of decision-making a fundamental problem is how to uncover people's choice behavior. While choices them- selves are often observable, our underlying decision strategies determining these choices are not entirely understood. Previous research defined a number of decision strategies and conjectured that people do not apply only one strategy but switch strategies during the decision process. To the best of our knowledge, empirical evidence for the latter conjecture is missing. This is why we monitored the purchase decisions 624 consumers shopping online. We study how many of the observed choices can be explained by the existing strategies in their pure form, how many decisions can be explained if we account for switching behavior, and investigate switching behavior in detail. Since accounting for switching leads to a large search space of possible mixed decision strategies, we apply a genetic algorithm to find the set of mixed decision strategies which best explains the observed behavior. The results show that mixed strategies are used more often than pure ones and that a set of four mixed strategies is able to explain 93.9% of choices in a scenario with 4 alternatives and 75.4% of choices in a scenario with 7 alternatives.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130486444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A cooperative and self-adaptive metaheuristic for the facility location problem 设施选址问题的合作自适应元启发式算法
D. Meignan, Jean-Charles Créput, A. Koukam
This paper presents a coalition-based metaheuristic (CBM) to solve the uncapacitated facility location problem. CBM is a population-based metaheuristic where individuals encapsulate a single solution and are considered as agents. In comparison to classical evolutionary algorithms, these agents have additional capacities of decision, learning and cooperation. Our approach is also a case study to present how concepts from multiagent systems' domain may contribute to the design of new metaheuristics. The tackled problem is a well-known combinatorial optimization problem, namely the uncapacitated facility location problem, that consists in determining the sites in which some facilities must be set up to satisfy the requirements of a client set at minimum cost. A computational experiment is conducted to test the performance of learning mechanisms and to compare our approach with several existing metaheuristics. The results showed that CBM is competitive with powerful heuristics approaches and presents several advantages in terms of flexibility and modularity.
本文提出了一种基于联盟的元启发式算法(CBM)来解决无容量设施选址问题。CBM是一种基于群体的元启发式算法,其中个体封装单个解决方案并被视为代理。与传统的进化算法相比,这些智能体具有额外的决策、学习和合作能力。我们的方法也是一个案例研究,展示了来自多智能体系统领域的概念如何有助于设计新的元启发式。所解决的问题是一个众所周知的组合优化问题,即无能力设施选址问题,该问题包括确定某些设施必须设置的地点,以最小成本满足客户集的要求。进行了计算实验来测试学习机制的性能,并将我们的方法与几种现有的元启发式方法进行比较。结果表明,CBM在灵活性和模块化方面具有强大的启发式方法的竞争优势。
{"title":"A cooperative and self-adaptive metaheuristic for the facility location problem","authors":"D. Meignan, Jean-Charles Créput, A. Koukam","doi":"10.1145/1569901.1569946","DOIUrl":"https://doi.org/10.1145/1569901.1569946","url":null,"abstract":"This paper presents a coalition-based metaheuristic (CBM) to solve the uncapacitated facility location problem. CBM is a population-based metaheuristic where individuals encapsulate a single solution and are considered as agents. In comparison to classical evolutionary algorithms, these agents have additional capacities of decision, learning and cooperation. Our approach is also a case study to present how concepts from multiagent systems' domain may contribute to the design of new metaheuristics. The tackled problem is a well-known combinatorial optimization problem, namely the uncapacitated facility location problem, that consists in determining the sites in which some facilities must be set up to satisfy the requirements of a client set at minimum cost. A computational experiment is conducted to test the performance of learning mechanisms and to compare our approach with several existing metaheuristics. The results showed that CBM is competitive with powerful heuristics approaches and presents several advantages in terms of flexibility and modularity.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130492617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
An extended evolution strategy for the characterization of fracture conductivities from well tests 从试井中描述裂缝导流性的扩展演化策略
J. Bruyelle, A. Lange
The characterization of fractured reservoirs involves: (1) the design of geological models integrating statistical and/or deterministic fracture properties; (2) the validation of flow simulation models by calibrating with dynamic field data e.g. well tests. The latter validation step is critical since it also validates the underlying geological model, it allows one to reduce some uncertainties among the fracture geometrical and distribution properties, and it is often the only mean to characterize fracture conductivities. However this is usually an ill-posed inverse problem: field data are usually not sufficient to fully characterize the fracture system. It is of interest to explore the parameters space effectively, so that multiple solutions may be characterized, and many production development scenarii may be studied. This paper presents a well tests inversion method to characterize fracture sets conductivities. The Covariance Matrix Adaptation-Evolution Strategy (CMA-ES) has been used as the optimization algorithm. It has been tested with some local optimization algorithms for comparison, and extended in order to detect several solutions simultaneously using a local proxy of the response surface. Moreover, uncertainty analyses are performed in regions of interest. Applications are presented for a fracture system with two fracture sets.
裂缝性储层的表征包括:(1)综合统计和/或确定性裂缝性质的地质模型设计;(2)利用动态现场数据(如试井)进行标定,验证流动模拟模型。后一个验证步骤至关重要,因为它也验证了潜在的地质模型,它允许人们减少裂缝几何和分布特性中的一些不确定性,并且它通常是表征裂缝导流性的唯一手段。然而,这通常是一个不适定逆问题:现场数据通常不足以完全表征裂缝系统。有效地探索参数空间,可以表征多个解,研究多种生产开发场景。本文提出了一种表征裂缝集导电性的试井反演方法。采用协方差矩阵自适应进化策略(CMA-ES)作为优化算法。并与一些局部优化算法进行了比较测试,并进行了扩展,以便使用响应面的局部代理同时检测多个解。此外,在感兴趣的区域进行了不确定性分析。介绍了一种具有两组裂缝的压裂系统的应用。
{"title":"An extended evolution strategy for the characterization of fracture conductivities from well tests","authors":"J. Bruyelle, A. Lange","doi":"10.1145/1569901.1570095","DOIUrl":"https://doi.org/10.1145/1569901.1570095","url":null,"abstract":"The characterization of fractured reservoirs involves: (1) the design of geological models integrating statistical and/or deterministic fracture properties; (2) the validation of flow simulation models by calibrating with dynamic field data e.g. well tests. The latter validation step is critical since it also validates the underlying geological model, it allows one to reduce some uncertainties among the fracture geometrical and distribution properties, and it is often the only mean to characterize fracture conductivities. However this is usually an ill-posed inverse problem: field data are usually not sufficient to fully characterize the fracture system. It is of interest to explore the parameters space effectively, so that multiple solutions may be characterized, and many production development scenarii may be studied. This paper presents a well tests inversion method to characterize fracture sets conductivities. The Covariance Matrix Adaptation-Evolution Strategy (CMA-ES) has been used as the optimization algorithm. It has been tested with some local optimization algorithms for comparison, and extended in order to detect several solutions simultaneously using a local proxy of the response surface. Moreover, uncertainty analyses are performed in regions of interest. Applications are presented for a fracture system with two fracture sets.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132994158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Uncertainty handling CMA-ES for reinforcement learning 用于强化学习的不确定性处理CMA-ES
V. Heidrich-Meisner, C. Igel
The covariance matrix adaptation evolution strategy (CMAES) has proven to be a powerful method for reinforcement learning (RL). Recently, the CMA-ES has been augmented with an adaptive uncertainty handling mechanism. Because uncertainty is a typical property of RL problems this new algorithm, termed UH-CMA-ES, is promising for RL. The UH-CMA-ES dynamically adjusts the number of episodes considered in each evaluation of a policy. It controls the signal to noise ratio such that it is just high enough for a sufficiently good ranking of candidate policies, which in turn allows the evolutionary learning to find better solutions. This significantly increases the learning speed as well as the robustness without impairing the quality of the final solutions. We evaluate the UH-CMA-ES on fully and partially observable Markov decision processes with random start states and noisy observations. A canonical natural policy gradient method and random search serve as a baseline for comparison.
协方差矩阵自适应进化策略(CMAES)已被证明是一种强大的强化学习方法。近年来,CMA-ES增加了自适应不确定性处理机制。由于不确定性是强化学习问题的一个典型特征,这种新的算法被称为UH-CMA-ES,在强化学习中很有前景。UH-CMA-ES动态调整每次政策评估中考虑的事件数。它控制信噪比,使其足够高,足以对候选策略进行足够好的排序,这反过来又允许进化学习找到更好的解决方案。这大大提高了学习速度和鲁棒性,同时又不影响最终解的质量。我们在完全可观察和部分可观察的马尔可夫决策过程上对UH-CMA-ES进行了评估。一个典型的自然策略梯度方法和随机搜索作为比较的基线。
{"title":"Uncertainty handling CMA-ES for reinforcement learning","authors":"V. Heidrich-Meisner, C. Igel","doi":"10.1145/1569901.1570064","DOIUrl":"https://doi.org/10.1145/1569901.1570064","url":null,"abstract":"The covariance matrix adaptation evolution strategy (CMAES) has proven to be a powerful method for reinforcement learning (RL). Recently, the CMA-ES has been augmented with an adaptive uncertainty handling mechanism. Because uncertainty is a typical property of RL problems this new algorithm, termed UH-CMA-ES, is promising for RL. The UH-CMA-ES dynamically adjusts the number of episodes considered in each evaluation of a policy. It controls the signal to noise ratio such that it is just high enough for a sufficiently good ranking of candidate policies, which in turn allows the evolutionary learning to find better solutions. This significantly increases the learning speed as well as the robustness without impairing the quality of the final solutions. We evaluate the UH-CMA-ES on fully and partially observable Markov decision processes with random start states and noisy observations. A canonical natural policy gradient method and random search serve as a baseline for comparison.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132996748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Multiobjectivization for parameter estimation: a case-study on the segment polarity network of drosophila 参数估计的多目标化:以果蝇片段极性网络为例
T. Hohm, E. Zitzler
Mathematical modeling for gene regulative networks (GRNs) provides an effective tool for hypothesis testing in biology. A necessary step in setting up such models is the estimation of model parameters, i.e., an optimization process during which the difference between model output and given experimental data is minimized. This parameter estimation step is often difficult, especially for larger systems due to often incomplete quantitative data, the large size of the parameter space, and non-linearities in system behavior. Addressing the task of parameter estimation, we investigate the influence multiobjectivization can have on the optimization process. On the example of an established model for the segment polarity GRN in Drosophila, we test different multiobjectivization scenarios compared to a singleobjective function proposed earlier for the parameter optimization of the segment polarity network model. Since, instead of a single optimal parameter setting, a set of optimal parameter settings exists for this GRN, the comparison of the different optimization scenarios focuses on the capabilities of the different scenarios to identify optimal parameter settings showing good diversity in the parameter space. By embedding the objective functions in an evolutionary algorithm (EA), we show the superiority of the multiobjective approaches in exploring the model's parameter space.
基因调控网络的数学建模为生物学中的假设检验提供了有效的工具。建立这种模型的必要步骤是模型参数的估计,即一个优化过程,在此过程中,模型输出与给定实验数据之间的差异最小化。这个参数估计步骤通常是困难的,特别是对于较大的系统,由于通常不完整的定量数据,参数空间的大小,以及系统行为的非线性。针对参数估计问题,研究了多目标化对优化过程的影响。以果蝇的片段极性GRN模型为例,与先前提出的单目标函数相比,我们测试了不同的多目标化场景,用于片段极性网络模型的参数优化。由于该GRN不是单一的最优参数设置,而是存在一组最优参数设置,因此不同优化场景的比较侧重于不同场景识别最优参数设置的能力,在参数空间上表现出良好的多样性。通过在进化算法中嵌入目标函数,我们展示了多目标方法在探索模型参数空间方面的优越性。
{"title":"Multiobjectivization for parameter estimation: a case-study on the segment polarity network of drosophila","authors":"T. Hohm, E. Zitzler","doi":"10.1145/1569901.1569931","DOIUrl":"https://doi.org/10.1145/1569901.1569931","url":null,"abstract":"Mathematical modeling for gene regulative networks (GRNs) provides an effective tool for hypothesis testing in biology. A necessary step in setting up such models is the estimation of model parameters, i.e., an optimization process during which the difference between model output and given experimental data is minimized. This parameter estimation step is often difficult, especially for larger systems due to often incomplete quantitative data, the large size of the parameter space, and non-linearities in system behavior. Addressing the task of parameter estimation, we investigate the influence multiobjectivization can have on the optimization process. On the example of an established model for the segment polarity GRN in Drosophila, we test different multiobjectivization scenarios compared to a singleobjective function proposed earlier for the parameter optimization of the segment polarity network model. Since, instead of a single optimal parameter setting, a set of optimal parameter settings exists for this GRN, the comparison of the different optimization scenarios focuses on the capabilities of the different scenarios to identify optimal parameter settings showing good diversity in the parameter space. By embedding the objective functions in an evolutionary algorithm (EA), we show the superiority of the multiobjective approaches in exploring the model's parameter space.","PeriodicalId":193093,"journal":{"name":"Proceedings of the 11th Annual conference on Genetic and evolutionary computation","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133067286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
期刊
Proceedings of the 11th Annual conference on Genetic and evolutionary computation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1