{"title":"基于强化学习的约束多目标优化Pareto Front搜索算法","authors":"Yuhang Hu , Yuelin Qu , Wei Li , Ying Huang","doi":"10.1016/j.ins.2025.121985","DOIUrl":null,"url":null,"abstract":"<div><div>Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"705 ","pages":"Article 121985"},"PeriodicalIF":6.8000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Pareto Front searching algorithm based on reinforcement learning for constrained multiobjective optimization\",\"authors\":\"Yuhang Hu , Yuelin Qu , Wei Li , Ying Huang\",\"doi\":\"10.1016/j.ins.2025.121985\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.</div></div>\",\"PeriodicalId\":51063,\"journal\":{\"name\":\"Information Sciences\",\"volume\":\"705 \",\"pages\":\"Article 121985\"},\"PeriodicalIF\":6.8000,\"publicationDate\":\"2025-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Sciences\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0020025525001173\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/17 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"0\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025525001173","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/17 0:00:00","PubModel":"Epub","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
约束多目标算法是智能优化中应用最广泛的方向,具有很好的研究价值。目前,大多数多目标多约束算法都是基于可行解与不可行解之间的关系来设计的,但忽略了约束之间的复杂关联。同时,约束问题最大的难点在于约束帕累托前沿(CPF)的不规则性和缺乏有效的探索策略。针对多约束多目标优化问题,提出了一种基于强化学习(PFRL)的Pareto前搜索方法。该算法通过与环境的交互作用,采用强化学习来引导进化过程,自适应学习CPF的形状和特征,有效覆盖CPF的结构。利用强化学习获得的环境和CPF信息对CPF进行翻译和扩展,以处理各种不规则可行区域。此外,本文还设计了一种基于相关距离(CD)度量的约束优先级评价机制来处理约束关系。它允许算法有效地跨越与CPF无关的单个约束的Pareto front (PF),提高算法效率。所引入的算法仅使用一个种群实现上述策略。将所引入算法的有效性与9种最新算法和4个现实约束多目标优化问题进行了对比验证。实验结果表明,该算法为求解CMOPs提供了一种低资源、高效的方法。
A Pareto Front searching algorithm based on reinforcement learning for constrained multiobjective optimization
Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.
期刊介绍:
Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions.
Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.