基于强化学习的约束多目标优化Pareto Front搜索算法

IF 6.8 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS Information Sciences Pub Date : 2025-07-01 Epub Date: 2025-02-17 DOI:10.1016/j.ins.2025.121985
Yuhang Hu , Yuelin Qu , Wei Li , Ying Huang
{"title":"基于强化学习的约束多目标优化Pareto Front搜索算法","authors":"Yuhang Hu ,&nbsp;Yuelin Qu ,&nbsp;Wei Li ,&nbsp;Ying Huang","doi":"10.1016/j.ins.2025.121985","DOIUrl":null,"url":null,"abstract":"<div><div>Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"705 ","pages":"Article 121985"},"PeriodicalIF":6.8000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Pareto Front searching algorithm based on reinforcement learning for constrained multiobjective optimization\",\"authors\":\"Yuhang Hu ,&nbsp;Yuelin Qu ,&nbsp;Wei Li ,&nbsp;Ying Huang\",\"doi\":\"10.1016/j.ins.2025.121985\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.</div></div>\",\"PeriodicalId\":51063,\"journal\":{\"name\":\"Information Sciences\",\"volume\":\"705 \",\"pages\":\"Article 121985\"},\"PeriodicalIF\":6.8000,\"publicationDate\":\"2025-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Sciences\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0020025525001173\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/17 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"0\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025525001173","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/17 0:00:00","PubModel":"Epub","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

约束多目标算法是智能优化中应用最广泛的方向,具有很好的研究价值。目前,大多数多目标多约束算法都是基于可行解与不可行解之间的关系来设计的,但忽略了约束之间的复杂关联。同时,约束问题最大的难点在于约束帕累托前沿(CPF)的不规则性和缺乏有效的探索策略。针对多约束多目标优化问题,提出了一种基于强化学习(PFRL)的Pareto前搜索方法。该算法通过与环境的交互作用,采用强化学习来引导进化过程,自适应学习CPF的形状和特征,有效覆盖CPF的结构。利用强化学习获得的环境和CPF信息对CPF进行翻译和扩展,以处理各种不规则可行区域。此外,本文还设计了一种基于相关距离(CD)度量的约束优先级评价机制来处理约束关系。它允许算法有效地跨越与CPF无关的单个约束的Pareto front (PF),提高算法效率。所引入的算法仅使用一个种群实现上述策略。将所引入算法的有效性与9种最新算法和4个现实约束多目标优化问题进行了对比验证。实验结果表明,该算法为求解CMOPs提供了一种低资源、高效的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Pareto Front searching algorithm based on reinforcement learning for constrained multiobjective optimization
Constraint multiobjective algorithms are the most widely applied direction in intelligent optimization, with excellent research value. Currently, most multiobjective multi-constraints algorithms are designed based on the relationship between feasible and infeasible solutions, but they ignore the complex associations between constraints. At the same time, the most significant difficulty in constraint problems lies in the irregularity of constrained Pareto front (CPF) and the lack of a powerful strategy for exploration. The paper proposes a Pareto front searching based on reinforcement learning (PFRL) for multi-constraints multiobjective optimization problems. The algorithm employs reinforcement learning to guide the evolution process through interaction with the environment and adaptively learns the shape and characteristics of CPF to cover the structure of CPF effectively. The environment and CPF information gained by reinforcement learning are utilized for CPF translation and extension to deal with various irregular feasible regions. In addition, the paper also designs a constraint priority evaluation mechanism based on the correlation distance (CD) metric to process constraint relationships. It allows the algorithm to effectively cross over Pareto front (PF) of a single constraint that is unrelated to CPF, improving algorithm efficiency. The introduced algorithm implemented the above strategy using only one population. The effectiveness of the introduced algorithm was verified and compared with nine state-of-the-art algorithms and four real-world constrained multiobjective optimization problems (CMOPs). Experimental results show that the algorithm provides a low-resource and efficient method for solving CMOPs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
期刊最新文献
MSTHH: A unified framework for asynchronous and heterogeneous multimodal traffic prediction Design of interval type-2 Takagi-Sugeno-Kang fuzzy neural network system based on hybrid algorithms Federated few-shot learning with explainable prototype representations for tuberculosis detection in chest X-rays Differential privacy strategies for data analytics in the banking sector MaskAttack: A black-box local adversarial attack on facial recognition based on dynamic adaptation and partition weighting
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1