International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications最新文献
Pub Date : 2023-01-31DOI: 10.48550/arXiv.2301.13374
Lan Tang, Xiaxi Li, Jinyuan Zhang, Guiying Li, Peng Yang, Ke Tang
Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement learning methods. However, the evaluation of the iteratively generated population usually requires a large amount of computational time and can be prohibitively expensive, which may potentially restrict the applicability of ERL. Surrogate is often used to reduce the computational burden of evaluation in EAs. Unfortunately, in ERL, each individual of policy usually represents millions of weights parameters of DNN. This high-dimensional representation of policy has introduced a great challenge to the application of surrogates into ERL to speed up training. This paper proposes a PE-SAERL Framework to at the first time enable surrogate-assisted evolutionary reinforcement learning via policy embedding (PE). Empirical results on 5 Atari games show that the proposed method can perform more efficiently than the four state-of-the-art algorithms. The training process is accelerated up to 7x on tested games, comparing to its counterpart without the surrogate and PE.
{"title":"Enabling surrogate-assisted evolutionary reinforcement learning via policy embedding","authors":"Lan Tang, Xiaxi Li, Jinyuan Zhang, Guiying Li, Peng Yang, Ke Tang","doi":"10.48550/arXiv.2301.13374","DOIUrl":"https://doi.org/10.48550/arXiv.2301.13374","url":null,"abstract":"Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement learning methods. However, the evaluation of the iteratively generated population usually requires a large amount of computational time and can be prohibitively expensive, which may potentially restrict the applicability of ERL. Surrogate is often used to reduce the computational burden of evaluation in EAs. Unfortunately, in ERL, each individual of policy usually represents millions of weights parameters of DNN. This high-dimensional representation of policy has introduced a great challenge to the application of surrogates into ERL to speed up training. This paper proposes a PE-SAERL Framework to at the first time enable surrogate-assisted evolutionary reinforcement learning via policy embedding (PE). Empirical results on 5 Atari games show that the proposed method can perform more efficiently than the four state-of-the-art algorithms. The training process is accelerated up to 7x on tested games, comparing to its counterpart without the surrogate and PE.","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"41 1","pages":"233-247"},"PeriodicalIF":0.0,"publicationDate":"2023-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81501639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.1007/978-981-99-1549-1
{"title":"Bio-Inspired Computing: Theories and Applications: 17th International Conference, BIC-TA 2022, Wuhan, China, December 16–18, 2022, Revised Selected Papers","authors":"","doi":"10.1007/978-981-99-1549-1","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"184 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80468516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_10
Xiaoyu Li, Lei Wang, Qiaoyong Jiang, Wei Li, Bin Wang
{"title":"A Self-adaptive Single-Objective Multitasking Optimization Algorithm","authors":"Xiaoyu Li, Lei Wang, Qiaoyong Jiang, Wei Li, Bin Wang","doi":"10.1007/978-981-99-1549-1_10","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_10","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"15 1","pages":"117-130"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78372054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-19-1256-6
{"title":"Bio-Inspired Computing: Theories and Applications: 16th International Conference, BIC-TA 2021, Taiyuan, China, December 17–19, 2021, Revised Selected Papers, Part I","authors":"","doi":"10.1007/978-981-19-1256-6","DOIUrl":"https://doi.org/10.1007/978-981-19-1256-6","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"81 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78107369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_55
Zirui Liang, Weigang Huang, Runzhe Rao, Fang Li
{"title":"An Analysis for Thermal Conductivity of Graphene/Polymer Nanocomposites","authors":"Zirui Liang, Weigang Huang, Runzhe Rao, Fang Li","doi":"10.1007/978-981-99-1549-1_55","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_55","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"86 1","pages":"684-690"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72917071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_26
Tao Zhou, Yuanxin He, Liang Luo, S. Ji
{"title":"Research on Soil Moisture Prediction Based on LSTM-Transformer Model","authors":"Tao Zhou, Yuanxin He, Liang Luo, S. Ji","doi":"10.1007/978-981-99-1549-1_26","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_26","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"131 1","pages":"329-342"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81795170","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_50
Yanbing Zhang, Hao Wang, Liang Luo
{"title":"Diffusion Optimization Algorithm Based on Membrane Calculation","authors":"Yanbing Zhang, Hao Wang, Liang Luo","doi":"10.1007/978-981-99-1549-1_50","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_50","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"5 1","pages":"628-646"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87380707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_21
Wei Zhao, Jing Wang
{"title":"Research on Helmet Wearing Detection Based on Improved YOLOv4 Algorithm","authors":"Wei Zhao, Jing Wang","doi":"10.1007/978-981-99-1549-1_21","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_21","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"39 1","pages":"265-274"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76208490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-01-01DOI: 10.1007/978-981-99-1549-1_47
Chao Lu, Guangwu Liu, Wenguo Zhang, Jian Wang
{"title":"Simulation of Airflow Characteristics of a Seabird Following a Ship Based on Steady State","authors":"Chao Lu, Guangwu Liu, Wenguo Zhang, Jian Wang","doi":"10.1007/978-981-99-1549-1_47","DOIUrl":"https://doi.org/10.1007/978-981-99-1549-1_47","url":null,"abstract":"","PeriodicalId":88899,"journal":{"name":"International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications","volume":"29 1","pages":"591-604"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74788460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
International Conference on Bio-inspired Computing, Theories and Applications : [proceedings]. International Conference on Bio-inspired Computing, Theories and Applications
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：