Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake
{"title":"河道路径控制与强化学习","authors":"Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake","doi":"10.1109/ICAS49788.2021.9551113","DOIUrl":null,"url":null,"abstract":"In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.","PeriodicalId":287105,"journal":{"name":"2021 IEEE International Conference on Autonomous Systems (ICAS)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"River Flow Path Control With Reinforcement Learning\",\"authors\":\"Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake\",\"doi\":\"10.1109/ICAS49788.2021.9551113\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.\",\"PeriodicalId\":287105,\"journal\":{\"name\":\"2021 IEEE International Conference on Autonomous Systems (ICAS)\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Conference on Autonomous Systems (ICAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAS49788.2021.9551113\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Autonomous Systems (ICAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAS49788.2021.9551113","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
River Flow Path Control With Reinforcement Learning
In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.