河道路径控制与强化学习

Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake
{"title":"河道路径控制与强化学习","authors":"Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake","doi":"10.1109/ICAS49788.2021.9551113","DOIUrl":null,"url":null,"abstract":"In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.","PeriodicalId":287105,"journal":{"name":"2021 IEEE International Conference on Autonomous Systems (ICAS)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"River Flow Path Control With Reinforcement Learning\",\"authors\":\"Dongqi Liu, Yutaka Naito, Chen Zhang, S. Muramatsu, H. Yasuda, Kiyoshi Hayasaka, Y. Otake\",\"doi\":\"10.1109/ICAS49788.2021.9551113\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.\",\"PeriodicalId\":287105,\"journal\":{\"name\":\"2021 IEEE International Conference on Autonomous Systems (ICAS)\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Conference on Autonomous Systems (ICAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAS49788.2021.9551113\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Autonomous Systems (ICAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAS49788.2021.9551113","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

本文提出了一种基于强化学习的信息物理控制系统(CPS)。近年来,由于暴雨导致的河流洪水频繁发生,造成了严重的经济损失和人员伤亡。河流泛滥的原因之一是河床的生长和流道的改变所造成的曲流。作为避免曲流的一种手段,河沟可以用来调节水流。然而,流路增长的机制及其最优控制尚不清楚。因此,本研究提出了一种采用数据驱动方法的动态流路控制系统,可以一次性解决这一问题。作为一种数据驱动的方法,采用了强化学习。该系统通过自适应地变形和移动流道,并以流道健康度作为奖励来控制流道。通过对河流模型的仿真,验证了所提出的流道控制系统的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
River Flow Path Control With Reinforcement Learning
In this study, a cyber-physical system (CPS) for river flow path control is proposed using reinforcement learning. Recently, there has been a frequent occurrence of river flooding due to heavy rains, resulting in serious economic losses and victims. One cause of river flooding is the meandering due to the river bed growing and flow path change. As a mean of avoiding the meandering, river groynes can be used to regularize the flow. However, the mechanism of the flow path growing, and its optimal control is unclear. Therefore, in this study, a dynamic flow path control system is proposed using a data-driven approach to solve the problem at once. As a data-driven approach, reinforcement learning is adopted. The proposed system is designed to control meandering by adaptively deforming and moving the groynes with the reward of the flow path health. The effectiveness of the proposed flow path control system is verified through a simulation of the river model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Improving Automated Search for Underwater Threats Using Multistatic Sensor Fields by Incorporating Unconfirmed Track Information Matching Models for Crowd-Shipping Considering Shipper’s Acceptance Uncertainty Observational Learning: Imitation Through an Adaptive Probabilistic Approach Simultaneous Calibration of Positions, Orientations, and Time Offsets, Among Multiple Microphone Arrays Modified crop health monitoring and pesticide spraying system using NDVI and Semantic Segmentation: An AGROCOPTER based approach
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1