基于仿真的强化和模仿学习用于多变环境条件下的自主帆船导航

Q4 Mathematics CLEI Electronic Journal Pub Date : 2024-07-21 DOI:10.19153/cleiej.27.2.5
Agustín Rieppi, Florencia Rieppi, Mercedes Marzoa, Gonzalo Tejera
{"title":"基于仿真的强化和模仿学习用于多变环境条件下的自主帆船导航","authors":"Agustín Rieppi, Florencia Rieppi, Mercedes Marzoa, Gonzalo Tejera","doi":"10.19153/cleiej.27.2.5","DOIUrl":null,"url":null,"abstract":"In light of escalating concerns over climate change, harnessing oceanic data becomes increasingly urgent. Oceans serve as linchpins in understanding the intricate dynamics governing climate phenomena, exerting pivotal influence over global weather patterns and ecological systems. Despite scientific consensus on climate change impacts, including temperature shifts and acidification, a lack of data infrastructure hampers understanding marine ecosystems.This paper presents an adaptive control system for autonomous sailboats that aims to navigate efficiently in varied conditions by favoring the acquisition of oceanographic data. Combining reinforcement and imitation learning, the controller emulates human decision-making, enabling robust navigation. While showcasing promising results, challenges persist in adverse varied conditions. This challenge is exacerbated when confronting necessitating adaptive control mechanisms resilient to wear and tear.Simulators are vital for training due to the need for vast data volumes. Real-world data collection is costly and risky, while simulations accelerate learning. This study employs a simulator operating at ten times real-time speed, significantly simplifying scenario generation by adjusting factors such as sailboat position, orientation, target location, water current, and wind.Nevertheless, this novel approach signifies progress in addressing climate challenges and advancing oceanic research, using advanced computational methods","PeriodicalId":30032,"journal":{"name":"CLEI Electronic Journal","volume":"99 14","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Simulation-based Reinforcement and Imitation Learning for Autonomous Sailboat Navigation in Variable Environmental Conditions\",\"authors\":\"Agustín Rieppi, Florencia Rieppi, Mercedes Marzoa, Gonzalo Tejera\",\"doi\":\"10.19153/cleiej.27.2.5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In light of escalating concerns over climate change, harnessing oceanic data becomes increasingly urgent. Oceans serve as linchpins in understanding the intricate dynamics governing climate phenomena, exerting pivotal influence over global weather patterns and ecological systems. Despite scientific consensus on climate change impacts, including temperature shifts and acidification, a lack of data infrastructure hampers understanding marine ecosystems.This paper presents an adaptive control system for autonomous sailboats that aims to navigate efficiently in varied conditions by favoring the acquisition of oceanographic data. Combining reinforcement and imitation learning, the controller emulates human decision-making, enabling robust navigation. While showcasing promising results, challenges persist in adverse varied conditions. This challenge is exacerbated when confronting necessitating adaptive control mechanisms resilient to wear and tear.Simulators are vital for training due to the need for vast data volumes. Real-world data collection is costly and risky, while simulations accelerate learning. This study employs a simulator operating at ten times real-time speed, significantly simplifying scenario generation by adjusting factors such as sailboat position, orientation, target location, water current, and wind.Nevertheless, this novel approach signifies progress in addressing climate challenges and advancing oceanic research, using advanced computational methods\",\"PeriodicalId\":30032,\"journal\":{\"name\":\"CLEI Electronic Journal\",\"volume\":\"99 14\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CLEI Electronic Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.19153/cleiej.27.2.5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Mathematics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CLEI Electronic Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.19153/cleiej.27.2.5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Mathematics","Score":null,"Total":0}
引用次数: 0

摘要

鉴于人们对气候变化的担忧不断升级,利用海洋数据变得日益紧迫。海洋是了解气候现象复杂动态的关键,对全球天气模式和生态系统有着举足轻重的影响。尽管科学界对气候变化的影响(包括温度变化和酸化)已达成共识,但数据基础设施的缺乏阻碍了人们对海洋生态系统的了解。本文介绍了一种用于自主帆船的自适应控制系统,该系统旨在通过获取海洋学数据,在各种条件下高效航行。结合强化学习和模仿学习,该控制器可模拟人类决策,实现稳健导航。虽然取得了可喜的成果,但在恶劣的各种条件下,挑战依然存在。由于需要大量数据,模拟器对培训至关重要。真实世界的数据收集成本高、风险大,而模拟则能加速学习。本研究采用的模拟器以十倍于实时速度运行,通过调整帆船位置、方向、目标位置、水流和风力等因素,大大简化了场景生成。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Simulation-based Reinforcement and Imitation Learning for Autonomous Sailboat Navigation in Variable Environmental Conditions
In light of escalating concerns over climate change, harnessing oceanic data becomes increasingly urgent. Oceans serve as linchpins in understanding the intricate dynamics governing climate phenomena, exerting pivotal influence over global weather patterns and ecological systems. Despite scientific consensus on climate change impacts, including temperature shifts and acidification, a lack of data infrastructure hampers understanding marine ecosystems.This paper presents an adaptive control system for autonomous sailboats that aims to navigate efficiently in varied conditions by favoring the acquisition of oceanographic data. Combining reinforcement and imitation learning, the controller emulates human decision-making, enabling robust navigation. While showcasing promising results, challenges persist in adverse varied conditions. This challenge is exacerbated when confronting necessitating adaptive control mechanisms resilient to wear and tear.Simulators are vital for training due to the need for vast data volumes. Real-world data collection is costly and risky, while simulations accelerate learning. This study employs a simulator operating at ten times real-time speed, significantly simplifying scenario generation by adjusting factors such as sailboat position, orientation, target location, water current, and wind.Nevertheless, this novel approach signifies progress in addressing climate challenges and advancing oceanic research, using advanced computational methods
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CLEI Electronic Journal
CLEI Electronic Journal Computer Science-Computer Science (miscellaneous)
CiteScore
0.70
自引率
0.00%
发文量
18
审稿时长
40 weeks
期刊最新文献
Preface to the CLTM-CLTD 2023 Special Issue A Formal Analysis of the Mimblewimble Cryptocurrency Protocol with a Security Approach Monte Carlo Tree Search Algorithm for SSPs Under the GUBS Criterion Explainability Analysis of the Evaluation Model of the Level of Digital Transformation in MSMEs based on Fuzzy Cognitive Maps The JavaScript Package Selection Task: A Comparative Experiment Using an LLM-based Approach
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1