利用深度强化学习为混合电动太阳能飞艇提取平流层风场特征并进行能量管理

IF 7.1 2区 工程技术 Q1 ENERGY & FUELS Sustainable Energy Technologies and Assessments Pub Date : 2024-09-19 DOI:10.1016/j.seta.2024.103993
Yang Liu, Kangwen Sun, Mingyun Lv
{"title":"利用深度强化学习为混合电动太阳能飞艇提取平流层风场特征并进行能量管理","authors":"Yang Liu,&nbsp;Kangwen Sun,&nbsp;Mingyun Lv","doi":"10.1016/j.seta.2024.103993","DOIUrl":null,"url":null,"abstract":"<div><p>Sufficient energy is demonstrated overwhelming superiority in both vehicles and aircrafts. Limited by the energy density, energy storage represented by Lithium-ion battery cannot meet the increasing energy requirements of diverse payloads on solar-powered stratospheric airship for months or years. In this paper, the hybrid fuel cell/battery system for stratospheric airship is presented. The relationship between the real wind field and the demand power is illustrated. Based on the reanalysis of historical wind data, the probabilistic model of demand propulsion power is established and integrated with the training environment. The deep reinforcement learning method is adopted to solve the energy management problem. The prioritized experience replay with extra identifier, which encourages the utilization of high-value samples without identifier, is proposed. Comparative analysis shows the proposed method is effective in determining the management strategy with promising convergence speed. The results demonstrate that changing the SOC reference of the proposed method from 0.4 to 0.7 can result in 5.9% increment in energy consumption. Furthermore, the potential decline of regulation capability of the hybrid system and the corresponding influence on the nighttime energy balance is investigated. The proposed method has reference value for advance alarm of power supply failure during long term flight.</p></div>","PeriodicalId":56019,"journal":{"name":"Sustainable Energy Technologies and Assessments","volume":"71 ","pages":"Article 103993"},"PeriodicalIF":7.1000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Stratospheric wind field feature extraction and energy management for hybrid electric solar airship with deep reinforcement learning\",\"authors\":\"Yang Liu,&nbsp;Kangwen Sun,&nbsp;Mingyun Lv\",\"doi\":\"10.1016/j.seta.2024.103993\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Sufficient energy is demonstrated overwhelming superiority in both vehicles and aircrafts. Limited by the energy density, energy storage represented by Lithium-ion battery cannot meet the increasing energy requirements of diverse payloads on solar-powered stratospheric airship for months or years. In this paper, the hybrid fuel cell/battery system for stratospheric airship is presented. The relationship between the real wind field and the demand power is illustrated. Based on the reanalysis of historical wind data, the probabilistic model of demand propulsion power is established and integrated with the training environment. The deep reinforcement learning method is adopted to solve the energy management problem. The prioritized experience replay with extra identifier, which encourages the utilization of high-value samples without identifier, is proposed. Comparative analysis shows the proposed method is effective in determining the management strategy with promising convergence speed. The results demonstrate that changing the SOC reference of the proposed method from 0.4 to 0.7 can result in 5.9% increment in energy consumption. Furthermore, the potential decline of regulation capability of the hybrid system and the corresponding influence on the nighttime energy balance is investigated. The proposed method has reference value for advance alarm of power supply failure during long term flight.</p></div>\",\"PeriodicalId\":56019,\"journal\":{\"name\":\"Sustainable Energy Technologies and Assessments\",\"volume\":\"71 \",\"pages\":\"Article 103993\"},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-09-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Sustainable Energy Technologies and Assessments\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2213138824003898\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sustainable Energy Technologies and Assessments","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213138824003898","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

充足的能量在车辆和飞机上都显示出压倒性的优势。受能量密度的限制,以锂离子电池为代表的能量存储无法满足太阳能平流层飞艇上各种有效载荷在数月或数年内不断增长的能量需求。本文介绍了用于平流层飞艇的燃料电池/电池混合系统。本文阐述了实际风场与需求功率之间的关系。基于对历史风力数据的再分析,建立了需求推进功率的概率模型,并与训练环境相结合。采用深度强化学习方法解决能量管理问题。提出了带有额外标识符的优先经验重放,鼓励利用无标识符的高价值样本。对比分析表明,所提方法能有效确定管理策略,且收敛速度快。结果表明,将所提方法的 SOC 参考值从 0.4 改为 0.7 可使能耗增加 5.9%。此外,还研究了混合动力系统调节能力的潜在下降及其对夜间能量平衡的相应影响。提出的方法对长期飞行过程中的供电故障提前报警具有参考价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Stratospheric wind field feature extraction and energy management for hybrid electric solar airship with deep reinforcement learning

Sufficient energy is demonstrated overwhelming superiority in both vehicles and aircrafts. Limited by the energy density, energy storage represented by Lithium-ion battery cannot meet the increasing energy requirements of diverse payloads on solar-powered stratospheric airship for months or years. In this paper, the hybrid fuel cell/battery system for stratospheric airship is presented. The relationship between the real wind field and the demand power is illustrated. Based on the reanalysis of historical wind data, the probabilistic model of demand propulsion power is established and integrated with the training environment. The deep reinforcement learning method is adopted to solve the energy management problem. The prioritized experience replay with extra identifier, which encourages the utilization of high-value samples without identifier, is proposed. Comparative analysis shows the proposed method is effective in determining the management strategy with promising convergence speed. The results demonstrate that changing the SOC reference of the proposed method from 0.4 to 0.7 can result in 5.9% increment in energy consumption. Furthermore, the potential decline of regulation capability of the hybrid system and the corresponding influence on the nighttime energy balance is investigated. The proposed method has reference value for advance alarm of power supply failure during long term flight.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Sustainable Energy Technologies and Assessments
Sustainable Energy Technologies and Assessments Energy-Renewable Energy, Sustainability and the Environment
CiteScore
12.70
自引率
12.50%
发文量
1091
期刊介绍: Encouraging a transition to a sustainable energy future is imperative for our world. Technologies that enable this shift in various sectors like transportation, heating, and power systems are of utmost importance. Sustainable Energy Technologies and Assessments welcomes papers focusing on a range of aspects and levels of technological advancements in energy generation and utilization. The aim is to reduce the negative environmental impact associated with energy production and consumption, spanning from laboratory experiments to real-world applications in the commercial sector.
期刊最新文献
Designing an integrative strategy to introduce electric vehicles in the tourism sector in an outermost region of the European Union Advances in smart cities with system integration and energy digitalization technologies: A state-of-the-art review Building-integrated passive and renewable solar technologies: A review from 3E perspectives Ceramic Air-to-Air Recuperator for energy recovery in HVAC systems: CFD analysis and comparison with experimental tests Day-ahead energy management in green microgrids: Impact of long-term scheduling of hydrogen storage systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1