{"title":"Deep Reinforcement Learning Control to Maximize Output Energy for a Wave Energy Converter","authors":"Jun Umeda, T. Fujiwara","doi":"10.2534/jjasnaoe.31.229","DOIUrl":null,"url":null,"abstract":"This paper presents a deep reinforcement learning control method to maximize output energy for a point absorber type wave energy converter (WEC) with a linear generator. Conventional control methods require the dynamic model of the WEC. Modeling errors of the dynamic model, however, make energy absorption smaller and cause incorrect control. The proposed method, which is a model- free control method learns the optimal damping and stiffness coefficients based on experiences. In the proposed control method, damping and stiffness coefficients are able to vary in time-domain depending on the incident waves by deep reinforcement learning. The performance of the proposed control method is investigated through numerical simulation in both regular and irregular waves. Compared with the conventional control method, averaged output power increased, and the power fluctuation decreased without the dynamic model. It is understood that the proposed method is more effective than the conventional control method.","PeriodicalId":192323,"journal":{"name":"Journal of the Japan Society of Naval Architects and Ocean Engineers","volume":"62 3","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Japan Society of Naval Architects and Ocean Engineers","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2534/jjasnaoe.31.229","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
This paper presents a deep reinforcement learning control method to maximize output energy for a point absorber type wave energy converter (WEC) with a linear generator. Conventional control methods require the dynamic model of the WEC. Modeling errors of the dynamic model, however, make energy absorption smaller and cause incorrect control. The proposed method, which is a model- free control method learns the optimal damping and stiffness coefficients based on experiences. In the proposed control method, damping and stiffness coefficients are able to vary in time-domain depending on the incident waves by deep reinforcement learning. The performance of the proposed control method is investigated through numerical simulation in both regular and irregular waves. Compared with the conventional control method, averaged output power increased, and the power fluctuation decreased without the dynamic model. It is understood that the proposed method is more effective than the conventional control method.