Maryne Febvre, Jonathan Rodriguez, Simon Chesne, Manuel Collet
{"title":"用于调整智能压电梁主动振动控制的深度强化学习","authors":"Maryne Febvre, Jonathan Rodriguez, Simon Chesne, Manuel Collet","doi":"10.1177/1045389x241260976","DOIUrl":null,"url":null,"abstract":"Piezoelectric transducers are used within smart structures to create functions such as energy harvesting, wave propagation or vibration control to prevent human discomfort, material fatigue, and instability. The design of the structure becomes more complex with shape optimization and the integration of multiple transducers. Most active vibration control strategies require the tuning of multiple parameters. In addition, the optimization of control methods has to consider experimental uncertainties and the global effect of local actuation. This paper presents the use of a Deep Reinforcement Learning (DRL) algorithm to tune a pseudo lead-lag controller on an experimental smart cantilever beam. The algorithm is trained to maximize a reward function that represents the objective of vibration mitigation. An experimental model is estimated from measurements to accelerate the DRL’s interaction with the environment. The paper compares DRL tuning strategies with [Formula: see text] and [Formula: see text] norm minimization approaches. It demonstrates the efficiency of DRL tuning by comparing the control performance of the different tuning methods on the model and experimental setup.","PeriodicalId":16121,"journal":{"name":"Journal of Intelligent Material Systems and Structures","volume":null,"pages":null},"PeriodicalIF":2.4000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning for tuning active vibration control on a smart piezoelectric beam\",\"authors\":\"Maryne Febvre, Jonathan Rodriguez, Simon Chesne, Manuel Collet\",\"doi\":\"10.1177/1045389x241260976\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Piezoelectric transducers are used within smart structures to create functions such as energy harvesting, wave propagation or vibration control to prevent human discomfort, material fatigue, and instability. The design of the structure becomes more complex with shape optimization and the integration of multiple transducers. Most active vibration control strategies require the tuning of multiple parameters. In addition, the optimization of control methods has to consider experimental uncertainties and the global effect of local actuation. This paper presents the use of a Deep Reinforcement Learning (DRL) algorithm to tune a pseudo lead-lag controller on an experimental smart cantilever beam. The algorithm is trained to maximize a reward function that represents the objective of vibration mitigation. An experimental model is estimated from measurements to accelerate the DRL’s interaction with the environment. The paper compares DRL tuning strategies with [Formula: see text] and [Formula: see text] norm minimization approaches. It demonstrates the efficiency of DRL tuning by comparing the control performance of the different tuning methods on the model and experimental setup.\",\"PeriodicalId\":16121,\"journal\":{\"name\":\"Journal of Intelligent Material Systems and Structures\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2024-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Intelligent Material Systems and Structures\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://doi.org/10.1177/1045389x241260976\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Material Systems and Structures","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1177/1045389x241260976","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
Deep reinforcement learning for tuning active vibration control on a smart piezoelectric beam
Piezoelectric transducers are used within smart structures to create functions such as energy harvesting, wave propagation or vibration control to prevent human discomfort, material fatigue, and instability. The design of the structure becomes more complex with shape optimization and the integration of multiple transducers. Most active vibration control strategies require the tuning of multiple parameters. In addition, the optimization of control methods has to consider experimental uncertainties and the global effect of local actuation. This paper presents the use of a Deep Reinforcement Learning (DRL) algorithm to tune a pseudo lead-lag controller on an experimental smart cantilever beam. The algorithm is trained to maximize a reward function that represents the objective of vibration mitigation. An experimental model is estimated from measurements to accelerate the DRL’s interaction with the environment. The paper compares DRL tuning strategies with [Formula: see text] and [Formula: see text] norm minimization approaches. It demonstrates the efficiency of DRL tuning by comparing the control performance of the different tuning methods on the model and experimental setup.
期刊介绍:
The Journal of Intelligent Materials Systems and Structures is an international peer-reviewed journal that publishes the highest quality original research reporting the results of experimental or theoretical work on any aspect of intelligent materials systems and/or structures research also called smart structure, smart materials, active materials, adaptive structures and adaptive materials.