Tian Lan;Jun Song;Zhiwei Hou;Kang Chen;Shuping He;Hai Wang;Jason J. R. Liu
{"title":"Event-Triggered Fixed-Time Sliding Mode Control for Lip-Reading-Driven UAV: Disturbance Rejection Using Wind Field Optimization","authors":"Tian Lan;Jun Song;Zhiwei Hou;Kang Chen;Shuping He;Hai Wang;Jason J. R. Liu","doi":"10.1109/TASE.2024.3496939","DOIUrl":null,"url":null,"abstract":"This paper investigates the fixed-time sliding mode control (FTSMC) problem for a quadcopter unmanned aerial vehicle (QUAV), which is driven by a lip-reading recognition module. The lip-reading recognition module is consisted of a trained deep neural network with the structure of 2D-Conv+GhostNet+TCN. In order to reduce the communication burden between the remote controller and the QUAV as well as reduce the computation burden in running the lip-reading recognition module, the event-triggered mechanism is introduced to the position controller design. The low-bound of the triggering interval is derived explicitly so that the Zeno phenomenon can be excluded. Furthermore, in order to overcome the main obstacle in high-accuracy control of QUAV, this paper launches a novel wind disturbance rejection approach by using wind field model, which is motivated by the physical dynamic characteristics of the practical wind. Specifically, the wind disturbance is estimated in the designed FTSMC by applying a specific wind field equation with preassigned physical parameters. To further reduce the chattering in the controller, a fitting technique is introduced via a local multivariate linear regression. Finally, both simulation and human-in-the-loop experiment results verify the applicability of the proposed control approach for the lip-reading-driven QUAV system. Note to Practitioners—This research is motivated by the need to design lip-reading-driven QUAV. In noisy environments or when silence is required, the efficiency of traditional human-computer interaction methods such as speech recognition is greatly reduced. Especially for people with damaged vocal cords, speech recognition is not achievable. In addition, it is difficulty to realize high-precision anti-interference control of QUAV with lower computational and communication burdens. In order to solve these problems, this research designs a lip-reading recognition module for QUAV control to cope with various complex application scenarios and realizes high-performance control by FTSMC algorithm. The key of this work to save system resources is to introduce the event-triggered mechanism into the position controller of the QUAV. In addition, this paper introduces the wind field model into the QUAV model to realize the wind disturbance suppression. The lip-reading-driven QUAV proposed in this paper have a wide range of applications, such as controlling QUAV in hazardous environments and improving the efficiency of interaction between human and QUAV.","PeriodicalId":51060,"journal":{"name":"IEEE Transactions on Automation Science and Engineering","volume":"22 ","pages":"9090-9103"},"PeriodicalIF":6.4000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automation Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10758337/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper investigates the fixed-time sliding mode control (FTSMC) problem for a quadcopter unmanned aerial vehicle (QUAV), which is driven by a lip-reading recognition module. The lip-reading recognition module is consisted of a trained deep neural network with the structure of 2D-Conv+GhostNet+TCN. In order to reduce the communication burden between the remote controller and the QUAV as well as reduce the computation burden in running the lip-reading recognition module, the event-triggered mechanism is introduced to the position controller design. The low-bound of the triggering interval is derived explicitly so that the Zeno phenomenon can be excluded. Furthermore, in order to overcome the main obstacle in high-accuracy control of QUAV, this paper launches a novel wind disturbance rejection approach by using wind field model, which is motivated by the physical dynamic characteristics of the practical wind. Specifically, the wind disturbance is estimated in the designed FTSMC by applying a specific wind field equation with preassigned physical parameters. To further reduce the chattering in the controller, a fitting technique is introduced via a local multivariate linear regression. Finally, both simulation and human-in-the-loop experiment results verify the applicability of the proposed control approach for the lip-reading-driven QUAV system. Note to Practitioners—This research is motivated by the need to design lip-reading-driven QUAV. In noisy environments or when silence is required, the efficiency of traditional human-computer interaction methods such as speech recognition is greatly reduced. Especially for people with damaged vocal cords, speech recognition is not achievable. In addition, it is difficulty to realize high-precision anti-interference control of QUAV with lower computational and communication burdens. In order to solve these problems, this research designs a lip-reading recognition module for QUAV control to cope with various complex application scenarios and realizes high-performance control by FTSMC algorithm. The key of this work to save system resources is to introduce the event-triggered mechanism into the position controller of the QUAV. In addition, this paper introduces the wind field model into the QUAV model to realize the wind disturbance suppression. The lip-reading-driven QUAV proposed in this paper have a wide range of applications, such as controlling QUAV in hazardous environments and improving the efficiency of interaction between human and QUAV.
期刊介绍:
The IEEE Transactions on Automation Science and Engineering (T-ASE) publishes fundamental papers on Automation, emphasizing scientific results that advance efficiency, quality, productivity, and reliability. T-ASE encourages interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, operations research, and other fields. T-ASE welcomes results relevant to industries such as agriculture, biotechnology, healthcare, home automation, maintenance, manufacturing, pharmaceuticals, retail, security, service, supply chains, and transportation. T-ASE addresses a research community willing to integrate knowledge across disciplines and industries. For this purpose, each paper includes a Note to Practitioners that summarizes how its results can be applied or how they might be extended to apply in practice.