{"title":"A Novel Dual-Model Adaptive Continuous Learning Strategy for Wrist-sEMG Real-Time Gesture Recognition","authors":"Yuehan Liu;Ruxin Wang;Ye Li;Yishan Wang","doi":"10.1109/TNSRE.2024.3502624","DOIUrl":null,"url":null,"abstract":"Surface electromyography (sEMG) is a promising technology for hand gesture recognition, yet faces challenges in user mobility and individual calibration. This paper introduces a novel dual-model adaptive continuous learning (DM-ACL) strategy for wrist-based sEMG real-time gesture recognition. The core of the DM-ACL strategy is a semi-supervised online learning algorithm that uses the kNN model to provide auxiliary labels for real-time sEMG signals, enhancing the robustness and adaptability of the deep learning model. Experimental results show that the DM-ACL strategy outperforms conventional transfer learning (TL) methods. Using the CNN-LSTM model as the baseline, the DM-ACL method achieved a recognition accuracy of 95.33% with an average of 33.6 s of sEMG data per gesture, while the conventional TL method attained an accuracy of 82.82%. With the CNN model as the baseline, the DM-ACL method achieved a recognition accuracy of 92.37% with an average of 48 s of sEMG data per gesture, while the conventional TL method attained an accuracy of 84.59%. The DM-ACL strategy efficiently improves performance for new users and maintains high accuracy across sessions, even in the presence of inter-session domain shifts. This enhances the practical usability of sEMG-based gesture recognition systems, particularly in real-time applications.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"32 ","pages":"4186-4196"},"PeriodicalIF":4.8000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10758785","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10758785/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Surface electromyography (sEMG) is a promising technology for hand gesture recognition, yet faces challenges in user mobility and individual calibration. This paper introduces a novel dual-model adaptive continuous learning (DM-ACL) strategy for wrist-based sEMG real-time gesture recognition. The core of the DM-ACL strategy is a semi-supervised online learning algorithm that uses the kNN model to provide auxiliary labels for real-time sEMG signals, enhancing the robustness and adaptability of the deep learning model. Experimental results show that the DM-ACL strategy outperforms conventional transfer learning (TL) methods. Using the CNN-LSTM model as the baseline, the DM-ACL method achieved a recognition accuracy of 95.33% with an average of 33.6 s of sEMG data per gesture, while the conventional TL method attained an accuracy of 82.82%. With the CNN model as the baseline, the DM-ACL method achieved a recognition accuracy of 92.37% with an average of 48 s of sEMG data per gesture, while the conventional TL method attained an accuracy of 84.59%. The DM-ACL strategy efficiently improves performance for new users and maintains high accuracy across sessions, even in the presence of inter-session domain shifts. This enhances the practical usability of sEMG-based gesture recognition systems, particularly in real-time applications.
期刊介绍:
Rehabilitative and neural aspects of biomedical engineering, including functional electrical stimulation, acoustic dynamics, human performance measurement and analysis, nerve stimulation, electromyography, motor control and stimulation; and hardware and software applications for rehabilitation engineering and assistive devices.