{"title":"基于多通道特征尺度卷积神经网络的复杂表面肌电信号手势识别","authors":"Tie Liu;Dianchun Bai;Le Ma;Qiang Du;Hiroshi Yokoi","doi":"10.1109/TIM.2024.3485448","DOIUrl":null,"url":null,"abstract":"Surface electromyography-based gesture recognition and prosthetic hand control using deep learning (DL) have become increasingly significant in the field of human-computer interaction. This study aims to enhance the control of prosthetic hands driven by complex gestures, addressing the challenge of low-resolution gesture differentiation caused by the coupling and superposition of surface electromyography signals in DL models. We propose a DL-based framework for the recognition of complex surface electromyography signals, utilizing a multipathway approach to acquire raw surface electromyography signals, process them in the time-frequency domain, and extract features using multiscale convolutional networks. The processed surface electromyography features are then analyzed in parallel to enhance accuracy. This method effectively processes multiple signals concurrently and extracts diverse feature sets. By collecting data from six channels, it achieves an 88.56% recognition rate for 16 complex hand gestures, enabling control of ten distinct prosthetic hand movements. By leveraging multidimensional continuous surface electromyography images, we have developed a feature model that resolves the issues of signal coupling and superposition in multichannel surface electromyography data, allowing for precise control of prosthetic hand movements.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Complex Surface Electromyography Signal Gesture Recognition Based on Multipathway Featured Scale Convolutional Neural Network\",\"authors\":\"Tie Liu;Dianchun Bai;Le Ma;Qiang Du;Hiroshi Yokoi\",\"doi\":\"10.1109/TIM.2024.3485448\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Surface electromyography-based gesture recognition and prosthetic hand control using deep learning (DL) have become increasingly significant in the field of human-computer interaction. This study aims to enhance the control of prosthetic hands driven by complex gestures, addressing the challenge of low-resolution gesture differentiation caused by the coupling and superposition of surface electromyography signals in DL models. We propose a DL-based framework for the recognition of complex surface electromyography signals, utilizing a multipathway approach to acquire raw surface electromyography signals, process them in the time-frequency domain, and extract features using multiscale convolutional networks. The processed surface electromyography features are then analyzed in parallel to enhance accuracy. This method effectively processes multiple signals concurrently and extracts diverse feature sets. By collecting data from six channels, it achieves an 88.56% recognition rate for 16 complex hand gestures, enabling control of ten distinct prosthetic hand movements. By leveraging multidimensional continuous surface electromyography images, we have developed a feature model that resolves the issues of signal coupling and superposition in multichannel surface electromyography data, allowing for precise control of prosthetic hand movements.\",\"PeriodicalId\":13341,\"journal\":{\"name\":\"IEEE Transactions on Instrumentation and Measurement\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2024-10-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Instrumentation and Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10731914/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10731914/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Complex Surface Electromyography Signal Gesture Recognition Based on Multipathway Featured Scale Convolutional Neural Network
Surface electromyography-based gesture recognition and prosthetic hand control using deep learning (DL) have become increasingly significant in the field of human-computer interaction. This study aims to enhance the control of prosthetic hands driven by complex gestures, addressing the challenge of low-resolution gesture differentiation caused by the coupling and superposition of surface electromyography signals in DL models. We propose a DL-based framework for the recognition of complex surface electromyography signals, utilizing a multipathway approach to acquire raw surface electromyography signals, process them in the time-frequency domain, and extract features using multiscale convolutional networks. The processed surface electromyography features are then analyzed in parallel to enhance accuracy. This method effectively processes multiple signals concurrently and extracts diverse feature sets. By collecting data from six channels, it achieves an 88.56% recognition rate for 16 complex hand gestures, enabling control of ten distinct prosthetic hand movements. By leveraging multidimensional continuous surface electromyography images, we have developed a feature model that resolves the issues of signal coupling and superposition in multichannel surface electromyography data, allowing for precise control of prosthetic hand movements.
期刊介绍:
Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.