Hand Exoskeleton Development Based on Voice Recognition Using Embedded Machine Learning on Raspberry Pi

Abstract

The choice of using speech to control the exoskeleton is based on the number of exoskeletons that are controlled using the EMG signal, where the EMG signal itself has the weakness of the complexity of the signal which is influenced by the position of the electrodes, as well as muscle fatigue. The purpose of this research is to develop an exoskeleton device using voice control based on embedded machine learning on a Raspberry Pi minicomputer. In this study, two feature extraction types namely mel-frequency cepstral coefficient (MFCC) and zero-crossing (ZC), and two machine learning algorithms, namely K-nearest Neighbor (K-NN) and Decision Tree (DT) were evaluated. The hand exoskeleton development consists of 3D hand design, microphone, Raspberry Pi 4B+, PCA9685 servo driver, and servo motor. Microphone was used to record voice commands given. After model evaluation, it was found that the MFCC extraction combined with the K-NN algorithm and the best accuracy (96±7.0%). In the implementation, we found that the accuracy is 79±14.46% and 90±14.14% for open and close commands.