Mok Win Soon, Muhammad Ikmal Hanafi Anuar, Mohamad Hafizat Zainal Abidin, Ahmad Syukri Azaman, N. Noor
{"title":"基于面部肌电信号的语音识别","authors":"Mok Win Soon, Muhammad Ikmal Hanafi Anuar, Mohamad Hafizat Zainal Abidin, Ahmad Syukri Azaman, N. Noor","doi":"10.1109/ICSIPA.2017.8120569","DOIUrl":null,"url":null,"abstract":"This paper presents a study of speech recognition based on electromyographic biosignals captured from the articulatory muscles in the face using surface electrodes. This paper compares the speech recognition system for spoken English and Malay words by a group of Malay native speakers. Feature extraction was done in both temporal and time-frequency domains. Temporal features used are integrated EMG (IEMG), mean absolute value (MAV), root mean square (RMS), variance (VAR), standard deviation (SD), and simple square integral (SSI) where time-frequency domain features were obtained using discrete wavelet transform. For classification, random forest classifier and ANNs multilayer perceptron both gave the overall best performance on using temporal features and time-frequency features respectively. The result of the classification shows that the Malay language is can be used in sEMG speech recognition.","PeriodicalId":268112,"journal":{"name":"2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":"{\"title\":\"Speech recognition using facial sEMG\",\"authors\":\"Mok Win Soon, Muhammad Ikmal Hanafi Anuar, Mohamad Hafizat Zainal Abidin, Ahmad Syukri Azaman, N. Noor\",\"doi\":\"10.1109/ICSIPA.2017.8120569\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents a study of speech recognition based on electromyographic biosignals captured from the articulatory muscles in the face using surface electrodes. This paper compares the speech recognition system for spoken English and Malay words by a group of Malay native speakers. Feature extraction was done in both temporal and time-frequency domains. Temporal features used are integrated EMG (IEMG), mean absolute value (MAV), root mean square (RMS), variance (VAR), standard deviation (SD), and simple square integral (SSI) where time-frequency domain features were obtained using discrete wavelet transform. For classification, random forest classifier and ANNs multilayer perceptron both gave the overall best performance on using temporal features and time-frequency features respectively. The result of the classification shows that the Malay language is can be used in sEMG speech recognition.\",\"PeriodicalId\":268112,\"journal\":{\"name\":\"2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)\",\"volume\":\"41 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"1900-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"11\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSIPA.2017.8120569\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSIPA.2017.8120569","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
This paper presents a study of speech recognition based on electromyographic biosignals captured from the articulatory muscles in the face using surface electrodes. This paper compares the speech recognition system for spoken English and Malay words by a group of Malay native speakers. Feature extraction was done in both temporal and time-frequency domains. Temporal features used are integrated EMG (IEMG), mean absolute value (MAV), root mean square (RMS), variance (VAR), standard deviation (SD), and simple square integral (SSI) where time-frequency domain features were obtained using discrete wavelet transform. For classification, random forest classifier and ANNs multilayer perceptron both gave the overall best performance on using temporal features and time-frequency features respectively. The result of the classification shows that the Malay language is can be used in sEMG speech recognition.