{"title":"Intelligent speech elderly rehabilitation learning assistance system based on deep learning and sensor networks","authors":"Liang Lai , Zhou Gaohua","doi":"10.1016/j.measen.2024.101191","DOIUrl":null,"url":null,"abstract":"<div><p>Recently, deep learning has been proved to significantly improve the quality of speech recognition. Convolutional neural networks are often used in speech recognition tasks because of their special network structure and powerful learning function. In order to solve the problem that the traditional convolutional neural network can not reflect the one-dimensional basic attributes of speech signal, this paper proposes to set the number of frames for one dimension of convolution kernel, and use one-dimensional model and two-dimensional convolutional network model for speech recognition. By moving the convolution kernel of time axis and frequency band, it can adapt to the time change of speech signal and maintain the correlation between frequency bands to a great extent. At the same time, this paper also discusses the speech signal preprocessing, feature parameter extraction and regularization algorithm. Due to the lack of hospital resources, the lag of information technology, the poor ability of accompanying and other reasons, the current accompanying service for elderly rehabilitation can not meet the needs of elderly patients. The rapid development and wide use of information technology provide opportunities for the optimization of health services for the elderly. In view of the difficulty of word memory and interpretation in current rehabilitation courses, a VR intelligent teaching system based on intelligent voice technology is developed. The application results show that the system can effectively improve the ability of language expression and word writing. At present, the system of intelligent speech function has not been completed, and lacks speech synthesis function. The next research will focus on the use of speech synthesis technology, in order to realize the man-machine dialogue between people and the system, and show a more real training situation.</p></div>","PeriodicalId":34311,"journal":{"name":"Measurement Sensors","volume":"33 ","pages":"Article 101191"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2665917424001673/pdfft?md5=e608eabd2944e0fd34f5dd5731cf3b19&pid=1-s2.0-S2665917424001673-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement Sensors","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2665917424001673","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
Abstract
Recently, deep learning has been proved to significantly improve the quality of speech recognition. Convolutional neural networks are often used in speech recognition tasks because of their special network structure and powerful learning function. In order to solve the problem that the traditional convolutional neural network can not reflect the one-dimensional basic attributes of speech signal, this paper proposes to set the number of frames for one dimension of convolution kernel, and use one-dimensional model and two-dimensional convolutional network model for speech recognition. By moving the convolution kernel of time axis and frequency band, it can adapt to the time change of speech signal and maintain the correlation between frequency bands to a great extent. At the same time, this paper also discusses the speech signal preprocessing, feature parameter extraction and regularization algorithm. Due to the lack of hospital resources, the lag of information technology, the poor ability of accompanying and other reasons, the current accompanying service for elderly rehabilitation can not meet the needs of elderly patients. The rapid development and wide use of information technology provide opportunities for the optimization of health services for the elderly. In view of the difficulty of word memory and interpretation in current rehabilitation courses, a VR intelligent teaching system based on intelligent voice technology is developed. The application results show that the system can effectively improve the ability of language expression and word writing. At present, the system of intelligent speech function has not been completed, and lacks speech synthesis function. The next research will focus on the use of speech synthesis technology, in order to realize the man-machine dialogue between people and the system, and show a more real training situation.