{"title":"基于机器学习技术的聋人语音手语翻译研究","authors":"P. K, D. S, D. R, Gomathi M, Dharshan K, D. M","doi":"10.1109/STCR55312.2022.10009341","DOIUrl":null,"url":null,"abstract":"The language of the hearing impaired people is a visual language. It has to transmit sound patterns in the form of signs. A person’s thoughts are expressed by hand signals and facial expressions. Deaf people normally get struggle by making conversation with normal people; The languages will be different for the various group of deaf people all over the world as well. Our project is to guide the hearing deaf or speech defected persons made communicating with normal persons. It automatically translates the speech in English into Indian sign language. It is the sign-language translating system. For the communication between the normal person and the impaired persons, it could be used as a translator for their natural way of speaking. It’s helpful for people who didn't understand sign language, the sign language gestures are emojis. Our proposed model brings the accuracy improvement by 10% compare to existing models of CNN based classification and SVM_HMM models. FPV and PPV improved by 23.52 % and 37.34 %.","PeriodicalId":338691,"journal":{"name":"2022 Smart Technologies, Communication and Robotics (STCR)","volume":"162 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Investigation on Speech to Sign Language Translator for Hearing Impaired (SSLT) using Machine Learning Techniques\",\"authors\":\"P. K, D. S, D. R, Gomathi M, Dharshan K, D. M\",\"doi\":\"10.1109/STCR55312.2022.10009341\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The language of the hearing impaired people is a visual language. It has to transmit sound patterns in the form of signs. A person’s thoughts are expressed by hand signals and facial expressions. Deaf people normally get struggle by making conversation with normal people; The languages will be different for the various group of deaf people all over the world as well. Our project is to guide the hearing deaf or speech defected persons made communicating with normal persons. It automatically translates the speech in English into Indian sign language. It is the sign-language translating system. For the communication between the normal person and the impaired persons, it could be used as a translator for their natural way of speaking. It’s helpful for people who didn't understand sign language, the sign language gestures are emojis. Our proposed model brings the accuracy improvement by 10% compare to existing models of CNN based classification and SVM_HMM models. FPV and PPV improved by 23.52 % and 37.34 %.\",\"PeriodicalId\":338691,\"journal\":{\"name\":\"2022 Smart Technologies, Communication and Robotics (STCR)\",\"volume\":\"162 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 Smart Technologies, Communication and Robotics (STCR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/STCR55312.2022.10009341\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 Smart Technologies, Communication and Robotics (STCR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/STCR55312.2022.10009341","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An Investigation on Speech to Sign Language Translator for Hearing Impaired (SSLT) using Machine Learning Techniques
The language of the hearing impaired people is a visual language. It has to transmit sound patterns in the form of signs. A person’s thoughts are expressed by hand signals and facial expressions. Deaf people normally get struggle by making conversation with normal people; The languages will be different for the various group of deaf people all over the world as well. Our project is to guide the hearing deaf or speech defected persons made communicating with normal persons. It automatically translates the speech in English into Indian sign language. It is the sign-language translating system. For the communication between the normal person and the impaired persons, it could be used as a translator for their natural way of speaking. It’s helpful for people who didn't understand sign language, the sign language gestures are emojis. Our proposed model brings the accuracy improvement by 10% compare to existing models of CNN based classification and SVM_HMM models. FPV and PPV improved by 23.52 % and 37.34 %.