Sign Language to Voice Translator Using Tensorflow and TTS Algorithm

G. K, Akkash. C, Sagaya Selvaraj. A, Arockiya Rayal Ruffus. M, Cesario De Cruz. E
{"title":"Sign Language to Voice Translator Using Tensorflow and TTS Algorithm","authors":"G. K, Akkash. C, Sagaya Selvaraj. A, Arockiya Rayal Ruffus. M, Cesario De Cruz. E","doi":"10.1109/ICMNWC52512.2021.9688545","DOIUrl":null,"url":null,"abstract":"In this system, it helps to convert the sign language to voice with hand gestures understanding and capture the motion of hands. Many sign languages are natural languages, but they are differing in construction from oral languages used in proximity to them, and are employed mainly by deaf people in order to communicate. It is based on a Raspberry Pi with a camera module and is programmed in Python with the Open-Source Computer Vision (Open CV) library as a backend. A built-in image processing algorithm on the Raspberry Pi is named gesture that tracks an object (a finger) with features pulled out. The main purpose of a gesture recognition system is to establish a connection between a human and a computer control system. Camera is used in this system and it captures the various gestures of hands. Various algorithms are taking place in processing of image. First preprocessing of the image takes place. Finally, the sign is identified by using Tensor flow algorithm and the outcome result as a voice using TTS algorithm. Open CV Python is implemented in this system. Various libraries are used in this system.","PeriodicalId":186283,"journal":{"name":"2021 IEEE International Conference on Mobile Networks and Wireless Communications (ICMNWC)","volume":"64 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Mobile Networks and Wireless Communications (ICMNWC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMNWC52512.2021.9688545","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In this system, it helps to convert the sign language to voice with hand gestures understanding and capture the motion of hands. Many sign languages are natural languages, but they are differing in construction from oral languages used in proximity to them, and are employed mainly by deaf people in order to communicate. It is based on a Raspberry Pi with a camera module and is programmed in Python with the Open-Source Computer Vision (Open CV) library as a backend. A built-in image processing algorithm on the Raspberry Pi is named gesture that tracks an object (a finger) with features pulled out. The main purpose of a gesture recognition system is to establish a connection between a human and a computer control system. Camera is used in this system and it captures the various gestures of hands. Various algorithms are taking place in processing of image. First preprocessing of the image takes place. Finally, the sign is identified by using Tensor flow algorithm and the outcome result as a voice using TTS algorithm. Open CV Python is implemented in this system. Various libraries are used in this system.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于Tensorflow和TTS算法的手语语音翻译
在这个系统中,它有助于将手语转换为语音,手势理解和捕捉手的动作。许多手语都是自然语言,但它们在结构上与附近使用的口语不同,主要是聋哑人用来交流的。它基于带有摄像头模块的树莓派,并使用Python编程,使用开源计算机视觉(Open CV)库作为后端。树莓派上的内置图像处理算法被命名为gesture,它可以跟踪物体(手指)的特征。手势识别系统的主要目的是建立人与计算机控制系统之间的联系。在这个系统中使用了摄像头,它可以捕捉到各种手势。在图像处理中出现了各种各样的算法。首先对图像进行预处理。最后,使用张量流算法对符号进行识别,并使用TTS算法将结果作为语音。本系统实现了Open CV Python。本系统使用了多种库。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Off-Board Li-Ion Battery Fast Charger with Two-Stage Bidirectional Converter for Electric Vehicles Approaches Towards A Recommendation Engine For Life Insurance Products Design of Quad-Band Antenna of 3.8 GHz range for Wi-Max Applications AGROIoT - IoT Assisted Farming Fusion of Brain MR Images for Tumor Analysis using Bi-Level Stationary Wavelet Transform
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1