Effectiveness evaluation of word characteristics obtained from 3D image information for lipreading

Proceedings 11th International Conference on Image Analysis and Processing Pub Date : 2001-09-26 DOI:10.1109/ICIAP.2001.957025

Koji Uda, N. Tagawa, A. Minagawa, T. Moriya

{"title":"Effectiveness evaluation of word characteristics obtained from 3D image information for lipreading","authors":"Koji Uda, N. Tagawa, A. Minagawa, T. Moriya","doi":"10.1109/ICIAP.2001.957025","DOIUrl":null,"url":null,"abstract":"Speech recognition using image information is worthy of remark as one of the next generation of man machine interfaces (MMIs). Several methods that use either voice information or voice information and image information for recognizing words, context and speech have been proposed. Compared to methods that use only voice information, the benefit of using image information is that it is not affected by unwanted sound noise, and so it is applicable in several different environments. However, in general, several constraints are required to capture an image, for example, camera position and the relationship between camera and face. We investigated the effectiveness of using three-dimensional image information for word recognition and found that these constraints are removed. To confirm the effectiveness of the proposed method, the characteristics of two- and three-dimensional images were compared. The results of the word recognition experiment show that the recognition rate for three-dimensional characteristics is higher than that for two-dimensional characteristics.","PeriodicalId":365627,"journal":{"name":"Proceedings 11th International Conference on Image Analysis and Processing","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2001-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings 11th International Conference on Image Analysis and Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIAP.2001.957025","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 3

Abstract

Speech recognition using image information is worthy of remark as one of the next generation of man machine interfaces (MMIs). Several methods that use either voice information or voice information and image information for recognizing words, context and speech have been proposed. Compared to methods that use only voice information, the benefit of using image information is that it is not affected by unwanted sound noise, and so it is applicable in several different environments. However, in general, several constraints are required to capture an image, for example, camera position and the relationship between camera and face. We investigated the effectiveness of using three-dimensional image information for word recognition and found that these constraints are removed. To confirm the effectiveness of the proposed method, the characteristics of two- and three-dimensional images were compared. The results of the word recognition experiment show that the recognition rate for three-dimensional characteristics is higher than that for two-dimensional characteristics.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

三维图像信息获取的词特征在唇读中的有效性评价

基于图像信息的语音识别作为下一代人机界面之一，值得关注。人们提出了几种利用语音信息或语音信息和图像信息来识别单词、上下文和语音的方法。与仅使用语音信息的方法相比，使用图像信息的好处是它不受不必要的声音噪声的影响，因此它适用于几种不同的环境。然而，通常情况下，需要几个约束条件来捕获图像，例如，相机的位置和相机与人脸之间的关系。我们研究了使用三维图像信息进行单词识别的有效性，发现这些限制被消除了。为了验证该方法的有效性，对比了二维和三维图像的特征。单词识别实验结果表明，三维特征的识别率高于二维特征的识别率。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Proceedings 11th International Conference on Image Analysis and Processing

自引率

0.00%

发文量