Odia音译引擎使用moses

R. Balabantaray, Deepak Sahoo
{"title":"Odia音译引擎使用moses","authors":"R. Balabantaray, Deepak Sahoo","doi":"10.1109/ICBIM.2014.6970927","DOIUrl":null,"url":null,"abstract":"Transliteration is an important Natural Language Processing task. Transliteration is an automatic method for converting words in one language into phonetically equivalent ones in another language. In this paper we use the popular phrase-based SMT techniques for the task of machine transliteration, for Odia-English and Odia-Hindi language pair. We have created two models for syllable based splits (Odia-English, Odia-Hindi) on 50,900 parallel entries and two models for character based splits (Odia-English, Odia-Hindi) on 1,10,000 parallel entries. SRILM is used to build statistical language models. GIZA++ is used to perform word alignments over parallel corpora. We have achieved an accuracy of 89% for Odia-English and 86% for Odia-Hindi on Syllable based split and 71% for Odia-English and 85% for Odia-Hindi on character based split.","PeriodicalId":6549,"journal":{"name":"2014 2nd International Conference on Business and Information Management (ICBIM)","volume":"69 1","pages":"27-29"},"PeriodicalIF":0.0000,"publicationDate":"2014-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":"{\"title\":\"Odia transliteration engine using moses\",\"authors\":\"R. Balabantaray, Deepak Sahoo\",\"doi\":\"10.1109/ICBIM.2014.6970927\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Transliteration is an important Natural Language Processing task. Transliteration is an automatic method for converting words in one language into phonetically equivalent ones in another language. In this paper we use the popular phrase-based SMT techniques for the task of machine transliteration, for Odia-English and Odia-Hindi language pair. We have created two models for syllable based splits (Odia-English, Odia-Hindi) on 50,900 parallel entries and two models for character based splits (Odia-English, Odia-Hindi) on 1,10,000 parallel entries. SRILM is used to build statistical language models. GIZA++ is used to perform word alignments over parallel corpora. We have achieved an accuracy of 89% for Odia-English and 86% for Odia-Hindi on Syllable based split and 71% for Odia-English and 85% for Odia-Hindi on character based split.\",\"PeriodicalId\":6549,\"journal\":{\"name\":\"2014 2nd International Conference on Business and Information Management (ICBIM)\",\"volume\":\"69 1\",\"pages\":\"27-29\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-12-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"7\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2014 2nd International Conference on Business and Information Management (ICBIM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICBIM.2014.6970927\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 2nd International Conference on Business and Information Management (ICBIM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICBIM.2014.6970927","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7

摘要

音译是一项重要的自然语言处理任务。音译是一种将一种语言中的单词自动转换成另一种语言中语音相等的单词的方法。在本文中,我们使用流行的基于短语的SMT技术来完成Odia-English和Odia-Hindi语言对的机器音译任务。我们为50900个平行条目创建了两个基于音节的分割模型(奥迪亚-英语,奥迪亚-印地语)和两个基于字符的分割模型(奥迪亚-英语,奥迪亚-印地语),分别为110,000个平行条目创建了两个模型。SRILM用于构建统计语言模型。giz++用于在并行语料库上执行单词对齐。在基于音节的分割上,奥迪亚-英语和奥迪亚-印地语的准确率分别为89%和86%,在基于字符的分割上,奥迪亚-英语和奥迪亚-印地语的准确率分别为71%和85%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Odia transliteration engine using moses
Transliteration is an important Natural Language Processing task. Transliteration is an automatic method for converting words in one language into phonetically equivalent ones in another language. In this paper we use the popular phrase-based SMT techniques for the task of machine transliteration, for Odia-English and Odia-Hindi language pair. We have created two models for syllable based splits (Odia-English, Odia-Hindi) on 50,900 parallel entries and two models for character based splits (Odia-English, Odia-Hindi) on 1,10,000 parallel entries. SRILM is used to build statistical language models. GIZA++ is used to perform word alignments over parallel corpora. We have achieved an accuracy of 89% for Odia-English and 86% for Odia-Hindi on Syllable based split and 71% for Odia-English and 85% for Odia-Hindi on character based split.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Novel and Efficient Rough Set Based Clustering Technique for Gene Expression Data An empirical study on the determinants of capital structure in Indian Cement Industry in Pre and Post period of Recession Modified Ant Colony Optimization to enhance MANET routing in Adhoc on demand Distance Vector Feasibility of mobile based learning in higher education institutions in India A threshold based Directional Weighted Median Filter for Removal of Random Impulses in thermal images
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1