Topic-aware pivot language approach for statisticalmachine translation

Jinzhi Su, Xiao-Dong Shi, Yanzhou Huang, Yang Liu, Qingzhu Wu, Yi-Dong Chen, Huai-lin Dong
{"title":"Topic-aware pivot language approach for statisticalmachine translation","authors":"Jinzhi Su, Xiao-Dong Shi, Yanzhou Huang, Yang Liu, Qingzhu Wu, Yi-Dong Chen, Huai-lin Dong","doi":"10.1631/jzus.C1300208","DOIUrl":null,"url":null,"abstract":"The pivot language approach for statistical machine translation (SMT) is a good method to break the resource bottleneck for certain language pairs. However, in the implementation of conventional approaches, pivot-side context information is far from fully utilized, resulting in erroneous estimations of translation probabilities. In this study, we propose two topic-aware pivot language approaches to use different levels of pivot-side context. The first method takes advantage of document-level context by assuming that the bridged phrase pairs should be similar in the document-level topic distributions. The second method focuses on the effect of local context. Central to this approach are that the phrase sense can be reflected by local context in the form of probabilistic topics, and that bridged phrase pairs should be compatible in the latent sense distributions. Then, we build an interpolated model bringing the above methods together to further enhance the system performance. Experimental results on French-Spanish and French-German translations using English as the pivot language demonstrate the effectiveness of topic-based context in pivot-based SMT.","PeriodicalId":49947,"journal":{"name":"Journal of Zhejiang University-Science C-Computers & Electronics","volume":"54 1","pages":"241 - 253"},"PeriodicalIF":0.0000,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1631/jzus.C1300208","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Zhejiang University-Science C-Computers & Electronics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1631/jzus.C1300208","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The pivot language approach for statistical machine translation (SMT) is a good method to break the resource bottleneck for certain language pairs. However, in the implementation of conventional approaches, pivot-side context information is far from fully utilized, resulting in erroneous estimations of translation probabilities. In this study, we propose two topic-aware pivot language approaches to use different levels of pivot-side context. The first method takes advantage of document-level context by assuming that the bridged phrase pairs should be similar in the document-level topic distributions. The second method focuses on the effect of local context. Central to this approach are that the phrase sense can be reflected by local context in the form of probabilistic topics, and that bridged phrase pairs should be compatible in the latent sense distributions. Then, we build an interpolated model bringing the above methods together to further enhance the system performance. Experimental results on French-Spanish and French-German translations using English as the pivot language demonstrate the effectiveness of topic-based context in pivot-based SMT.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
面向统计机器翻译的主题感知支点语言方法
统计机器翻译的中心语言方法是打破某些语言对资源瓶颈的一种很好的方法。然而,在传统方法的实施中,轴心侧上下文信息远未得到充分利用,导致对翻译概率的错误估计。在本研究中,我们提出了两种主题感知支点语言方法来使用不同层次的支点侧语境。第一种方法利用文档级上下文,假设桥接短语对在文档级主题分布中应该是相似的。第二种方法侧重于当地情境的影响。该方法的核心是短语意义可以以概率主题的形式反映在局部上下文中,并且桥接短语对应该在潜在意义分布中兼容。然后,我们将上述方法结合在一起,建立了一个插值模型,以进一步提高系统的性能。以英语为中心语言的法语-西班牙语和法语-德语翻译实验结果表明,基于主题的语境在基于主题的SMT中是有效的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
审稿时长
2.66667 months
期刊最新文献
Supply chain network design under uncertainty with new insights from contracts Degree elevation of unified and extended spline curves A 31–45.5 GHz injection-locked frequency divider in 90-nm CMOS technology Optimizing urban traffic control using a rational agent Speech enhancement with a GSC-like structure employing sparse coding
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1