{"title":"Automatic Construction of Chinese-Mongolian Parallel Corpora from the Web Based on the New Heuristic Information","authors":"Zede Zhu, Miao Li, Lei Chen, Shouguo Zheng","doi":"10.1109/IALP.2011.17","DOIUrl":null,"url":null,"abstract":"Parallel corpora are important resources in data-driven natural language processing domain. Concerning the issues such as the scale, comprehensiveness and timeliness, the existing Chinese-Mongolian parallel corpora are significantly limited in practical use. Reviewing the traditional heuristic information used to identify major languages parallel web pages, this paper focuses on exploring new heuristic information to improve the performance of identifying Chinese-Mongolian parallel pages. Based on these heuristics, support vector machine is used to classify webs as parallel pages or non-parallel pages. Experiment gains a precision rate of 95% and a recall rate of 88%. This paper makes preliminary research in automatically constructing minority languages parallel corpora from the web.","PeriodicalId":297167,"journal":{"name":"2011 International Conference on Asian Language Processing","volume":" 10","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 International Conference on Asian Language Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IALP.2011.17","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Parallel corpora are important resources in data-driven natural language processing domain. Concerning the issues such as the scale, comprehensiveness and timeliness, the existing Chinese-Mongolian parallel corpora are significantly limited in practical use. Reviewing the traditional heuristic information used to identify major languages parallel web pages, this paper focuses on exploring new heuristic information to improve the performance of identifying Chinese-Mongolian parallel pages. Based on these heuristics, support vector machine is used to classify webs as parallel pages or non-parallel pages. Experiment gains a precision rate of 95% and a recall rate of 88%. This paper makes preliminary research in automatically constructing minority languages parallel corpora from the web.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
