基于位置信息和词频的中文命名实体识别

Zhibo Chen, Jun-Shon Huang, Ya Wang
{"title":"基于位置信息和词频的中文命名实体识别","authors":"Zhibo Chen, Jun-Shon Huang, Ya Wang","doi":"10.1109/ICACTE55855.2022.9943631","DOIUrl":null,"url":null,"abstract":"In view of the problem of error propagation caused by the traditional word segmentation error, and the insufficient application of the word vector in the Chinese named entity recognition, this paper proposes an improvement method based on location information and word frequency. Enter it in terms of characters, match the single character and the vocabulary in the vocabulary bank, classify the matched vocabulary according to the position of the characters in the vocabulary, calculate the weight according to the vocabulary of different positions, fuse it with each word vector, and finally join it with the word vector. The splicing results were taken as input to the bidirectional long and short-term network and finally decoded through a conditional random field. Simulations performed on the People’s Daily dataset achieved 95.80% F1 values, better than BiLSTM-CRF, BiLSTM-CNN, etc.","PeriodicalId":165068,"journal":{"name":"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)","volume":"02 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Chinese Named Entity Recognition Based on Location Information and Word Frequency\",\"authors\":\"Zhibo Chen, Jun-Shon Huang, Ya Wang\",\"doi\":\"10.1109/ICACTE55855.2022.9943631\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In view of the problem of error propagation caused by the traditional word segmentation error, and the insufficient application of the word vector in the Chinese named entity recognition, this paper proposes an improvement method based on location information and word frequency. Enter it in terms of characters, match the single character and the vocabulary in the vocabulary bank, classify the matched vocabulary according to the position of the characters in the vocabulary, calculate the weight according to the vocabulary of different positions, fuse it with each word vector, and finally join it with the word vector. The splicing results were taken as input to the bidirectional long and short-term network and finally decoded through a conditional random field. Simulations performed on the People’s Daily dataset achieved 95.80% F1 values, better than BiLSTM-CRF, BiLSTM-CNN, etc.\",\"PeriodicalId\":165068,\"journal\":{\"name\":\"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)\",\"volume\":\"02 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICACTE55855.2022.9943631\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICACTE55855.2022.9943631","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

针对传统的分词误差导致的误差传播问题,以及词向量在中文命名实体识别中的应用不足,本文提出了一种基于位置信息和词频的改进方法。按字符输入,将单个字符与词汇库中的词汇进行匹配,根据字符在词汇库中的位置对匹配的词汇进行分类,根据不同位置的词汇计算权重,将其与各个词向量融合,最后与词向量结合。将拼接结果作为输入输入到双向长短期网络中,最后通过条件随机场进行解码。在《人民日报》数据集上进行模拟,F1值达到95.80%,优于BiLSTM-CRF、BiLSTM-CNN等。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Chinese Named Entity Recognition Based on Location Information and Word Frequency
In view of the problem of error propagation caused by the traditional word segmentation error, and the insufficient application of the word vector in the Chinese named entity recognition, this paper proposes an improvement method based on location information and word frequency. Enter it in terms of characters, match the single character and the vocabulary in the vocabulary bank, classify the matched vocabulary according to the position of the characters in the vocabulary, calculate the weight according to the vocabulary of different positions, fuse it with each word vector, and finally join it with the word vector. The splicing results were taken as input to the bidirectional long and short-term network and finally decoded through a conditional random field. Simulations performed on the People’s Daily dataset achieved 95.80% F1 values, better than BiLSTM-CRF, BiLSTM-CNN, etc.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Analysis and Sharing System of the Second Pollution Source Census Results Data Based on Apache Kylin and WebGIS ICACTE 2022 Cover Page Matrix-based Genetic Algorithm for Mobile Robot Global Path Planning Evaluation in Development of E-Government: Taking Macao E-Government as An Example A Modular Reasoning Approach to Knowledge Graph
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1