Chinese named entity recognition based on Heterogeneous Graph and Dynamic Attention Network

Yuke Wang, Ling Lu, Wu Yang, Yinong Chen
{"title":"Chinese named entity recognition based on Heterogeneous Graph and Dynamic Attention Network","authors":"Yuke Wang, Ling Lu, Wu Yang, Yinong Chen","doi":"10.1109/ISADS56919.2023.10092180","DOIUrl":null,"url":null,"abstract":"Abstract Lexicon have been proved to enhance character representation to help Chinese named entity recognition (NER) model distinguish entities. Although lexicon information includes both semantic and boundary information of words, existing studies usually use only part of them and has low utilization of lexicon information. To efficiently extract dictionary features and integrate character representation, we propose a Heterogeneous Graph and Dynamic Attention Network (HGDAN), aiming at fusing contextual information and capturing dynamic associations between characters and words, thus improving the performance of Chinese NER. PGDNA uses the boundary information of the dictionary to construct a heterogeneous graph and uses the graph attention method to extract semantic information, as well as suppressing lexical noise through the gating unit. In addition, we found the traditional attention model has a non-zero attention problem that will distract the attention of the model, and proposed a simple and effective method to solve it. Experiments on the performance and inference speed of HGDAN on four Chinese datasets have proved its superiority.","PeriodicalId":412453,"journal":{"name":"2023 IEEE 15th International Symposium on Autonomous Decentralized System (ISADS)","volume":"60 7","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 15th International Symposium on Autonomous Decentralized System (ISADS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISADS56919.2023.10092180","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract Lexicon have been proved to enhance character representation to help Chinese named entity recognition (NER) model distinguish entities. Although lexicon information includes both semantic and boundary information of words, existing studies usually use only part of them and has low utilization of lexicon information. To efficiently extract dictionary features and integrate character representation, we propose a Heterogeneous Graph and Dynamic Attention Network (HGDAN), aiming at fusing contextual information and capturing dynamic associations between characters and words, thus improving the performance of Chinese NER. PGDNA uses the boundary information of the dictionary to construct a heterogeneous graph and uses the graph attention method to extract semantic information, as well as suppressing lexical noise through the gating unit. In addition, we found the traditional attention model has a non-zero attention problem that will distract the attention of the model, and proposed a simple and effective method to solve it. Experiments on the performance and inference speed of HGDAN on four Chinese datasets have proved its superiority.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于异构图和动态注意网络的中文命名实体识别
摘要:词汇已被证明可以增强汉字的表征能力,以帮助中文命名实体识别(NER)模型识别实体。虽然词汇信息包括词的语义信息和边界信息,但现有的研究通常只使用其中的一部分,对词汇信息的利用率较低。为了有效地提取字典特征和整合字符表示,我们提出了一种异构图和动态注意网络(HGDAN),旨在融合上下文信息和捕获字符与单词之间的动态关联,从而提高汉语NER的性能。PGDNA利用字典的边界信息构建异构图,利用图注意方法提取语义信息,并通过门控单元抑制词汇噪声。此外,我们发现传统的注意力模型存在非零注意力问题,会分散模型的注意力,并提出了一种简单有效的方法来解决这个问题。在四个中文数据集上对HGDAN的性能和推理速度进行了实验,证明了它的优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A pipeline to collaborative AI models creation between Brazilian governmental institutions Policy-Based Task Allocation at Runtime for a Self-Adaptive Edge Computing Infrastructure A Computer Vision Approach to Terminus Movement Analysis of Viedma Glacier An Approach to Workload Generation for Cloud Benchmarking: a View from Alibaba Trace Design of a Soft Gripper Hand for a Quadruped Robot
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1