DuST:使用双粒度语法感知变压器网络的中国NER

IF 8.1 1区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Information Processing & Management Pub Date : 2025-05-01 Epub Date: 2025-01-07 DOI:10.1016/j.ipm.2024.104041
Yinlong Xiao , Zongcheng Ji , Jianqiang Li , Mei Han
{"title":"DuST:使用双粒度语法感知变压器网络的中国NER","authors":"Yinlong Xiao ,&nbsp;Zongcheng Ji ,&nbsp;Jianqiang Li ,&nbsp;Mei Han","doi":"10.1016/j.ipm.2024.104041","DOIUrl":null,"url":null,"abstract":"<div><div>Recent studies have attempted to exploit syntactic information (<em>e.g.,</em> dependency relation) to enhance Chinese named entity recognition (NER) performance and achieved promising results. These methods usually leverage single-grained syntactic parsing results which are based on single-grained word segmentation. However, entities may be annotated with varying granularities, resulting in inconsistent boundaries when compared to single-grained results. Therefore, merely using single-grained syntactic information may inadvertently introduce noise into boundary detection in Chinese NER. In this paper, we introduce a Dual-grained Syntax-aware Transformer network (DuST) to mitigate the noise introduced by single-grained syntactic parsing results. We first introduce coarse- and fine-grained syntactic dependency parsing results to comprehensively consider possible boundary scenarios. We then design the DuST network with dual syntax-aware Transformers to capture syntax-enhanced features at different granularities, a contextual Transformer to model the contextual features and an aggregation module to dynamically aggregate these features. Experiments are conducted on four widely-used Chinese NER datasets and our model achieves superior performance. Specifically, our approach outperforms two single-grained syntax-enhanced baselines with an increase of up to 3.9% and 2.94% in F1 score, respectively.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"62 3","pages":"Article 104041"},"PeriodicalIF":8.1000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DuST: Chinese NER using dual-grained syntax-aware transformer network\",\"authors\":\"Yinlong Xiao ,&nbsp;Zongcheng Ji ,&nbsp;Jianqiang Li ,&nbsp;Mei Han\",\"doi\":\"10.1016/j.ipm.2024.104041\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Recent studies have attempted to exploit syntactic information (<em>e.g.,</em> dependency relation) to enhance Chinese named entity recognition (NER) performance and achieved promising results. These methods usually leverage single-grained syntactic parsing results which are based on single-grained word segmentation. However, entities may be annotated with varying granularities, resulting in inconsistent boundaries when compared to single-grained results. Therefore, merely using single-grained syntactic information may inadvertently introduce noise into boundary detection in Chinese NER. In this paper, we introduce a Dual-grained Syntax-aware Transformer network (DuST) to mitigate the noise introduced by single-grained syntactic parsing results. We first introduce coarse- and fine-grained syntactic dependency parsing results to comprehensively consider possible boundary scenarios. We then design the DuST network with dual syntax-aware Transformers to capture syntax-enhanced features at different granularities, a contextual Transformer to model the contextual features and an aggregation module to dynamically aggregate these features. Experiments are conducted on four widely-used Chinese NER datasets and our model achieves superior performance. Specifically, our approach outperforms two single-grained syntax-enhanced baselines with an increase of up to 3.9% and 2.94% in F1 score, respectively.</div></div>\",\"PeriodicalId\":50365,\"journal\":{\"name\":\"Information Processing & Management\",\"volume\":\"62 3\",\"pages\":\"Article 104041\"},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Processing & Management\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S030645732400400X\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/7 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S030645732400400X","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/7 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

近年来的研究尝试利用句法信息(如依赖关系)来提高中文命名实体识别(NER)的性能,并取得了可喜的成果。这些方法通常利用基于单粒度分词的单粒度语法解析结果。然而,实体可能被标注为不同的粒度,与单粒度结果相比,会导致不一致的边界。因此,仅仅使用单粒度的句法信息可能会在不经意间将噪声引入中文NER的边界检测中。在本文中,我们引入了一种双粒度语法感知变压器网络(DuST)来减轻单粒度语法解析结果带来的噪声。我们首先引入粗粒度和细粒度的语法依赖解析结果,以综合考虑可能的边界场景。然后,我们设计了具有双重语法感知转换器的DuST网络,以捕获不同粒度的语法增强特征,一个上下文转换器对上下文特征进行建模,一个聚合模块动态地聚合这些特征。在四个广泛使用的中文NER数据集上进行了实验,我们的模型取得了较好的性能。具体来说,我们的方法优于两个单粒度语法增强的基线,F1得分分别提高了3.9%和2.94%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DuST: Chinese NER using dual-grained syntax-aware transformer network
Recent studies have attempted to exploit syntactic information (e.g., dependency relation) to enhance Chinese named entity recognition (NER) performance and achieved promising results. These methods usually leverage single-grained syntactic parsing results which are based on single-grained word segmentation. However, entities may be annotated with varying granularities, resulting in inconsistent boundaries when compared to single-grained results. Therefore, merely using single-grained syntactic information may inadvertently introduce noise into boundary detection in Chinese NER. In this paper, we introduce a Dual-grained Syntax-aware Transformer network (DuST) to mitigate the noise introduced by single-grained syntactic parsing results. We first introduce coarse- and fine-grained syntactic dependency parsing results to comprehensively consider possible boundary scenarios. We then design the DuST network with dual syntax-aware Transformers to capture syntax-enhanced features at different granularities, a contextual Transformer to model the contextual features and an aggregation module to dynamically aggregate these features. Experiments are conducted on four widely-used Chinese NER datasets and our model achieves superior performance. Specifically, our approach outperforms two single-grained syntax-enhanced baselines with an increase of up to 3.9% and 2.94% in F1 score, respectively.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Processing & Management
Information Processing & Management 工程技术-计算机:信息系统
CiteScore
17.00
自引率
11.60%
发文量
276
审稿时长
39 days
期刊介绍: Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing. We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.
期刊最新文献
Attribute topology modeling for causal discovery in linguistic environment Multi-connected temporal subgraph querying based on vertex index EvoFlow: A closed-loop first-order optimizer for stable and robust deep learning Graph-prompted explainable fake news detection with multimodal large language models DADSA: Dual-Side Adaptive Deep Safety Alignment for Large Language Models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1