半监督实体识别方法在技术政策领域的研究与应用

Bihui Yu, Xiangxiang Zhang
{"title":"半监督实体识别方法在技术政策领域的研究与应用","authors":"Bihui Yu, Xiangxiang Zhang","doi":"10.1109/ICTech55460.2022.00093","DOIUrl":null,"url":null,"abstract":"In the field of technology policy, a large number of technology policies are released every day, and scientific researchers need to always pay attention to a great number of technology policy information on different websites, and it is arduous to find crucial policy information from them. Using named entity recognition technology to convert a great number of unstructured text information in technology policy fields into structured information can help scientific researchers obtain crucial policy information. Compared with named entity recognition in the general field, the main challenge of entity recognition in the professional field is that there is less data in the professional field with annotations. In order to reduce the resource overhead of annotated data, a semi-supervised learning method for named entity recognition is produced. The advantage of the semi-supervised learning training model is that it can use the text data with label information and the text data without label information to train the recognition model, and improve the generalization ability of the named entity recognition model. This paper innovatively proposes a dynamic adversarial training method DAT (Dynamic Adversarial Training) that dynamically adjusts the loss weights of supervised data and unsupervised data, and applies it to semi-supervised entity recognition tasks, and proposes the DAT-Bert-CRF model. Effectively solve the problem of semi-supervised entity recognition. The result of our experiment show that compared with other semi-supervised entity recognition methods, the performance of our model in this paper is better.","PeriodicalId":290836,"journal":{"name":"2022 11th International Conference of Information and Communication Technology (ICTech))","volume":"36 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research and Application of Semi-Supervised Entity Recognition Method in The Field of Technology Policy\",\"authors\":\"Bihui Yu, Xiangxiang Zhang\",\"doi\":\"10.1109/ICTech55460.2022.00093\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the field of technology policy, a large number of technology policies are released every day, and scientific researchers need to always pay attention to a great number of technology policy information on different websites, and it is arduous to find crucial policy information from them. Using named entity recognition technology to convert a great number of unstructured text information in technology policy fields into structured information can help scientific researchers obtain crucial policy information. Compared with named entity recognition in the general field, the main challenge of entity recognition in the professional field is that there is less data in the professional field with annotations. In order to reduce the resource overhead of annotated data, a semi-supervised learning method for named entity recognition is produced. The advantage of the semi-supervised learning training model is that it can use the text data with label information and the text data without label information to train the recognition model, and improve the generalization ability of the named entity recognition model. This paper innovatively proposes a dynamic adversarial training method DAT (Dynamic Adversarial Training) that dynamically adjusts the loss weights of supervised data and unsupervised data, and applies it to semi-supervised entity recognition tasks, and proposes the DAT-Bert-CRF model. Effectively solve the problem of semi-supervised entity recognition. The result of our experiment show that compared with other semi-supervised entity recognition methods, the performance of our model in this paper is better.\",\"PeriodicalId\":290836,\"journal\":{\"name\":\"2022 11th International Conference of Information and Communication Technology (ICTech))\",\"volume\":\"36 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 11th International Conference of Information and Communication Technology (ICTech))\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICTech55460.2022.00093\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 11th International Conference of Information and Communication Technology (ICTech))","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTech55460.2022.00093","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在技术政策领域,每天都有大量的技术政策发布,科研人员需要时刻关注不同网站上的大量技术政策信息,从中寻找关键的政策信息是一项艰巨的任务。利用命名实体识别技术将技术政策领域中大量的非结构化文本信息转换为结构化信息,可以帮助科研人员获取关键的政策信息。与一般领域的命名实体识别相比,专业领域实体识别面临的主要挑战是专业领域中带有标注的数据较少。为了减少标注数据的资源开销,提出了一种半监督学习的命名实体识别方法。半监督学习训练模型的优点是可以使用带标签信息的文本数据和不带标签信息的文本数据来训练识别模型,提高命名实体识别模型的泛化能力。本文创新性地提出了一种动态调整有监督数据和无监督数据损失权值的动态对抗训练方法DAT (dynamic adversarial training),并将其应用于半监督实体识别任务,提出了DAT- bert - crf模型。有效地解决了半监督实体识别问题。实验结果表明,与其他半监督实体识别方法相比,本文模型的性能更好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Research and Application of Semi-Supervised Entity Recognition Method in The Field of Technology Policy
In the field of technology policy, a large number of technology policies are released every day, and scientific researchers need to always pay attention to a great number of technology policy information on different websites, and it is arduous to find crucial policy information from them. Using named entity recognition technology to convert a great number of unstructured text information in technology policy fields into structured information can help scientific researchers obtain crucial policy information. Compared with named entity recognition in the general field, the main challenge of entity recognition in the professional field is that there is less data in the professional field with annotations. In order to reduce the resource overhead of annotated data, a semi-supervised learning method for named entity recognition is produced. The advantage of the semi-supervised learning training model is that it can use the text data with label information and the text data without label information to train the recognition model, and improve the generalization ability of the named entity recognition model. This paper innovatively proposes a dynamic adversarial training method DAT (Dynamic Adversarial Training) that dynamically adjusts the loss weights of supervised data and unsupervised data, and applies it to semi-supervised entity recognition tasks, and proposes the DAT-Bert-CRF model. Effectively solve the problem of semi-supervised entity recognition. The result of our experiment show that compared with other semi-supervised entity recognition methods, the performance of our model in this paper is better.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Digital Twin Model Construction and Management Method of Workshop Based on Cloud Platform Security Enhancement for SMS Verification Code in Mobile Payment Intelligent Drug Delivery Car System Using STM32 Motor Fault Diagnosis Method Based on Deep Learning Design and Implementation of SPARQL Engine Based on Heuristic Algorithm
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1