Joint Extraction of Organizations and Relations for Emergency Response Plans With Rich Semantic Information Based On Multi-Head Attention Mechanism

Tong Liu, Haoyu Liu, Weijian Ni, Mengxiao Si
{"title":"Joint Extraction of Organizations and Relations for Emergency Response Plans With Rich Semantic Information Based On Multi-Head Attention Mechanism","authors":"Tong Liu, Haoyu Liu, Weijian Ni, Mengxiao Si","doi":"10.34028/iajit/20/6/5","DOIUrl":null,"url":null,"abstract":"At present, deep learning-based joint entity-relation extraction models are gradually able to accomplish complex tasks, but the research progress in specific fields is relatively slow. Compared with other fields, emergency plan text has the characteristics of high entity density, long text, and many professional terms, which make some general models unable to handle the semantic information of emergency plan text well. Therefore, this paper addresses the problem of complex semantics of emergency plan text, and proposes a joint extraction model of emergency plan organization and relationship based on multi-Head Attention Mechanism (MA-JE) to enrich semantic information, starting from multiple perspectives and different levels to obtain contextual information, aiming to deeply mine and use sentence semantic information through deep feature extraction of emergency plan text. The proposed model and the baseline model are experimented separately on the Chinese emergency response plan dataset, and the results show that the proposed approach outperforms existing baseline models for joint extraction of entity and their relations. In addition, ablation experiments were performed to verify the validity of each module in the model.","PeriodicalId":161392,"journal":{"name":"The International Arab Journal of Information Technology","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The International Arab Journal of Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34028/iajit/20/6/5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

At present, deep learning-based joint entity-relation extraction models are gradually able to accomplish complex tasks, but the research progress in specific fields is relatively slow. Compared with other fields, emergency plan text has the characteristics of high entity density, long text, and many professional terms, which make some general models unable to handle the semantic information of emergency plan text well. Therefore, this paper addresses the problem of complex semantics of emergency plan text, and proposes a joint extraction model of emergency plan organization and relationship based on multi-Head Attention Mechanism (MA-JE) to enrich semantic information, starting from multiple perspectives and different levels to obtain contextual information, aiming to deeply mine and use sentence semantic information through deep feature extraction of emergency plan text. The proposed model and the baseline model are experimented separately on the Chinese emergency response plan dataset, and the results show that the proposed approach outperforms existing baseline models for joint extraction of entity and their relations. In addition, ablation experiments were performed to verify the validity of each module in the model.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于多头关注机制的富语义应急预案组织关系联合抽取
目前,基于深度学习的联合实体关系提取模型逐渐能够完成复杂的任务,但在特定领域的研究进展相对缓慢。与其他领域相比,应急预案文本具有实体密度高、文本长、专业术语多的特点,这使得一些通用模型无法很好地处理应急预案文本的语义信息。为此,本文针对应急预案文本语义复杂的问题,提出了一种基于多头注意机制(multi-Head Attention Mechanism, MA-JE)的应急预案组织与关系联合提取模型,丰富语义信息,从多角度、不同层次入手获取语境信息,旨在通过对应急预案文本的深度特征提取,对句子语义信息进行深度挖掘和利用。在中国应急预案数据集上分别对所提模型和基线模型进行了实验,结果表明,所提方法在实体及其关系联合抽取方面优于现有的基线模型。并通过烧蚀实验验证了模型中各模块的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Cohesive Pair-Wises Constrained Deep Embedding for Semi-Supervised Clustering with Very Few Labeled Samples* Scrupulous SCGAN Framework for Recognition of Restored Images with Caffe based PCA Filtration Fuzzy Heuristics for Detecting and Preventing Black Hole Attack XAI-PDF: A Robust Framework for Malicious PDF Detection Leveraging SHAP-Based Feature Engineering Healthcare Data Security in Cloud Storage Using Light Weight Symmetric Key Algorithm
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1