{"title":"Joint Extraction of Organizations and Relations for Emergency Response Plans With Rich Semantic Information Based On Multi-Head Attention Mechanism","authors":"Tong Liu, Haoyu Liu, Weijian Ni, Mengxiao Si","doi":"10.34028/iajit/20/6/5","DOIUrl":null,"url":null,"abstract":"At present, deep learning-based joint entity-relation extraction models are gradually able to accomplish complex tasks, but the research progress in specific fields is relatively slow. Compared with other fields, emergency plan text has the characteristics of high entity density, long text, and many professional terms, which make some general models unable to handle the semantic information of emergency plan text well. Therefore, this paper addresses the problem of complex semantics of emergency plan text, and proposes a joint extraction model of emergency plan organization and relationship based on multi-Head Attention Mechanism (MA-JE) to enrich semantic information, starting from multiple perspectives and different levels to obtain contextual information, aiming to deeply mine and use sentence semantic information through deep feature extraction of emergency plan text. The proposed model and the baseline model are experimented separately on the Chinese emergency response plan dataset, and the results show that the proposed approach outperforms existing baseline models for joint extraction of entity and their relations. In addition, ablation experiments were performed to verify the validity of each module in the model.","PeriodicalId":161392,"journal":{"name":"The International Arab Journal of Information Technology","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The International Arab Journal of Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34028/iajit/20/6/5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
At present, deep learning-based joint entity-relation extraction models are gradually able to accomplish complex tasks, but the research progress in specific fields is relatively slow. Compared with other fields, emergency plan text has the characteristics of high entity density, long text, and many professional terms, which make some general models unable to handle the semantic information of emergency plan text well. Therefore, this paper addresses the problem of complex semantics of emergency plan text, and proposes a joint extraction model of emergency plan organization and relationship based on multi-Head Attention Mechanism (MA-JE) to enrich semantic information, starting from multiple perspectives and different levels to obtain contextual information, aiming to deeply mine and use sentence semantic information through deep feature extraction of emergency plan text. The proposed model and the baseline model are experimented separately on the Chinese emergency response plan dataset, and the results show that the proposed approach outperforms existing baseline models for joint extraction of entity and their relations. In addition, ablation experiments were performed to verify the validity of each module in the model.