{"title":"Enhancing Machine Comprehension Using Multi-Knowledge Bases and Offline Answer Span Improving System","authors":"Feifei Xu, Wenkai Zhang, Haizhou Du, Shanlin Zhou","doi":"10.53106/160792642021092205013","DOIUrl":null,"url":null,"abstract":"Machine Reading Comprehension (MRC) is a challenging but meaningful task in natural language processing (NLP) that requires us to teach a machine to read and understand a given passage and answer questions related to that passage. In this paper, we present a rich knowledge-enhanced reader (RKE-Reader), a hierarchical MRC model that employs double knowledge bases with an NER system as its knowledge enhancement unit. Besides, we are the first to propose an offline answer-imporving method to help model to determine the uncertain answer without extra online training process. Our experimental results indicate that on most datasets, the RKE-Reader significantly outperforms most of the published models that do not have knowledge base, especially on datasets that need commonsense reasoning. And the ablation study also reflects that external knowledge bases and answer-selecting unit do make a positive contribution in the entire model.","PeriodicalId":50172,"journal":{"name":"Journal of Internet Technology","volume":"22 1","pages":"1093-1105"},"PeriodicalIF":0.9000,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Internet Technology","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.53106/160792642021092205013","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Machine Reading Comprehension (MRC) is a challenging but meaningful task in natural language processing (NLP) that requires us to teach a machine to read and understand a given passage and answer questions related to that passage. In this paper, we present a rich knowledge-enhanced reader (RKE-Reader), a hierarchical MRC model that employs double knowledge bases with an NER system as its knowledge enhancement unit. Besides, we are the first to propose an offline answer-imporving method to help model to determine the uncertain answer without extra online training process. Our experimental results indicate that on most datasets, the RKE-Reader significantly outperforms most of the published models that do not have knowledge base, especially on datasets that need commonsense reasoning. And the ablation study also reflects that external knowledge bases and answer-selecting unit do make a positive contribution in the entire model.
期刊介绍:
The Journal of Internet Technology accepts original technical articles in all disciplines of Internet Technology & Applications. Manuscripts are submitted for review with the understanding that they have not been published elsewhere.
Topics of interest to JIT include but not limited to:
Broadband Networks
Electronic service systems (Internet, Intranet, Extranet, E-Commerce, E-Business)
Network Management
Network Operating System (NOS)
Intelligent systems engineering
Government or Staff Jobs Computerization
National Information Policy
Multimedia systems
Network Behavior Modeling
Wireless/Satellite Communication
Digital Library
Distance Learning
Internet/WWW Applications
Telecommunication Networks
Security in Networks and Systems
Cloud Computing
Internet of Things (IoT)
IPv6 related topics are especially welcome.