{"title":"Joint modeling method of question intent detection and slot filling for domain-oriented question answering system","authors":"Huiyong Wang, Ding Yang, Liang Guo, Xiaoming Zhang","doi":"10.1108/dta-07-2022-0281","DOIUrl":null,"url":null,"abstract":"PurposeIntent detection and slot filling are two important tasks in question comprehension of a question answering system. This study aims to build a joint task model with some generalization ability and benchmark its performance over other neural network models mentioned in this paper.Design/methodology/approachThis study used a deep-learning-based approach for the joint modeling of question intent detection and slot filling. Meanwhile, the internal cell structure of the long short-term memory (LSTM) network was improved. Furthermore, the dataset Computer Science Literature Question (CSLQ) was constructed based on the Science and Technology Knowledge Graph. The datasets Airline Travel Information Systems, Snips (a natural language processing dataset of the consumer intent engine collected by Snips) and CSLQ were used for the empirical analysis. The accuracy of intent detection and F1 score of slot filling, as well as the semantic accuracy of sentences, were compared for several models.FindingsThe results showed that the proposed model outperformed all other benchmark methods, especially for the CSLQ dataset. This proves that the design of this study improved the comprehensive performance and generalization ability of the model to some extent.Originality/valueThis study contributes to the understanding of question sentences in a specific domain. LSTM was improved, and a computer literature domain dataset was constructed herein. This will lay the data and model foundation for the future construction of a computer literature question answering system.","PeriodicalId":56156,"journal":{"name":"Data Technologies and Applications","volume":" ","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2023-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Data Technologies and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1108/dta-07-2022-0281","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
PurposeIntent detection and slot filling are two important tasks in question comprehension of a question answering system. This study aims to build a joint task model with some generalization ability and benchmark its performance over other neural network models mentioned in this paper.Design/methodology/approachThis study used a deep-learning-based approach for the joint modeling of question intent detection and slot filling. Meanwhile, the internal cell structure of the long short-term memory (LSTM) network was improved. Furthermore, the dataset Computer Science Literature Question (CSLQ) was constructed based on the Science and Technology Knowledge Graph. The datasets Airline Travel Information Systems, Snips (a natural language processing dataset of the consumer intent engine collected by Snips) and CSLQ were used for the empirical analysis. The accuracy of intent detection and F1 score of slot filling, as well as the semantic accuracy of sentences, were compared for several models.FindingsThe results showed that the proposed model outperformed all other benchmark methods, especially for the CSLQ dataset. This proves that the design of this study improved the comprehensive performance and generalization ability of the model to some extent.Originality/valueThis study contributes to the understanding of question sentences in a specific domain. LSTM was improved, and a computer literature domain dataset was constructed herein. This will lay the data and model foundation for the future construction of a computer literature question answering system.
目的意图检测和空位填充是问答系统问题理解中的两项重要任务。本研究旨在建立一个具有一定泛化能力的联合任务模型,并将其性能与本文中提到的其他神经网络模型进行比较。设计/方法论/方法本研究使用了一种基于深度学习的方法来对问题意图检测和空位填充进行联合建模。同时,长短期记忆(LSTM)网络的内部细胞结构得到了改善。此外,基于科学技术知识图谱构建了计算机科学文献问题数据集(CSLQ)。数据集Airline Travel Information Systems、Snipps(由Snipps收集的消费者意图引擎的自然语言处理数据集)和CSLQ用于实证分析。比较了几种模型的意图检测的准确性、空位填充的F1分数以及句子的语义准确性。结果表明,所提出的模型优于所有其他基准方法,尤其是对于CSLQ数据集。这证明了本研究的设计在一定程度上提高了模型的综合性能和泛化能力。独创性/价值这项研究有助于理解特定领域的疑问句。对LSTM进行了改进,构建了计算机文献领域数据集。这将为未来构建计算机文献问答系统奠定数据和模型基础。