Fen Zhao, Huishuang Shao, Shuo Li, Yintong Wang, Yan Yu
{"title":"基于注意力的 RNN,具有问题感知损失和多级复制机制,适用于自然答案生成","authors":"Fen Zhao, Huishuang Shao, Shuo Li, Yintong Wang, Yan Yu","doi":"10.1007/s40747-024-01538-5","DOIUrl":null,"url":null,"abstract":"<p>Natural answer generation is in a very clear practical significance and strong application background, which can be widely used in the field of knowledge services such as community question answering and intelligent customer service. Traditional knowledge question answering is to provide precise answer entities and neglect the defects; namely, users hope to receive a complete natural answer. In this research, we propose a novel attention-based recurrent neural network for natural answer generation, which is enhanced with multi-level copying mechanisms and question-aware loss. To generate natural answers that conform to grammar, we leverage multi-level copying mechanisms and the prediction mechanism which can copy semantic units and predict common words. Moreover, considering the problem that the generated natural answer does not match the user question, question-aware loss is introduced to make the generated target answer sequences correspond to the question. Experiments on three response generation tasks show our model to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 0.727 BLEU on the SimpleQuestions response generation task, improving over the existing best results by over 0.007 BLEU. Our model has scored a significant enhancement on naturalness with up to 0.05 more than best performing baseline. The simulation results show that our method can generate grammatical and contextual natural answers according to user needs.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":null,"pages":null},"PeriodicalIF":5.0000,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Attention-based RNN with question-aware loss and multi-level copying mechanism for natural answer generation\",\"authors\":\"Fen Zhao, Huishuang Shao, Shuo Li, Yintong Wang, Yan Yu\",\"doi\":\"10.1007/s40747-024-01538-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Natural answer generation is in a very clear practical significance and strong application background, which can be widely used in the field of knowledge services such as community question answering and intelligent customer service. Traditional knowledge question answering is to provide precise answer entities and neglect the defects; namely, users hope to receive a complete natural answer. In this research, we propose a novel attention-based recurrent neural network for natural answer generation, which is enhanced with multi-level copying mechanisms and question-aware loss. To generate natural answers that conform to grammar, we leverage multi-level copying mechanisms and the prediction mechanism which can copy semantic units and predict common words. Moreover, considering the problem that the generated natural answer does not match the user question, question-aware loss is introduced to make the generated target answer sequences correspond to the question. Experiments on three response generation tasks show our model to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 0.727 BLEU on the SimpleQuestions response generation task, improving over the existing best results by over 0.007 BLEU. Our model has scored a significant enhancement on naturalness with up to 0.05 more than best performing baseline. The simulation results show that our method can generate grammatical and contextual natural answers according to user needs.</p>\",\"PeriodicalId\":10524,\"journal\":{\"name\":\"Complex & Intelligent Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-07-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Complex & Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s40747-024-01538-5\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-024-01538-5","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Attention-based RNN with question-aware loss and multi-level copying mechanism for natural answer generation
Natural answer generation is in a very clear practical significance and strong application background, which can be widely used in the field of knowledge services such as community question answering and intelligent customer service. Traditional knowledge question answering is to provide precise answer entities and neglect the defects; namely, users hope to receive a complete natural answer. In this research, we propose a novel attention-based recurrent neural network for natural answer generation, which is enhanced with multi-level copying mechanisms and question-aware loss. To generate natural answers that conform to grammar, we leverage multi-level copying mechanisms and the prediction mechanism which can copy semantic units and predict common words. Moreover, considering the problem that the generated natural answer does not match the user question, question-aware loss is introduced to make the generated target answer sequences correspond to the question. Experiments on three response generation tasks show our model to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 0.727 BLEU on the SimpleQuestions response generation task, improving over the existing best results by over 0.007 BLEU. Our model has scored a significant enhancement on naturalness with up to 0.05 more than best performing baseline. The simulation results show that our method can generate grammatical and contextual natural answers according to user needs.
期刊介绍:
Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.