{"title":"基于改进Seq2seq模型的人机对话研究","authors":"Wenqian Shang, Sunyu Zhu, Dong Xiao","doi":"10.1109/icisfall51598.2021.9627419","DOIUrl":null,"url":null,"abstract":"With the constant maturity of deep learning technology, human-computer dialogue has become a research hotspot in natural language processing. People in academia and industry are very concerned about it. The extensive use of artificial intelligence and deep learning technology in the human-machine dialogue system and the deep neural network modeling for text semantics are of great significance in promoting human-computer dialogue technologies and the application of human-computer dialogue to serve humanity better. Based on the above background, this paper focuses on the research of the human-computer dialogue system based on the improved seq2seq model, using the pre-trained Bert improved model as the codec modeling, and addressing the lack of Q&A data sets, the imbalance of category distribution, and the robustness of the model. These problems can be solved by adding disturbance structure adversarial sample training.","PeriodicalId":240142,"journal":{"name":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","volume":"68 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Research On Human-computer Dialogue Based On Improved Seq2seq Model\",\"authors\":\"Wenqian Shang, Sunyu Zhu, Dong Xiao\",\"doi\":\"10.1109/icisfall51598.2021.9627419\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the constant maturity of deep learning technology, human-computer dialogue has become a research hotspot in natural language processing. People in academia and industry are very concerned about it. The extensive use of artificial intelligence and deep learning technology in the human-machine dialogue system and the deep neural network modeling for text semantics are of great significance in promoting human-computer dialogue technologies and the application of human-computer dialogue to serve humanity better. Based on the above background, this paper focuses on the research of the human-computer dialogue system based on the improved seq2seq model, using the pre-trained Bert improved model as the codec modeling, and addressing the lack of Q&A data sets, the imbalance of category distribution, and the robustness of the model. These problems can be solved by adding disturbance structure adversarial sample training.\",\"PeriodicalId\":240142,\"journal\":{\"name\":\"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)\",\"volume\":\"68 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/icisfall51598.2021.9627419\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icisfall51598.2021.9627419","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Research On Human-computer Dialogue Based On Improved Seq2seq Model
With the constant maturity of deep learning technology, human-computer dialogue has become a research hotspot in natural language processing. People in academia and industry are very concerned about it. The extensive use of artificial intelligence and deep learning technology in the human-machine dialogue system and the deep neural network modeling for text semantics are of great significance in promoting human-computer dialogue technologies and the application of human-computer dialogue to serve humanity better. Based on the above background, this paper focuses on the research of the human-computer dialogue system based on the improved seq2seq model, using the pre-trained Bert improved model as the codec modeling, and addressing the lack of Q&A data sets, the imbalance of category distribution, and the robustness of the model. These problems can be solved by adding disturbance structure adversarial sample training.