标签增强阅读理解模型

苏立新, 郭嘉丰, 范意兴, 兰艳艳, 程学旗
{"title":"标签增强阅读理解模型","authors":"苏立新, 郭嘉丰, 范意兴, 兰艳艳, 程学旗","doi":"10.16451/J.CNKI.ISSN1003-6059.202002002","DOIUrl":null,"url":null,"abstract":"In the existing extractive reading comprehension models,only the boundary of answers is utilized as the supervision signal and the labeling processed by human is ignored.Consequently,learned models are prone to learn the superficial features and the generalization performance is degraded.In this paper,a label-enhanced reading comprehension model is proposed to imitate human activity.The answer-bearing sentence,the content and the boundary of the answer are learned simultaneously.The answer-bearing sentence and the content of the answer can be derived from the boundary of the answer and these three types of labels are regarded as supervision signals.The model is trained by multitask learning.During prediction,the probabilities from three predictions are merged to determine the answer,and thus the generalization performance is improved.Experiments on SQuAD dataset demonstrate the effectiveness of LE-Reader model.","PeriodicalId":34917,"journal":{"name":"模式识别与人工智能","volume":"33 1","pages":"106-112"},"PeriodicalIF":0.0000,"publicationDate":"2020-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Label-Enhanced Reading Comprehension Model\",\"authors\":\"苏立新, 郭嘉丰, 范意兴, 兰艳艳, 程学旗\",\"doi\":\"10.16451/J.CNKI.ISSN1003-6059.202002002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the existing extractive reading comprehension models,only the boundary of answers is utilized as the supervision signal and the labeling processed by human is ignored.Consequently,learned models are prone to learn the superficial features and the generalization performance is degraded.In this paper,a label-enhanced reading comprehension model is proposed to imitate human activity.The answer-bearing sentence,the content and the boundary of the answer are learned simultaneously.The answer-bearing sentence and the content of the answer can be derived from the boundary of the answer and these three types of labels are regarded as supervision signals.The model is trained by multitask learning.During prediction,the probabilities from three predictions are merged to determine the answer,and thus the generalization performance is improved.Experiments on SQuAD dataset demonstrate the effectiveness of LE-Reader model.\",\"PeriodicalId\":34917,\"journal\":{\"name\":\"模式识别与人工智能\",\"volume\":\"33 1\",\"pages\":\"106-112\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"模式识别与人工智能\",\"FirstCategoryId\":\"1093\",\"ListUrlMain\":\"https://doi.org/10.16451/J.CNKI.ISSN1003-6059.202002002\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"模式识别与人工智能","FirstCategoryId":"1093","ListUrlMain":"https://doi.org/10.16451/J.CNKI.ISSN1003-6059.202002002","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0

摘要

在现有的抽取式阅读理解模型中,只有答案的边界被用作监督信号,而忽略了人类处理的标记。因此,学习模型容易学习表面特征,泛化性能下降。本文提出了一种模仿人类活动的标签增强阅读理解模型。答案附带的句子、答案的内容和边界是同时学习的。从答案的边界可以得出带有答案的句子和答案的内容,这三种类型的标签被视为监督信号。该模型通过多任务学习进行训练。在预测过程中,将三个预测的概率合并以确定答案,从而提高了泛化性能。在SQuAD数据集上的实验证明了LE阅读器模型的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Label-Enhanced Reading Comprehension Model
In the existing extractive reading comprehension models,only the boundary of answers is utilized as the supervision signal and the labeling processed by human is ignored.Consequently,learned models are prone to learn the superficial features and the generalization performance is degraded.In this paper,a label-enhanced reading comprehension model is proposed to imitate human activity.The answer-bearing sentence,the content and the boundary of the answer are learned simultaneously.The answer-bearing sentence and the content of the answer can be derived from the boundary of the answer and these three types of labels are regarded as supervision signals.The model is trained by multitask learning.During prediction,the probabilities from three predictions are merged to determine the answer,and thus the generalization performance is improved.Experiments on SQuAD dataset demonstrate the effectiveness of LE-Reader model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
模式识别与人工智能
模式识别与人工智能 Computer Science-Artificial Intelligence
CiteScore
1.60
自引率
0.00%
发文量
3316
期刊介绍:
期刊最新文献
Pattern Recognition and Artificial Intelligence: 5th Mediterranean Conference, MedPRAI 2021, Istanbul, Turkey, December 17–18, 2021, Proceedings Pattern Recognition and Artificial Intelligence: Third International Conference, ICPRAI 2022, Paris, France, June 1–3, 2022, Proceedings, Part I Pattern Recognition and Artificial Intelligence: Third International Conference, ICPRAI 2022, Paris, France, June 1–3, 2022, Proceedings, Part II Conditional Graph Pattern Matching with a Basic Static Analysis Ensemble Classification Using Entropy-Based Features for MRI Tissue Segmentation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1