硬标签黑盒环境下命名实体识别的文本对抗性攻击

Miaomiao Li, Jie Yu, Shasha Li, Jun Ma, Huijun Liu
{"title":"硬标签黑盒环境下命名实体识别的文本对抗性攻击","authors":"Miaomiao Li, Jie Yu, Shasha Li, Jun Ma, Huijun Liu","doi":"10.1109/ICACTE55855.2022.9943674","DOIUrl":null,"url":null,"abstract":"Named entity recognition is a key task in the field of natural language processing, which plays a key role in many downstream tasks. Adversarial examples attack based on hard label black box is to generate adversarial examples which make the model classification wrong under the condition that only the decision results of the model are obtained. However, at present, there is little research on adversarial examples attack in hard-label black box setting for named entity recognition task. Influenced by adversarial examples attacks in hard-label black box settings in text classification task, we apply genetic algorithm to adversarial examples attacks in named entity recognition task. In this paper, we first randomly generate the initial adversarial examples, and shorten the search space to a certain extent, and then use genetic algorithm to continuously optimize the examples, and finally generate high quality adversarial examples. Experiments and analysis show that the adversarial examples generated in the hard label black box setting can effectively reduce the accuracy of the model.","PeriodicalId":165068,"journal":{"name":"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Textual Adversarial Attacks on Named Entity Recognition in a Hard Label Black Box Setting\",\"authors\":\"Miaomiao Li, Jie Yu, Shasha Li, Jun Ma, Huijun Liu\",\"doi\":\"10.1109/ICACTE55855.2022.9943674\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Named entity recognition is a key task in the field of natural language processing, which plays a key role in many downstream tasks. Adversarial examples attack based on hard label black box is to generate adversarial examples which make the model classification wrong under the condition that only the decision results of the model are obtained. However, at present, there is little research on adversarial examples attack in hard-label black box setting for named entity recognition task. Influenced by adversarial examples attacks in hard-label black box settings in text classification task, we apply genetic algorithm to adversarial examples attacks in named entity recognition task. In this paper, we first randomly generate the initial adversarial examples, and shorten the search space to a certain extent, and then use genetic algorithm to continuously optimize the examples, and finally generate high quality adversarial examples. Experiments and analysis show that the adversarial examples generated in the hard label black box setting can effectively reduce the accuracy of the model.\",\"PeriodicalId\":165068,\"journal\":{\"name\":\"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICACTE55855.2022.9943674\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 15th International Conference on Advanced Computer Theory and Engineering (ICACTE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICACTE55855.2022.9943674","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

命名实体识别是自然语言处理领域的一项关键任务,在许多下游任务中起着关键作用。基于硬标签黑箱的对抗样例攻击是在只得到模型的决策结果的情况下,生成导致模型分类错误的对抗样例。然而,目前针对命名实体识别任务的硬标签黑盒设置中对抗性示例攻击的研究很少。受文本分类任务中硬标签黑箱设置中的对抗性示例攻击的影响,我们将遗传算法应用于命名实体识别任务中的对抗性示例攻击。在本文中,我们首先随机生成初始的对抗样例,并在一定程度上缩短搜索空间,然后使用遗传算法对样例进行持续优化,最终生成高质量的对抗样例。实验和分析表明,在硬标签黑箱设置下生成的对抗样例可以有效地降低模型的准确率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Textual Adversarial Attacks on Named Entity Recognition in a Hard Label Black Box Setting
Named entity recognition is a key task in the field of natural language processing, which plays a key role in many downstream tasks. Adversarial examples attack based on hard label black box is to generate adversarial examples which make the model classification wrong under the condition that only the decision results of the model are obtained. However, at present, there is little research on adversarial examples attack in hard-label black box setting for named entity recognition task. Influenced by adversarial examples attacks in hard-label black box settings in text classification task, we apply genetic algorithm to adversarial examples attacks in named entity recognition task. In this paper, we first randomly generate the initial adversarial examples, and shorten the search space to a certain extent, and then use genetic algorithm to continuously optimize the examples, and finally generate high quality adversarial examples. Experiments and analysis show that the adversarial examples generated in the hard label black box setting can effectively reduce the accuracy of the model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Analysis and Sharing System of the Second Pollution Source Census Results Data Based on Apache Kylin and WebGIS ICACTE 2022 Cover Page Matrix-based Genetic Algorithm for Mobile Robot Global Path Planning Evaluation in Development of E-Government: Taking Macao E-Government as An Example A Modular Reasoning Approach to Knowledge Graph
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1