Generative propaganda: Evidence of AI's impact from a state-backed disinformation campaign.

IF 3.8 Q2 MULTIDISCIPLINARY SCIENCES PNAS nexus Pub Date : 2025-04-01 DOI:10.1093/pnasnexus/pgaf083
Morgan Wack, Carl Ehrett, Darren Linvill, Patrick Warren
{"title":"Generative propaganda: Evidence of AI's impact from a state-backed disinformation campaign.","authors":"Morgan Wack, Carl Ehrett, Darren Linvill, Patrick Warren","doi":"10.1093/pnasnexus/pgaf083","DOIUrl":null,"url":null,"abstract":"<p><p>Can AI bolster state-backed propaganda campaigns, in practice? Growing use of AI and large language models has drawn attention to the potential for accompanying tools to be used by malevolent actors. Though recent laboratory and experimental evidence has substantiated these concerns in principle, the usefulness of AI tools in the production of propaganda campaigns has remained difficult to ascertain. Drawing on the adoption of generative-AI techniques by a state-affiliated propaganda site with ties to Russia, we test whether AI adoption enabled the website to amplify and enhance its production of disinformation. First, we find that the use of generative-AI tools facilitated the outlet's generation of larger quantities of disinformation. Second, we find that use of generative-AI coincided with shifts in the volume and breadth of published content. Finally, drawing on a survey experiment comparing perceptions of articles produced prior to and following the adoption of AI tools, we show that the AI-assisted articles maintained their persuasiveness in the postadoption period. Our results illustrate how generative-AI tools have already begun to alter the size and scope of state-backed propaganda campaigns.</p>","PeriodicalId":74468,"journal":{"name":"PNAS nexus","volume":"4 4","pages":"pgaf083"},"PeriodicalIF":3.8000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11950819/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PNAS nexus","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/pnasnexus/pgaf083","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Can AI bolster state-backed propaganda campaigns, in practice? Growing use of AI and large language models has drawn attention to the potential for accompanying tools to be used by malevolent actors. Though recent laboratory and experimental evidence has substantiated these concerns in principle, the usefulness of AI tools in the production of propaganda campaigns has remained difficult to ascertain. Drawing on the adoption of generative-AI techniques by a state-affiliated propaganda site with ties to Russia, we test whether AI adoption enabled the website to amplify and enhance its production of disinformation. First, we find that the use of generative-AI tools facilitated the outlet's generation of larger quantities of disinformation. Second, we find that use of generative-AI coincided with shifts in the volume and breadth of published content. Finally, drawing on a survey experiment comparing perceptions of articles produced prior to and following the adoption of AI tools, we show that the AI-assisted articles maintained their persuasiveness in the postadoption period. Our results illustrate how generative-AI tools have already begun to alter the size and scope of state-backed propaganda campaigns.

Abstract Image

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
生成式宣传:国家支持的虚假信息运动证明人工智能的影响。
人工智能能否在实践中支持国家支持的宣传活动?人工智能和大型语言模型的使用日益增多,这引起了人们对恶意行为者可能使用相关工具的关注。尽管最近的实验室和实验证据在原则上证实了这些担忧,但人工智能工具在宣传活动中的实用性仍然难以确定。我们以一个与俄罗斯有联系的国家附属宣传网站采用生成式人工智能技术为基础,检验了人工智能的采用是否使该网站扩大并加强了其虚假信息的生产。首先,我们发现生成式人工智能工具的使用有助于该网站生成更大量的虚假信息。其次,我们发现生成式人工智能的使用与发布内容的数量和广度的变化相吻合。最后,我们利用一项调查实验,比较了人们对采用人工智能工具之前和之后发表的文章的看法,结果表明,人工智能辅助文章在采用人工智能工具之后仍保持了其说服力。我们的研究结果表明,人工智能生成工具已经开始改变国家支持的宣传活动的规模和范围。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
1.80
自引率
0.00%
发文量
0
期刊最新文献
Correction to: From transcripts to trajectories: A framework for studying academic pathways through college. Information about immigrants' deservingness reduces misperceptions and opposition to immigration. Thermal constraints on the distribution of Japanese eel (Anguilla japonica) at its northern limit: Links to land use and geology. A genome-wide RNAi screen for novel CIN genes using human artificial chromosome. Correction to: AI-based satellite survey offers independent assessment of migratory wildebeest numbers in the Serengeti.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1