Assessing the Validity of Prevalence Estimates in Double List Experiments

IF 3.2 Q1 POLITICAL SCIENCE Journal of Experimental Political Science Pub Date : 2023-09-18 DOI:10.1017/xps.2023.24
Gustavo Diaz
{"title":"Assessing the Validity of Prevalence Estimates in Double List Experiments","authors":"Gustavo Diaz","doi":"10.1017/xps.2023.24","DOIUrl":null,"url":null,"abstract":"Abstract Social scientists use list experiments in surveys to estimate the prevalence of sensitive attitudes and behaviors in a population of interest. However, the cumulative evidence suggests that the list experiment estimator is underpowered to capture the extent of sensitivity bias in common applications. The literature suggests double list experiments (DLEs) as an alternative to improve along the bias-variance frontier. This variant of the research design brings the additional burden of justifying the list experiment identification assumptions in both lists, which raises concerns over the validity of DLE estimates. To overcome this difficulty, this paper outlines two statistical tests to detect strategic misreporting that follows from violations to the identification assumptions. I illustrate their implementation with data from a study on support toward anti-immigration organizations in California and explore their properties via simulation.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Political Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1017/xps.2023.24","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"POLITICAL SCIENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract Social scientists use list experiments in surveys to estimate the prevalence of sensitive attitudes and behaviors in a population of interest. However, the cumulative evidence suggests that the list experiment estimator is underpowered to capture the extent of sensitivity bias in common applications. The literature suggests double list experiments (DLEs) as an alternative to improve along the bias-variance frontier. This variant of the research design brings the additional burden of justifying the list experiment identification assumptions in both lists, which raises concerns over the validity of DLE estimates. To overcome this difficulty, this paper outlines two statistical tests to detect strategic misreporting that follows from violations to the identification assumptions. I illustrate their implementation with data from a study on support toward anti-immigration organizations in California and explore their properties via simulation.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
评估双表实验中患病率估计的有效性
社会科学家在调查中使用列表实验来估计敏感态度和行为在感兴趣的人群中的流行程度。然而,累积的证据表明,列表实验估计器是不够的,以捕捉灵敏度偏差的程度在常见的应用。文献建议双表实验(dle)作为沿偏差-方差边界改进的替代方法。这种研究设计的变体带来了证明两个列表中列表实验识别假设的额外负担,这引起了对DLE估计有效性的担忧。为了克服这一困难,本文概述了两种统计检验,以检测从违规到识别假设的战略误报。我用加州对反移民组织的支持研究中的数据来说明它们的实施,并通过模拟来探索它们的特性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Experimental Political Science
Journal of Experimental Political Science Social Sciences-Sociology and Political Science
CiteScore
5.10
自引率
8.30%
发文量
25
期刊介绍: The Journal of Experimental Political Science (JEPS) features cutting-edge research that utilizes experimental methods or experimental reasoning based on naturally occurring data. We define experimental methods broadly: research featuring random (or quasi-random) assignment of subjects to different treatments in an effort to isolate causal relationships in the sphere of politics. JEPS embraces all of the different types of experiments carried out as part of political science research, including survey experiments, laboratory experiments, field experiments, lab experiments in the field, natural and neurological experiments. We invite authors to submit concise articles (around 4000 words or fewer) that immediately address the subject of the research. We do not require lengthy explanations regarding and justifications of the experimental method. Nor do we expect extensive literature reviews of pros and cons of the methodological approaches involved in the experiment unless the goal of the article is to explore these methodological issues. We expect readers to be familiar with experimental methods and therefore to not need pages of literature reviews to be convinced that experimental methods are a legitimate methodological approach. We will consider longer articles in rare, but appropriate cases, as in the following examples: when a new experimental method or approach is being introduced and discussed or when novel theoretical results are being evaluated through experimentation. Finally, we strongly encourage authors to submit manuscripts that showcase informative null findings or inconsistent results from well-designed, executed, and analyzed experiments.
期刊最新文献
The Way She Moves: Political Repositioning and Gender Stereotypes Public Health Communication Reduces COVID-19 Misinformation Sharing and Boosts Self-Efficacy (Small D-democratic) vacation, all I ever wanted? The effect of democratic backsliding on leisure travel in the American states Public Responses to Unilateral Policymaking More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1