{"title":"Viewers like you: the effect of elite co-identity reinforcement on U.S. immigration attitudes","authors":"Tyler Reny, Justin Gest","doi":"10.1080/21565503.2023.2265906","DOIUrl":null,"url":null,"abstract":"ABSTRACTAs the political salience of immigrant-origin minorities continues to increase in the United States and Europe, researchers are increasingly focused on understanding what interventions reduce exclusionary attitudes. While several recent studies have examined the effect of different narrative and interpersonal communication techniques, few have focused on the role of the “messenger” that delivers these techniques. Drawing from psychological research on persuasion, we hypothesize that anti-exclusionary messages are more persuasive when delivered by elite messengers who reinforce shared identities. To test this, we conduct a large, pre-registered survey experiment exposing a sample of American adults to audio messages on immigration from persuasive elites performed by professional voice actors. We find that a persuasive message only shifts attitudes about immigration when elites include co-identity reinforcement primes. These findings offer additional nuance to the literature on immigration attitudes, persuasion, and elite-led public opinion, and have important implications for immigration advocacy work.KEYWORDS: Immigration attitudespersuasionelitespublic opinionidentity Disclosure statementNo potential conflict of interest was reported by the author(s).Notes1 While this study focuses on explicit prejudice, researchers have studied interventions for reducing implicit prejudice as well. For a thorough comparative investigation of these techniques, see Lai (Citation2014).2 This is consistent with recent research on elites and attitudes related to race, ethnicity, and immigration.3 https://immigrationforum.org/landing_page/bibles-badges-business/4 There is evidence that generic elite/party cues – those from “Republicans,” “Democrats,” or fictional candidates (see Arcenueax 2008; Bullock 2011; Ciuk and Yose 2016; Druckman et al 2013) – are often not powerful enough to persuade co-partisans to update their attitudes. Instead, evidence suggests that cues from known elites like the president of the United States, are the most persuasive (Agadjanian 2020; Lenz 2012; Nicholson 2012; Barber and Pope Citation2019). We suspect that generic party cues are often weak because of issues of informational equivalence where the respondent might project onto the elite their perception of the elite’s strength of partisan identity or core political values, for example.5 We pre-registered our design and analyses with OSF.io on August 7, 2020, before full data collection commenced on August 10, 2020. Full pre-analysis plan is included in Appendix B. IRB approval was acquired for all pilot tests and the full survey experiment at each of the authors’ institutions.6 We discuss our decision to measure our moderator before treatment in Appendix A.7 In Appendix A, we also display tests for non-random attrition and show balance for pre-registered pre-treatment covariates across treatment conditions.8 We ensured compliance with the treatment in a few different ways. First, we ensured that respondents had working speakers and could watch video on their device by having them pass a video and audio check (picture of a cow and audio of a dog barking) before they could proceed to the video. The video itself was hosted on YouTube to maximize compatibility across mobile devices and browsers and minimize streaming issues. We set a timer for the duration of the video time so that respondents could not skip the video without waiting for 20 s, removed the scroll bar from the video so they had to watch the entire thing, and embedded a code at the end of the video that respondents had to enter into a text box correctly before proceeding.All respondents so exposed were informed of the deception immediately at the conclusion of the survey. As part of the experimental design, this deception was necessary so that all the messengers’ statements were standardized. The statements, however, were crafted after real messages made by real political elites. To isolate the effect of the speaker in our experiment we need to use the same exact message for each one; otherwise, we would have confounded different messages with different speakers. The deception employed involved minimal risk to subjects. While the deception may alter respondents’ impressions of real people, this alteration only extended until the end of the survey administration. No respondent completed participation without being informed about the deception, and so it will not adversely affect any participant's rights or welfare.9 This message was derived from speeches that the late Republican Senator from Arizona, John McCain, made on immigration. Though a decorated ideological conservative who was once his party’s presidential nominee, McCain held very centrist views on immigration policy and persuaded many Republican voters and legislators to take more liberal positions in his attempts to pass comprehensive immigration reform. For more on this message construction, see Appendix A.10 For full wording for all questions see Appendix C. We measured but did not include an item on English-language only policy because a double negative was clearly confusing for respondents and does not positively correlate with other immigration policy attitudes. While the inclusion of the item, a departure from our pre-analysis plan, does not change substantive finding of the study, we have omitted it from all analyses.11 Pre-registration is posted but currently embargoed on OSF. For review purposes, an anonymized pre-registration has been included in the appendix of this manuscript. We report non-covariate adjusted means in the body of the manuscript and leave adjusted means, which are substantively identical, in the appendix.12 We further probe this relationship by breaking Republicans into strong versus weak partisanship (as measured by branching partisan identity question), those with stronger versus weaker partisan identity (Huddy, Mason, and Aarøe Citation2015), and those high or low in self-monitoring (Connors Citation2020). Full wording of all items in Appendix C.13 By examining partisan subgroups separately, we are theoretically assuming, of course, that respondent partisanship is moderating the treatment effects we observe in each, though we acknowledge that making a causal moderation claim here requires randomly assigning respondent partisanship which is infeasible (Kam and Trussler Citation2017). Our covariate-adjusted regression estimates in Appendix D help assuage concerns by assessing our assumed model’s sensitivity to the most theoretically relevant confounders.14 For context, this change in attitude is about two-thirds the size of the gap in immigration policy attitudes between college and non-college educated Americans, about one-half the size of the gap in immigration policy attitudes between white and non-white Americans, and about three-quarters the size of the gap in immigration policy attitudes between Independents and Republicans. A one-fifth of a standard deviation shift in attitudes is similar to the Paluck et al. (Citation2021) meta-analytic estimates of the effects of prejudice reduction experiments in large samples.15 Results for individual attitude items are included in Appendix Table D3. We find that the message is most likely to move respondents’ attitudes about a pathway to citizenship, job training programs, welfare benefits, and establishing a Hispanic heritage month, all policies aimed at accommodation. It did not, however, change attitudes about deportation.16 Hannity is notably anti-immigrant in his current programming in 2020 but in 2012 famously pivoted to an accommodationist messaging urging Republicans to embrace a pathway to citizenship.17 These divergent responses are likely due to the fact that our treatment message is predominantly focused on moving attitudes about policy rather than about who immigrants are.18 We did not pre-register looking at effects by pre-existing levels of immigration attitudes, so this analysis can be treated as exploratory; however, we feel that this analysis is very important for organizations hoping to shift immigration attitudes to see whether the effects are concentrated, maybe, among those Republicans who already felt warmer toward immigrants, for example.19 We did not actually give respondents the opportunity to sign a petition, but respondents were not aware of this when they indicated their intentions. They were debriefed on the purpose of this measure after they completed the survey.20 Research suggests that asking about attitude change exhibits poor measurement properties (Graham and Coppock Citation2020). We are limited, however, by our use a fictional elite speaker with little auxiliary information with which to otherwise form attitudes (or counterfactual assessments).","PeriodicalId":46590,"journal":{"name":"Politics Groups and Identities","volume":"137 ","pages":"0"},"PeriodicalIF":1.8000,"publicationDate":"2023-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Politics Groups and Identities","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/21565503.2023.2265906","RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"POLITICAL SCIENCE","Score":null,"Total":0}
引用次数: 0
Abstract
ABSTRACTAs the political salience of immigrant-origin minorities continues to increase in the United States and Europe, researchers are increasingly focused on understanding what interventions reduce exclusionary attitudes. While several recent studies have examined the effect of different narrative and interpersonal communication techniques, few have focused on the role of the “messenger” that delivers these techniques. Drawing from psychological research on persuasion, we hypothesize that anti-exclusionary messages are more persuasive when delivered by elite messengers who reinforce shared identities. To test this, we conduct a large, pre-registered survey experiment exposing a sample of American adults to audio messages on immigration from persuasive elites performed by professional voice actors. We find that a persuasive message only shifts attitudes about immigration when elites include co-identity reinforcement primes. These findings offer additional nuance to the literature on immigration attitudes, persuasion, and elite-led public opinion, and have important implications for immigration advocacy work.KEYWORDS: Immigration attitudespersuasionelitespublic opinionidentity Disclosure statementNo potential conflict of interest was reported by the author(s).Notes1 While this study focuses on explicit prejudice, researchers have studied interventions for reducing implicit prejudice as well. For a thorough comparative investigation of these techniques, see Lai (Citation2014).2 This is consistent with recent research on elites and attitudes related to race, ethnicity, and immigration.3 https://immigrationforum.org/landing_page/bibles-badges-business/4 There is evidence that generic elite/party cues – those from “Republicans,” “Democrats,” or fictional candidates (see Arcenueax 2008; Bullock 2011; Ciuk and Yose 2016; Druckman et al 2013) – are often not powerful enough to persuade co-partisans to update their attitudes. Instead, evidence suggests that cues from known elites like the president of the United States, are the most persuasive (Agadjanian 2020; Lenz 2012; Nicholson 2012; Barber and Pope Citation2019). We suspect that generic party cues are often weak because of issues of informational equivalence where the respondent might project onto the elite their perception of the elite’s strength of partisan identity or core political values, for example.5 We pre-registered our design and analyses with OSF.io on August 7, 2020, before full data collection commenced on August 10, 2020. Full pre-analysis plan is included in Appendix B. IRB approval was acquired for all pilot tests and the full survey experiment at each of the authors’ institutions.6 We discuss our decision to measure our moderator before treatment in Appendix A.7 In Appendix A, we also display tests for non-random attrition and show balance for pre-registered pre-treatment covariates across treatment conditions.8 We ensured compliance with the treatment in a few different ways. First, we ensured that respondents had working speakers and could watch video on their device by having them pass a video and audio check (picture of a cow and audio of a dog barking) before they could proceed to the video. The video itself was hosted on YouTube to maximize compatibility across mobile devices and browsers and minimize streaming issues. We set a timer for the duration of the video time so that respondents could not skip the video without waiting for 20 s, removed the scroll bar from the video so they had to watch the entire thing, and embedded a code at the end of the video that respondents had to enter into a text box correctly before proceeding.All respondents so exposed were informed of the deception immediately at the conclusion of the survey. As part of the experimental design, this deception was necessary so that all the messengers’ statements were standardized. The statements, however, were crafted after real messages made by real political elites. To isolate the effect of the speaker in our experiment we need to use the same exact message for each one; otherwise, we would have confounded different messages with different speakers. The deception employed involved minimal risk to subjects. While the deception may alter respondents’ impressions of real people, this alteration only extended until the end of the survey administration. No respondent completed participation without being informed about the deception, and so it will not adversely affect any participant's rights or welfare.9 This message was derived from speeches that the late Republican Senator from Arizona, John McCain, made on immigration. Though a decorated ideological conservative who was once his party’s presidential nominee, McCain held very centrist views on immigration policy and persuaded many Republican voters and legislators to take more liberal positions in his attempts to pass comprehensive immigration reform. For more on this message construction, see Appendix A.10 For full wording for all questions see Appendix C. We measured but did not include an item on English-language only policy because a double negative was clearly confusing for respondents and does not positively correlate with other immigration policy attitudes. While the inclusion of the item, a departure from our pre-analysis plan, does not change substantive finding of the study, we have omitted it from all analyses.11 Pre-registration is posted but currently embargoed on OSF. For review purposes, an anonymized pre-registration has been included in the appendix of this manuscript. We report non-covariate adjusted means in the body of the manuscript and leave adjusted means, which are substantively identical, in the appendix.12 We further probe this relationship by breaking Republicans into strong versus weak partisanship (as measured by branching partisan identity question), those with stronger versus weaker partisan identity (Huddy, Mason, and Aarøe Citation2015), and those high or low in self-monitoring (Connors Citation2020). Full wording of all items in Appendix C.13 By examining partisan subgroups separately, we are theoretically assuming, of course, that respondent partisanship is moderating the treatment effects we observe in each, though we acknowledge that making a causal moderation claim here requires randomly assigning respondent partisanship which is infeasible (Kam and Trussler Citation2017). Our covariate-adjusted regression estimates in Appendix D help assuage concerns by assessing our assumed model’s sensitivity to the most theoretically relevant confounders.14 For context, this change in attitude is about two-thirds the size of the gap in immigration policy attitudes between college and non-college educated Americans, about one-half the size of the gap in immigration policy attitudes between white and non-white Americans, and about three-quarters the size of the gap in immigration policy attitudes between Independents and Republicans. A one-fifth of a standard deviation shift in attitudes is similar to the Paluck et al. (Citation2021) meta-analytic estimates of the effects of prejudice reduction experiments in large samples.15 Results for individual attitude items are included in Appendix Table D3. We find that the message is most likely to move respondents’ attitudes about a pathway to citizenship, job training programs, welfare benefits, and establishing a Hispanic heritage month, all policies aimed at accommodation. It did not, however, change attitudes about deportation.16 Hannity is notably anti-immigrant in his current programming in 2020 but in 2012 famously pivoted to an accommodationist messaging urging Republicans to embrace a pathway to citizenship.17 These divergent responses are likely due to the fact that our treatment message is predominantly focused on moving attitudes about policy rather than about who immigrants are.18 We did not pre-register looking at effects by pre-existing levels of immigration attitudes, so this analysis can be treated as exploratory; however, we feel that this analysis is very important for organizations hoping to shift immigration attitudes to see whether the effects are concentrated, maybe, among those Republicans who already felt warmer toward immigrants, for example.19 We did not actually give respondents the opportunity to sign a petition, but respondents were not aware of this when they indicated their intentions. They were debriefed on the purpose of this measure after they completed the survey.20 Research suggests that asking about attitude change exhibits poor measurement properties (Graham and Coppock Citation2020). We are limited, however, by our use a fictional elite speaker with little auxiliary information with which to otherwise form attitudes (or counterfactual assessments).
摘要随着美国和欧洲移民出身的少数族裔的政治地位不断提高,研究人员越来越关注于了解哪些干预措施可以减少排外态度。虽然最近有几项研究考察了不同的叙述和人际沟通技巧的影响,但很少有人关注传递这些技巧的“信使”的作用。根据对说服的心理学研究,我们假设反排他性信息在由强化共同身份的精英信使传递时更有说服力。为了验证这一点,我们进行了一项预先登记的大型调查实验,让一组美国成年人听由专业配音演员表演的有说服力的精英们关于移民的音频信息。我们发现,有说服力的信息只有在精英阶层包含共同身份强化启动因子时才会改变对移民的态度。这些发现为有关移民态度、说服和精英主导的公众舆论的文献提供了额外的细微差别,并对移民倡导工作具有重要意义。关键词:移民态度、说服精英、舆论认同披露声明作者未报告潜在的利益冲突。注1本研究的重点是外显偏见,研究者也研究了减少内隐偏见的干预措施。有关这些技术的全面比较调查,请参见Lai (Citation2014).2这与最近关于精英和与种族、民族和移民有关的态度的研究是一致的。3 https://immigrationforum.org/landing_page/bibles-badges-business/4有证据表明,一般的精英/政党线索——来自“共和党人”、“民主党人”或虚构的候选人(见Arcenueax 2008;布洛克2011;Ciuk and Yose 2016;Druckman等人2013)——往往不足以说服同僚更新他们的态度。相反,有证据表明,来自美国总统等知名精英的暗示最有说服力(Agadjanian 2020;楞次2012;尼科尔森2012;Barber and Pope citation(2019)。我们怀疑,由于信息对等的问题,一般的党派线索往往很弱,例如,被调查者可能会将他们对精英的党派认同或核心政治价值观的力量的看法投射到精英身上我们预先在OSF注册了我们的设计和分析。2020年8月10日开始全面数据收集。完整的预分析计划载于附录b。在每个提交人所在机构进行的所有试点试验和全面调查实验都获得了审计委员会的批准我们在附录A中讨论了我们在治疗前测量调节因子的决定。在附录A中,我们还显示了非随机损耗的检验,并显示了在治疗条件下预登记的预处理协变量的平衡我们用几种不同的方法来确保治疗的依从性。首先,我们让受访者通过视频和音频检查(牛的图片和狗叫的音频),确保他们有正常工作的扬声器,并可以在他们的设备上观看视频,然后他们才能继续观看视频。视频本身托管在YouTube上,以最大限度地提高移动设备和浏览器的兼容性,并最大限度地减少流媒体问题。我们为视频时间设置了一个计时器,这样受访者就不能跳过视频,除非等待20秒,从视频中删除滚动条,这样他们就必须观看整个视频,并在视频结束时嵌入一个代码,受访者必须在文本框中正确输入才能继续。所有被曝光的应答者在调查结束时都被立即告知骗局。作为实验设计的一部分,这种欺骗是必要的,这样所有信使的陈述都是标准化的。然而,这些声明是根据真正的政治精英发出的真实信息精心制作的。为了在我们的实验中分离出说话者的效果,我们需要对每个人使用完全相同的信息;否则,我们就会把不同的信息与不同的说话者混淆。所采用的欺骗对受试者的风险最小。虽然欺骗可能会改变受访者对真人的印象,但这种改变只会持续到调查管理结束。没有被调查者在没有被告知欺骗的情况下完成参与,因此它不会对任何参与者的权利或福利产生不利影响这一信息来自已故亚利桑那州共和党参议员约翰·麦凯恩就移民问题发表的演讲。虽然麦凯恩是一位杰出的意识形态保守派,曾是共和党总统候选人,但他在移民政策上持非常中立的观点,并说服许多共和党选民和议员在他试图通过全面移民改革的过程中采取更自由的立场。有关此消息构造的更多信息,请参见附录A。