In the course of running computational reproducibility checks for Peyton, Huber and Coppock (2021), the Yale ISPS Data Archive identified mistakes concerning the number of statistically significant differences reported for comparisons made between pre-COVID experiments and our replications. These mistakes arose because of errors in the code used to adjust p-values for multiple comparisons, leading to inconsistent reporting of the number of significant differences before and after adjustment. Correcting these mistakes affects Figures 2-3 and the first paragraph on p. 6 in the published article. All point estimates, standard errors, and substantive conclusions are unchanged. In Figure 1, we present the original version of Figure 2 from Peyton, Huber and Coppock (2021) in the top panel (1a) and the correction in the bottom panel (1b). Figure 2 likewise shows the original version of Figure 3 in the top panel (2a) and the correction in the bottom panel (2b). The text on p. 6 of Peyton, Huber and Coppock (2021) reads:
{"title":"“The Generalizability of Online Experiments Conducted During The COVID-19 Pandemic” – CORRIGENDUM","authors":"K. Peyton, G. Huber, A. Coppock","doi":"10.1017/XPS.2022.23","DOIUrl":"https://doi.org/10.1017/XPS.2022.23","url":null,"abstract":"In the course of running computational reproducibility checks for Peyton, Huber and Coppock (2021), the Yale ISPS Data Archive identified mistakes concerning the number of statistically significant differences reported for comparisons made between pre-COVID experiments and our replications. These mistakes arose because of errors in the code used to adjust p-values for multiple comparisons, leading to inconsistent reporting of the number of significant differences before and after adjustment. Correcting these mistakes affects Figures 2-3 and the first paragraph on p. 6 in the published article. All point estimates, standard errors, and substantive conclusions are unchanged. In Figure 1, we present the original version of Figure 2 from Peyton, Huber and Coppock (2021) in the top panel (1a) and the correction in the bottom panel (1b). Figure 2 likewise shows the original version of Figure 3 in the top panel (2a) and the correction in the bottom panel (2b). The text on p. 6 of Peyton, Huber and Coppock (2021) reads:","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"306 - 309"},"PeriodicalIF":3.6,"publicationDate":"2022-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43907651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract Researchers face difficult decisions about whether to ask potential moderators before or after a survey experiment. Competing concerns exist about priming respondents before the experiment and about introducing post-treatment bias. We replicate the classic “welfare” versus “assistance to the poor” survey experiment, randomly assigning respondents to be asked a battery of racial resentment questions either before or after the question wording experiment. We find little evidence that the question wording effect is different between those who are asked about racial resentment before versus after the experiment. Furthermore, we find little evidence that measured racial resentment is affected by this ordering or by the question wording treatment itself.
{"title":"Moderator Placement in Survey Experiments: Racial Resentment and the “Welfare” versus “Assistance to the Poor” Question Wording Experiment","authors":"B. Albertson, S. Jessee","doi":"10.1017/XPS.2022.18","DOIUrl":"https://doi.org/10.1017/XPS.2022.18","url":null,"abstract":"Abstract Researchers face difficult decisions about whether to ask potential moderators before or after a survey experiment. Competing concerns exist about priming respondents before the experiment and about introducing post-treatment bias. We replicate the classic “welfare” versus “assistance to the poor” survey experiment, randomly assigning respondents to be asked a battery of racial resentment questions either before or after the question wording experiment. We find little evidence that the question wording effect is different between those who are asked about racial resentment before versus after the experiment. Furthermore, we find little evidence that measured racial resentment is affected by this ordering or by the question wording treatment itself.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"448 - 454"},"PeriodicalIF":3.6,"publicationDate":"2022-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49063748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract We document the effectiveness of automated (robo) calls for increasing voter participation in contrast to most published research which finds little or no effect from automated calls. We establish this finding in a large field experiment which mimics campaign behavior with a targeted, partisan get-out-the-vote campaign. Our findings show that across all treatments, automated calls led to three additional votes for every thousand subjects called during the 2014 midterm general election. Additionally, our experimental design allows for testing how the number of calls in a treatment, that is dosage, affects voter turnout. Here, results show that three extra calls increase the treatment effect to seven additional votes per thousand subjects called, but that too many additional calls decrease that effect to statistical insignificance in a six-call treatment.
{"title":"Large-Scale Evidence for the Effectiveness of Partisan GOTV Robo Calls","authors":"Daniel T. Kling, Thomas Stratmann","doi":"10.1017/XPS.2022.16","DOIUrl":"https://doi.org/10.1017/XPS.2022.16","url":null,"abstract":"Abstract We document the effectiveness of automated (robo) calls for increasing voter participation in contrast to most published research which finds little or no effect from automated calls. We establish this finding in a large field experiment which mimics campaign behavior with a targeted, partisan get-out-the-vote campaign. Our findings show that across all treatments, automated calls led to three additional votes for every thousand subjects called during the 2014 midterm general election. Additionally, our experimental design allows for testing how the number of calls in a treatment, that is dosage, affects voter turnout. Here, results show that three extra calls increase the treatment effect to seven additional votes per thousand subjects called, but that too many additional calls decrease that effect to statistical insignificance in a six-call treatment.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"188 - 200"},"PeriodicalIF":3.6,"publicationDate":"2022-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41573542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract Objectification and dehumanization are topics often discussed within the social psychology and feminist theory literature. Research on objectification has largely focused on the sexual objectification of women’s bodies, whereas the dehumanization literature has focused on dehumanization in the context of racial and ethnic groups. Extant political science research has only recently begun to engage with these concepts. In this manuscript, we build upon these literatures and apply these insights to questions relevant to politics. In particular, we argue that objectifying and dehumanizing portrayals of women impact how voters evaluate women politicians and how much they support gender parity in politics. Through a proposed experimental design, we test our hypothesis that the objectification of women as a group can decrease positive evaluations and likelihood of electoral support for women political candidates.
{"title":"Objectified and Dehumanized: Does Objectification Impact Perceptions of Women Political Candidates?","authors":"Claire M. Gothreau, A. Alvarez, Amanda Friesen","doi":"10.1017/XPS.2022.15","DOIUrl":"https://doi.org/10.1017/XPS.2022.15","url":null,"abstract":"Abstract Objectification and dehumanization are topics often discussed within the social psychology and feminist theory literature. Research on objectification has largely focused on the sexual objectification of women’s bodies, whereas the dehumanization literature has focused on dehumanization in the context of racial and ethnic groups. Extant political science research has only recently begun to engage with these concepts. In this manuscript, we build upon these literatures and apply these insights to questions relevant to politics. In particular, we argue that objectifying and dehumanizing portrayals of women impact how voters evaluate women politicians and how much they support gender parity in politics. Through a proposed experimental design, we test our hypothesis that the objectification of women as a group can decrease positive evaluations and likelihood of electoral support for women political candidates.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"174 - 187"},"PeriodicalIF":3.6,"publicationDate":"2022-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48355358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Verkuyten, J. Gale, K. Yogeeswaran, Levi Adelman
Abstract An increasing number of states permit dual citizenship, but there are public concerns about divided loyalties of dual citizens which might lead to intolerance of their political rights. We propose and test whether these concerns depend on the emotional versus instrumental reasons immigrants express for acquiring their second, host society citizenship. Using a survey experiment on a nationally representative sample of native-born Dutch, we find that emotional (vs. instrumental) reasons for a second citizenship lead to higher perceived host society loyalty, which is related to greater political tolerance of dual citizens. Instrumental reason for dual citizenship leads to higher perceived loyalty to the country of origin; however, this is not related to political tolerance of such dual citizens. Implications for theory and society are considered.
{"title":"The Impact of Emotional versus Instrumental Reasons for Dual Citizenship on the Perceived Loyalty and Political Tolerance of Immigrant-Origin Minorities","authors":"M. Verkuyten, J. Gale, K. Yogeeswaran, Levi Adelman","doi":"10.1017/XPS.2022.17","DOIUrl":"https://doi.org/10.1017/XPS.2022.17","url":null,"abstract":"Abstract An increasing number of states permit dual citizenship, but there are public concerns about divided loyalties of dual citizens which might lead to intolerance of their political rights. We propose and test whether these concerns depend on the emotional versus instrumental reasons immigrants express for acquiring their second, host society citizenship. Using a survey experiment on a nationally representative sample of native-born Dutch, we find that emotional (vs. instrumental) reasons for a second citizenship lead to higher perceived host society loyalty, which is related to greater political tolerance of dual citizens. Instrumental reason for dual citizenship leads to higher perceived loyalty to the country of origin; however, this is not related to political tolerance of such dual citizens. Implications for theory and society are considered.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"354 - 366"},"PeriodicalIF":3.6,"publicationDate":"2022-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44241943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract A substantial body of research has found biased recruitment in a variety of societal spheres. We study selection in the judiciary, a domain that has received less attention than the economic and political spheres. Our field experiment took place in the midst of a Swedish government campaign encouraging ordinary citizens to contact local parties, which are responsible for recruiting lay judges (jurors) and put themselves forward as lay judge candidates. Parties’ responsiveness to citizen requests does not seem to favor their own sympathizers, does not vary at all with signals of gender, and is only marginally affected by ethnicity and age. Given the potential importance of ideology and identity in judicial decision-making, the finding that there is little bias with respect to these factors at this first stage of the recruitment process is reassuring from the perspective of impartiality.
{"title":"Let Me Be the Judge: Ideology, Identity, and Judicial Selection","authors":"Lina M. Eriksson, Kåre Vernby","doi":"10.1017/XPS.2022.10","DOIUrl":"https://doi.org/10.1017/XPS.2022.10","url":null,"abstract":"Abstract A substantial body of research has found biased recruitment in a variety of societal spheres. We study selection in the judiciary, a domain that has received less attention than the economic and political spheres. Our field experiment took place in the midst of a Swedish government campaign encouraging ordinary citizens to contact local parties, which are responsible for recruiting lay judges (jurors) and put themselves forward as lay judge candidates. Parties’ responsiveness to citizen requests does not seem to favor their own sympathizers, does not vary at all with signals of gender, and is only marginally affected by ethnicity and age. Given the potential importance of ideology and identity in judicial decision-making, the finding that there is little bias with respect to these factors at this first stage of the recruitment process is reassuring from the perspective of impartiality.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"221 - 230"},"PeriodicalIF":3.6,"publicationDate":"2022-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41476070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bruno Castanho Silva, F. Neuner, Christopher Wratil
Abstract Much of the contemporary literature on populism focuses on its status as a “thin” ideology comprising three key components: people-centrism, anti-elitism, and anti-pluralism. Populist politicians pair this “thin” ideology with extreme positions on policy issues such as immigration or taxation (referred to as “host” or “thick” ideologies). A recent study using German samples leveraged conjoint experiments to disentangle the effects of these appeals on vote choice. The results not only showed that extreme host-ideological positions mattered more than so-called “thin” populist appeals, but also that effects of populist appeals were nearly identical among populist and non-populist voters. Our replication in the US context reaffirms both the importance of host-ideological positions and the lack of heterogeneous effects by voters’ “thin” populist attitudes. Furthermore, by uncovering some divergence from the German case (e.g. anti-elite appeals trumping people-centric appeals), we highlight the need to experimentally examine the effects of populism’s constituent components across contexts.
{"title":"Populism and Candidate Support in the US: The Effects of “Thin” and “Host” Ideology","authors":"Bruno Castanho Silva, F. Neuner, Christopher Wratil","doi":"10.1017/XPS.2022.9","DOIUrl":"https://doi.org/10.1017/XPS.2022.9","url":null,"abstract":"Abstract Much of the contemporary literature on populism focuses on its status as a “thin” ideology comprising three key components: people-centrism, anti-elitism, and anti-pluralism. Populist politicians pair this “thin” ideology with extreme positions on policy issues such as immigration or taxation (referred to as “host” or “thick” ideologies). A recent study using German samples leveraged conjoint experiments to disentangle the effects of these appeals on vote choice. The results not only showed that extreme host-ideological positions mattered more than so-called “thin” populist appeals, but also that effects of populist appeals were nearly identical among populist and non-populist voters. Our replication in the US context reaffirms both the importance of host-ideological positions and the lack of heterogeneous effects by voters’ “thin” populist attitudes. Furthermore, by uncovering some divergence from the German case (e.g. anti-elite appeals trumping people-centric appeals), we highlight the need to experimentally examine the effects of populism’s constituent components across contexts.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"438 - 447"},"PeriodicalIF":3.6,"publicationDate":"2022-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46874008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract We hired a well-known market research firm whose surveys have been published in leading political science journals, including JEPS. Based on a set of rigorous “screeners,” we detected what appears to be exceedingly high rates of identity falsification: over 81 percent of respondents seemed to misrepresent their credentials to gain access to the survey and earn compensation. Similarly high rates of presumptive character falsification were present in panels from multiple sub-vendors procured by the firm. Moreover, we found additional, serious irregularities embedded in the data, including evidence of respondents using deliberate strategies to detect and circumvent one of our screeners, as well as pervasive, observable patterns reflecting that the survey had been taken repeatedly by a respondent or collection of respondents. This evidence offers reasons to be concerned about the quality of online nonprobability, subpopulation samples, and calls for further, systematic research.
{"title":"Fraud in Online Surveys: Evidence from a Nonprobability, Subpopulation Sample","authors":"Andrew M. Bell, Thomas Gift","doi":"10.1017/XPS.2022.8","DOIUrl":"https://doi.org/10.1017/XPS.2022.8","url":null,"abstract":"Abstract We hired a well-known market research firm whose surveys have been published in leading political science journals, including JEPS. Based on a set of rigorous “screeners,” we detected what appears to be exceedingly high rates of identity falsification: over 81 percent of respondents seemed to misrepresent their credentials to gain access to the survey and earn compensation. Similarly high rates of presumptive character falsification were present in panels from multiple sub-vendors procured by the firm. Moreover, we found additional, serious irregularities embedded in the data, including evidence of respondents using deliberate strategies to detect and circumvent one of our screeners, as well as pervasive, observable patterns reflecting that the survey had been taken repeatedly by a respondent or collection of respondents. This evidence offers reasons to be concerned about the quality of online nonprobability, subpopulation samples, and calls for further, systematic research.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"148 - 153"},"PeriodicalIF":3.6,"publicationDate":"2022-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44310680","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael M. Bechtel, William O’Brochta, Margit Tavits
Abstract To successfully address large-scale public health threats such as the novel coronavirus outbreak, policymakers need to limit feelings of fear that threaten social order and political stability. We study how policy responses to an infectious disease affect mass fear using data from a survey experiment conducted on a representative sample of the adult population in the USA (N = 5,461). We find that fear is affected strongly by the final policy outcome, mildly by the severity of the initial outbreak, and minimally by policy response type and rapidity. These results hold across alternative measures of fear and various subgroups of individuals regardless of their level of exposure to coronavirus, knowledge of the virus, and several other theoretically relevant characteristics. Remarkably, despite accumulating evidence of intense partisan conflict over pandemic-related attitudes and behaviors, we show that effective government policy reduces fear among Democrats, Republicans, and Independents alike.
{"title":"Can Policy Responses to Pandemics Reduce Mass Fear?","authors":"Michael M. Bechtel, William O’Brochta, Margit Tavits","doi":"10.1017/XPS.2022.7","DOIUrl":"https://doi.org/10.1017/XPS.2022.7","url":null,"abstract":"Abstract To successfully address large-scale public health threats such as the novel coronavirus outbreak, policymakers need to limit feelings of fear that threaten social order and political stability. We study how policy responses to an infectious disease affect mass fear using data from a survey experiment conducted on a representative sample of the adult population in the USA (N = 5,461). We find that fear is affected strongly by the final policy outcome, mildly by the severity of the initial outbreak, and minimally by policy response type and rapidity. These results hold across alternative measures of fear and various subgroups of individuals regardless of their level of exposure to coronavirus, knowledge of the virus, and several other theoretically relevant characteristics. Remarkably, despite accumulating evidence of intense partisan conflict over pandemic-related attitudes and behaviors, we show that effective government policy reduces fear among Democrats, Republicans, and Independents alike.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":"10 1","pages":"343 - 353"},"PeriodicalIF":3.6,"publicationDate":"2022-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49203856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：