Matthew J. Camp, Michael Schwam-Baird, Adam Zelizer
It is widely thought that lobbyists exert influence over legislators’ policy positions and, as a result, over policy outcomes. One mechanism of influence is the provision of policy expertise. Yet, there is little credible empirical evidence that lobbyists’ expertise influences legislative outcomes. Across four experiments fielded with three lobbyists in two state legislatures that examine two public measures of legislators’ positions, we find no evidence that lobbyists’ expertise influences legislators’ policy positions. We do find, in contrast, that the same policy expertise treatment is influential when provided by a legislative staffer. We conclude that policy information can influence legislators’ positions, but that legislators are cautious when that information is provided by lobbyists.
{"title":"The Limits of Lobbying: Null Effects from Four Field Experiments in Two State Legislatures","authors":"Matthew J. Camp, Michael Schwam-Baird, Adam Zelizer","doi":"10.1017/xps.2022.25","DOIUrl":"https://doi.org/10.1017/xps.2022.25","url":null,"abstract":"\u0000 It is widely thought that lobbyists exert influence over legislators’ policy positions and, as a result, over policy outcomes. One mechanism of influence is the provision of policy expertise. Yet, there is little credible empirical evidence that lobbyists’ expertise influences legislative outcomes. Across four experiments fielded with three lobbyists in two state legislatures that examine two public measures of legislators’ positions, we find no evidence that lobbyists’ expertise influences legislators’ policy positions. We do find, in contrast, that the same policy expertise treatment is influential when provided by a legislative staffer. We conclude that policy information can influence legislators’ positions, but that legislators are cautious when that information is provided by lobbyists.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2023-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48103450","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract Experimentalists and survey researchers regularly measure the makeup and size of respondent personal discussion networks to learn about the social context in which citizens make political choices. When measuring these personal networks, some scholars use question prompts that specifically ask respondents about whom they discuss “politics” with, while others use more general prompts that ask respondents about whom they discuss “important matters” with. Prior research suggests that “political” discussion network prompts create self-reported networks that are substantively similar to “important matters” prompts. We conduct a nationally representative survey experiment to re-evaluate this question. Our results suggest that, although the size of networks generated by the two questions may be similar on average, the two questions generate different response distributions overall. In particular, respondents interested in politics report larger political discussion networks than general discussion networks, and respondents uninterested in politics report smaller political discussion networks than general discussion networks.
{"title":"Political and Social Discussion Network Survey Items Are Not Interchangeable","authors":"J. Reilly, Jack K. Belk","doi":"10.1017/XPS.2022.34","DOIUrl":"https://doi.org/10.1017/XPS.2022.34","url":null,"abstract":"Abstract Experimentalists and survey researchers regularly measure the makeup and size of respondent personal discussion networks to learn about the social context in which citizens make political choices. When measuring these personal networks, some scholars use question prompts that specifically ask respondents about whom they discuss “politics” with, while others use more general prompts that ask respondents about whom they discuss “important matters” with. Prior research suggests that “political” discussion network prompts create self-reported networks that are substantively similar to “important matters” prompts. We conduct a nationally representative survey experiment to re-evaluate this question. Our results suggest that, although the size of networks generated by the two questions may be similar on average, the two questions generate different response distributions overall. In particular, respondents interested in politics report larger political discussion networks than general discussion networks, and respondents uninterested in politics report smaller political discussion networks than general discussion networks.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43735749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
An abstract is not available for this content so a preview has been provided. As you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
{"title":"XPS volume 10 issue 3 Cover and Back matter","authors":"","doi":"10.1017/xps.2023.38","DOIUrl":"https://doi.org/10.1017/xps.2023.38","url":null,"abstract":"An abstract is not available for this content so a preview has been provided. As you have access to this content, a full PDF is available via the ‘Save PDF’ action button.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135841194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"XPS volume 10 issue 1 Cover and Back matter","authors":"","doi":"10.1017/xps.2023.9","DOIUrl":"https://doi.org/10.1017/xps.2023.9","url":null,"abstract":"","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57592414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"XPS volume 10 issue 1 Cover and Front matter","authors":"","doi":"10.1017/xps.2023.2","DOIUrl":"https://doi.org/10.1017/xps.2023.2","url":null,"abstract":"","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57592295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
An abstract is not available for this content so a preview has been provided. As you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
{"title":"XPS volume 10 issue 3 Cover and Front matter","authors":"","doi":"10.1017/xps.2023.37","DOIUrl":"https://doi.org/10.1017/xps.2023.37","url":null,"abstract":"An abstract is not available for this content so a preview has been provided. As you have access to this content, a full PDF is available via the ‘Save PDF’ action button.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135841198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract How does political ideology affect the processing of information incongruent with one’s worldview? The disagreement in prior research about this question lies in how one’s ideology interacts with cognitive ability to shape motivated numeracy or the tendency to misinterpret data to confirm one’s prior beliefs. Our study conceptually replicates and extends previous research on motivated numeracy by testing whether monetary incentives for accuracy lessen motivated reasoning when high- and low-numeracy partisans interpret data about mask mandates and COVID-19 cases. This research leverages the ongoing COVID-19 crisis, as Americans are polarized along party lines regarding an appropriate government response to the pandemic.
{"title":"The effect of incentives on motivated numeracy amidst COVID-19","authors":"E. Chung, P. Govindan, Anna O. Pechenkina","doi":"10.1017/XPS.2022.32","DOIUrl":"https://doi.org/10.1017/XPS.2022.32","url":null,"abstract":"Abstract How does political ideology affect the processing of information incongruent with one’s worldview? The disagreement in prior research about this question lies in how one’s ideology interacts with cognitive ability to shape motivated numeracy or the tendency to misinterpret data to confirm one’s prior beliefs. Our study conceptually replicates and extends previous research on motivated numeracy by testing whether monetary incentives for accuracy lessen motivated reasoning when high- and low-numeracy partisans interpret data about mask mandates and COVID-19 cases. This research leverages the ongoing COVID-19 crisis, as Americans are polarized along party lines regarding an appropriate government response to the pandemic.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2022-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43828625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract Misinformation about events surrounding the 2020 election and the COVID-19 pandemic pose an existential threat to American democracy and public health. Public opinion surveys reveal that high percentages of Republicans indicate that they endorse some aspects of mistaken beliefs surrounding election fraud in the 2020 election. Still, understanding how to measure the endorsement of misperceptions is critical for understanding the threat at hand. Are high levels of mistaken beliefs genuinely held, or are they partially a function of expressive responding? I address this question through a set of survey experiments encouraging accuracy-oriented processing among the general public. Using well-powered surveys of Republicans and Independents, I find that treatments designed to encourage more accurate responses are ineffective in reducing the endorsement of partisan electoral and public health misperceptions and can in some cases even backfire. These findings suggest that support for these misperceptions is genuinely held.
{"title":"The Big Lie: Expressive Responding and Misperceptions in the United States","authors":"James J. Fahey","doi":"10.1017/XPS.2022.33","DOIUrl":"https://doi.org/10.1017/XPS.2022.33","url":null,"abstract":"Abstract Misinformation about events surrounding the 2020 election and the COVID-19 pandemic pose an existential threat to American democracy and public health. Public opinion surveys reveal that high percentages of Republicans indicate that they endorse some aspects of mistaken beliefs surrounding election fraud in the 2020 election. Still, understanding how to measure the endorsement of misperceptions is critical for understanding the threat at hand. Are high levels of mistaken beliefs genuinely held, or are they partially a function of expressive responding? I address this question through a set of survey experiments encouraging accuracy-oriented processing among the general public. Using well-powered surveys of Republicans and Independents, I find that treatments designed to encourage more accurate responses are ineffective in reducing the endorsement of partisan electoral and public health misperceptions and can in some cases even backfire. These findings suggest that support for these misperceptions is genuinely held.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47444034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rahsaan Maxwell, Efrén O. Pérez, Stephanie Zonszein
Abstract As the number of people of color (PoC) grows in the United States, a key question is how partisanship will develop among this important electoral group. Yet many open questions remain about PoC partisanship, due to limited availability of panel data, a lack of sensitive instrumentation, and small samples of PoC in most public opinion surveys. This brief report leverages a unique panel of African American (N = 650) and Latino (N = 650) eligible voters, before and after the 2020 Presidential Election between Democrat Joe Biden and Republican Donald Trump. Using measures that tap expressive partisan, racial, and national identity attachments, we find that Biden’s electoral victory significantly intensified partisan identity among his Democratic PoC supporters, relative to PoC who were not Democrats and supported Trump. We do not find significant changes in racial or national identities. Our results advance research on PoC’s partisanship.
{"title":"Basking in Their Glory? Expressive Partisanship among People of Color Before and After the 2020 US Election","authors":"Rahsaan Maxwell, Efrén O. Pérez, Stephanie Zonszein","doi":"10.1017/XPS.2022.27","DOIUrl":"https://doi.org/10.1017/XPS.2022.27","url":null,"abstract":"Abstract As the number of people of color (PoC) grows in the United States, a key question is how partisanship will develop among this important electoral group. Yet many open questions remain about PoC partisanship, due to limited availability of panel data, a lack of sensitive instrumentation, and small samples of PoC in most public opinion surveys. This brief report leverages a unique panel of African American (N = 650) and Latino (N = 650) eligible voters, before and after the 2020 Presidential Election between Democrat Joe Biden and Republican Donald Trump. Using measures that tap expressive partisan, racial, and national identity attachments, we find that Biden’s electoral victory significantly intensified partisan identity among his Democratic PoC supporters, relative to PoC who were not Democrats and supported Trump. We do not find significant changes in racial or national identities. Our results advance research on PoC’s partisanship.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2022-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41877736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract Manipulations checks are postexperimental measures widely used to verify that subjects understood the treatment. Some researchers drop subjects who failed manipulation checks in order to limit the analyses to attentive subjects. This short report offers a novel illustration on how this practice may bias experimental results: in the present case, through confirming a hypothesis that is likely false. In a survey experiment, subjects were primed with a fictional news story depicting an economic decline versus prosperity. Subjects were then asked whether the news story depicted an economic decline or prosperity. Results indicate that responses to this manipulation check captured subjects’ preexisting beliefs about the economic situation. As a consequence, dropping subjects who failed the manipulation check mixes the effects of preexisting and induced beliefs, increasing the risk of false positive findings. Researchers should avoid dropping subjects based on posttreatment measures and rely on pretreatment measures of attentiveness.
{"title":"How Dropping Subjects Who Failed Manipulation Checks Can Bias Your Results: An Illustrative Case","authors":"Simon Varaine","doi":"10.1017/XPS.2022.28","DOIUrl":"https://doi.org/10.1017/XPS.2022.28","url":null,"abstract":"Abstract Manipulations checks are postexperimental measures widely used to verify that subjects understood the treatment. Some researchers drop subjects who failed manipulation checks in order to limit the analyses to attentive subjects. This short report offers a novel illustration on how this practice may bias experimental results: in the present case, through confirming a hypothesis that is likely false. In a survey experiment, subjects were primed with a fictional news story depicting an economic decline versus prosperity. Subjects were then asked whether the news story depicted an economic decline or prosperity. Results indicate that responses to this manipulation check captured subjects’ preexisting beliefs about the economic situation. As a consequence, dropping subjects who failed the manipulation check mixes the effects of preexisting and induced beliefs, increasing the risk of false positive findings. Researchers should avoid dropping subjects based on posttreatment measures and rely on pretreatment measures of attentiveness.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.6,"publicationDate":"2022-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46453017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}