首页 > 最新文献

Research & Politics最新文献

英文 中文
Political trust and public support for propaganda in China 中国的政治信任与公众对宣传的支持
Pub Date : 2024-01-01 DOI: 10.1177/20531680231225308
Haifeng Huang, Chanita Intawan, Stephen P. Nicholson
Authoritarian governments heavily rely on propaganda as a means of maintaining rule. Although scholars have examined the effects of propaganda exposure, much less is known about attitudes toward propaganda messages. In this study, we explore the foundations underlying propaganda support in China by examining the role of political trust, a primary ingredient for explaining public support for government actions and compliance. Using a survey with a broad sample of Chinese internet users and taking measures to address endogeneity, we found that trust in government, whether measured indirectly (implicitly) or directly (explicitly), is a vital source of positive attitudes toward propaganda and hence its potential effects. Our results have important implications for understanding the foundations of propaganda support, the scope of political trust, and the value of indirect measures for gauging public opinion in authoritarian contexts. They also suggest that propaganda may lose its bite under certain conditions.
专制政府严重依赖宣传作为维持统治的手段。尽管学者们研究了宣传接触的影响,但对宣传信息的态度却知之甚少。在本研究中,我们通过研究政治信任的作用来探索中国民众支持宣传的基础,政治信任是解释公众支持政府行为和遵守政府规定的主要因素。通过对广泛的中国网民样本进行调查,并采取措施解决内生性问题,我们发现,对政府的信任,无论是间接(隐性)还是直接(显性)测量,都是对宣传持积极态度的重要来源,因而也是宣传潜在效果的重要来源。我们的研究结果对于理解宣传支持的基础、政治信任的范围以及在专制背景下间接测量民意的价值具有重要意义。这些结果还表明,在某些条件下,宣传可能会失去作用。
{"title":"Political trust and public support for propaganda in China","authors":"Haifeng Huang, Chanita Intawan, Stephen P. Nicholson","doi":"10.1177/20531680231225308","DOIUrl":"https://doi.org/10.1177/20531680231225308","url":null,"abstract":"Authoritarian governments heavily rely on propaganda as a means of maintaining rule. Although scholars have examined the effects of propaganda exposure, much less is known about attitudes toward propaganda messages. In this study, we explore the foundations underlying propaganda support in China by examining the role of political trust, a primary ingredient for explaining public support for government actions and compliance. Using a survey with a broad sample of Chinese internet users and taking measures to address endogeneity, we found that trust in government, whether measured indirectly (implicitly) or directly (explicitly), is a vital source of positive attitudes toward propaganda and hence its potential effects. Our results have important implications for understanding the foundations of propaganda support, the scope of political trust, and the value of indirect measures for gauging public opinion in authoritarian contexts. They also suggest that propaganda may lose its bite under certain conditions.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"63 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139639966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The war on flags: The opposition to state-sponsored LGBTQ+ symbols 旗帜之战反对国家赞助的 LGBTQ+ 标志
Pub Date : 2024-01-01 DOI: 10.1177/20531680241240824
Alberto López Ortega
Negativity against LGBTQ+ and gender equality symbols is escalating across Western European countries, including those at the forefront of sexual modernism. Drawing on data from Spain, this paper theorizes and finds that state-sponsored LGBTQ+ symbols receive significantly more negativity than other aspects of LGBTQ+ issues related to general and specific attitudes toward formal rights. The negativity is primarily explained by support for Vox, a radical right-wing party, and age. The study provides insights into the complexities of public opinion surrounding LGBTQ+ symbols, offering a nuanced understanding of the challenges faced by the LGBTQ+ community in terms of acceptance and visibility. Furthermore, it highlights the influence of political affiliations and generational factors in shaping these attitudes.
针对 LGBTQ+ 和性别平等标志的负面情绪在西欧各国不断升级,包括那些处于性现代主义前沿的国家。根据西班牙的数据,本文提出理论并发现,国家支持的 LGBTQ+ 标志所受到的负面影响明显高于 LGBTQ+ 问题的其他方面,包括对正式权利的一般态度和具体态度。造成这种负面影响的主要原因是对激进右翼政党 Vox 的支持以及年龄。本研究深入揭示了围绕 LGBTQ+ 符号的舆论的复杂性,对 LGBTQ+ 群体在接受度和可见度方面所面临的挑战提供了细致入微的理解。此外,它还强调了政治派别和代际因素对这些态度形成的影响。
{"title":"The war on flags: The opposition to state-sponsored LGBTQ+ symbols","authors":"Alberto López Ortega","doi":"10.1177/20531680241240824","DOIUrl":"https://doi.org/10.1177/20531680241240824","url":null,"abstract":"Negativity against LGBTQ+ and gender equality symbols is escalating across Western European countries, including those at the forefront of sexual modernism. Drawing on data from Spain, this paper theorizes and finds that state-sponsored LGBTQ+ symbols receive significantly more negativity than other aspects of LGBTQ+ issues related to general and specific attitudes toward formal rights. The negativity is primarily explained by support for Vox, a radical right-wing party, and age. The study provides insights into the complexities of public opinion surrounding LGBTQ+ symbols, offering a nuanced understanding of the challenges faced by the LGBTQ+ community in terms of acceptance and visibility. Furthermore, it highlights the influence of political affiliations and generational factors in shaping these attitudes.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"32 8","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140522826","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Belt and road initiative membership and voting patterns in the United Nations General Assembly 一带一路 "倡议的成员国和在联合国大会的投票模式
Pub Date : 2024-01-01 DOI: 10.1177/20531680241233784
C. Steinert, David Weyrauch
The Belt and Road Initiative (BRI) is not only an unprecedented cross-continental infrastructure investment program, it is also a key pillar of China’s foreign policy. The Chinese government seeks to tie BRI member states closer to its political system and to enhance its soft power across the globe. Whether this has been successful has been analyzed for individual countries but, as of yet, there is a paucity of cross-national evidence on the geopolitical impact of the BRI. We collected a novel global dataset on bilateral cooperation agreements with China in the context of the BRI for all states across the globe. We rely on voting similarities in the United Nations General Assembly (UNGA) to analyze whether the decision to join the BRI is linked to geopolitical alignment with China. We apply generalized synthetic control models and community detection algorithms to estimate the impact of BRI membership on voting similarity to China. Our findings show that the signature of BRI membership agreements had no discernible short-term impact on voting similarity to China in most regions of the world. The exception is Europe, where BRI membership induced a backlash against China. Our findings suggest that European states counter-balance to the US and signal their independence from China after signing a BRI agreement.
一带一路 "倡议(BRI)不仅是一项史无前例的跨洲基础设施投资计划,也是中国外交政策的重要支柱。中国政府力图将 "一带一路 "倡议的成员国与中国的政治体制紧密联系在一起,增强中国在全球的软实力。我们分析了个别国家的做法是否成功,但迄今为止,有关金砖四国地缘政治影响的跨国证据还很少。我们收集了一个新颖的全球数据集,涉及全球所有国家在金砖倡议背景下与中国达成的双边合作协议。我们依靠联合国大会(UNGA)的投票相似性来分析加入金砖倡议的决定是否与与中国的地缘政治结盟有关。我们运用广义合成控制模型和社群检测算法来估计加入金砖四国对中国投票相似性的影响。我们的研究结果表明,在世界大多数地区,金砖四国成员协议的签署对中国的投票相似度没有明显的短期影响。欧洲是个例外,加入金砖四国引起了欧洲对中国的反弹。我们的研究结果表明,欧洲国家在签署金砖四国协议后会反制美国,并发出独立于中国的信号。
{"title":"Belt and road initiative membership and voting patterns in the United Nations General Assembly","authors":"C. Steinert, David Weyrauch","doi":"10.1177/20531680241233784","DOIUrl":"https://doi.org/10.1177/20531680241233784","url":null,"abstract":"The Belt and Road Initiative (BRI) is not only an unprecedented cross-continental infrastructure investment program, it is also a key pillar of China’s foreign policy. The Chinese government seeks to tie BRI member states closer to its political system and to enhance its soft power across the globe. Whether this has been successful has been analyzed for individual countries but, as of yet, there is a paucity of cross-national evidence on the geopolitical impact of the BRI. We collected a novel global dataset on bilateral cooperation agreements with China in the context of the BRI for all states across the globe. We rely on voting similarities in the United Nations General Assembly (UNGA) to analyze whether the decision to join the BRI is linked to geopolitical alignment with China. We apply generalized synthetic control models and community detection algorithms to estimate the impact of BRI membership on voting similarity to China. Our findings show that the signature of BRI membership agreements had no discernible short-term impact on voting similarity to China in most regions of the world. The exception is Europe, where BRI membership induced a backlash against China. Our findings suggest that European states counter-balance to the US and signal their independence from China after signing a BRI agreement.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"4 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140524821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using MI-LASSO to study populist radical right voting in times of pandemic 利用 MI-LASSO 研究大流行时期民粹主义激进右翼的投票情况
Pub Date : 2024-01-01 DOI: 10.1177/20531680241228358
Ka‐Ming Chan, Laura B Stephenson
As immigration issues waned in salience during the COVID-19 pandemic, populist radical right (PRR) parties repositioned themselves by politicizing various pandemic policies. In light of this changing political landscape, scholars have analyzed what factors are associated with PRR voting. Yet, most studies focus on small sets of covariates that could easily ignore other key determinants. To address this limitation, we use MI-LASSO logistic regression, which is a more inductive data-driven approach that can incorporate a huge number of covariates. Our research analyzes the key determinants of voting for the People’s Party of Canada—a PRR party that rose rapidly during the pandemic. Using the 2021 Canadian Election Study dataset ( N = 14,841), we confirm that PRR voters in the pandemic were both protest and policy-oriented voters. They were protest voters since anti-establishment attitudes consistently correlate with their vote choice. On the other hand, PRR voters’ policy concern was about pandemic policies rather than immigration, as nativist attitudes never emerge as key determinants. Additionally, we uncover that the ideological placement of the mainstream right party and the defense of hate speech are strong correlates, while conventional variables like sociodemographics are not. These findings enrich our understanding of PRR voting during the pandemic.
在 COVID-19 大流行期间,随着移民问题的重要性减弱,激进右翼民粹主义政党(PRR)通过将各种流行病政策政治化来重新定位自己。鉴于这种政治格局的变化,学者们分析了哪些因素与激进右翼政党的投票有关。然而,大多数研究都只关注一小部分协变量,很容易忽略其他关键决定因素。为了解决这一局限,我们采用了 MI-LASSO 逻辑回归,这是一种归纳性更强的数据驱动方法,可以纳入大量协变量。我们的研究分析了加拿大人民党(People's Party of Canada)--一个在大流行病期间迅速崛起的共和党--投票的关键决定因素。通过使用 2021 年加拿大选举研究数据集(N = 14,841),我们证实大流行病期间的人民革命党选民既是抗议选民,也是政策导向选民。他们是抗议选民,因为反建制态度与他们的投票选择始终相关。另一方面,PRR 选民的政策关注点是大流行病政策而非移民政策,因为本土主义态度从未成为关键的决定因素。此外,我们还发现,主流右翼政党的意识形态定位和对仇恨言论的辩护与他们的投票选择密切相关,而社会人口统计等传统变量则与之无关。这些发现丰富了我们对大流行病期间 PRR 投票的理解。
{"title":"Using MI-LASSO to study populist radical right voting in times of pandemic","authors":"Ka‐Ming Chan, Laura B Stephenson","doi":"10.1177/20531680241228358","DOIUrl":"https://doi.org/10.1177/20531680241228358","url":null,"abstract":"As immigration issues waned in salience during the COVID-19 pandemic, populist radical right (PRR) parties repositioned themselves by politicizing various pandemic policies. In light of this changing political landscape, scholars have analyzed what factors are associated with PRR voting. Yet, most studies focus on small sets of covariates that could easily ignore other key determinants. To address this limitation, we use MI-LASSO logistic regression, which is a more inductive data-driven approach that can incorporate a huge number of covariates. Our research analyzes the key determinants of voting for the People’s Party of Canada—a PRR party that rose rapidly during the pandemic. Using the 2021 Canadian Election Study dataset ( N = 14,841), we confirm that PRR voters in the pandemic were both protest and policy-oriented voters. They were protest voters since anti-establishment attitudes consistently correlate with their vote choice. On the other hand, PRR voters’ policy concern was about pandemic policies rather than immigration, as nativist attitudes never emerge as key determinants. Additionally, we uncover that the ideological placement of the mainstream right party and the defense of hate speech are strong correlates, while conventional variables like sociodemographics are not. These findings enrich our understanding of PRR voting during the pandemic.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"312 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139635880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
It’s the robots, stupid? Automation risk, labour market resources and incumbent support in Europe 都是机器人惹的祸?欧洲的自动化风险、劳动力市场资源和在职人员支持
Pub Date : 2024-01-01 DOI: 10.1177/20531680241228914
Toon Van Overbeke
As automation challenges labour markets across Europe, research in political science is pointing towards the socially corrosive link between such technological change and political dissatisfaction. In this paper, I extend this research agenda by looking at the relation between automation risk and incumbent support in 20 European countries between 2012 and 2018. I find strong support for the notion that workers with substantial exposure to automation risk are more likely to reject governments at the ballot box. Importantly, however, these findings indicate that this anti-incumbent voting is less prevalent among theoretically at-risk workers who enjoy some level of protection, in the form of permanent contracts, co-determination rights or higher educational attainment. As such, this paper argues that technological occupation risk should be seen as feeding into broader labour market risks faced by voters.
随着自动化对整个欧洲的劳动力市场提出挑战,政治学研究指出,这种技术变革与政治不满之间存在社会腐蚀性联系。在本文中,我扩展了这一研究议程,研究了 2012 年至 2018 年间 20 个欧洲国家的自动化风险与执政者支持率之间的关系。我发现,大量面临自动化风险的工人更有可能在投票箱前拒绝政府,这一观点得到了强有力的支持。但重要的是,这些研究结果表明,在理论上面临风险的工人中,这种反现任者的投票不太普遍,因为他们享有某种程度的保护,如永久合同、共同决定权或较高的教育程度。因此,本文认为,技术职业风险应被视为投票者所面临的更广泛的劳动力市场风险。
{"title":"It’s the robots, stupid? Automation risk, labour market resources and incumbent support in Europe","authors":"Toon Van Overbeke","doi":"10.1177/20531680241228914","DOIUrl":"https://doi.org/10.1177/20531680241228914","url":null,"abstract":"As automation challenges labour markets across Europe, research in political science is pointing towards the socially corrosive link between such technological change and political dissatisfaction. In this paper, I extend this research agenda by looking at the relation between automation risk and incumbent support in 20 European countries between 2012 and 2018. I find strong support for the notion that workers with substantial exposure to automation risk are more likely to reject governments at the ballot box. Importantly, however, these findings indicate that this anti-incumbent voting is less prevalent among theoretically at-risk workers who enjoy some level of protection, in the form of permanent contracts, co-determination rights or higher educational attainment. As such, this paper argues that technological occupation risk should be seen as feeding into broader labour market risks faced by voters.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"33 11","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139633157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ambivalence and perceptions of China: Two list experiments 矛盾心理与对中国的看法:两个列表实验
Pub Date : 2024-01-01 DOI: 10.1177/20531680241234833
Chung-li Wu, Alex Min-Wei Lin
Do citizens reveal their valid preferences when asked about a potential foreign threat? This study presents the results of two list experiments implemented in Taiwan, a democratic and independently ruled island that leaders in China have long vowed to reunify with the mainland. Our two experiments—conducted in March 2019 and September 2021—focus on the percentage of Taiwanese who perceive China as a “friend” and those who regard China as an “enemy.” The findings reveal that, first, the proportion of Taiwanese citizens who harbored hostile feelings toward China grew by 30% points between the two dates. In comparison, those with a more friendly perception of China declined by 18% points. Second, we detected significant misreporting or preference falsification when comparing the list experiment estimates with answers to a direct question. Third, we found evidence that the hypothesized China-ambivalent respondents are most likely to have switched their perceptions of China.
当被问及潜在的外国威胁时,公民是否会透露他们的有效偏好?台湾是一个民主独立的岛屿,中国领导人长期以来一直誓言要统一台湾。我们的两项实验分别于 2019 年 3 月和 2021 年 9 月进行,重点关注将中国视为 "朋友 "和将中国视为 "敌人 "的台湾人比例。实验结果显示:首先,对中国大陆怀有敌意的台湾民众比例在这两个日期之间增长了 30%。相比之下,对中国持友好看法的台湾人则减少了 18%。其次,在比较列表实验估计值和直接问题答案时,我们发现了严重的误报或偏好伪造现象。第三,我们发现有证据表明,对中国持敌对态度的受访者最有可能改变了对中国的看法。
{"title":"Ambivalence and perceptions of China: Two list experiments","authors":"Chung-li Wu, Alex Min-Wei Lin","doi":"10.1177/20531680241234833","DOIUrl":"https://doi.org/10.1177/20531680241234833","url":null,"abstract":"Do citizens reveal their valid preferences when asked about a potential foreign threat? This study presents the results of two list experiments implemented in Taiwan, a democratic and independently ruled island that leaders in China have long vowed to reunify with the mainland. Our two experiments—conducted in March 2019 and September 2021—focus on the percentage of Taiwanese who perceive China as a “friend” and those who regard China as an “enemy.” The findings reveal that, first, the proportion of Taiwanese citizens who harbored hostile feelings toward China grew by 30% points between the two dates. In comparison, those with a more friendly perception of China declined by 18% points. Second, we detected significant misreporting or preference falsification when comparing the list experiment estimates with answers to a direct question. Third, we found evidence that the hypothesized China-ambivalent respondents are most likely to have switched their perceptions of China.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"32 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140526181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large language models as a substitute for human experts in annotating political text 在政治文本注释中替代人类专家的大型语言模型
Pub Date : 2024-01-01 DOI: 10.1177/20531680241236239
Michael Heseltine, Bernhard Clemm von Hohenberg
Large-scale text analysis has grown rapidly as a method in political science and beyond. To date, text-as-data methods rely on large volumes of human-annotated training examples, which place a premium on researcher resources. However, advances in large language models (LLMs) may make automated annotation increasingly viable. This paper tests the performance of GPT-4 across a range of scenarios relevant for analysis of political text. We compare GPT-4 coding with human expert coding of tweets and news articles across four variables (whether text is political, its negativity, its sentiment, and its ideology) and across four countries (the United States, Chile, Germany, and Italy). GPT-4 coding is highly accurate, especially for shorter texts such as tweets, correctly classifying texts up to 95% of the time. Performance drops for longer news articles, and very slightly for non-English text. We introduce a ‘hybrid’ coding approach, in which disagreements of multiple GPT-4 runs are adjudicated by a human expert, which boosts accuracy. Finally, we explore downstream effects, finding that transformer models trained on hand-coded or GPT-4-coded data yield almost identical outcomes. Our results suggest that LLM-assisted coding is a viable and cost-efficient approach, although consideration should be given to task complexity.
作为一种方法,大规模文本分析在政治学及其他领域发展迅速。迄今为止,文本即数据的方法依赖于大量人工标注的训练实例,这对研究人员的资源造成了极大的压力。然而,大语言模型(LLM)的进步可能会使自动注释变得越来越可行。本文测试了 GPT-4 在一系列与政治文本分析相关的场景中的性能。我们比较了 GPT-4 编码与人类专家对推文和新闻文章的编码在四个变量(文本是否具有政治性、文本的负面性、文本的情感和文本的意识形态)和四个国家(美国、智利、德国和意大利)中的表现。GPT-4 编码的准确性很高,尤其是对于推文等较短的文本,高达 95% 的时间都能正确分类。对于较长的新闻文章,性能有所下降,而对于非英语文本,性能则略有下降。我们引入了一种 "混合 "编码方法,由人工专家对多次 GPT-4 运行中出现的分歧进行裁决,从而提高了准确性。最后,我们探讨了下游效应,发现在手工编码或 GPT-4 编码数据上训练的转换器模型产生了几乎相同的结果。我们的研究结果表明,LLM 辅助编码是一种可行且具有成本效益的方法,但应考虑到任务的复杂性。
{"title":"Large language models as a substitute for human experts in annotating political text","authors":"Michael Heseltine, Bernhard Clemm von Hohenberg","doi":"10.1177/20531680241236239","DOIUrl":"https://doi.org/10.1177/20531680241236239","url":null,"abstract":"Large-scale text analysis has grown rapidly as a method in political science and beyond. To date, text-as-data methods rely on large volumes of human-annotated training examples, which place a premium on researcher resources. However, advances in large language models (LLMs) may make automated annotation increasingly viable. This paper tests the performance of GPT-4 across a range of scenarios relevant for analysis of political text. We compare GPT-4 coding with human expert coding of tweets and news articles across four variables (whether text is political, its negativity, its sentiment, and its ideology) and across four countries (the United States, Chile, Germany, and Italy). GPT-4 coding is highly accurate, especially for shorter texts such as tweets, correctly classifying texts up to 95% of the time. Performance drops for longer news articles, and very slightly for non-English text. We introduce a ‘hybrid’ coding approach, in which disagreements of multiple GPT-4 runs are adjudicated by a human expert, which boosts accuracy. Finally, we explore downstream effects, finding that transformer models trained on hand-coded or GPT-4-coded data yield almost identical outcomes. Our results suggest that LLM-assisted coding is a viable and cost-efficient approach, although consideration should be given to task complexity.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"41 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140516062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Do AIs know what the most important issue is? Using language models to code open-text social survey responses at scale 人工智能知道什么是最重要的问题吗?使用语言模型对开放文本社会调查回复进行大规模编码
Pub Date : 2024-01-01 DOI: 10.1177/20531680241231468
Jonathan Mellon, J. Bailey, Ralph Scott, James Breckwoldt, Marta Miori, Phillip Schmedeman
Can artificial intelligence accurately label open-text survey responses? We compare the accuracy of six large language models (LLMs) using a few-shot approach, three supervised learning algorithms (SVM, DistilRoBERTa, and a neural network trained on BERT embeddings), and a second human coder on the task of categorizing “most important issue” responses from the British Election Study Internet Panel into 50 categories. For the scenario where a researcher lacks existing training data, the accuracy of the highest-performing LLM (Claude-1.3: 93.9%) neared human performance (94.7%) and exceeded the highest-performing supervised approach trained on 1000 randomly sampled cases (neural network: 93.5%). In a scenario where previous data has been labeled but a researcher wants to label novel text, the best LLM’s (Claude-1.3: 80.9%) few-shot performance is only slightly behind the human (88.6%) and exceeds the best supervised model trained on 576,000 cases (DistilRoBERTa: 77.8%). PaLM-2, Llama-2, and the SVM all performed substantially worse than the best LLMs and supervised models across all metrics and scenarios. Our results suggest that LLMs may allow for greater use of open-ended survey questions in the future.
人工智能能否准确标注开放文本调查回复?在将英国大选研究互联网小组的 "最重要问题 "回复分为 50 个类别的任务中,我们比较了六种大型语言模型(LLM)的准确性,这六种模型分别采用了少数几次拍摄方法、三种监督学习算法(SVM、DistilRoBERTa 和基于 BERT 内嵌训练的神经网络),以及第二名人工编码员的准确性。在研究人员缺乏现有训练数据的情况下,性能最高的 LLM(Claude-1.3:93.9%)的准确率接近人类(94.7%),并超过了在 1000 个随机抽样案例上训练的性能最高的监督方法(神经网络:93.5%)。在已对先前数据进行标注,但研究人员希望对新文本进行标注的情况下,最佳 LLM(Claude-1.3:80.9%)的少量标注性能仅略微落后于人类(88.6%),并超过了在 576,000 个案例上训练的最佳监督模型(DistilRoBERTa:77.8%)。在所有指标和场景中,PaLM-2、Llama-2 和 SVM 的表现都大大低于最佳 LLM 和监督模型。我们的研究结果表明,LLMs 可以在未来更多地使用开放式调查问题。
{"title":"Do AIs know what the most important issue is? Using language models to code open-text social survey responses at scale","authors":"Jonathan Mellon, J. Bailey, Ralph Scott, James Breckwoldt, Marta Miori, Phillip Schmedeman","doi":"10.1177/20531680241231468","DOIUrl":"https://doi.org/10.1177/20531680241231468","url":null,"abstract":"Can artificial intelligence accurately label open-text survey responses? We compare the accuracy of six large language models (LLMs) using a few-shot approach, three supervised learning algorithms (SVM, DistilRoBERTa, and a neural network trained on BERT embeddings), and a second human coder on the task of categorizing “most important issue” responses from the British Election Study Internet Panel into 50 categories. For the scenario where a researcher lacks existing training data, the accuracy of the highest-performing LLM (Claude-1.3: 93.9%) neared human performance (94.7%) and exceeded the highest-performing supervised approach trained on 1000 randomly sampled cases (neural network: 93.5%). In a scenario where previous data has been labeled but a researcher wants to label novel text, the best LLM’s (Claude-1.3: 80.9%) few-shot performance is only slightly behind the human (88.6%) and exceeds the best supervised model trained on 576,000 cases (DistilRoBERTa: 77.8%). PaLM-2, Llama-2, and the SVM all performed substantially worse than the best LLMs and supervised models across all metrics and scenarios. Our results suggest that LLMs may allow for greater use of open-ended survey questions in the future.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"214 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140521713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Is that ethical? An exploration of political scientists’ views on research ethics 这符合伦理道德吗?探讨政治学家对研究伦理的看法
Pub Date : 2023-10-01 DOI: 10.1177/20531680231209553
Mia Costa, Charles Crabtree, John B. Holbein, M. Landgrave
What do political scientists think about research ethics? What research practices do they find acceptable? Using a survey conducted with the American Political Science Association, we explore perceptions of ethics among 362 political scientists. We find that political scientists do not place much relative weight on ethics when evaluating research. We do, however, find that researchers view different modes of inquiry as having different potential harms. Furthermore, using a conjoint experiment, we find that factors like author affiliation, study location, method, and sample size shape evaluations of study ethicality. Our results contribute to the growing body of metascience by expanding understanding of ethics in political science research.
政治学家如何看待研究伦理?他们认为哪些研究实践是可以接受的?通过与美国政治科学协会合作开展的一项调查,我们探讨了 362 位政治科学家对伦理的看法。我们发现,政治学家在评估研究时并不太重视伦理。不过,我们确实发现,研究人员认为不同的研究模式具有不同的潜在危害。此外,通过联合实验,我们发现作者归属、研究地点、方法和样本大小等因素会影响对研究伦理性的评价。我们的研究结果拓展了人们对政治学研究伦理的理解,从而为不断发展的元科学做出了贡献。
{"title":"Is that ethical? An exploration of political scientists’ views on research ethics","authors":"Mia Costa, Charles Crabtree, John B. Holbein, M. Landgrave","doi":"10.1177/20531680231209553","DOIUrl":"https://doi.org/10.1177/20531680231209553","url":null,"abstract":"What do political scientists think about research ethics? What research practices do they find acceptable? Using a survey conducted with the American Political Science Association, we explore perceptions of ethics among 362 political scientists. We find that political scientists do not place much relative weight on ethics when evaluating research. We do, however, find that researchers view different modes of inquiry as having different potential harms. Furthermore, using a conjoint experiment, we find that factors like author affiliation, study location, method, and sample size shape evaluations of study ethicality. Our results contribute to the growing body of metascience by expanding understanding of ethics in political science research.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"225 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139328872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Arab identity and attitudes toward migration in Kuwait and Qatar 科威特和卡塔尔的阿拉伯特征和对移民的态度
Pub Date : 2023-10-01 DOI: 10.1177/20531680231223289
Lisa Blaydes, Justin Gengler
This paper explores the attitudes of expatriate workers towards the future of migration to the Arab Gulf states. We conduct an online survey and framing experiment administered to more than 2900 expatriate workers in Kuwait and Qatar. We find that Arab migrants are less supportive of future migration than other migrants and also exhibit high levels of ethnic-group bias in favor of fellow Arabs. Evidence from the framing experiment suggests that Arab migrants disfavor Indian workers, even though workers from South Asia are less likely to pose competition for jobs. Our findings provide empirical evidence for ethnic boundary policing within the migrant community and speak to the conditions that encourage anti-migrant sentiment and in-group favoritism among Arab expatriate workers in the Gulf region.
本文探讨了外籍工人对未来向阿拉伯海湾国家移民的态度。我们对科威特和卡塔尔的 2900 多名外籍员工进行了在线调查和框架实验。我们发现,与其他移民相比,阿拉伯移民对未来移民的支持度较低,同时还表现出较高的族群偏见,偏向于阿拉伯同胞。框架实验的证据表明,阿拉伯移民不喜欢印度工人,尽管来自南亚的工人不太可能构成就业竞争。我们的研究结果为移民社区内的种族边界维持提供了经验证据,并说明了在海湾地区的阿拉伯外籍工人中助长反移民情绪和内部群体偏好的条件。
{"title":"Arab identity and attitudes toward migration in Kuwait and Qatar","authors":"Lisa Blaydes, Justin Gengler","doi":"10.1177/20531680231223289","DOIUrl":"https://doi.org/10.1177/20531680231223289","url":null,"abstract":"This paper explores the attitudes of expatriate workers towards the future of migration to the Arab Gulf states. We conduct an online survey and framing experiment administered to more than 2900 expatriate workers in Kuwait and Qatar. We find that Arab migrants are less supportive of future migration than other migrants and also exhibit high levels of ethnic-group bias in favor of fellow Arabs. Evidence from the framing experiment suggests that Arab migrants disfavor Indian workers, even though workers from South Asia are less likely to pose competition for jobs. Our findings provide empirical evidence for ethnic boundary policing within the migrant community and speak to the conditions that encourage anti-migrant sentiment and in-group favoritism among Arab expatriate workers in the Gulf region.","PeriodicalId":125693,"journal":{"name":"Research & Politics","volume":"76 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139327746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Research & Politics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1