首页 > 最新文献

Perspectives on Psychological Science最新文献

英文 中文
Social Drivers and Algorithmic Mechanisms on Digital Media. 数字媒体的社会驱动力和算法机制。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-07-19 DOI: 10.1177/17456916231185057
Hannah Metzler, David Garcia

On digital media, algorithms that process data and recommend content have become ubiquitous. Their fast and barely regulated adoption has raised concerns about their role in well-being both at the individual and collective levels. Algorithmic mechanisms on digital media are powered by social drivers, creating a feedback loop that complicates research to disentangle the role of algorithms and already existing social phenomena. Our brief overview of the current evidence on how algorithms affect well-being, misinformation, and polarization suggests that the role of algorithms in these phenomena is far from straightforward and that substantial further empirical research is needed. Existing evidence suggests that algorithms mostly reinforce existing social drivers, a finding that stresses the importance of reflecting on algorithms in the larger societal context that encompasses individualism, populist politics, and climate change. We present concrete ideas and research questions to improve algorithms on digital platforms and to investigate their role in current problems and potential solutions. Finally, we discuss how the current shift from social media to more algorithmically curated media brings both risks and opportunities if algorithms are designed for individual and societal flourishing rather than short-term profit.

在数字媒体上,处理数据和推荐内容的算法已经无处不在。算法的快速应用和几乎不受监管,引发了人们对算法在个人和集体福祉中的作用的担忧。数字媒体上的算法机制是由社会驱动力推动的,这就形成了一个反馈回路,使研究将算法的作用与已有的社会现象区分开来变得更加复杂。我们对算法如何影响幸福感、错误信息和两极分化的现有证据进行的简要概述表明,算法在这些现象中的作用远非简单明了,需要进一步开展大量实证研究。现有证据表明,算法在很大程度上强化了现有的社会驱动力,这一发现强调了在包括个人主义、民粹主义政治和气候变化在内的更大社会背景下反思算法的重要性。我们提出了具体的想法和研究问题,以改进数字平台上的算法,研究算法在当前问题中的作用和潜在的解决方案。最后,我们讨论了如果算法是为了个人和社会的繁荣而不是短期利益而设计的,那么当前从社交媒体向更多算法策划媒体的转变是如何带来风险和机遇的。
{"title":"Social Drivers and Algorithmic Mechanisms on Digital Media.","authors":"Hannah Metzler, David Garcia","doi":"10.1177/17456916231185057","DOIUrl":"10.1177/17456916231185057","url":null,"abstract":"<p><p>On digital media, algorithms that process data and recommend content have become ubiquitous. Their fast and barely regulated adoption has raised concerns about their role in well-being both at the individual and collective levels. Algorithmic mechanisms on digital media are powered by social drivers, creating a feedback loop that complicates research to disentangle the role of algorithms and already existing social phenomena. Our brief overview of the current evidence on how algorithms affect well-being, misinformation, and polarization suggests that the role of algorithms in these phenomena is far from straightforward and that substantial further empirical research is needed. Existing evidence suggests that algorithms mostly reinforce existing social drivers, a finding that stresses the importance of reflecting on algorithms in the larger societal context that encompasses individualism, populist politics, and climate change. We present concrete ideas and research questions to improve algorithms on digital platforms and to investigate their role in current problems and potential solutions. Finally, we discuss how the current shift from social media to more algorithmically curated media brings both risks and opportunities if algorithms are designed for individual and societal flourishing rather than short-term profit.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"735-748"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373151/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9822531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
People Think That Social Media Platforms Do (but Should Not) Amplify Divisive Content. 人们认为社交媒体平台确实(但不应该)放大了分裂性的内容。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-09-26 DOI: 10.1177/17456916231190392
Steve Rathje, Claire Robertson, William J Brady, Jay J Van Bavel

Recent studies have documented the type of content that is most likely to spread widely, or go "viral," on social media, yet little is known about people's perceptions of what goes viral or what should go viral. This is critical to understand because there is widespread debate about how to improve or regulate social media algorithms. We recruited a sample of participants that is nationally representative of the U.S. population (according to age, gender, and race/ethnicity) and surveyed them about their perceptions of social media virality (n = 511). In line with prior research, people believe that divisive content, moral outrage, negative content, high-arousal content, and misinformation are all likely to go viral online. However, they reported that this type of content should not go viral on social media. Instead, people reported that many forms of positive content-such as accurate content, nuanced content, and educational content-are not likely to go viral even though they think this content should go viral. These perceptions were shared among most participants and were only weakly related to political orientation, social media usage, and demographic variables. In sum, there is broad consensus around the type of content people think social media platforms should and should not amplify, which can help inform solutions for improving social media.

最近的研究记录了最有可能在社交媒体上广泛传播或“病毒式”传播的内容类型,但人们对什么会病毒式传播或什么应该病毒式传播的看法知之甚少。理解这一点至关重要,因为关于如何改进或监管社交媒体算法,存在着广泛的争论。我们招募了一个具有全国代表性的参与者样本(根据年龄、性别和种族/民族),并调查了他们对社交媒体病毒性的看法(n=511)。与之前的研究一致,人们认为分裂性内容、道德愤怒、负面内容、高唤醒内容和错误信息都可能在网上疯传。然而,他们报告说,这类内容不应该在社交媒体上疯传。相反,人们报告说,许多形式的积极内容,如准确的内容、细致入微的内容和教育内容,不太可能在网上疯传,尽管他们认为这些内容应该在网上疯传播。这些看法在大多数参与者中都是一致的,与政治取向、社交媒体使用和人口变量的相关性很弱。总之,人们对社交媒体平台应该和不应该放大的内容类型达成了广泛共识,这有助于为改进社交媒体提供解决方案。
{"title":"People Think That Social Media Platforms Do (but Should Not) Amplify Divisive Content.","authors":"Steve Rathje, Claire Robertson, William J Brady, Jay J Van Bavel","doi":"10.1177/17456916231190392","DOIUrl":"10.1177/17456916231190392","url":null,"abstract":"<p><p>Recent studies have documented the type of content that is most likely to spread widely, or go \"viral,\" on social media, yet little is known about people's perceptions of what goes viral or what should go viral. This is critical to understand because there is widespread debate about how to improve or regulate social media algorithms. We recruited a sample of participants that is nationally representative of the U.S. population (according to age, gender, and race/ethnicity) and surveyed them about their perceptions of social media virality (<i>n</i> = 511). In line with prior research, people believe that divisive content, moral outrage, negative content, high-arousal content, and misinformation are all likely to go viral online. However, they reported that this type of content should not go viral on social media. Instead, people reported that many forms of positive content-such as accurate content, nuanced content, and educational content-are not likely to go viral even though they think this content should go viral. These perceptions were shared among most participants and were only weakly related to political orientation, social media usage, and demographic variables. In sum, there is broad consensus around the type of content people think social media platforms should and should not amplify, which can help inform solutions for improving social media.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"781-795"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41109994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Inversion Problem: Why Algorithms Should Infer Mental State and Not Just Predict Behavior. 反转问题 为什么算法应该推断心理状态,而不仅仅是预测行为?
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-12-12 DOI: 10.1177/17456916231212138
Jon Kleinberg, Jens Ludwig, Sendhil Mullainathan, Manish Raghavan

More and more machine learning is applied to human behavior. Increasingly these algorithms suffer from a hidden-but serious-problem. It arises because they often predict one thing while hoping for another. Take a recommender system: It predicts clicks but hopes to identify preferences. Or take an algorithm that automates a radiologist: It predicts in-the-moment diagnoses while hoping to identify their reflective judgments. Psychology shows us the gaps between the objectives of such prediction tasks and the goals we hope to achieve: People can click mindlessly; experts can get tired and make systematic errors. We argue such situations are ubiquitous and call them "inversion problems": The real goal requires understanding a mental state that is not directly measured in behavioral data but must instead be inverted from the behavior. Identifying and solving these problems require new tools that draw on both behavioral and computational science.

越来越多的机器学习被应用于人类行为。这些算法越来越多地存在一个隐藏但严重的问题。出现这个问题的原因是,它们往往在预测一件事的同时,又希望预测另一件事。以推荐系统为例:它预测点击率,却希望识别偏好。或者以放射科医生的自动化算法为例:它在预测当下诊断的同时,也希望识别他们的反思性判断。心理学向我们展示了此类预测任务的目标与我们希望实现的目标之间的差距:人们可能会漫不经心地点击;专家可能会感到疲劳,从而犯下系统性错误。我们认为这种情况无处不在,并称之为 "反转问题":真正的目标需要理解一种心理状态,而这种心理状态并不能通过行为数据直接测量,而是必须从行为中反转出来。识别和解决这些问题需要借助行为科学和计算科学的新工具。
{"title":"The Inversion Problem: Why Algorithms Should Infer Mental State and Not Just Predict Behavior.","authors":"Jon Kleinberg, Jens Ludwig, Sendhil Mullainathan, Manish Raghavan","doi":"10.1177/17456916231212138","DOIUrl":"10.1177/17456916231212138","url":null,"abstract":"<p><p>More and more machine learning is applied to human behavior. Increasingly these algorithms suffer from a hidden-but serious-problem. It arises because they often predict one thing while hoping for another. Take a recommender system: It predicts clicks but hopes to identify preferences. Or take an algorithm that automates a radiologist: It predicts in-the-moment diagnoses while hoping to identify their reflective judgments. Psychology shows us the gaps between the objectives of such prediction tasks and the goals we hope to achieve: People can click mindlessly; experts can get tired and make systematic errors. We argue such situations are ubiquitous and call them \"inversion problems\": The real goal requires understanding a mental state that is not directly measured in behavioral data but must instead be inverted from the behavior. Identifying and solving these problems require new tools that draw on both behavioral and computational science.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"827-838"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138808387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Blinding to Circumvent Human Biases: Deliberate Ignorance in Humans, Institutions, and Machines. 蒙蔽以规避人类偏见:人类、机构和机器的故意无知。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-09-05 DOI: 10.1177/17456916231188052
Ralph Hertwig, Stefan M Herzog, Anastasia Kozyreva

Inequalities and injustices are thorny issues in liberal societies, manifesting in forms such as the gender-pay gap; sentencing discrepancies among Black, Hispanic, and White defendants; and unequal medical-resource distribution across ethnicities. One cause of these inequalities is implicit social bias-unconsciously formed associations between social groups and attributions such as "nurturing," "lazy," or "uneducated." One strategy to counteract implicit and explicit human biases is delegating crucial decisions, such as how to allocate benefits, resources, or opportunities, to algorithms. Algorithms, however, are not necessarily impartial and objective. Although they can detect and mitigate human biases, they can also perpetuate and even amplify existing inequalities and injustices. We explore how a philosophical thought experiment, Rawls's "veil of ignorance," and a psychological phenomenon, deliberate ignorance, can help shield individuals, institutions, and algorithms from biases. We discuss the benefits and drawbacks of methods for shielding human and artificial decision makers from potentially biasing information. We then broaden our discussion beyond the issues of bias and fairness and turn to a research agenda aimed at improving human judgment accuracy with the assistance of algorithms that conceal information that has the potential to undermine performance. Finally, we propose interdisciplinary research questions.

不平等和不公正是自由社会中的棘手问题,其表现形式包括男女薪酬差距;黑人、西班牙裔和白人被告之间的量刑差异;以及不同种族之间医疗资源分配不均。造成这些不平等现象的原因之一是隐性社会偏见--社会群体与 "养育"、"懒惰 "或 "未受教育 "等归因之间不自觉形成的关联。抵消人类隐性和显性偏见的一种策略是将关键决策,如如何分配利益、资源或机会,委托给算法。然而,算法并不一定公正客观。虽然它们可以发现并减轻人类的偏见,但也可能延续甚至扩大现有的不平等和不公正。我们将探讨哲学思想实验--罗尔斯的 "无知之纱 "和心理现象--刻意的无知--如何帮助个人、机构和算法避免偏见。我们讨论了使人类和人工决策者免受潜在偏见信息影响的方法的益处和弊端。然后,我们将讨论的范围扩大到偏见和公平问题之外,并转向研究议程,旨在通过算法的帮助提高人类判断的准确性,从而掩盖有可能影响绩效的信息。最后,我们提出了跨学科的研究问题。
{"title":"Blinding to Circumvent Human Biases: Deliberate Ignorance in Humans, Institutions, and Machines.","authors":"Ralph Hertwig, Stefan M Herzog, Anastasia Kozyreva","doi":"10.1177/17456916231188052","DOIUrl":"10.1177/17456916231188052","url":null,"abstract":"<p><p>Inequalities and injustices are thorny issues in liberal societies, manifesting in forms such as the gender-pay gap; sentencing discrepancies among Black, Hispanic, and White defendants; and unequal medical-resource distribution across ethnicities. One cause of these inequalities is <i>implicit social bias</i>-unconsciously formed associations between social groups and attributions such as \"nurturing,\" \"lazy,\" or \"uneducated.\" One strategy to counteract implicit and explicit human biases is delegating crucial decisions, such as how to allocate benefits, resources, or opportunities, to algorithms. Algorithms, however, are not necessarily impartial and objective. Although they can detect and mitigate human biases, they can also perpetuate and even amplify existing inequalities and injustices. We explore how a philosophical thought experiment, Rawls's \"veil of ignorance,\" and a psychological phenomenon, deliberate ignorance, can help shield individuals, institutions, and algorithms from biases. We discuss the benefits and drawbacks of methods for shielding human and artificial decision makers from potentially biasing information. We then broaden our discussion beyond the issues of bias and fairness and turn to a research agenda aimed at improving human judgment accuracy with the assistance of algorithms that conceal information that has the potential to undermine performance. Finally, we propose interdisciplinary research questions.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"849-859"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373160/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10157746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Normative Framework for Assessing the Information Curation Algorithms of the Internet. 评估互联网信息管理算法的规范框架。
IF 8.4 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-11-27 DOI: 10.1177/17456916231186779
David Lazer, Briony Swire-Thompson, Christo Wilson

It is critical to understand how algorithms structure the information people see and how those algorithms support or undermine society's core values. We offer a normative framework for the assessment of the information curation algorithms that determine much of what people see on the internet. The framework presents two levels of assessment: one for individual-level effects and another for systemic effects. With regard to individual-level effects we discuss whether (a) the information is aligned with the user's interests, (b) the information is accurate, and (c) the information is so appealing that it is difficult for a person's self-regulatory resources to ignore ("agency hacking"). At the systemic level we discuss whether (a) there are adverse civic-level effects on a system-level variable, such as political polarization; (b) there are negative distributional or discriminatory effects; and (c) there are anticompetitive effects, with the information providing an advantage to the platform. The objective of this framework is both to inform the direction of future scholarship as well as to offer tools for intervention for policymakers.

理解算法如何构建人们看到的信息,以及这些算法如何支持或破坏社会的核心价值观,这一点至关重要。我们为评估信息管理算法提供了一个规范框架,这些算法决定了人们在互联网上看到的大部分内容。该框架提出了两个评估水平:一个是针对个人层面的影响,另一个是针对系统影响。关于个人层面的影响,我们讨论(a)信息是否与用户的兴趣一致,(b)信息是否准确,以及(c)信息是否如此吸引人,以至于个人的自我监管资源难以忽视(“机构黑客”)。在系统层面,我们讨论(a)是否存在对系统层面变量的不利公民层面影响,如政治两极分化;(b)有消极的分配影响或歧视性影响;(c)存在反竞争效应,这些信息为平台提供了优势。该框架的目标是为未来学术研究的方向提供信息,并为政策制定者提供干预工具。
{"title":"A Normative Framework for Assessing the Information Curation Algorithms of the Internet.","authors":"David Lazer, Briony Swire-Thompson, Christo Wilson","doi":"10.1177/17456916231186779","DOIUrl":"10.1177/17456916231186779","url":null,"abstract":"<p><p>It is critical to understand how algorithms structure the information people see and how those algorithms support or undermine society's core values. We offer a normative framework for the assessment of the information curation algorithms that determine much of what people see on the internet. The framework presents two levels of assessment: one for individual-level effects and another for systemic effects. With regard to individual-level effects we discuss whether (a) the information is aligned with the user's interests, (b) the information is accurate, and (c) the information is so appealing that it is difficult for a person's self-regulatory resources to ignore (\"agency hacking\"). At the systemic level we discuss whether (a) there are adverse civic-level effects on a system-level variable, such as political polarization; (b) there are negative distributional or discriminatory effects; and (c) there are anticompetitive effects, with the information providing an advantage to the platform. The objective of this framework is both to inform the direction of future scholarship as well as to offer tools for intervention for policymakers.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"749-757"},"PeriodicalIF":8.4,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138445669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AI Psychometrics: Assessing the Psychological Profiles of Large Language Models Through Psychometric Inventories. 人工智能心理测量学:通过心理测量问卷评估大型语言模型的心理特征。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2024-01-02 DOI: 10.1177/17456916231214460
Max Pellert, Clemens M Lechner, Claudia Wagner, Beatrice Rammstedt, Markus Strohmaier

We illustrate how standard psychometric inventories originally designed for assessing noncognitive human traits can be repurposed as diagnostic tools to evaluate analogous traits in large language models (LLMs). We start from the assumption that LLMs, inadvertently yet inevitably, acquire psychological traits (metaphorically speaking) from the vast text corpora on which they are trained. Such corpora contain sediments of the personalities, values, beliefs, and biases of the countless human authors of these texts, which LLMs learn through a complex training process. The traits that LLMs acquire in such a way can potentially influence their behavior, that is, their outputs in downstream tasks and applications in which they are employed, which in turn may have real-world consequences for individuals and social groups. By eliciting LLMs' responses to language-based psychometric inventories, we can bring their traits to light. Psychometric profiling enables researchers to study and compare LLMs in terms of noncognitive characteristics, thereby providing a window into the personalities, values, beliefs, and biases these models exhibit (or mimic). We discuss the history of similar ideas and outline possible psychometric approaches for LLMs. We demonstrate one promising approach, zero-shot classification, for several LLMs and psychometric inventories. We conclude by highlighting open challenges and future avenues of research for AI Psychometrics.

我们说明了如何将最初设计用于评估人类非认知特质的标准心理测量清单重新用作诊断工具,以评估大型语言模型(LLMs)的类似特质。我们的出发点是假设 LLM 会在无意中不可避免地从训练它们的庞大文本库中获得心理特征(比喻说)。这些语料库包含了这些文本的无数人类作者的个性、价值观、信仰和偏见的沉淀物,LLM 通过复杂的训练过程学习这些沉淀物。LLM 通过这种方式获得的特征可能会影响他们的行为,即他们在下游任务和应用中的产出,这反过来可能会对个人和社会群体产生现实世界的影响。通过诱导本地语言学习者对基于语言的心理测量问卷的回答,我们可以揭示他们的特质。心理测量剖析使研究人员能够从非认知特征的角度研究和比较 LLMs,从而为了解这些模型所表现(或模仿)的个性、价值观、信仰和偏见提供了一个窗口。我们讨论了类似想法的历史,并概述了 LLMs 可能采用的心理测量方法。我们为几种 LLM 和心理测量清单演示了一种很有前景的方法--零点分类法。最后,我们强调了人工智能心理测量学面临的挑战和未来的研究方向。
{"title":"AI Psychometrics: Assessing the Psychological Profiles of Large Language Models Through Psychometric Inventories.","authors":"Max Pellert, Clemens M Lechner, Claudia Wagner, Beatrice Rammstedt, Markus Strohmaier","doi":"10.1177/17456916231214460","DOIUrl":"10.1177/17456916231214460","url":null,"abstract":"<p><p>We illustrate how standard psychometric inventories originally designed for assessing noncognitive human traits can be repurposed as diagnostic tools to evaluate analogous traits in large language models (LLMs). We start from the assumption that LLMs, inadvertently yet inevitably, acquire psychological traits (metaphorically speaking) from the vast text corpora on which they are trained. Such corpora contain sediments of the personalities, values, beliefs, and biases of the countless human authors of these texts, which LLMs learn through a complex training process. The traits that LLMs acquire in such a way can potentially influence their behavior, that is, their outputs in downstream tasks and applications in which they are employed, which in turn may have real-world consequences for individuals and social groups. By eliciting LLMs' responses to language-based psychometric inventories, we can bring their traits to light. Psychometric profiling enables researchers to study and compare LLMs in terms of noncognitive characteristics, thereby providing a window into the personalities, values, beliefs, and biases these models exhibit (or mimic). We discuss the history of similar ideas and outline possible psychometric approaches for LLMs. We demonstrate one promising approach, zero-shot classification, for several LLMs and psychometric inventories. We conclude by highlighting open challenges and future avenues of research for AI Psychometrics.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"808-826"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373167/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139080662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human and Algorithmic Predictions in Geopolitical Forecasting: Quantifying Uncertainty in Hard-to-Quantify Domains. 地缘政治预测中的人工和算法预测:量化难以量化领域的不确定性。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-08-29 DOI: 10.1177/17456916231185339
Barbara A Mellers, John P McCoy, Louise Lu, Philip E Tetlock

Research on clinical versus statistical prediction has demonstrated that algorithms make more accurate predictions than humans in many domains. Geopolitical forecasting is an algorithm-unfriendly domain, with hard-to-quantify data and elusive reference classes that make predictive model-building difficult. Furthermore, the stakes can be high, with missed forecasts leading to mass-casualty consequences. For these reasons, geopolitical forecasting is typically done by humans, even though algorithms play important roles. They are essential as aggregators of crowd wisdom, as frameworks to partition human forecasting variance, and as inputs to hybrid forecasting models. Algorithms are extremely important in this domain. We doubt that humans will relinquish control to algorithms anytime soon-nor do we think they should. However, the accuracy of forecasts will greatly improve if humans are aided by algorithms.

有关临床预测与统计预测的研究表明,在许多领域,算法比人类能做出更准确的预测。地缘政治预测是一个对算法不友好的领域,难以量化的数据和难以捉摸的参考类使得预测模型的建立十分困难。此外,地缘政治预测的风险可能很高,预测失误会导致大规模伤亡。由于这些原因,地缘政治预测通常由人类完成,尽管算法发挥着重要作用。作为群众智慧的汇集者、划分人类预测差异的框架以及混合预测模型的输入,算法是必不可少的。算法在这一领域极为重要。我们怀疑人类是否会很快将控制权交给算法,我们也不认为他们应该这样做。但是,如果人类能够得到算法的帮助,预测的准确性将会大大提高。
{"title":"Human and Algorithmic Predictions in Geopolitical Forecasting: Quantifying Uncertainty in Hard-to-Quantify Domains.","authors":"Barbara A Mellers, John P McCoy, Louise Lu, Philip E Tetlock","doi":"10.1177/17456916231185339","DOIUrl":"10.1177/17456916231185339","url":null,"abstract":"<p><p>Research on clinical versus statistical prediction has demonstrated that algorithms make more accurate predictions than humans in many domains. Geopolitical forecasting is an algorithm-unfriendly domain, with hard-to-quantify data and elusive reference classes that make predictive model-building difficult. Furthermore, the stakes can be high, with missed forecasts leading to mass-casualty consequences. For these reasons, geopolitical forecasting is typically done by humans, even though algorithms play important roles. They are essential as aggregators of crowd wisdom, as frameworks to partition human forecasting variance, and as inputs to hybrid forecasting models. Algorithms are extremely important in this domain. We doubt that humans will relinquish control to algorithms anytime soon-nor do we think they should. However, the accuracy of forecasts will greatly improve if humans are aided by algorithms.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"711-721"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373164/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10109373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Building Human-Like Artificial Agents: A General Cognitive Algorithm for Emulating Human Decision-Making in Dynamic Environments. 构建类人人工智能体:一种在动态环境中模拟人类决策的通用认知算法。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2023-10-31 DOI: 10.1177/17456916231196766
Cleotilde Gonzalez

One of the early goals of artificial intelligence (AI) was to create algorithms that exhibited behavior indistinguishable from human behavior (i.e., human-like behavior). Today, AI has diverged, often aiming to excel in tasks inspired by human capabilities and outperform humans, rather than replicating human cogntion and action. In this paper, I explore the overarching question of whether computational algorithms have achieved this initial goal of AI. I focus on dynamic decision-making, approaching the question from the perspective of computational cognitive science. I present a general cognitive algorithm that intends to emulate human decision-making in dynamic environments, as defined in instance-based learning theory (IBLT). I use the cognitive steps proposed in IBLT to organize and discuss current evidence that supports some of the human-likeness of the decision-making mechanisms. I also highlight the significant gaps in research that are required to improve current models and to create higher fidelity in computational algorithms to represent human decision processes. I conclude with concrete steps toward advancing the construction of algorithms that exhibit human-like behavior with the ultimate goal of supporting human dynamic decision-making.

人工智能(AI)的早期目标之一是创建表现出与人类行为(即类人行为)无法区分的行为的算法。如今,人工智能已经出现了分歧,其目标往往是在受人类能力启发的任务中脱颖而出,超越人类,而不是复制人类的认知和行动。在这篇论文中,我探讨了计算算法是否实现了人工智能的最初目标这一首要问题。我专注于动态决策,从计算认知科学的角度来处理这个问题。我提出了一种通用的认知算法,旨在模拟动态环境中的人类决策,如基于实例的学习理论(IBLT)所定义的那样。我使用IBLT中提出的认知步骤来组织和讨论当前支持决策机制的一些人类相似性的证据。我还强调了改进当前模型和在表示人类决策过程的计算算法中创造更高保真度所需的研究中的重大差距。最后,我以具体步骤来推进展现类人行为的算法构建,最终目标是支持人类的动态决策。
{"title":"Building Human-Like Artificial Agents: A General Cognitive Algorithm for Emulating Human Decision-Making in Dynamic Environments.","authors":"Cleotilde Gonzalez","doi":"10.1177/17456916231196766","DOIUrl":"10.1177/17456916231196766","url":null,"abstract":"<p><p>One of the early goals of artificial intelligence (AI) was to create algorithms that exhibited behavior indistinguishable from human behavior (i.e., human-like behavior). Today, AI has diverged, often aiming to excel in tasks inspired by human capabilities and outperform humans, rather than replicating human cogntion and action. In this paper, I explore the overarching question of whether computational algorithms have achieved this initial goal of AI. I focus on dynamic decision-making, approaching the question from the perspective of computational cognitive science. I present a general cognitive algorithm that intends to emulate human decision-making in dynamic environments, as defined in instance-based learning theory (IBLT). I use the cognitive steps proposed in IBLT to organize and discuss current evidence that supports some of the human-likeness of the decision-making mechanisms. I also highlight the significant gaps in research that are required to improve current models and to create higher fidelity in computational algorithms to represent human decision processes. I conclude with concrete steps toward advancing the construction of algorithms that exhibit human-like behavior with the ultimate goal of supporting human dynamic decision-making.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"860-873"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71413406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial for the Special Issue on Algorithms in Our Lives. 为 "我们生活中的算法 "特刊撰写社论。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-09-01 Epub Date: 2024-01-02 DOI: 10.1177/17456916231214452
Sudeep Bhatia, Mirta Galesic, Melanie Mitchell
{"title":"Editorial for the Special Issue on Algorithms in Our Lives.","authors":"Sudeep Bhatia, Mirta Galesic, Melanie Mitchell","doi":"10.1177/17456916231214452","DOIUrl":"10.1177/17456916231214452","url":null,"abstract":"","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"707-710"},"PeriodicalIF":10.5,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139080663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Managing Fear During Pandemics: Risks and Opportunities. 在大流行病期间管理恐惧:风险与机遇。
IF 10.5 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2024-07-01 Epub Date: 2023-06-26 DOI: 10.1177/17456916231178720
Gaëtan Mertens, Iris M Engelhard, Derek M Novacek, Richard J McNally

Fear is an emotion triggered by the perception of danger and motivates safety behaviors. Within the context of the COVID-19 pandemic, there were ample danger cues (e.g., images of patients on ventilators) and a high need for people to use appropriate safety behaviors (e.g., social distancing). Given this central role of fear within the context of a pandemic, it is important to review some of the emerging findings and lessons learned during the COVID-19 pandemic and their implications for managing fear. We highlight factors that determine fear (i.e., proximity, predictability, and controllability) and review several adaptive and maladaptive consequences of fear of COVID-19 (e.g., following governmental health policies and panic buying). Finally, we provide directions for future research and make policy recommendations that can promote adequate health behaviors and limit the negative consequences of fear during pandemics.

恐惧是由对危险的感知引发的一种情绪,并促使人们采取安全行为。在 COVID-19 大流行的背景下,存在大量的危险线索(如使用呼吸机的病人图像),人们非常需要采取适当的安全行为(如社会疏远)。鉴于恐惧在大流行中的核心作用,有必要回顾一下 COVID-19 大流行期间的一些新发现和经验教训及其对控制恐惧的影响。我们强调了决定恐惧的因素(即临近性、可预测性和可控性),并回顾了 COVID-19 带来的几种适应性和不适应性后果(如遵循政府卫生政策和恐慌性购买)。最后,我们为今后的研究指明了方向,并提出了政策建议,以促进适当的健康行为,限制大流行病期间恐惧带来的负面影响。
{"title":"Managing Fear During Pandemics: Risks and Opportunities.","authors":"Gaëtan Mertens, Iris M Engelhard, Derek M Novacek, Richard J McNally","doi":"10.1177/17456916231178720","DOIUrl":"10.1177/17456916231178720","url":null,"abstract":"<p><p>Fear is an emotion triggered by the perception of danger and motivates safety behaviors. Within the context of the COVID-19 pandemic, there were ample danger cues (e.g., images of patients on ventilators) and a high need for people to use appropriate safety behaviors (e.g., social distancing). Given this central role of fear within the context of a pandemic, it is important to review some of the emerging findings and lessons learned during the COVID-19 pandemic and their implications for managing fear. We highlight factors that determine fear (i.e., proximity, predictability, and controllability) and review several adaptive and maladaptive consequences of fear of COVID-19 (e.g., following governmental health policies and panic buying). Finally, we provide directions for future research and make policy recommendations that can promote adequate health behaviors and limit the negative consequences of fear during pandemics.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"652-659"},"PeriodicalIF":10.5,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10293863/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9705158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Perspectives on Psychological Science
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1