Context Dependency as a Predictor of Replicability

IF 3.6 2区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Review of General Psychology Pub Date : 2020-12-01 DOI:10.1177/10892680211015635
M. Gollwitzer, J. Schwabe
{"title":"Context Dependency as a Predictor of Replicability","authors":"M. Gollwitzer, J. Schwabe","doi":"10.1177/10892680211015635","DOIUrl":null,"url":null,"abstract":"We scrutinize the argument that unsuccessful replications—and heterogeneous effect sizes more generally—may reflect an underappreciated influence of context characteristics. Notably, while some of these context characteristics may be conceptually irrelevant (as they merely affect psychometric properties of the measured/manipulated variables), others are conceptually relevant as they qualify a theory. Here, we present a conceptual and analytical framework that allows researchers to empirically estimate the extent to which effect size heterogeneity is due to conceptually relevant versus irrelevant context characteristics. According to this framework, contextual characteristics are conceptually relevant when the observed heterogeneity of effect sizes cannot be attributed to psychometric properties. As an illustrative example, we demonstrate that the observed heterogeneity of the “moral typecasting” effect, which had been included in the ManyLabs 2 replication project, is more likely attributable to conceptually relevant rather than irrelevant context characteristics, which suggests that the psychological theory behind this effect may need to be specified. In general, we argue that context dependency should be taken more seriously and treated more carefully by replication research.","PeriodicalId":48306,"journal":{"name":"Review of General Psychology","volume":null,"pages":null},"PeriodicalIF":3.6000,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/10892680211015635","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Review of General Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/10892680211015635","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 1

Abstract

We scrutinize the argument that unsuccessful replications—and heterogeneous effect sizes more generally—may reflect an underappreciated influence of context characteristics. Notably, while some of these context characteristics may be conceptually irrelevant (as they merely affect psychometric properties of the measured/manipulated variables), others are conceptually relevant as they qualify a theory. Here, we present a conceptual and analytical framework that allows researchers to empirically estimate the extent to which effect size heterogeneity is due to conceptually relevant versus irrelevant context characteristics. According to this framework, contextual characteristics are conceptually relevant when the observed heterogeneity of effect sizes cannot be attributed to psychometric properties. As an illustrative example, we demonstrate that the observed heterogeneity of the “moral typecasting” effect, which had been included in the ManyLabs 2 replication project, is more likely attributable to conceptually relevant rather than irrelevant context characteristics, which suggests that the psychological theory behind this effect may need to be specified. In general, we argue that context dependency should be taken more seriously and treated more carefully by replication research.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
上下文依赖性作为可复制性的预测因子
我们仔细研究了不成功的复制——以及更普遍的异质效应大小——可能反映了环境特征的未被充分认识的影响。值得注意的是,虽然这些背景特征中的一些可能在概念上无关紧要(因为它们只影响被测量/操纵变量的心理测量特性),但其他一些在概念上相关,因为它们限定了一个理论。在这里,我们提出了一个概念和分析框架,使研究人员能够经验地估计效应大小异质性在多大程度上是由于概念相关与不相关的背景特征。根据这一框架,当观察到的效应大小的异质性不能归因于心理测量特性时,情境特征在概念上是相关的。作为一个说说性的例子,我们证明了在ManyLabs 2复制项目中观察到的“道德类型塑造”效应的异质性,更有可能归因于概念相关而不是无关的上下文特征,这表明这种效应背后的心理学理论可能需要指定。总的来说,我们认为在复制研究中应该更认真地对待和更仔细地对待上下文依赖性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Review of General Psychology
Review of General Psychology PSYCHOLOGY, MULTIDISCIPLINARY-
CiteScore
7.60
自引率
4.80%
发文量
26
期刊介绍: Review of General Psychology seeks to publish innovative theoretical, conceptual, or methodological articles that cross-cut the traditional subdisciplines of psychology. The journal contains articles that advance theory, evaluate and integrate research literatures, provide a new historical analysis, or discuss new methodological developments in psychology as a whole. Review of General Psychology is especially interested in articles that bridge gaps between subdisciplines in psychology as well as related fields or that focus on topics that transcend traditional subdisciplinary boundaries.
期刊最新文献
Relational Ontology in the Mapuche Thinking: Possibilities for Indigenous Well-Being Amidst Colonial Settings Education and Training: Professional The 4D Model of American Political Conservatism: Disgust, Disorder Aversion, Deontology, and (Social) Dominance The Kokoro in Japanese Spiritual Care Antiracist Psychology to Advance Equitable Public Policy
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1