首页 > 最新文献

Psychological methods最新文献

英文 中文
What are the mathematical bounds for coefficient α? 系数α的数学界限是什么?
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-05-25 DOI: 10.1037/met0000583
Niels Waller, William Revelle

Coefficient α, although ubiquitous in the research literature, is frequently criticized for being a poor estimate of test reliability. In this note, we consider the range of α and prove that it has no lower bound (i.e., α ∈ ( - ∞, 1]). While outlining our proofs, we present algorithms for generating data sets that will yield any fixed value of α in its range. We also prove that for some data sets-even those with appreciable item correlations-α is undefined. Although α is a putative estimate of the correlation between parallel forms, it is not a correlation as α can assume any value below-1 (and α values below 0 are nonsensical reliability estimates). In the online supplemental materials, we provide R code for replicating our empirical findings and for generating data sets with user-defined α values. We hope that researchers will use this code to better understand the limitations of α as an index of scale reliability. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

系数α虽然在研究文献中无处不在,但经常被批评为测试信度的不良估计。本文考虑α的值域,并证明它没有下界(即α∈(-∞,1])。在概述我们的证明时,我们提出了生成数据集的算法,这些数据集将产生α在其范围内的任何固定值。我们也证明了对于一些数据集——甚至那些具有明显项目相关性的数据集——α是未定义的。虽然α是平行形式之间相关性的假定估计,但它不是相关性,因为α可以假设低于1的任何值(α值低于0是无意义的可靠性估计)。在在线补充材料中,我们提供了R代码来复制我们的经验发现,并生成具有用户定义的α值的数据集。我们希望研究人员将使用这个代码来更好地理解α作为量表可靠性指标的局限性。(PsycInfo Database Record (c) 2025 APA,版权所有)。
{"title":"What are the mathematical bounds for coefficient α?","authors":"Niels Waller, William Revelle","doi":"10.1037/met0000583","DOIUrl":"10.1037/met0000583","url":null,"abstract":"<p><p>Coefficient α, although ubiquitous in the research literature, is frequently criticized for being a poor estimate of test reliability. In this note, we consider the range of α and prove that it has no lower bound (i.e., α ∈ ( - ∞, 1]). While outlining our proofs, we present algorithms for generating data sets that will yield any fixed value of α in its range. We also prove that for some data sets-even those with appreciable item correlations-α is undefined. Although α is a putative estimate of the correlation between parallel forms, it is not a correlation as α can assume any value below-1 (and α values below 0 are nonsensical reliability estimates). In the online supplemental materials, we provide R code for replicating our empirical findings and for generating data sets with user-defined α values. We hope that researchers will use this code to better understand the limitations of α as an index of scale reliability. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1385-1390"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9892839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On estimating the frequency of a target behavior from time-constrained yes/no survey questions: A parametric approach based on the Poisson process. 从时间约束的是/否调查问题中估计目标行为的频率:基于泊松过程的参数化方法。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-07-20 DOI: 10.1037/met0000588
Benedikt Iberl, Rolf Ulrich

We propose a novel method to analyze time-constrained yes/no questions about a target behavior (e.g., "Did you take sleeping pills during the last 12 months?"). A drawback of these questions is that the relative frequency of answering these questions with "yes" does not allow one to draw definite conclusions about the frequency of the target behavior (i.e., how often sleeping pills were taken) nor about the prevalence of trait carriers (i.e., percentage of people that take sleeping pills). Here we show how this information can be extracted from the results of such questions employing a prevalence curve and a Poisson model. The applicability of the method was evaluated with a survey on everyday behavior, which revealed plausible results and reasonable model fit. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

我们提出了一种新的方法来分析关于目标行为的有时间限制的是/否问题(例如,“你在过去的12个月里吃过安眠药吗?”)。这些问题的一个缺点是,回答“是”的相对频率不能让一个人对目标行为的频率(即,服用安眠药的频率)或特质携带者的流行程度(即,服用安眠药的人的百分比)得出明确的结论。在这里,我们展示了如何利用流行曲线和泊松模型从这些问题的结果中提取这些信息。通过对日常行为的调查评估了该方法的适用性,结果表明该方法的结果合理,模型拟合合理。(PsycInfo Database Record (c) 2025 APA,版权所有)。
{"title":"On estimating the frequency of a target behavior from time-constrained yes/no survey questions: A parametric approach based on the Poisson process.","authors":"Benedikt Iberl, Rolf Ulrich","doi":"10.1037/met0000588","DOIUrl":"10.1037/met0000588","url":null,"abstract":"<p><p>We propose a novel method to analyze time-constrained yes/no questions about a target behavior (e.g., \"Did you take sleeping pills during the last 12 months?\"). A drawback of these questions is that the relative frequency of answering these questions with \"yes\" does not allow one to draw definite conclusions about the frequency of the target behavior (i.e., how often sleeping pills were taken) nor about the prevalence of trait carriers (i.e., percentage of people that take sleeping pills). Here we show how this information can be extracted from the results of such questions employing a prevalence curve and a Poisson model. The applicability of the method was evaluated with a survey on everyday behavior, which revealed plausible results and reasonable model fit. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1185-1197"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9838249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A sensitivity analysis for temporal bias in cross-sectional mediation. 横截面调解中时间偏差的敏感性分析。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-12-21 DOI: 10.1037/met0000628
A R Georgeson, Diana Alvarez-Bartolo, David P MacKinnon

For over three decades, methodologists have cautioned against the use of cross-sectional mediation analyses because they yield biased parameter estimates. Yet, cross-sectional mediation models persist in practice and sometimes represent the only analytic option. We propose a sensitivity analysis procedure to encourage a more principled use of cross-sectional mediation analysis, drawing inspiration from Gollob and Reichardt (1987, 1991). The procedure is based on the two-wave longitudinal mediation model and uses phantom variables for the baseline data. After a researcher provides ranges of possible values for cross-lagged, autoregressive, and baseline Y and M correlations among the phantom and observed variables, they can use the sensitivity analysis to identify longitudinal conditions in which conclusions from a cross-sectional model would differ most from a longitudinal model. To support the procedure, we first show that differences in sign and effect size of the b-path occur most often when the cross-sectional effect size of the b-path is small and the cross-lagged and the autoregressive correlations are equal or similar in magnitude. We then apply the procedure to cross-sectional analyses from real studies and compare the sensitivity analysis results to actual results from a longitudinal mediation analysis. While no statistical procedure can replace longitudinal data, these examples demonstrate that the sensitivity analysis can recover the effect that was actually observed in the longitudinal data if provided with the correct input information. Implications of the routine application of sensitivity analysis to temporal bias are discussed. R code for the procedure is provided in the online supplementary materials. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

三十多年来,方法论专家一直告诫人们不要使用横截面中介分析,因为它们会产生有偏差的参数估计。然而,横截面中介模型在实践中依然存在,有时甚至是唯一的分析选择。我们从 Gollob 和 Reichardt(1987,1991)那里得到启发,提出了一种敏感性分析程序,以鼓励更有原则地使用横截面中介分析。该程序以两波纵向中介模型为基础,使用幻象变量作为基线数据。在研究人员提供了幽灵变量和观察变量之间的交叉滞后、自回归、基线 Y 和 M 相关性的可能值范围后,他们就可以使用敏感性分析来确定纵向条件,在这些条件下,横截面模型的结论与纵向模型的结论差异最大。为了支持这一程序,我们首先表明,当 b 路径的横截面效应大小较小,且交叉滞后相关性和自回归相关性的大小相等或相似时,b 路径的符号和效应大小的差异最常出现。然后,我们将该程序应用于实际研究的横截面分析,并将敏感性分析结果与纵向中介分析的实际结果进行比较。虽然没有任何统计程序可以取代纵向数据,但这些例子表明,如果提供正确的输入信息,灵敏度分析可以恢复纵向数据中实际观察到的效果。本文讨论了将灵敏度分析常规应用于时间偏差的意义。在线补充材料中提供了程序的 R 代码。(PsycInfo Database Record (c) 2023 APA, 版权所有)。
{"title":"A sensitivity analysis for temporal bias in cross-sectional mediation.","authors":"A R Georgeson, Diana Alvarez-Bartolo, David P MacKinnon","doi":"10.1037/met0000628","DOIUrl":"10.1037/met0000628","url":null,"abstract":"<p><p>For over three decades, methodologists have cautioned against the use of cross-sectional mediation analyses because they yield biased parameter estimates. Yet, cross-sectional mediation models persist in practice and sometimes represent the only analytic option. We propose a sensitivity analysis procedure to encourage a more principled use of cross-sectional mediation analysis, drawing inspiration from Gollob and Reichardt (1987, 1991). The procedure is based on the two-wave longitudinal mediation model and uses phantom variables for the baseline data. After a researcher provides ranges of possible values for cross-lagged, autoregressive, and baseline <i>Y</i> and <i>M</i> correlations among the phantom and observed variables, they can use the sensitivity analysis to identify longitudinal conditions in which conclusions from a cross-sectional model would differ most from a longitudinal model. To support the procedure, we first show that differences in sign and effect size of the <i>b</i>-path occur most often when the cross-sectional effect size of the <i>b</i>-path is small and the cross-lagged and the autoregressive correlations are equal or similar in magnitude. We then apply the procedure to cross-sectional analyses from real studies and compare the sensitivity analysis results to actual results from a longitudinal mediation analysis. While no statistical procedure can replace longitudinal data, these examples demonstrate that the sensitivity analysis can recover the effect that was actually observed in the longitudinal data if provided with the correct input information. Implications of the routine application of sensitivity analysis to temporal bias are discussed. R code for the procedure is provided in the online supplementary materials. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1326-1344"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11190060/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138831224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The case for the curve: Parametric regression with second- and third-order polynomial functions of predictors should be routine. 曲线的情况:使用预测因子的二阶和三阶多项式函数进行参数回归应该是常规做法。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-12-14 DOI: 10.1037/met0000629
Edward Kroc, Oscar L Olvera Astivia

Polynomial regression is an old and commonly discussed modeling technique, though recommendations for its usage are widely variable. Here, we make the case that polynomial regression with second- and third-order terms should be part of every applied practitioners standard model-building toolbox, and should be taught to new students of the subject as the default technique to model nonlinearity. We argue that polynomial regression is superior to nonparametric alternatives for nonstatisticians due to its ease of interpretation, flexibility, and its nonreliance on sophisticated mathematics, like knots and kernel smoothing. This makes it the ideal default for nonstatisticians interested in building realistic models that can capture global as well as local effects of predictors on a response variable. Low-order polynomial regression can effectively model compact floor and ceiling effects, local linearity, and prevent inferring the presence of spurious interaction effects between distinct predictors when none are present. We also argue that the case against polynomial regression is largely specious, relying on either misconceptions around the method, strawman arguments, or historical artifacts. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

多项式回归是一种古老而常被讨论的建模技术,但对其使用的建议却众说纷纭。在这里,我们提出的理由是,带有二阶和三阶项的多项式回归应该成为每个应用实践者标准建模工具箱的一部分,并且应该作为非线性建模的默认技术教授给该学科的新生。我们认为,对于非统计人员来说,多项式回归优于非参数回归,因为它易于解释、具有灵活性,而且不依赖于复杂的数学,如结和核平滑。这使得它成为有兴趣建立现实模型的非统计人员的理想默认设置,这些模型可以捕捉到预测因子对响应变量的整体和局部影响。低阶多项式回归可以有效地模拟紧凑的下限和上限效应、局部线性,并防止在不同预测因子之间不存在相互作用效应的情况下推断出虚假的相互作用效应。我们还认为,反对多项式回归的理由大多似是而非,要么是对该方法的误解,要么是稻草人论点,要么是历史伪命题。(PsycInfo Database Record (c) 2023 APA, 版权所有)。
{"title":"The case for the curve: Parametric regression with second- and third-order polynomial functions of predictors should be routine.","authors":"Edward Kroc, Oscar L Olvera Astivia","doi":"10.1037/met0000629","DOIUrl":"10.1037/met0000629","url":null,"abstract":"<p><p>Polynomial regression is an old and commonly discussed modeling technique, though recommendations for its usage are widely variable. Here, we make the case that polynomial regression with second- and third-order terms should be part of every applied practitioners standard model-building toolbox, and should be taught to new students of the subject as the default technique to model nonlinearity. We argue that polynomial regression is superior to nonparametric alternatives for nonstatisticians due to its ease of interpretation, flexibility, and its nonreliance on sophisticated mathematics, like knots and kernel smoothing. This makes it the ideal default for nonstatisticians interested in building realistic models that can capture global as well as local effects of predictors on a response variable. Low-order polynomial regression can effectively model compact floor and ceiling effects, local linearity, and prevent inferring the presence of spurious interaction effects between distinct predictors when none are present. We also argue that the case against polynomial regression is largely specious, relying on either misconceptions around the method, strawman arguments, or historical artifacts. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1277-1293"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138807009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using group level factor models to resolve high dimensionality in model-based sampling. 在基于模型的抽样中使用组级因子模型解决高维度问题。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2024-06-24 DOI: 10.1037/met0000618
Niek Stevenson, Reilly J Innes, Quentin F Gronau, Steven Miletić, Andrew Heathcote, Birte U Forstmann, Scott D Brown

Joint modeling of decisions and neural activation poses the potential to provide significant advances in linking brain and behavior. However, methods of joint modeling have been limited by difficulties in estimation, often due to high dimensionality and simultaneous estimation challenges. In the current article, we propose a method of model estimation that draws on state-of-the-art Bayesian hierarchical modeling techniques and uses factor analysis as a means of dimensionality reduction and inference at the group level. This hierarchical factor approach can adopt any model for the individual and distill the relationships of its parameters across individuals through a factor structure. We demonstrate the significant dimensionality reduction gained by factor analysis and good parameter recovery, and illustrate a variety of factor loading constraints that can be used for different purposes and research questions, as well as three applications of the method to previously analyzed data. We conclude that this method provides a flexible and usable approach with interpretable outcomes that are primarily data-driven, in contrast to the largely hypothesis-driven methods often used in joint modeling. Although we focus on joint modeling methods, this model-based estimation approach could be used for any high dimensional modeling problem. We provide open-source code and accompanying tutorial documentation to make the method accessible to any researchers. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

决策和神经激活的联合建模有可能为大脑和行为之间的联系带来重大进展。然而,联合建模的方法一直受到估计困难的限制,这通常是由于高维度和同步估计的挑战。在这篇文章中,我们提出了一种模型估计方法,它借鉴了最先进的贝叶斯分层建模技术,并使用因子分析作为群体层面的降维和推断手段。这种分层因子方法可以采用任何个体模型,并通过因子结构提炼出个体间的参数关系。我们展示了因子分析显著的降维效果和良好的参数恢复能力,并说明了可用于不同目的和研究问题的各种因子载荷约束,以及该方法在先前分析数据中的三个应用。我们的结论是,与联合建模中常用的主要以假设为导向的方法相比,这种方法提供了一种灵活可用的方法,其结果主要以数据为导向,可解释性强。虽然我们关注的是联合建模方法,但这种基于模型的估计方法可用于任何高维建模问题。我们提供了开源代码和随附的教程文档,使任何研究人员都能使用这种方法。(PsycInfo Database Record (c) 2024 APA, 版权所有)。
{"title":"Using group level factor models to resolve high dimensionality in model-based sampling.","authors":"Niek Stevenson, Reilly J Innes, Quentin F Gronau, Steven Miletić, Andrew Heathcote, Birte U Forstmann, Scott D Brown","doi":"10.1037/met0000618","DOIUrl":"10.1037/met0000618","url":null,"abstract":"<p><p>Joint modeling of decisions and neural activation poses the potential to provide significant advances in linking brain and behavior. However, methods of joint modeling have been limited by difficulties in estimation, often due to high dimensionality and simultaneous estimation challenges. In the current article, we propose a method of model estimation that draws on state-of-the-art Bayesian hierarchical modeling techniques and uses factor analysis as a means of dimensionality reduction and inference at the group level. This hierarchical factor approach can adopt any model for the individual and distill the relationships of its parameters across individuals through a factor structure. We demonstrate the significant dimensionality reduction gained by factor analysis and good parameter recovery, and illustrate a variety of factor loading constraints that can be used for different purposes and research questions, as well as three applications of the method to previously analyzed data. We conclude that this method provides a flexible and usable approach with interpretable outcomes that are primarily data-driven, in contrast to the largely hypothesis-driven methods often used in joint modeling. Although we focus on joint modeling methods, this model-based estimation approach could be used for any high dimensional modeling problem. We provide open-source code and accompanying tutorial documentation to make the method accessible to any researchers. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1218-1241"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141446886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Yes stormtrooper, these are the droids you are looking for: Identifying and preliminarily evaluating bot and fraud detection strategies in online psychological research. 是的,暴风兵,这些就是你要找的机器人:识别和初步评估在线心理研究中的机器人和欺诈检测策略。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2025-03-03 DOI: 10.1037/met0000724
Thomas J Shaw, Cory J Cascalheira, Emily C Helminen, Cal D Brisbin, Skyler D Jackson, Melissa Simone, Tami P Sullivan, Abigail W Batchelder, Jillian R Scheer

Bots (i.e., automated software programs that perform various tasks) and fraudulent responders pose a growing and costly threat to psychological research as well as affect data integrity. However, few studies have been published on this topic. (a) Describe our experience with bots and fraudulent responders using a case study, (b) present various bot and fraud detection tactics (BFDTs) and identify the number of suspected bot and fraudulent respondents removed, (c) propose a consensus confidence system for eliminating bots and fraudulent responders to determine the number of BFDTs researchers should use, and (d) examine the initial effectiveness of dynamic versus static BFDT protocols. This study is part of a larger 14-day experience sampling method study with trauma-exposed sexual minority cisgender women and transgender and/or nonbinary people. Faced with several bot and fraudulent responder infiltrations during data collection, we developed an evolving BFDT protocol to eliminate bots and fraudulent responders. Throughout this study, we received 24,053 responses on our baseline survey. After applying our BFDT protocols, we eliminated 99.75% of respondents that were likely bots or fraudulent responders. Some BFDTs seemed to be more effective and afford higher confidence than others, dynamic protocols seemed to be more effective than static protocols, and bots and fraudulent responders introduced significant bias in the results. This study advances online psychological research by curating one of the largest samples of bot and fraudulent respondents and pilot testing the largest number of BFDTs to date. Recommendations for future research are provided. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

机器人(即执行各种任务的自动化软件程序)和欺诈性应答者对心理学研究构成了日益增长的、代价高昂的威胁,并影响了数据的完整性。然而,关于这一主题的研究很少发表。(a)通过案例研究描述我们在机器人和欺诈性应答者方面的经验,(b)提出各种机器人和欺诈检测策略(BFDT),并确定被删除的可疑机器人和欺诈应答者的数量,(c)提出一个共识信任系统,用于消除机器人和欺诈性应答者,以确定研究人员应该使用的BFDT数量,以及(d)检查动态与静态BFDT协议的初始有效性。这项研究是一项更大的为期14天的经验抽样方法研究的一部分,研究对象是暴露在创伤中的性少数、顺性、变性和/或非二元性别的女性。在数据收集过程中,面对一些bot和欺诈性应答器渗透,我们开发了一个不断发展的BFDT协议来消除bot和欺诈性应答器。在整个研究过程中,我们在基线调查中收到了24053份回复。在应用BFDT协议后,我们消除了99.75%的可能是机器人或欺诈性应答者的应答者。一些bfdt似乎比其他bfdt更有效,提供更高的置信度,动态协议似乎比静态协议更有效,机器人和欺诈性应答者在结果中引入了显著的偏差。这项研究通过策划最大的机器人和欺诈性受访者样本之一,以及迄今为止最大数量的bfdt试点测试,推进了在线心理学研究。对今后的研究提出了建议。(PsycInfo Database Record (c) 2025 APA,版权所有)。
{"title":"Yes stormtrooper, these are the droids you are looking for: Identifying and preliminarily evaluating bot and fraud detection strategies in online psychological research.","authors":"Thomas J Shaw, Cory J Cascalheira, Emily C Helminen, Cal D Brisbin, Skyler D Jackson, Melissa Simone, Tami P Sullivan, Abigail W Batchelder, Jillian R Scheer","doi":"10.1037/met0000724","DOIUrl":"10.1037/met0000724","url":null,"abstract":"<p><p>Bots (i.e., automated software programs that perform various tasks) and fraudulent responders pose a growing and costly threat to psychological research as well as affect data integrity. However, few studies have been published on this topic. (a) Describe our experience with bots and fraudulent responders using a case study, (b) present various bot and fraud detection tactics (BFDTs) and identify the number of suspected bot and fraudulent respondents removed, (c) propose a consensus confidence system for eliminating bots and fraudulent responders to determine the number of BFDTs researchers should use, and (d) examine the initial effectiveness of dynamic versus static BFDT protocols. This study is part of a larger 14-day experience sampling method study with trauma-exposed sexual minority cisgender women and transgender and/or nonbinary people. Faced with several bot and fraudulent responder infiltrations during data collection, we developed an evolving BFDT protocol to eliminate bots and fraudulent responders. Throughout this study, we received 24,053 responses on our baseline survey. After applying our BFDT protocols, we eliminated 99.75% of respondents that were likely bots or fraudulent responders. Some BFDTs seemed to be more effective and afford higher confidence than others, dynamic protocols seemed to be more effective than static protocols, and bots and fraudulent responders introduced significant bias in the results. This study advances online psychological research by curating one of the largest samples of bot and fraudulent respondents and pilot testing the largest number of BFDTs to date. Recommendations for future research are provided. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1294-1310"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12353484/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143543217","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Bayesian item response theory for multicohort repeated measure design to estimate individual latent change scores. 在多队列重复测量设计中使用贝叶斯项目反应理论估算个体潜在变化分数。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-12-14 DOI: 10.1037/met0000635
Chun Wang, Ruoyi Zhu, Paul K Crane, Seo-Eun Choi, Richard N Jones, Douglas Tommet

Repeated measure data design has been used extensively in a wide range of fields, such as brain aging or developmental psychology, to answer important research questions exploring relationships between trajectory of change and external variables. In many cases, such data may be collected from multiple study cohorts and harmonized, with the intention of gaining higher statistical power and enhanced external validity. When psychological constructs are measured using survey scales, a fundamental psychometric challenge for data harmonization is to create commensurate measures for the constructs of interest across studies. Traditional analysis may fit a unidimensional item response theory model to data from one time point and one cohort to obtain item parameters and fix the same parameters in subsequent analyses. Such a simplified approach ignores item residual dependencies in the repeated measure design on one hand, and on the other hand, it does not exploit accumulated information from different cohorts. Instead, two alternative approaches should serve such data designs much better: an integrative approach using multiple-group two-tier model via concurrent calibration, and if such calibration fails to converge, a Bayesian sequential calibration approach that uses informative priors on common items to establish the scale. Both approaches use a Markov chain Monte Carlo algorithm that handles computational complexity well. Through a simulation study and an empirical study using Alzheimer's diseases neuroimage initiative cognitive battery data (i.e., language and executive functioning), we conclude that latent change scores obtained from these two alternative approaches are more precisely recovered. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

重复测量数据设计已被广泛应用于大脑衰老或发展心理学等多个领域,以回答探索变化轨迹与外部变量之间关系的重要研究问题。在许多情况下,此类数据可能是从多个研究队列中收集并统一的,目的是获得更高的统计能力和更强的外部效度。在使用调查量表测量心理结构时,数据协调的一个基本心理测量挑战是为不同研究中的相关结构创建相称的测量方法。传统的分析方法可能会对一个时间点和一个队列的数据拟合一个单维度的项目反应理论模型,以获得项目参数,并在后续分析中固定相同的参数。这种简化方法一方面忽略了重复测量设计中的项目残差依赖性,另一方面也无法利用不同队列中积累的信息。取而代之的是两种更适合此类数据设计的方法:一种是通过同时校准使用多组双层模型的综合方法,另一种是在校准失败的情况下使用贝叶斯序列校准方法,该方法使用共同项目的信息先验来建立量表。这两种方法都使用马尔科夫链蒙特卡罗算法,能很好地处理计算复杂性。通过模拟研究和使用阿尔茨海默氏症神经影像倡议认知电池数据(即语言和执行功能)进行的实证研究,我们得出结论:从这两种替代方法中获得的潜在变化分数可以更精确地恢复。(PsycInfo Database Record (c) 2023 APA, 版权所有)。
{"title":"Using Bayesian item response theory for multicohort repeated measure design to estimate individual latent change scores.","authors":"Chun Wang, Ruoyi Zhu, Paul K Crane, Seo-Eun Choi, Richard N Jones, Douglas Tommet","doi":"10.1037/met0000635","DOIUrl":"10.1037/met0000635","url":null,"abstract":"<p><p>Repeated measure data design has been used extensively in a wide range of fields, such as brain aging or developmental psychology, to answer important research questions exploring relationships between trajectory of change and external variables. In many cases, such data may be collected from multiple study cohorts and harmonized, with the intention of gaining higher statistical power and enhanced external validity. When psychological constructs are measured using survey scales, a fundamental psychometric challenge for data harmonization is to create commensurate measures for the constructs of interest across studies. Traditional analysis may fit a unidimensional item response theory model to data from one time point and one cohort to obtain item parameters and fix the same parameters in subsequent analyses. Such a simplified approach ignores item residual dependencies in the repeated measure design on one hand, and on the other hand, it does not exploit accumulated information from different cohorts. Instead, two alternative approaches should serve such data designs much better: an integrative approach using multiple-group two-tier model via concurrent calibration, and if such calibration fails to converge, a Bayesian sequential calibration approach that uses informative priors on common items to establish the scale. Both approaches use a Markov chain Monte Carlo algorithm that handles computational complexity well. Through a simulation study and an empirical study using Alzheimer's diseases neuroimage initiative cognitive battery data (i.e., language and executive functioning), we conclude that latent change scores obtained from these two alternative approaches are more precisely recovered. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1364-1384"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138807189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Thinking clearly about time-invariant confounders in cross-lagged panel models: A guide for choosing a statistical model from a causal inference perspective. 清晰思考交叉滞后面板模型中的时变混杂因素:从因果推论角度选择统计模型指南》。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2024-09-19 DOI: 10.1037/met0000647
Kou Murayama, Thomas Gfrörer

Many statistical models have been proposed to examine reciprocal cross-lagged causal effects from panel data. The present article aims to clarify how these various statistical models control for unmeasured time-invariant confounders, helping researchers understand the differences in the statistical models from a causal inference perspective. Assuming that the true data generation model (i.e., causal model) has time-invariant confounders that were not measured, we compared different statistical models (e.g., dynamic panel model and random-intercept cross-lagged panel model) in terms of the conditions under which they can provide a relatively accurate estimate of the target causal estimand. Based on the comparisons and realistic plausibility of these conditions, we made some practical suggestions for researchers to select a statistical model when they are interested in causal inference. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

人们提出了许多统计模型来研究面板数据的互惠跨滞后因果效应。本文旨在阐明这些不同的统计模型如何控制未测量的时间不变混杂因素,帮助研究人员从因果推断的角度理解统计模型的差异。假设真实的数据生成模型(即因果模型)有未测量的时变型混杂因素,我们比较了不同统计模型(如动态面板模型和随机截距交叉滞后面板模型)在何种条件下能对目标因果估计值提供相对准确的估计。基于这些条件的比较和现实合理性,我们为研究人员在进行因果推断时选择统计模型提出了一些实用建议。(PsycInfo Database Record (c) 2024 APA, 版权所有)。
{"title":"Thinking clearly about time-invariant confounders in cross-lagged panel models: A guide for choosing a statistical model from a causal inference perspective.","authors":"Kou Murayama, Thomas Gfrörer","doi":"10.1037/met0000647","DOIUrl":"10.1037/met0000647","url":null,"abstract":"<p><p>Many statistical models have been proposed to examine reciprocal cross-lagged causal effects from panel data. The present article aims to clarify how these various statistical models control for unmeasured time-invariant confounders, helping researchers understand the differences in the statistical models from a causal inference perspective. Assuming that the true data generation model (i.e., causal model) has time-invariant confounders that were not measured, we compared different statistical models (e.g., dynamic panel model and random-intercept cross-lagged panel model) in terms of the conditions under which they can provide a relatively accurate estimate of the target causal estimand. Based on the comparisons and realistic plausibility of these conditions, we made some practical suggestions for researchers to select a statistical model when they are interested in causal inference. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1311-1325"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142293952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling categorical time-to-event data: The example of social interaction dynamics captured with event-contingent experience sampling methods. 对分类时间到事件数据建模:用事件偶然经验抽样方法捕获的社会互动动态示例。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2023-09-07 DOI: 10.1037/met0000598
Timon Elmer, Marijtje A J van Duijn, Nilam Ram, Laura F Bringmann

The depth of information collected in participants' daily lives with active (e.g., experience sampling surveys) and passive (e.g., smartphone sensors) ambulatory measurement methods is immense. When measuring participants' behaviors in daily life, the timing of particular events-such as social interactions-is often recorded. These data facilitate the investigation of new types of research questions about the timing of those events, including whether individuals' affective state is associated with the rate of social interactions (binary event occurrence) and what types of social interactions are likely to occur (multicategory event occurrences, e.g., interactions with friends or family). Although survival analysis methods have been used to analyze time-to-event data in longitudinal settings for several decades, these methods have not yet been incorporated into ambulatory assessment research. This article illustrates how multilevel and multistate survival analysis methods can be used to model the social interaction dynamics captured in intensive longitudinal data, specifically when individuals exhibit particular categories of behavior. We provide an introduction to these models and a tutorial on how the timing and type of social interactions can be modeled using the R statistical programming language. Using event-contingent reports (N = 150, Nevents = 64,112) obtained in an ambulatory study of interpersonal interactions, we further exemplify an empirical application case. In sum, this article demonstrates how survival models can advance the understanding of (social interaction) dynamics that unfold in daily life. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

通过主动(如经验抽样调查)和被动(如智能手机传感器)动态测量方法在参与者的日常生活中收集的信息深度是巨大的。在测量参与者在日常生活中的行为时,通常会记录特定事件(如社交互动)发生的时间。这些数据有助于调查关于这些事件发生时间的新型研究问题,包括个人的情感状态是否与社会互动的频率有关(二元事件发生),以及什么类型的社会互动可能发生(多类别事件发生,例如与朋友或家人的互动)。尽管生存分析方法已被用于分析纵向设置的事件时间数据几十年,但这些方法尚未被纳入动态评估研究。本文阐述了如何使用多层次和多状态生存分析方法来模拟密集纵向数据中捕获的社会互动动态,特别是当个体表现出特定类别的行为时。我们提供了这些模型的介绍,以及如何使用R统计编程语言对社会互动的时间和类型进行建模的教程。利用在人际互动动态研究中获得的事件或有报告(N = 150,事件= 64,112),我们进一步举例说明了一个实证应用案例。总而言之,本文展示了生存模型如何促进对日常生活中展开的(社会互动)动态的理解。(PsycInfo Database Record (c) 2025 APA,版权所有)。
{"title":"Modeling categorical time-to-event data: The example of social interaction dynamics captured with event-contingent experience sampling methods.","authors":"Timon Elmer, Marijtje A J van Duijn, Nilam Ram, Laura F Bringmann","doi":"10.1037/met0000598","DOIUrl":"10.1037/met0000598","url":null,"abstract":"<p><p>The depth of information collected in participants' daily lives with active (e.g., experience sampling surveys) and passive (e.g., smartphone sensors) ambulatory measurement methods is immense. When measuring participants' behaviors in daily life, the timing of particular events-such as social interactions-is often recorded. These data facilitate the investigation of new types of research questions about the timing of those events, including whether individuals' affective state is associated with the rate of social interactions (binary event occurrence) and what types of social interactions are likely to occur (multicategory event occurrences, e.g., interactions with friends or family). Although survival analysis methods have been used to analyze time-to-event data in longitudinal settings for several decades, these methods have not yet been incorporated into ambulatory assessment research. This article illustrates how multilevel and multistate survival analysis methods can be used to model the social interaction dynamics captured in intensive longitudinal data, specifically <i>when individuals exhibit particular categories of behavior</i>. We provide an introduction to these models and a tutorial on how the timing and type of social interactions can be modeled using the R statistical programming language. Using event-contingent reports (<i>N</i> = 150, <i>N</i><sub>events</sub> = 64,112) obtained in an ambulatory study of interpersonal interactions, we further exemplify an empirical application case. In sum, this article demonstrates how survival models can advance the understanding of (social interaction) dynamics that unfold in daily life. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1345-1363"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10227502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A computationally efficient and robust method to estimate exploratory factor analysis models with correlated residuals. 估算具有相关残差的探索性因子分析模型的高效稳健计算方法。
IF 7.8 1区 心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY Pub Date : 2025-12-01 Epub Date: 2024-09-23 DOI: 10.1037/met0000609
Guangjian Zhang, Dayoung Lee

A critical assumption in exploratory factor analysis (EFA) is that manifest variables are no longer correlated after the influences of the common factors are controlled. The assumption may not be valid in some EFA applications; for example, questionnaire items share other characteristics in addition to their relations to common factors. We present a computationally efficient and robust method to estimate EFA with correlated residuals. We provide details on the implementation of the method with both ordinary least squares estimation and maximum likelihood estimation. We demonstrate the method using empirical data and conduct a simulation study to explore its statistical properties. The results are (a) that the new method encountered much fewer convergence problems than the existing method; (b) that the EFA model with correlated residuals produced a more satisfactory model fit than the conventional EFA model; and (c) that the EFA model with correlated residuals and the conventional EFA model produced very similar estimates for factor loadings. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

探索性因素分析(EFA)的一个重要假设是,在控制了共同因素的影响后,显变量不再相关。在某些 EFA 应用中,这一假设可能并不成立;例如,除了与公共因子的关系外,问卷项目还具有其他共同特征。我们提出了一种计算效率高且稳健的方法来估计具有相关残差的 EFA。我们详细介绍了普通最小二乘估计和最大似然估计方法的实施。我们利用经验数据演示了该方法,并进行了模拟研究以探索其统计特性。结果是:(a) 与现有方法相比,新方法遇到的收敛问题要少得多;(b) 与传统的 EFA 模型相比,带有相关残差的 EFA 模型产生了更令人满意的模型拟合效果;(c) 带有相关残差的 EFA 模型和传统的 EFA 模型产生了非常相似的因子载荷估计值。(PsycInfo Database Record (c) 2024 APA, 版权所有)。
{"title":"A computationally efficient and robust method to estimate exploratory factor analysis models with correlated residuals.","authors":"Guangjian Zhang, Dayoung Lee","doi":"10.1037/met0000609","DOIUrl":"10.1037/met0000609","url":null,"abstract":"<p><p>A critical assumption in exploratory factor analysis (EFA) is that manifest variables are no longer correlated after the influences of the common factors are controlled. The assumption may not be valid in some EFA applications; for example, questionnaire items share other characteristics in addition to their relations to common factors. We present a computationally efficient and robust method to estimate EFA with correlated residuals. We provide details on the implementation of the method with both ordinary least squares estimation and maximum likelihood estimation. We demonstrate the method using empirical data and conduct a simulation study to explore its statistical properties. The results are (a) that the new method encountered much fewer convergence problems than the existing method; (b) that the EFA model with correlated residuals produced a more satisfactory model fit than the conventional EFA model; and (c) that the EFA model with correlated residuals and the conventional EFA model produced very similar estimates for factor loadings. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"1263-1276"},"PeriodicalIF":7.8,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142293947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Psychological methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1