首页 > 最新文献

Methodology: European Journal of Research Methods for The Behavioral and Social Sciences最新文献

英文 中文
Incorporating machine learning into factor mixture modeling: Identification of covariate interactions to explain population heterogeneity 将机器学习纳入因子混合建模:识别协变量相互作用以解释种群异质性
3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2023-09-29 DOI: 10.5964/meth.9487
Yan Wang, Tonghui Xu, Jiabin Shen

Factor mixture modeling (FMM) has been widely adopted in health and behavioral sciences to examine unobserved population heterogeneity. Covariates are often included in FMM as predictors of the latent class membership via multinomial logistic regression to help understand the formation and characterization of population heterogeneity. However, interaction effects among covariates have received considerably less attention, which might be attributable to the fact that interaction effects cannot be identified in a straightforward fashion. This study demonstrated the utility of structural equation model or SEM trees as an exploratory method to automatically search for covariate interactions that might explain heterogeneity in FMM. That is, following FMM analyses, SEM trees are conducted to identify covariate interactions. Next, latent class membership is regressed on the covariate interactions as well as all main effects of covariates. This approach was demonstrated using the Traumatic Brain Injury Model System National Database.

因子混合模型(FMM)已广泛应用于健康和行为科学,以检查未观察到的人口异质性。协变量通常包含在FMM中,通过多项逻辑回归作为潜在类隶属度的预测因子,以帮助理解群体异质性的形成和表征。然而,协变量之间的相互作用效应受到的关注相当少,这可能是由于相互作用效应不能以直接的方式确定。本研究证明了结构方程模型或SEM树作为一种探索性方法的效用,可以自动搜索可能解释FMM异质性的协变量相互作用。也就是说,在FMM分析之后,进行SEM树来识别协变量相互作用。接下来,对协变量相互作用以及协变量的所有主要影响进行了潜在类隶属度的回归。使用创伤性脑损伤模型系统国家数据库证明了这种方法。
{"title":"Incorporating machine learning into factor mixture modeling: Identification of covariate interactions to explain population heterogeneity","authors":"Yan Wang, Tonghui Xu, Jiabin Shen","doi":"10.5964/meth.9487","DOIUrl":"https://doi.org/10.5964/meth.9487","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">Factor mixture modeling (FMM) has been widely adopted in health and behavioral sciences to examine unobserved population heterogeneity. Covariates are often included in FMM as predictors of the latent class membership via multinomial logistic regression to help understand the formation and characterization of population heterogeneity. However, interaction effects among covariates have received considerably less attention, which might be attributable to the fact that interaction effects cannot be identified in a straightforward fashion. This study demonstrated the utility of structural equation model or SEM trees as an exploratory method to automatically search for covariate interactions that might explain heterogeneity in FMM. That is, following FMM analyses, SEM trees are conducted to identify covariate interactions. Next, latent class membership is regressed on the covariate interactions as well as all main effects of covariates. This approach was demonstrated using the Traumatic Brain Injury Model System National Database.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"116 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135132981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bias and sensitivity analyses for linear front-door models 线性前门模型的偏差和敏感性分析
3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2023-09-29 DOI: 10.5964/meth.9205
Felix Thoemmes, Yongnam Kim

The front-door model allows unbiased estimation of a total effect in the presence of unobserved confounding. This guarantee of unbiasedness hinges on a set of assumptions that can be violated in practice. We derive formulas that quantify the amount of bias for specific violations, and contrast them with bias that would be realized from a naive estimator of the effect. Some violations result in simple, monotonic increases in bias, while others lead to more complex bias, consisting of confounding bias, collider bias, and bias amplification. In some instances, these sources of bias can (partially) cancel each other out. We present ways to conduct sensitivity analyses for all violations, and provide code that performs sensitivity analyses for the linear front-door model. We finish with an applied example of the effect of math self-efficacy on educational achievement.

前门模型允许在存在未观察到的混淆的情况下对总效应进行无偏估计。这种对无偏性的保证依赖于一组在实践中可能被违背的假设。我们推导出量化特定违规偏差量的公式,并将其与从效果的朴素估计器中实现的偏差进行对比。一些违规会导致简单的、单调的偏置增加,而另一些则会导致更复杂的偏置,包括混杂偏置、碰撞偏置和偏置放大。在某些情况下,这些偏见的来源可以(部分地)相互抵消。我们提出了对所有违规行为进行敏感性分析的方法,并提供了对线性前门模型进行敏感性分析的代码。最后以数学自我效能感对学业成绩影响的应用为例。
{"title":"Bias and sensitivity analyses for linear front-door models","authors":"Felix Thoemmes, Yongnam Kim","doi":"10.5964/meth.9205","DOIUrl":"https://doi.org/10.5964/meth.9205","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">The front-door model allows unbiased estimation of a total effect in the presence of unobserved confounding. This guarantee of unbiasedness hinges on a set of assumptions that can be violated in practice. We derive formulas that quantify the amount of bias for specific violations, and contrast them with bias that would be realized from a naive estimator of the effect. Some violations result in simple, monotonic increases in bias, while others lead to more complex bias, consisting of confounding bias, collider bias, and bias amplification. In some instances, these sources of bias can (partially) cancel each other out. We present ways to conduct sensitivity analyses for all violations, and provide code that performs sensitivity analyses for the linear front-door model. We finish with an applied example of the effect of math self-efficacy on educational achievement.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"220 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135132982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Opaque prior distributions in Bayesian latent variable models 贝叶斯潜变量模型中的不透明先验分布
3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2023-09-29 DOI: 10.5964/meth.11167
Edgar C. Merkle, Oludare Ariyo, Sonja D. Winter, Mauricio Garnier-Villarreal

We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite requirement on correlation matrices, from sign indeterminacy of factor loadings, and from order constraints on threshold parameters. The issue is especially problematic for reproducibility and for model checks that involve prior distributions, including prior predictive assessment and Bayes factors. In these cases, one might be assessing the wrong model, casting doubt on the relevance of the results. The most straightforward solution to the issue sometimes involves use of informative prior distributions. We explore other solutions and make recommendations for practice.

我们回顾了贝叶斯潜变量模型中的常见情况,其中研究人员指定的先验分布与估计过程中使用的先验分布不同。这些情况可能来自相关矩阵的正定要求,因子负载的符号不确定性,以及阈值参数的顺序约束。对于再现性和涉及先验分布(包括先验预测评估和贝叶斯因子)的模型检查来说,这个问题尤其成问题。在这些情况下,人们可能会评估错误的模型,从而对结果的相关性产生怀疑。这个问题最直接的解决方案有时涉及使用信息性先验分布。我们探索其他解决方案,并为实践提出建议。
{"title":"Opaque prior distributions in Bayesian latent variable models","authors":"Edgar C. Merkle, Oludare Ariyo, Sonja D. Winter, Mauricio Garnier-Villarreal","doi":"10.5964/meth.11167","DOIUrl":"https://doi.org/10.5964/meth.11167","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite requirement on correlation matrices, from sign indeterminacy of factor loadings, and from order constraints on threshold parameters. The issue is especially problematic for reproducibility and for model checks that involve prior distributions, including prior predictive assessment and Bayes factors. In these cases, one might be assessing the wrong model, casting doubt on the relevance of the results. The most straightforward solution to the issue sometimes involves use of informative prior distributions. We explore other solutions and make recommendations for practice.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135132978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extracting vocal characteristics and calculating vocal synchrony using Praat and R: A tutorial 提取人声特征和计算人声同步使用Praat和R:一个教程
3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2023-09-29 DOI: 10.5964/meth.9375
Désirée Schoenherr, Alisa Shugaley, Franziska Roller, Lukas A. Knitter, Bernhard Strauss, Uwe Altmann

In clinical research, the dependence of the results on the methods used is frequently discussed. In research on nonverbal synchrony, human ratings or automated methods do not lead to congruent results. Even when automated methods are used, the choice of the method and parameter settings are important to obtain congruent results. However, these are often insufficiently reported and do not meet the standard of transparency and reproducibility. This tutorial is aimed at researchers who are not familiar with the software Praat and R and shows in detail how to extract acoustic features like fundamental frequency or speech rate from video or audio files in conversations. Furthermore, it is presented how vocal synchrony indices can be calculated from these characteristics to represent how well two interaction partners vocally adapt to each other. All used scripts as well as a minimal example, can be found on the Open Science Framework and Github.

在临床研究中,经常讨论结果对所用方法的依赖性。在非语言同步性的研究中,人类评分或自动化方法不能得出一致的结果。即使使用自动化方法,方法和参数设置的选择对于获得一致的结果也很重要。然而,这些通常报告不足,不符合透明度和可重复性的标准。本教程针对不熟悉Praat和R软件的研究人员,详细介绍了如何从对话中的视频或音频文件中提取基本频率或语音速率等声学特征。此外,本文还介绍了如何从这些特征中计算出声音同步指数,以表示两个互动伙伴在声音上相互适应的程度。所有使用的脚本以及一个最小的例子,都可以在开放科学框架和Github上找到。
{"title":"Extracting vocal characteristics and calculating vocal synchrony using Praat and R: A tutorial","authors":"Désirée Schoenherr, Alisa Shugaley, Franziska Roller, Lukas A. Knitter, Bernhard Strauss, Uwe Altmann","doi":"10.5964/meth.9375","DOIUrl":"https://doi.org/10.5964/meth.9375","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">In clinical research, the dependence of the results on the methods used is frequently discussed. In research on nonverbal synchrony, human ratings or automated methods do not lead to congruent results. Even when automated methods are used, the choice of the method and parameter settings are important to obtain congruent results. However, these are often insufficiently reported and do not meet the standard of transparency and reproducibility. This tutorial is aimed at researchers who are not familiar with the software Praat and R and shows in detail how to extract acoustic features like fundamental frequency or speech rate from video or audio files in conversations. Furthermore, it is presented how vocal synchrony indices can be calculated from these characteristics to represent how well two interaction partners vocally adapt to each other. All used scripts as well as a minimal example, can be found on the Open Science Framework and Github.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135133247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Scaling metric measurement invariance models 缩放度量不变性模型
3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2023-09-29 DOI: 10.5964/meth.10177
Eric Klopp, Stefan Klößner

This paper aims at clarifying the questions regarding the effects of the scaling method on the discrepancy function of the metric measurement invariance model. We provide examples and a formal account showing that neither the choice of the scaling method in general nor the choice of a particular referent indicator affects the value of the discrepancy function. Thus, the test statistic is not affected by the scaling method, either. The results rely on an appropriate application of the scaling restrictions, which can be phrased as a simple rule: "Apply the scaling restriction in one group only!" We develop formulas to calculate the degrees of freedom of χ²-difference tests comparing metric models to the corresponding configural model. Our findings show that it is impossible to test the invariance of the estimated loading of exactly one indicator, because metric MI models aimed at doing so are actually equivalent to the configural model.

本文旨在澄清标度法对度量不变性模型的差异函数的影响问题。我们提供的例子和一个正式的帐户表明,无论是选择一般的标度方法,还是选择特定的参考指标,都不会影响差异函数的值。因此,测试统计量也不受缩放方法的影响。结果依赖于缩放限制的适当应用,可以将其表述为一个简单的规则:“仅在一个组中应用缩放限制!”我们开发了公式来计算比较度量模型和相应的构形模型的χ 2差异检验的自由度。我们的研究结果表明,不可能准确地测试一个指标的估计负荷的不变性,因为旨在这样做的度量MI模型实际上等同于配置模型。
{"title":"Scaling metric measurement invariance models","authors":"Eric Klopp, Stefan Klößner","doi":"10.5964/meth.10177","DOIUrl":"https://doi.org/10.5964/meth.10177","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">This paper aims at clarifying the questions regarding the effects of the scaling method on the discrepancy function of the metric measurement invariance model. We provide examples and a formal account showing that neither the choice of the scaling method in general nor the choice of a particular referent indicator affects the value of the discrepancy function. Thus, the test statistic is not affected by the scaling method, either. The results rely on an appropriate application of the scaling restrictions, which can be phrased as a simple rule: \"Apply the scaling restriction in one group only!\" We develop formulas to calculate the degrees of freedom of χ²-difference tests comparing metric models to the corresponding configural model. Our findings show that it is impossible to test the invariance of the estimated loading of exactly one indicator, because metric MI models aimed at doing so are actually equivalent to the configural model.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135133113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pushing the Limits: The Performance of Maximum Likelihood and Bayesian Estimation With Small and Unbalanced Samples in a Latent Growth Model 突破极限:潜在增长模型中小样本和不平衡样本的最大似然和贝叶斯估计的性能
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2019-01-01 DOI: 10.1027/1614-2241/a000162
Mariëlle Zondervan-Zwijnenburg, S. Depaoli, M. Peeters, R. van de Schoot
Longitudinal developmental research is often focused on patterns of change or growth across different (sub)groups of individuals. Particular to some research contexts, developmental inquiries may involve one or more (sub)groups that are small in nature and therefore difficult to properly capture through statistical analysis. The current study explores the lower-bound limits of subsample sizes in a multiple group latent growth modeling by means of a simulation study. We particularly focus on how the maximum likelihood (ML) and Bayesian estimation approaches differ when (sub)sample sizes are small. The results show that Bayesian estimation resolves computational issues that occur with ML estimation and that the addition of prior information can be the key to detect a difference between groups when sample and effect sizes are expected to be limited. The acquisition of prior information with respect to the smaller group is especially influential in this context.
纵向发展研究通常侧重于不同(亚)个体群体的变化或成长模式。特别是在某些研究背景下,发展调查可能涉及一个或多个性质较小的(子)群体,因此难以通过统计分析正确捕捉。本研究通过模拟研究探讨了多组潜在增长模型中子样本大小的下限。我们特别关注当(子)样本量小时,最大似然(ML)和贝叶斯估计方法如何不同。结果表明,贝叶斯估计解决了ML估计中出现的计算问题,并且当样本和效果大小预计有限时,先验信息的添加可能是检测组之间差异的关键。在这种情况下,对较小群体的先验信息的获取尤其有影响。
{"title":"Pushing the Limits: The Performance of Maximum Likelihood and Bayesian Estimation With Small and Unbalanced Samples in a Latent Growth Model","authors":"Mariëlle Zondervan-Zwijnenburg, S. Depaoli, M. Peeters, R. van de Schoot","doi":"10.1027/1614-2241/a000162","DOIUrl":"https://doi.org/10.1027/1614-2241/a000162","url":null,"abstract":"Longitudinal developmental research is often focused on patterns of change or growth across different (sub)groups of individuals. Particular to some research contexts, developmental inquiries may involve one or more (sub)groups that are small in nature and therefore difficult to properly capture through statistical analysis. The current study explores the lower-bound limits of subsample sizes in a multiple group latent growth modeling by means of a simulation study. We particularly focus on how the maximum likelihood (ML) and Bayesian estimation approaches differ when (sub)sample sizes are small. The results show that Bayesian estimation resolves computational issues that occur with ML estimation and that the addition of prior information can be the key to detect a difference between groups when sample and effect sizes are expected to be limited. The acquisition of prior information with respect to the smaller group is especially influential in this context.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"15 1","pages":"31–43"},"PeriodicalIF":3.1,"publicationDate":"2019-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45944329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
What Can We Learn From Factorial Surveys About Human Behavior?: A Validation Study Comparing Field and Survey Experiments on Discrimination 我们能从人类行为的析因调查中学到什么?:一项比较现场和调查实验的鉴别验证研究
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2019-01-01 DOI: 10.1027/1614-2241/a000161
Knut Petzold, Tobias Wolbring
Factorial survey experiments are increasingly used in the social sciences to investigate behavioral intentions. The measurement of self-reported behavioral intentions with factorial survey experiments frequently assumes that the determinants of intended behavior affect actual behavior in a similar way. We critically investigate this fundamental assumption using the misdirected email technique. Student participants of a survey were randomly assigned to a field experiment or a survey experiment. The email informs the recipient about the reception of a scholarship with varying stakes (full-time vs. book) and recipient’s names (German vs. Arabic). In the survey experiment, respondents saw an image of the same email. This validation design ensured a high level of correspondence between units, settings, and treatments across both studies. Results reveal that while the frequencies of self-reported intentions and actual behavior deviate, treatments show similar relative effects. Hence, although further research on this topic is needed, this study suggests that determinants of behavior might be inferred from behavioral intentions measured with survey experiments.
析因调查实验在社会科学中越来越多地用于调查行为意图。用析因调查实验测量自我报告的行为意图经常假设预期行为的决定因素以类似的方式影响实际行为。我们使用误导电子邮件技术批判性地调查了这一基本假设。参加调查的学生被随机分配到实地实验或调查实验中。这封电子邮件通知收件人收到的奖学金有不同的利害关系(全日制vs书制)和收件人的名字(德语vs阿拉伯语)。在调查实验中,被调查者看到了同一封邮件的图片。该验证设计确保了两项研究中单位、环境和治疗之间的高度对应。结果显示,虽然自我报告的意图和实际行为的频率有所偏离,但治疗显示出相似的相对效果。因此,尽管这一主题还需要进一步的研究,但本研究表明,行为的决定因素可能是从通过调查实验测量的行为意图中推断出来的。
{"title":"What Can We Learn From Factorial Surveys About Human Behavior?: A Validation Study Comparing Field and Survey Experiments on Discrimination","authors":"Knut Petzold, Tobias Wolbring","doi":"10.1027/1614-2241/a000161","DOIUrl":"https://doi.org/10.1027/1614-2241/a000161","url":null,"abstract":"Factorial survey experiments are increasingly used in the social sciences to investigate behavioral intentions. The measurement of self-reported behavioral intentions with factorial survey experiments frequently assumes that the determinants of intended behavior affect actual behavior in a similar way. We critically investigate this fundamental assumption using the misdirected email technique. Student participants of a survey were randomly assigned to a field experiment or a survey experiment. The email informs the recipient about the reception of a scholarship with varying stakes (full-time vs. book) and recipient’s names (German vs. Arabic). In the survey experiment, respondents saw an image of the same email. This validation design ensured a high level of correspondence between units, settings, and treatments across both studies. Results reveal that while the frequencies of self-reported intentions and actual behavior deviate, treatments show similar relative effects. Hence, although further research on this topic is needed, this study suggests that determinants of behavior might be inferred from behavioral intentions measured with survey experiments.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"15 1","pages":"19–30"},"PeriodicalIF":3.1,"publicationDate":"2019-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Is That Measure Really One-Dimensional?: Nuisance Parameters Can Mask Severe Model Misspecification When Assessing Factorial Validity 这个衡量标准真的是一维的吗?在评估析因效度时,干扰参数可以掩盖严重的模型错配
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2018-10-01 DOI: 10.1027/1614-2241/a000158
Esther T. Beierl, M. Bühner, M. Heene
Factorial validity is often assessed using confirmatory factor analysis. Model fit is commonly evaluated using the cutoff values for the fit indices proposed by Hu and Bentler (1999). There is a body of research showing that those cutoff values cannot be generalized. Model fit does not only depend on the severity of misspecification, but also on nuisance parameters, which are independent of the misspecification. Using a simulation study, we demonstrate their influence on measures of model fit. We specified a severe misspecification, omitting a second factor, which signifies factorial invalidity. Measures of model fit showed only small misfit because nuisance parameters, magnitude of factor loadings and a balanced/imbalanced number of indicators per factor, also influenced the degree of misfit. Drawing from our results, we discuss challenges in the assessment of factorial validity.
析因效度通常使用验证性因子分析来评估。模型拟合通常使用Hu和Bentler(1999)提出的拟合指标的截止值来评估。有大量研究表明,这些临界值不能一概而论。模型拟合不仅取决于错配的严重程度,而且还取决于与错配无关的干扰参数。通过仿真研究,我们证明了它们对模型拟合测度的影响。我们指定了一个严重的错误说明,忽略了第二个因素,它表示因子无效。模型拟合的测量只显示出很小的失配,因为干扰参数、因子负荷的大小和每个因子的平衡/不平衡指标数量也会影响失配的程度。根据我们的结果,我们讨论了评估析因效度的挑战。
{"title":"Is That Measure Really One-Dimensional?: Nuisance Parameters Can Mask Severe Model Misspecification When Assessing Factorial Validity","authors":"Esther T. Beierl, M. Bühner, M. Heene","doi":"10.1027/1614-2241/a000158","DOIUrl":"https://doi.org/10.1027/1614-2241/a000158","url":null,"abstract":"Factorial validity is often assessed using confirmatory factor analysis. Model fit is commonly evaluated using the cutoff values for the fit indices proposed by Hu and Bentler (1999). There is a body of research showing that those cutoff values cannot be generalized. Model fit does not only depend on the severity of misspecification, but also on nuisance parameters, which are independent of the misspecification. Using a simulation study, we demonstrate their influence on measures of model fit. We specified a severe misspecification, omitting a second factor, which signifies factorial invalidity. Measures of model fit showed only small misfit because nuisance parameters, magnitude of factor loadings and a balanced/imbalanced number of indicators per factor, also influenced the degree of misfit. Drawing from our results, we discuss challenges in the assessment of factorial validity.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"14 1","pages":"188–196"},"PeriodicalIF":3.1,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41624275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Examining Validity Evidence of Self-Report Measures Using Differential Item Functioning: An Illustration of Three Methods 利用差异项函数检验自我报告测量的有效性证据——三种方法的例证
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2018-10-01 DOI: 10.1027/1614-2241/a000156
A. Gadermann, Michelle Y. Chen, S. D. Emerson, B. Zumbo
The investigation of differential item functioning (DIF) is important for any group comparison because the validity of the inferences made from scale scores could be compromised if DIF is present. DIF occurs when individuals from different groups show different probabilities of selecting a response option to an item after being matched on the underlying latent variable that the item is supposed to measure. The aim of this paper is to inform the practice of DIF analyses in survey research. We focus on three quantitative methods to detect DIF, namely nonparametric item response theory (NIRT), ordinal logistic regression (OLR), and mixed-effects or multilevel models. Using these methods, we demonstrate how to examine DIF at the item and scale levels, as well as in multilevel settings. We discuss when these techniques are appropriate to use, what data assumptions they have, and their advantages and disadvantages in the analysis of survey data.
差异项目功能(DIF)的调查对于任何小组比较都很重要,因为如果存在DIF,从量表得分得出的推论的有效性可能会受到影响。当来自不同群体的个体在与项目应该测量的潜在变量匹配后,表现出选择对项目的响应选项的不同概率时,就会发生DIF。本文的目的是为DIF分析在调查研究中的实践提供信息。我们重点研究了三种检测DIF的定量方法,即非参数项目反应理论(NIRT)、有序逻辑回归(OLR)和混合效应或多水平模型。使用这些方法,我们演示了如何在项目和规模级别以及多级别设置中检查DIF。我们讨论了这些技术何时适合使用,它们有什么数据假设,以及它们在调查数据分析中的优缺点。
{"title":"Examining Validity Evidence of Self-Report Measures Using Differential Item Functioning: An Illustration of Three Methods","authors":"A. Gadermann, Michelle Y. Chen, S. D. Emerson, B. Zumbo","doi":"10.1027/1614-2241/a000156","DOIUrl":"https://doi.org/10.1027/1614-2241/a000156","url":null,"abstract":"The investigation of differential item functioning (DIF) is important for any group comparison because the validity of the inferences made from scale scores could be compromised if DIF is present. DIF occurs when individuals from different groups show different probabilities of selecting a response option to an item after being matched on the underlying latent variable that the item is supposed to measure. The aim of this paper is to inform the practice of DIF analyses in survey research. We focus on three quantitative methods to detect DIF, namely nonparametric item response theory (NIRT), ordinal logistic regression (OLR), and mixed-effects or multilevel models. Using these methods, we demonstrate how to examine DIF at the item and scale levels, as well as in multilevel settings. We discuss when these techniques are appropriate to use, what data assumptions they have, and their advantages and disadvantages in the analysis of survey data.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"14 1","pages":"164–175"},"PeriodicalIF":3.1,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47116384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Three Conceptual Impediments to Developing Scale Theory for Formative Scales 形成性量表发展尺度理论的三个概念性障碍
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2018-10-01 DOI: 10.1027/1614-2241/a000154
K. Markus
Bollen and colleagues have advocated the use of formative scales despite the fact that formative scales lack an adequate underlying theory to guide development or validation such as that which underlies reflective scales. Three conceptual impediments impede the development of such theory: the redefinition of measurement restricted to the context of model fitting, the inscrutable notion of conceptual unity, and a systematic conflation of item scores with attributes. Setting aside these impediments opens the door to progress in developing the needed theory to support formative scale use. A broader perspective facilitates consideration of standard scale development concerns as applied to formative scales including scale development, item analysis, reliability, and item bias. While formative scales require a different pattern of emphasis, all five of the traditional sources of validity evidence apply to formative scales. Responsible use of formative scales requires greater attention to developing the requisite underlying theory.
Bollen及其同事提倡使用形成量表,尽管事实上形成量表缺乏足够的基础理论来指导发展或验证,比如反思量表的基础理论。三个概念障碍阻碍了这一理论的发展:仅在模型拟合的背景下重新定义测量,概念统一的概念难以理解,以及项目得分与属性的系统融合。抛开这些障碍,打开了发展所需理论以支持形成性量表使用的进步之门。更广泛的视角有助于考虑标准量表发展问题,这些问题适用于形成量表,包括量表发展、项目分析、可靠性和项目偏差。虽然形成量表需要不同的强调模式,但所有五种传统的有效性证据来源都适用于形成量表。负责任地使用形成性量表需要更多地关注发展必要的基础理论。
{"title":"Three Conceptual Impediments to Developing Scale Theory for Formative Scales","authors":"K. Markus","doi":"10.1027/1614-2241/a000154","DOIUrl":"https://doi.org/10.1027/1614-2241/a000154","url":null,"abstract":"Bollen and colleagues have advocated the use of formative scales despite the fact that formative scales lack an adequate underlying theory to guide development or validation such as that which underlies reflective scales. Three conceptual impediments impede the development of such theory: the redefinition of measurement restricted to the context of model fitting, the inscrutable notion of conceptual unity, and a systematic conflation of item scores with attributes. Setting aside these impediments opens the door to progress in developing the needed theory to support formative scale use. A broader perspective facilitates consideration of standard scale development concerns as applied to formative scales including scale development, item analysis, reliability, and item bias. While formative scales require a different pattern of emphasis, all five of the traditional sources of validity evidence apply to formative scales. Responsible use of formative scales requires greater attention to developing the requisite underlying theory.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"14 1","pages":"156–163"},"PeriodicalIF":3.1,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46711045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
Methodology: European Journal of Research Methods for The Behavioral and Social Sciences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1