首页 > 最新文献

Methodology: European Journal of Research Methods for The Behavioral and Social Sciences最新文献

英文 中文
The Impact of the Number of Dyads on Estimation of Dyadic Data Analysis Using Multilevel Modeling 二元数对多层次模型二元数据分析估计的影响
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2016-04-01 DOI: 10.1027/1614-2241/A000105
H. Du, Lijuan Wang
Abstract. Dyadic data often appear in social and behavioral research, and multilevel models (MLMs) can be used to analyze them. For dyadic data, the group size is 2, which is the minimum group size we could have for fitting a multilevel model. This Monte Carlo study examines the effects of the number of dyads, the intraclass correlation (ICC), the proportion of singletons, and the missingness mechanism on convergence, bias, coverage rates, and Type I error rates of parameter estimates of dyadic data analysis using MLMs. Results showed that the estimation of variance components could have nonconvergence problems, nonignorable bias, and deviated coverage rates from nominal values when ICC is low, the proportion of singletons is high, and/or the number of dyads is small. More dyads helped obtain more reliable and valid estimates. Sample size guidelines based on the simulation model are given and discussed.
摘要二元数据经常出现在社会和行为研究中,多层次模型(MLMs)可以用来分析二元数据。对于二元数据,组大小为2,这是我们可以拟合多层模型的最小组大小。这项蒙特卡罗研究考察了二元数、类内相关(ICC)、单子比例和缺失机制对使用mlm的二元数据分析参数估计的收敛性、偏差、覆盖率和I型错误率的影响。结果表明,当ICC较低、单例比例较高和/或双例数量较少时,方差分量的估计可能存在非收敛问题、不可忽略的偏差和偏离标称值的覆盖率。更多的二对有助于获得更可靠和有效的估计。给出并讨论了基于仿真模型的样本量准则。
{"title":"The Impact of the Number of Dyads on Estimation of Dyadic Data Analysis Using Multilevel Modeling","authors":"H. Du, Lijuan Wang","doi":"10.1027/1614-2241/A000105","DOIUrl":"https://doi.org/10.1027/1614-2241/A000105","url":null,"abstract":"Abstract. Dyadic data often appear in social and behavioral research, and multilevel models (MLMs) can be used to analyze them. For dyadic data, the group size is 2, which is the minimum group size we could have for fitting a multilevel model. This Monte Carlo study examines the effects of the number of dyads, the intraclass correlation (ICC), the proportion of singletons, and the missingness mechanism on convergence, bias, coverage rates, and Type I error rates of parameter estimates of dyadic data analysis using MLMs. Results showed that the estimation of variance components could have nonconvergence problems, nonignorable bias, and deviated coverage rates from nominal values when ICC is low, the proportion of singletons is high, and/or the number of dyads is small. More dyads helped obtain more reliable and valid estimates. Sample size guidelines based on the simulation model are given and discussed.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"12 1","pages":"21-31"},"PeriodicalIF":3.1,"publicationDate":"2016-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293379","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
Methodological Challenges of Mixed Methods Intervention Evaluations 混合方法干预评估的方法学挑战
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2015-12-23 DOI: 10.1027/1614-2241/A000101
H. Boeije, S. Drabble, A. O’Cathain
Abstract. This paper addresses the methodological challenges that accompany the use of a combination of research methods to evaluate complex interventions. In evaluating complex interventions, the question about effectiveness is not the only question that needs to be answered. Of equal interest are questions about acceptability, feasibility, and implementation of the intervention and the evaluation study itself. Using qualitative research in conjunction with trials enables us to address this diversity of questions. The combination of methods results in a mixed methods intervention evaluation (MMIE). In this article we demonstrate the relevance of mixed methods evaluation studies and provide case studies from health care. Methodological challenges that need our attention are, among others, choosing appropriate designs for MMIEs, determining realistic expectations of both components, and assigning adequate resources to both components. Solving these methodological issues will improve our research designs an...
摘要本文解决了方法上的挑战,伴随着使用研究方法的组合来评估复杂的干预。在评估复杂干预措施时,有关有效性的问题并不是需要回答的唯一问题。同样令人感兴趣的是有关干预和评估研究本身的可接受性、可行性和实施的问题。将定性研究与试验相结合,使我们能够解决这种多样性的问题。这些方法的组合形成了一种混合方法干预评价(MMIE)。在本文中,我们展示了混合方法评估研究的相关性,并提供了来自医疗保健的案例研究。需要我们注意的方法挑战包括,为mmi选择适当的设计,确定两个组件的现实期望,并为两个组件分配足够的资源。解决这些方法学问题将改进我们的研究设计和…
{"title":"Methodological Challenges of Mixed Methods Intervention Evaluations","authors":"H. Boeije, S. Drabble, A. O’Cathain","doi":"10.1027/1614-2241/A000101","DOIUrl":"https://doi.org/10.1027/1614-2241/A000101","url":null,"abstract":"Abstract. This paper addresses the methodological challenges that accompany the use of a combination of research methods to evaluate complex interventions. In evaluating complex interventions, the question about effectiveness is not the only question that needs to be answered. Of equal interest are questions about acceptability, feasibility, and implementation of the intervention and the evaluation study itself. Using qualitative research in conjunction with trials enables us to address this diversity of questions. The combination of methods results in a mixed methods intervention evaluation (MMIE). In this article we demonstrate the relevance of mixed methods evaluation studies and provide case studies from health care. Methodological challenges that need our attention are, among others, choosing appropriate designs for MMIEs, determining realistic expectations of both components, and assigning adequate resources to both components. Solving these methodological issues will improve our research designs an...","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"11 1","pages":"119-125"},"PeriodicalIF":3.1,"publicationDate":"2015-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Methodological Issues in Categorical Data Analysis 分类数据分析中的方法问题
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2015-12-23 DOI: 10.1027/1614-2241/A000102
J. Hagenaars
Abstract. The “General Linear Reality” view of the social world endorsed by analysis models assuming (underlying) continuous variables that are normally distributed is still prevailing in most of s...
摘要社会世界的“一般线性现实”观点得到了假设(潜在的)连续变量正态分布的分析模型的支持,在大多数国家仍然盛行。
{"title":"Methodological Issues in Categorical Data Analysis","authors":"J. Hagenaars","doi":"10.1027/1614-2241/A000102","DOIUrl":"https://doi.org/10.1027/1614-2241/A000102","url":null,"abstract":"Abstract. The “General Linear Reality” view of the social world endorsed by analysis models assuming (underlying) continuous variables that are normally distributed is still prevailing in most of s...","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"11 1","pages":"126-141"},"PeriodicalIF":3.1,"publicationDate":"2015-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Internet Panels, Professional Respondents, and Data Quality 互联网小组、专业受访者和数据质量
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2015-10-30 DOI: 10.1027/1614-2241/A000094
S. Matthijsse, E. D. Leeuw, J. Hox
Abstract. Most web surveys collect data through nonprobability or opt-in online panels, which are characterized by self-selection. A concern in online research is the emergence of professional respondents, who frequently participate in surveys and are mainly doing so for the incentives. This study investigates if professional respondents can be distinguished in online panels and if they provide lower quality data than nonprofessionals. We analyzed a data set of the NOPVO (Netherlands Online Panel Comparison) study that includes 19 panels, which together capture 90% of the respondents in online market research in the Netherlands. Latent class analysis showed that four types of respondents can be distinguished, ranging from the professional respondent to the altruistic respondent. A profile of professional respondents is depicted. Professional respondents appear not to be a great threat to data quality.
摘要大多数网络调查通过非概率或选择在线小组收集数据,其特点是自我选择。在线研究的一个问题是专业受访者的出现,他们经常参与调查,主要是为了奖励。本研究调查了专业受访者是否可以在在线面板中区分,以及他们提供的数据质量是否低于非专业人士。我们分析了NOPVO(荷兰在线面板比较)研究的数据集,其中包括19个面板,这些面板共同捕获了荷兰在线市场研究中90%的受访者。潜在类别分析表明,被调查者可以区分为四种类型,从专业被调查者到利他被调查者。描述了专业受访者的概况。专业受访者似乎不会对数据质量构成重大威胁。
{"title":"Internet Panels, Professional Respondents, and Data Quality","authors":"S. Matthijsse, E. D. Leeuw, J. Hox","doi":"10.1027/1614-2241/A000094","DOIUrl":"https://doi.org/10.1027/1614-2241/A000094","url":null,"abstract":"Abstract. Most web surveys collect data through nonprobability or opt-in online panels, which are characterized by self-selection. A concern in online research is the emergence of professional respondents, who frequently participate in surveys and are mainly doing so for the incentives. This study investigates if professional respondents can be distinguished in online panels and if they provide lower quality data than nonprofessionals. We analyzed a data set of the NOPVO (Netherlands Online Panel Comparison) study that includes 19 panels, which together capture 90% of the respondents in online market research in the Netherlands. Latent class analysis showed that four types of respondents can be distinguished, ranging from the professional respondent to the altruistic respondent. A profile of professional respondents is depicted. Professional respondents appear not to be a great threat to data quality.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"11 1","pages":"81-88"},"PeriodicalIF":3.1,"publicationDate":"2015-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 42
Assessing Model Fit in Latent Class Analysis When Asymptotics Do Not Hold 当渐近性不成立时,评估潜在类分析中的模型拟合
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2015-01-01 DOI: 10.1027/1614-2241/A000093
Geert H. van Kollenburg, J. Mulder, J. Vermunt
The application of latent class (LC) analysis involves evaluating the LC model using goodness-of-fit statistics. To assess the misfit of a specified model, say with the Pearson chi-squared statistic, a p-value can be obtained using an asymptotic reference distribution. However, asymptotic p-values are not valid when the sample size is not large and/or the analyzed contingency table is sparse. Another problem is that for various other conceivable global and local fit measures, asymptotic distributions are not readily available. An alternative way to obtain the p-value for the statistic of interest is by constructing its empirical reference distribution using resampling techniques such as the parametric bootstrap or the posterior predictive check (PPC). In the current paper, we show how to apply the parametric bootstrap and two versions of the PPC to obtain empirical p-values for a number of commonly used global and local fit statistics within the context of LC analysis. The main difference between the PPC ...
潜在类(LC)分析的应用包括使用拟合优度统计来评估LC模型。为了评估特定模型的不拟合,例如使用皮尔逊卡方统计量,可以使用渐近参考分布获得p值。然而,当样本量不大和/或分析的列联表稀疏时,渐近p值是无效的。另一个问题是,对于各种其他可想象的全局和局部拟合度量,渐近分布并不容易获得。获得感兴趣统计量的p值的另一种方法是通过使用重采样技术(如参数自举或后验预测检查(PPC))构建其经验参考分布。在本文中,我们展示了如何应用参数bootstrap和两个版本的PPC来获得LC分析背景下一些常用的全局和局部拟合统计的经验p值。PPC的主要区别是…
{"title":"Assessing Model Fit in Latent Class Analysis When Asymptotics Do Not Hold","authors":"Geert H. van Kollenburg, J. Mulder, J. Vermunt","doi":"10.1027/1614-2241/A000093","DOIUrl":"https://doi.org/10.1027/1614-2241/A000093","url":null,"abstract":"The application of latent class (LC) analysis involves evaluating the LC model using goodness-of-fit statistics. To assess the misfit of a specified model, say with the Pearson chi-squared statistic, a p-value can be obtained using an asymptotic reference distribution. However, asymptotic p-values are not valid when the sample size is not large and/or the analyzed contingency table is sparse. Another problem is that for various other conceivable global and local fit measures, asymptotic distributions are not readily available. An alternative way to obtain the p-value for the statistic of interest is by constructing its empirical reference distribution using resampling techniques such as the parametric bootstrap or the posterior predictive check (PPC). In the current paper, we show how to apply the parametric bootstrap and two versions of the PPC to obtain empirical p-values for a number of commonly used global and local fit statistics within the context of LC analysis. The main difference between the PPC ...","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"11 1","pages":"65-79"},"PeriodicalIF":3.1,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
How Low Can You Go? An Investigation of the Influence of Sample Size and Model Complexity on Point and Interval Estimates in Two-Level Linear Models 你能走多低?二水平线性模型中样本大小和模型复杂度对点和区间估计影响的研究
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2014-01-01 DOI: 10.1027/1614-2241/A000062
B. Bell, G. Morgan, J. Schoeneberger, J. Kromrey, J. Ferron
Whereas general sample size guidelines have been suggested when estimating multilevel models, they are only generalizable to a relatively limited number of data conditions and model structures, both of which are not very feasible for the applied researcher. In an effort to expand our understanding of two-level multilevel models under less than ideal conditions, Monte Carlo methods, through SAS/IML, were used to examine model convergence rates, parameter point estimates (statistical bias), parameter interval estimates (confidence interval accuracy and precision), and both Type I error control and statistical power of tests associated with the fixed effects from linear two-level models estimated with PROC MIXED. These outcomes were analyzed as a function of: (a) level-1 sample size, (b) level-2 sample size, (c) intercept variance, (d) slope variance, (e) collinearity, and (f) model complexity. Bias was minimal across nearly all conditions simulated. The 95% confidence interval coverage and Type I error rate tended to be slightly conservative. The degree of statistical power was related to sample sizes and level of fixed effects; higher power was observed with larger sample sizes and level-1 fixed effects. Hierarchically organized data are commonplace in educa- tional, clinical, and other settings in which research often occurs. Students are nested within classrooms or teachers, and teachers are nested within schools. Alternatively, service recipients are nested within social workers providing ser- vices, who may in turn be nested within local civil service entities. Conducting research at any of these levels while ignoring the more detailed levels (students) or contextual levels (schools) can lead to erroneous conclusions. As such, multilevel models have been developed to properly account
虽然在估计多层模型时建议了一般样本量指南,但它们只能推广到相对有限数量的数据条件和模型结构,这两者对于应用研究人员来说都不是很可行。为了扩大我们对非理想条件下的两级多水平模型的理解,我们通过SAS/IML使用蒙特卡罗方法来检查模型的收敛率、参数点估计(统计偏差)、参数区间估计(置信区间准确度和精度),以及与PROC MIXED估计的线性两级模型的固定效应相关的I型误差控制和统计能力。将这些结果作为(a)一级样本量、(b)二级样本量、(c)截距方差、(d)斜率方差、(e)共线性和(f)模型复杂性的函数进行分析。在几乎所有模拟条件下,偏差都是最小的。95%置信区间覆盖率和I型错误率略显保守。统计效力程度与样本量和固定效应水平有关;样本量越大,一级固定效应越显著。在教育、临床和其他经常发生研究的环境中,分层组织的数据是司空见惯的。学生嵌套在教室或教师中,教师嵌套在学校中。或者,服务接受者嵌套在提供服务的社会工作者中,而社会工作者又可能嵌套在当地的公务员机构中。在这些层面上进行研究,而忽略更详细的层面(学生)或背景层面(学校)可能会导致错误的结论。因此,已经开发了多层模型来适当地解释
{"title":"How Low Can You Go? An Investigation of the Influence of Sample Size and Model Complexity on Point and Interval Estimates in Two-Level Linear Models","authors":"B. Bell, G. Morgan, J. Schoeneberger, J. Kromrey, J. Ferron","doi":"10.1027/1614-2241/A000062","DOIUrl":"https://doi.org/10.1027/1614-2241/A000062","url":null,"abstract":"Whereas general sample size guidelines have been suggested when estimating multilevel models, they are only generalizable to a relatively limited number of data conditions and model structures, both of which are not very feasible for the applied researcher. In an effort to expand our understanding of two-level multilevel models under less than ideal conditions, Monte Carlo methods, through SAS/IML, were used to examine model convergence rates, parameter point estimates (statistical bias), parameter interval estimates (confidence interval accuracy and precision), and both Type I error control and statistical power of tests associated with the fixed effects from linear two-level models estimated with PROC MIXED. These outcomes were analyzed as a function of: (a) level-1 sample size, (b) level-2 sample size, (c) intercept variance, (d) slope variance, (e) collinearity, and (f) model complexity. Bias was minimal across nearly all conditions simulated. The 95% confidence interval coverage and Type I error rate tended to be slightly conservative. The degree of statistical power was related to sample sizes and level of fixed effects; higher power was observed with larger sample sizes and level-1 fixed effects. Hierarchically organized data are commonplace in educa- tional, clinical, and other settings in which research often occurs. Students are nested within classrooms or teachers, and teachers are nested within schools. Alternatively, service recipients are nested within social workers providing ser- vices, who may in turn be nested within local civil service entities. Conducting research at any of these levels while ignoring the more detailed levels (students) or contextual levels (schools) can lead to erroneous conclusions. As such, multilevel models have been developed to properly account","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"84 1","pages":"1-11"},"PeriodicalIF":3.1,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293598","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 156
The Impact of Using Incorrect Weights With the Multiple Membership Random Effects Model 多隶属度随机效应模型中权重不正确的影响
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2014-01-01 DOI: 10.1027/1614-2241/A000066
L. Smith, S. N. Beretvas
The multiple membership random effects model (MMREM) is used to appropriately model multiple membership data structures. Use of the MMREM requires selection of weights reflecting the hypothesized contribution of each level two unit (e.g., school) and their descriptors to the level one outcome. This study assessed the impact on MMREM parameter and residual estimates of the choice of weight pattern used. Parameter and residual estimates resulting from use of different weight patterns were compared using a real dataset and a small-scale simulation study. Under the conditions examined here, results indicated that choice of weight pattern did not greatly impact relative parameter bias nor level two residuals’ ranks. Limitations and directions for future research are discussed.
采用多隶属度随机效应模型(MMREM)对多隶属度数据结构进行适当建模。使用MMREM需要选择反映每个二级单位(例如,学校)及其描述符对一级结果的假设贡献的权重。本研究评估了使用的权重模式的选择对MMREM参数和残差估计的影响。使用真实数据集和小规模模拟研究比较了使用不同权重模式产生的参数和残差估计。在本研究的条件下,结果表明,权重模式的选择对相对参数偏差和二级残差的排名影响不大。讨论了今后研究的局限性和方向。
{"title":"The Impact of Using Incorrect Weights With the Multiple Membership Random Effects Model","authors":"L. Smith, S. N. Beretvas","doi":"10.1027/1614-2241/A000066","DOIUrl":"https://doi.org/10.1027/1614-2241/A000066","url":null,"abstract":"The multiple membership random effects model (MMREM) is used to appropriately model multiple membership data structures. Use of the MMREM requires selection of weights reflecting the hypothesized contribution of each level two unit (e.g., school) and their descriptors to the level one outcome. This study assessed the impact on MMREM parameter and residual estimates of the choice of weight pattern used. Parameter and residual estimates resulting from use of different weight patterns were compared using a real dataset and a small-scale simulation study. Under the conditions examined here, results indicated that choice of weight pattern did not greatly impact relative parameter bias nor level two residuals’ ranks. Limitations and directions for future research are discussed.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"10 1","pages":"31-42"},"PeriodicalIF":3.1,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
Sample Size Requirements of the Robust Weighted Least Squares Estimator 鲁棒加权最小二乘估计的样本量要求
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2014-01-01 DOI: 10.1027/1614-2241/A000068
Morten Moshagen, J. Musch
The present study investigated sample size requirements of maximum likelihood (ML) and robust weighted least squares (robust WLS) estimation for ordinal data with confirmatory factor analysis (CFA) models with 3-10 indicators per factor, primary loadings between .4 and .9, and four different levels of categorization (2, 3, 5, and 7). Additionally, the utility of the H-measure of construct reliability (an index combining the number of indicators and the magnitude of loadings) in predicting sample size requirements was examined. Results indicated that a higher number of indicators per factors and higher factor loadings increased the rates of proper convergence and solution propriety. However, the H-measure could only partly account for the results. Moreover, it was demonstrated that robust WLS was mostly superior to ML, suggesting that there is little reason to prefer ML over robust WLS when the data are ordinal. Sample size recommendations for the robust WLS estimator are provided. Confirmatory factor analysis (CFA), as a special case of structural equation models, is a powerful technique to model and test relationships between manifest variables and latent constructs. Estimation of CFA models usually proceeds using normal-theory estimators with the most commonly used being maximum likelihood (ML). Nor- mal-theory estimation methods assume continuous and multivariate normally distributed observed variables; how- ever, many measures in the social and behavioral sciences are characterized by a dichotomous or an ordinal level of measurement. Although the items of a test or a question- naire are conceived to be measures of a theoretically contin- uous construct, the observed responses are discrete realizations of a small number of categories and, thus, lack the scale and distributional properties assumed by normal- theory estimators.
本研究利用验证性因子分析(CFA)模型研究了对有序数据的最大似然(ML)和稳健加权最小二乘(robust WLS)估计的样本量要求,每个因子有3-10个指标,主要负荷在0.4到0.9之间,以及四种不同的分类水平(2、3、5和7)。构造可靠性的h测量(结合指标数量和负荷大小的指标)在预测样本量需求中的效用进行了检验。结果表明,每个因子的指标数量越多,因子负荷越高,适当收敛率和解决方案适当性越高。然而,h测量只能部分解释结果。此外,研究表明,鲁棒WLS在大多数情况下优于ML,这表明当数据是有序的时,几乎没有理由更喜欢ML而不是鲁棒WLS。给出了鲁棒WLS估计器的样本大小建议。验证性因子分析(Confirmatory factor analysis, CFA)作为结构方程模型的一种特例,是一种模拟和检验显性变量与潜在构式之间关系的有力技术。CFA模型的估计通常使用正态理论估计器,最常用的是最大似然(ML)。非马尔理论估计方法假定观测变量连续且多元正态分布;然而,在社会科学和行为科学中,许多测量都以二分类或有序测量水平为特征。虽然测试或问卷的项目被认为是理论上连续结构的测量,但观察到的反应是对少数类别的离散实现,因此缺乏正常理论估计所假定的规模和分布特性。
{"title":"Sample Size Requirements of the Robust Weighted Least Squares Estimator","authors":"Morten Moshagen, J. Musch","doi":"10.1027/1614-2241/A000068","DOIUrl":"https://doi.org/10.1027/1614-2241/A000068","url":null,"abstract":"The present study investigated sample size requirements of maximum likelihood (ML) and robust weighted least squares (robust WLS) estimation for ordinal data with confirmatory factor analysis (CFA) models with 3-10 indicators per factor, primary loadings between .4 and .9, and four different levels of categorization (2, 3, 5, and 7). Additionally, the utility of the H-measure of construct reliability (an index combining the number of indicators and the magnitude of loadings) in predicting sample size requirements was examined. Results indicated that a higher number of indicators per factors and higher factor loadings increased the rates of proper convergence and solution propriety. However, the H-measure could only partly account for the results. Moreover, it was demonstrated that robust WLS was mostly superior to ML, suggesting that there is little reason to prefer ML over robust WLS when the data are ordinal. Sample size recommendations for the robust WLS estimator are provided. Confirmatory factor analysis (CFA), as a special case of structural equation models, is a powerful technique to model and test relationships between manifest variables and latent constructs. Estimation of CFA models usually proceeds using normal-theory estimators with the most commonly used being maximum likelihood (ML). Nor- mal-theory estimation methods assume continuous and multivariate normally distributed observed variables; how- ever, many measures in the social and behavioral sciences are characterized by a dichotomous or an ordinal level of measurement. Although the items of a test or a question- naire are conceived to be measures of a theoretically contin- uous construct, the observed responses are discrete realizations of a small number of categories and, thus, lack the scale and distributional properties assumed by normal- theory estimators.","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"421 1","pages":"60-70"},"PeriodicalIF":3.1,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 105
Validity Concerns with Multiplying Ordinal Items Defined by Binned Counts: An Application to a Quantity-Frequency Measure of Alcohol Use. 用分类计数定义的数项相乘的效度问题:酒精使用数量-频率测量的应用。
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2014-01-01 DOI: 10.1027/1614-2241/a000081
James S McGinley, Patrick J Curran

Social and behavioral scientists often measure constructs that are truly discrete counts by collapsing (or binning) the counts into a smaller number of ordinal responses. While prior quantitative research has identified a series of concerns with similar binning procedures, there has been a lack of study on the consequences of multiplying these ordinal items to create a desired index. This measurement strategy is incorporated in many research applications, but it is particularly salient in the study of substance use where the product of ordinal quantity (number of drinks) and frequency (number of days) items is used to create an index of total consumption. In the current study, we demonstrate both analytically and empirically that this multiplicative procedure can introduce serious threats to construct validity. These threats, in turn, directly impact the ability to accurately measure alcohol consumption.

社会和行为科学家通常通过将计数分解(或分组)成较小数量的顺序反应来测量真正离散计数的结构。虽然先前的定量研究已经确定了一系列与类似分类程序有关的问题,但缺乏对将这些顺序项目相乘以创建所需指数的后果的研究。这种测量策略被纳入许多研究应用中,但它在物质使用研究中尤其突出,其中使用序数(饮料数量)和频率(天数)项目的乘积来创建总消费指数。在目前的研究中,我们从分析和经验两方面证明了这种乘法过程会给结构效度带来严重的威胁。这些威胁反过来又直接影响了准确测量酒精摄入量的能力。
{"title":"Validity Concerns with Multiplying Ordinal Items Defined by Binned Counts: An Application to a Quantity-Frequency Measure of Alcohol Use.","authors":"James S McGinley,&nbsp;Patrick J Curran","doi":"10.1027/1614-2241/a000081","DOIUrl":"https://doi.org/10.1027/1614-2241/a000081","url":null,"abstract":"<p><p>Social and behavioral scientists often measure constructs that are truly discrete counts by collapsing (or binning) the counts into a smaller number of ordinal responses. While prior quantitative research has identified a series of concerns with similar binning procedures, there has been a lack of study on the consequences of multiplying these ordinal items to create a desired index. This measurement strategy is incorporated in many research applications, but it is particularly salient in the study of substance use where the product of ordinal quantity (number of drinks) and frequency (number of days) items is used to create an index of total consumption. In the current study, we demonstrate both analytically and empirically that this multiplicative procedure can introduce serious threats to construct validity. These threats, in turn, directly impact the ability to accurately measure alcohol consumption.</p>","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"10 3","pages":"108-116"},"PeriodicalIF":3.1,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4217492/pdf/nihms548509.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"32804715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
A Hierarchical Bayesian Model With Correlated Residuals for Investigating Stability and Change in Intensive Longitudinal Data Settings 一种具有相关残差的层次贝叶斯模型用于研究密集纵向数据设置的稳定性和变化
IF 3.1 3区 心理学 Q2 PSYCHOLOGY, MATHEMATICAL Pub Date : 2014-01-01 DOI: 10.1027/1614-2241/A000083
F. Gasimova, A. Robitzsch, O. Wilhelm, G. Hülür
The present paper’s focus is the modeling of interindividual and intraindividual variability in longitudinal data. We propose a hierarchical Bayesian model with correlated residuals, employing an autoregressive parameter AR(1) for focusing on intraindividual variability. The hierarchical model possesses four individual random effects: intercept, slope, variability, and autocorrelation. The performance of the proposed Bayesian estimation is investigated in simulated longitudinal data with three different sample sizes (N = 100, 200, 500) and three different numbers of measurement points (T = 10, 20, 40). The initial simulation values are selected according to the results of the first 20 measurement occasions from a longitudinal study on working memory capacity in 9th graders. Within this simulation study, we investigate the root mean square error (RMSE), bias, relative percentage bias, and the 90% coverage probability of parameter estimates. Results indicate that more accurate estimates are associated with ...
本文的重点是纵向数据中个体间和个体内部变异的建模。我们提出了一个具有相关残差的分层贝叶斯模型,采用自回归参数AR(1)来关注个体内部变异性。分层模型具有四个单独的随机效应:截距、斜率、可变性和自相关性。在三种不同样本量(N = 100,200,500)和三种不同测点数量(T = 10,20,40)的模拟纵向数据中研究了所提出的贝叶斯估计的性能。初始模拟值是根据九年级学生工作记忆容量纵向研究的前20次测量结果选取的。在这个模拟研究中,我们研究了均方根误差(RMSE)、偏差、相对百分比偏差和参数估计的90%覆盖概率。结果表明,更准确的估计与……有关。
{"title":"A Hierarchical Bayesian Model With Correlated Residuals for Investigating Stability and Change in Intensive Longitudinal Data Settings","authors":"F. Gasimova, A. Robitzsch, O. Wilhelm, G. Hülür","doi":"10.1027/1614-2241/A000083","DOIUrl":"https://doi.org/10.1027/1614-2241/A000083","url":null,"abstract":"The present paper’s focus is the modeling of interindividual and intraindividual variability in longitudinal data. We propose a hierarchical Bayesian model with correlated residuals, employing an autoregressive parameter AR(1) for focusing on intraindividual variability. The hierarchical model possesses four individual random effects: intercept, slope, variability, and autocorrelation. The performance of the proposed Bayesian estimation is investigated in simulated longitudinal data with three different sample sizes (N = 100, 200, 500) and three different numbers of measurement points (T = 10, 20, 40). The initial simulation values are selected according to the results of the first 20 measurement occasions from a longitudinal study on working memory capacity in 9th graders. Within this simulation study, we investigate the root mean square error (RMSE), bias, relative percentage bias, and the 90% coverage probability of parameter estimates. Results indicate that more accurate estimates are associated with ...","PeriodicalId":18476,"journal":{"name":"Methodology: European Journal of Research Methods for The Behavioral and Social Sciences","volume":"10 1","pages":"126-137"},"PeriodicalIF":3.1,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"57293255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
期刊
Methodology: European Journal of Research Methods for The Behavioral and Social Sciences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1