首页 > 最新文献

Measurement-Interdisciplinary Research and Perspectives最新文献

英文 中文
Identifying Response Styles Using Person Fit Analysis and Response-Styles Models 使用人匹配分析和反应风格模型识别反应风格
IF 1 Q2 Mathematics Pub Date : 2023-07-03 DOI: 10.1080/15366367.2022.2104565
Stefanie A. Wind, Yuan Ge
In selected-response assessments such as attitude surveys with Likert-type rating scales, examinees often select from rating scale categories to reflect their locations on a construct. Researchers have observed that some examinees exhibit response styles, which are systematic patterns of responses in which examinees are more likely to select certain response categories, regardless of their locations on the construct (Baumgartner & Steenkamp, 2001; Paulhus, 1991; Roberts, 2016; Van Vaerenbergh & Thomas, 2013). For example, a midpoint response style occurs when examinees select middle rating scale categories most often, and an extreme response style occurs when examinees tend to select extreme categories most often. Response styles complicate the interpretation of examinee and item location estimates because responses may not fully reflect examinee locations on the construct. Accordingly, response styles can present a source of construct-irrelevant variance that threatens the validity of the interpretation and use of scores (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on Measurement in Education [NCME], 2014). To identify and minimize construct-irrelevant impacts of response styles, researchers have proposed tools such as the Partial Credit Model – Response Style (PCMRS; Tutz et al., 2018) as an extension of the Partial credit model (PCM; Masters, 1982) to model the tendency for examinees to exhibit response styles. The PCMRS directly models response styles as a person-specific gamma parameter and corrects estimates of item difficulty for the presence of response styles. Specifically, the response style is treated as a random effect, where small distances between thresholds indicate a tendency to exhibit an extreme response style and widened distances between thresholds indicate a tendency to exhibit a midpoint response style. Thus far, most research on the PCMRS has focused on the presentation of the model and statistical software tools for estimating it (Schauberger, 2020, 2020; Tutz et al., 2018; Tutz & Schauberger, 2020). However, we identified one application of this approach in which Dibek (2020) employed the PCM and the PCMRS to data from the 2015 administration of the TIMSS assessment and detected the presence of response styles among student participants. Given the lack of prior research focusing on the interpretation and use of the PCMRS in applied survey research contexts, additional explorations are warranted. We describe details about the PCMRS model parameters and interpretation more detail later in the manuscript. Researchers have also used person fit analysis (Glas & Khalid, 2016) from models based on measurement frameworks with clear guidelines for identifying meaningful response patterns. For example, researchers have used the PCM, which falls within the Rasch measurement theory framework (Rasch, 1960) to identify examinees whose patterns of responses are different
在选择反应评估中,如李克特式评定量表的态度调查,考生通常从评定量表类别中选择反映他们在一个构念上的位置。研究人员观察到,一些考生表现出反应风格,这是一种系统的反应模式,在这种模式下,考生更有可能选择某些反应类别,而不管他们在结构上的位置(Baumgartner & Steenkamp, 2001;Paulhus, 1991;罗伯茨,2016;Van vaerenbergh&thomas, 2013)。例如,当考生最常选择中等等级的类别时,就会出现中点反应风格;当考生倾向于最常选择极端类别时,就会出现极端反应风格。反应风格使对考生和项目位置估计的解释复杂化,因为反应可能不能完全反映考生在构式上的位置。因此,反应风格可以作为构念无关方差的来源,威胁到分数解释和使用的有效性(美国教育研究协会[AERA]、美国心理协会[APA]和国家教育测量委员会[NCME], 2014)。为了识别和减少反应风格对建构无关的影响,研究人员提出了一些工具,如部分信用模型-反应风格(PCMRS);Tutz等人,2018)作为部分信用模型(PCM;Masters, 1982)来模拟考生表现出回应风格的趋势。PCMRS直接将反应风格作为个人特定的gamma参数进行建模,并根据反应风格的存在对项目难度进行校正。具体来说,反应风格被视为一种随机效应,阈值之间的距离越小,表明倾向于表现出极端的反应风格,阈值之间的距离越宽,表明倾向于表现出中点的反应风格。到目前为止,大多数关于PCMRS的研究都集中在模型的呈现和用于估计它的统计软件工具上(Schauberger, 2020, 2020;Tutz et al., 2018;Tutz & Schauberger, 2020)。然而,我们确定了该方法的一个应用,Dibek(2020)将PCM和PCMRS用于2015年TIMSS评估管理的数据,并检测了学生参与者中存在的反应风格。鉴于在应用调查研究背景下缺乏对PCMRS的解释和使用的先前研究,有必要进行更多的探索。我们将详细描述PCMRS模型参数,并在后面的手稿中详细解释。研究人员还使用了基于测量框架的模型的个人契合分析(Glas & Khalid, 2016),这些模型具有明确的指导方针,用于识别有意义的反应模式。例如,研究人员使用了属于Rasch测量理论框架(Rasch, 1960)的PCM来识别那些反应模式与潜在变量估计位置不同的考生。与PCMRS方法相比,Rasch测量方法更侧重于评估基于观察和预期反应的人员估计的可解释性,这反映在与PCM的人员匹配分析程序中
{"title":"Identifying Response Styles Using Person Fit Analysis and Response-Styles Models","authors":"Stefanie A. Wind, Yuan Ge","doi":"10.1080/15366367.2022.2104565","DOIUrl":"https://doi.org/10.1080/15366367.2022.2104565","url":null,"abstract":"In selected-response assessments such as attitude surveys with Likert-type rating scales, examinees often select from rating scale categories to reflect their locations on a construct. Researchers have observed that some examinees exhibit response styles, which are systematic patterns of responses in which examinees are more likely to select certain response categories, regardless of their locations on the construct (Baumgartner & Steenkamp, 2001; Paulhus, 1991; Roberts, 2016; Van Vaerenbergh & Thomas, 2013). For example, a midpoint response style occurs when examinees select middle rating scale categories most often, and an extreme response style occurs when examinees tend to select extreme categories most often. Response styles complicate the interpretation of examinee and item location estimates because responses may not fully reflect examinee locations on the construct. Accordingly, response styles can present a source of construct-irrelevant variance that threatens the validity of the interpretation and use of scores (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on Measurement in Education [NCME], 2014). To identify and minimize construct-irrelevant impacts of response styles, researchers have proposed tools such as the Partial Credit Model – Response Style (PCMRS; Tutz et al., 2018) as an extension of the Partial credit model (PCM; Masters, 1982) to model the tendency for examinees to exhibit response styles. The PCMRS directly models response styles as a person-specific gamma parameter and corrects estimates of item difficulty for the presence of response styles. Specifically, the response style is treated as a random effect, where small distances between thresholds indicate a tendency to exhibit an extreme response style and widened distances between thresholds indicate a tendency to exhibit a midpoint response style. Thus far, most research on the PCMRS has focused on the presentation of the model and statistical software tools for estimating it (Schauberger, 2020, 2020; Tutz et al., 2018; Tutz & Schauberger, 2020). However, we identified one application of this approach in which Dibek (2020) employed the PCM and the PCMRS to data from the 2015 administration of the TIMSS assessment and detected the presence of response styles among student participants. Given the lack of prior research focusing on the interpretation and use of the PCMRS in applied survey research contexts, additional explorations are warranted. We describe details about the PCMRS model parameters and interpretation more detail later in the manuscript. Researchers have also used person fit analysis (Glas & Khalid, 2016) from models based on measurement frameworks with clear guidelines for identifying meaningful response patterns. For example, researchers have used the PCM, which falls within the Rasch measurement theory framework (Rasch, 1960) to identify examinees whose patterns of responses are different","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79645427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Misclassification Error, Binary Regression Bias, and Reliability in Multidimensional Poverty Measurement: An Estimation Approach Based on Bayesian Modelling 多维贫困测量中的误分类误差、二元回归偏差和可靠性:基于贝叶斯模型的估计方法
IF 1 Q2 Mathematics Pub Date : 2023-04-03 DOI: 10.1080/15366367.2022.2026104
Héctor Nájera
ABSTRACT Measurement error affects the quality of population orderings of an index and, hence, increases the misclassification of the poor and the non-poor groups and affects statistical inferences from binary regression models. Hence, the conclusions about the extent, profile, and distribution of poverty are likely to be misleading. However, the size and type (false positive/negatives) of classification error have remained untraceable in poverty research. This paper draws upon previous theoretical literature to develop a Bayesian-based estimator of population misclassification and binary-regression coefficient bias. The study uses the reliability values of existing poverty indices to set up a Monte Carlo study based on factor mixture models to illustrate the connections between measurement error, misclassification, and bias and evaluate the procedure and discusses its importance for real-world applications.
测量误差会影响指数的人口排序质量,从而增加对贫困和非贫困群体的错误分类,并影响二元回归模型的统计推断。因此,关于贫困程度、状况和分布的结论很可能具有误导性。然而,在贫困研究中,分类误差的大小和类型(假阳性/假阴性)仍然无法追踪。本文在借鉴前人理论文献的基础上,提出了一种基于贝叶斯的种群误分类和二元回归系数偏差估计方法。本研究利用现有贫困指数的信度值,建立了基于因子混合模型的蒙特卡罗研究,以说明测量误差、误分类和偏差之间的联系,并对该过程进行了评估,并讨论了其在现实应用中的重要性。
{"title":"Misclassification Error, Binary Regression Bias, and Reliability in Multidimensional Poverty Measurement: An Estimation Approach Based on Bayesian Modelling","authors":"Héctor Nájera","doi":"10.1080/15366367.2022.2026104","DOIUrl":"https://doi.org/10.1080/15366367.2022.2026104","url":null,"abstract":"ABSTRACT Measurement error affects the quality of population orderings of an index and, hence, increases the misclassification of the poor and the non-poor groups and affects statistical inferences from binary regression models. Hence, the conclusions about the extent, profile, and distribution of poverty are likely to be misleading. However, the size and type (false positive/negatives) of classification error have remained untraceable in poverty research. This paper draws upon previous theoretical literature to develop a Bayesian-based estimator of population misclassification and binary-regression coefficient bias. The study uses the reliability values of existing poverty indices to set up a Monte Carlo study based on factor mixture models to illustrate the connections between measurement error, misclassification, and bias and evaluate the procedure and discusses its importance for real-world applications.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78614906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Tree-Based Approach to Identifying Response Styles with Anchoring Vignettes 一种基于树的方法来识别锚定小片段的回应风格
IF 1 Q2 Mathematics Pub Date : 2023-04-03 DOI: 10.1080/15366367.2022.2156219
B. Leventhal, C. Zigler
ABSTRACT Survey score interpretations are often plagued by sources of construct-irrelevant variation, such as response styles. In this study, we propose the use of an IRTree Model to account for response styles by making use of self-report items and anchoring vignettes. Specifically, we investigate how the IRTree approach with anchoring vignettes compares to traditional approaches that either do not include anchoring vignettes or do not account for response styles. We analyze secondary data using four different models: 1) total score; 2) graded response model; 3) IRTree without the consideration of anchoring vignettes, and 4) IRTree considering anchoring vignettes. We found significant differences in trait estimates from models that account for response styles compared to those that do not. Additionally, we found differences in trait estimates between the IRTree Models when considering anchoring vignettes and when not. Model comparisons suggest that trait differences are due to adjusting for acquiescence response style.
调查分数的解释经常受到构念无关变异的来源的困扰,例如回答风格。在本研究中,我们建议使用IRTree模型通过使用自我报告项目和锚定小片段来解释反应风格。具体来说,我们研究了带有锚定小片段的IRTree方法与不包含锚定小片段或不考虑响应风格的传统方法相比如何。我们使用四种不同的模型分析二手数据:1)总分;2)分级响应模型;3)不考虑锚点的IRTree和4)考虑锚点的IRTree。我们发现,与那些不考虑反应风格的模型相比,考虑反应风格的模型在性状估计上存在显著差异。此外,我们发现IRTree模型在考虑锚定小片段和不考虑锚定小片段时的性状估计存在差异。模型比较表明,性状差异是由于对默认反应方式的调整。
{"title":"A Tree-Based Approach to Identifying Response Styles with Anchoring Vignettes","authors":"B. Leventhal, C. Zigler","doi":"10.1080/15366367.2022.2156219","DOIUrl":"https://doi.org/10.1080/15366367.2022.2156219","url":null,"abstract":"ABSTRACT Survey score interpretations are often plagued by sources of construct-irrelevant variation, such as response styles. In this study, we propose the use of an IRTree Model to account for response styles by making use of self-report items and anchoring vignettes. Specifically, we investigate how the IRTree approach with anchoring vignettes compares to traditional approaches that either do not include anchoring vignettes or do not account for response styles. We analyze secondary data using four different models: 1) total score; 2) graded response model; 3) IRTree without the consideration of anchoring vignettes, and 4) IRTree considering anchoring vignettes. We found significant differences in trait estimates from models that account for response styles compared to those that do not. Additionally, we found differences in trait estimates between the IRTree Models when considering anchoring vignettes and when not. Model comparisons suggest that trait differences are due to adjusting for acquiescence response style.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76990868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Educational Measurement for Applied Researchers: Theory into Practice 应用研究人员的教育测量:理论到实践
IF 1 Q2 Mathematics Pub Date : 2023-04-03 DOI: 10.1080/15366367.2022.2106536
Mengyao Zhang
{"title":"Educational Measurement for Applied Researchers: Theory into Practice","authors":"Mengyao Zhang","doi":"10.1080/15366367.2022.2106536","DOIUrl":"https://doi.org/10.1080/15366367.2022.2106536","url":null,"abstract":"","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90330401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
Item Response Theory and Modeling with Stata 项目反应理论与状态建模
IF 1 Q2 Mathematics Pub Date : 2023-04-03 DOI: 10.1080/15366367.2022.2133528
T. Raykov
ABSTRACT This software review discusses the capabilities of Stata to conduct item response theory modeling. The commands needed for fitting the popular one-, two-, and three-parameter logistic models are initially discussed. The procedure for testing the discrimination parameter equality in the one-parameter model is then outlined. The commands for fitting several polytomous models are subsequently indicated, as are those facilitating model comparison. Scoring of individual units of analysis with Stata’s item response theory module is next discussed, and various graphical features of this module are pointed out. The review concludes with an illustration example of using Stata for item response modeling on an empirical data set.
本软件综述讨论了Stata进行项目反应理论建模的能力。首先讨论了拟合流行的一参数、二参数和三参数逻辑模型所需的命令。然后概述了单参数模型中判别参数相等性检验的步骤。随后指出了拟合几个多聚模型的命令,以及那些促进模型比较的命令。接着讨论了用Stata的项目反应理论模块对单个分析单元进行评分,并指出了该模块的各种图形特征。回顾总结了一个使用Stata对经验数据集进行项目反应建模的示例。
{"title":"Item Response Theory and Modeling with Stata","authors":"T. Raykov","doi":"10.1080/15366367.2022.2133528","DOIUrl":"https://doi.org/10.1080/15366367.2022.2133528","url":null,"abstract":"ABSTRACT This software review discusses the capabilities of Stata to conduct item response theory modeling. The commands needed for fitting the popular one-, two-, and three-parameter logistic models are initially discussed. The procedure for testing the discrimination parameter equality in the one-parameter model is then outlined. The commands for fitting several polytomous models are subsequently indicated, as are those facilitating model comparison. Scoring of individual units of analysis with Stata’s item response theory module is next discussed, and various graphical features of this module are pointed out. The review concludes with an illustration example of using Stata for item response modeling on an empirical data set.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76714734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical Considerations in Choosing an Anchor Test Form for Equating Under the Random Groups Design 随机群设计下方程锚点检验形式选择的实际考虑
IF 1 Q2 Mathematics Pub Date : 2023-04-03 DOI: 10.1080/15366367.2022.2087354
Zhongmin Cui, Yong He
ABSTRACT Careful considerations are necessary when there is a need to choose an anchor test form from a list of old test forms for equating under the random groups design. The choice of the anchor form potentially affects the accuracy of equated scores on new test forms. Few guidelines, however, can be found in the literature on choosing the anchor form. Five indices were proposed in this study to aid the selection and their performances were evaluated through a real-data-based simulation. The results shed some light on how to choose an anchor form in practice.
在随机分组设计下,当需要从旧的测试表格列表中选择一个锚点测试表格时,需要仔细考虑。锚点表格的选择可能会影响新测试表格等效分数的准确性。然而,在选择锚点形式的文献中可以找到很少的指导方针。本研究提出了五个指标来辅助选择,并通过基于真实数据的模拟来评估它们的性能。研究结果对实践中如何选择锚形有一定的启示。
{"title":"Practical Considerations in Choosing an Anchor Test Form for Equating Under the Random Groups Design","authors":"Zhongmin Cui, Yong He","doi":"10.1080/15366367.2022.2087354","DOIUrl":"https://doi.org/10.1080/15366367.2022.2087354","url":null,"abstract":"ABSTRACT Careful considerations are necessary when there is a need to choose an anchor test form from a list of old test forms for equating under the random groups design. The choice of the anchor form potentially affects the accuracy of equated scores on new test forms. Few guidelines, however, can be found in the literature on choosing the anchor form. Five indices were proposed in this study to aid the selection and their performances were evaluated through a real-data-based simulation. The results shed some light on how to choose an anchor form in practice.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80174741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparison of R Packages for Automated Test Assembly with Mixed-Integer Linear Programming 混合整数线性规划自动化测试装配R包的比较
IF 1 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/15366367.2022.2151081
Michael R. Peabody
ABSTRACT Many organizations utilize some form of automation in the test assembly process; either fully algorithmic or heuristically constructed. However, one issue with heuristic models is that when the test assembly problem changes the entire model may need to be re-conceptualized and recoded. In contrast, mixed-integer programming (MIP) is a mathematical representation of the test assembly problem that looks for the statistically optimal solution. Because MIP is a mathematical representation, changes to the test assembly problem typically involve only minor changes to the programming. This review focuses on comparing two free and open-source R packages for mixed integer linear programming: inlinelpSolveAPI and inlineompr. Programming style (with code provided), ease of use, run time, and other considerations will be examined. Solvers from other open-source platforms (e.g. Python, Julia) will also be discussed. Code and sample data are also provided.
许多组织在测试装配过程中使用某种形式的自动化;完全由算法或启发式构造的。然而,启发式模型的一个问题是,当测试组装问题发生变化时,整个模型可能需要重新概念化和重新编码。相反,混合整数规划(MIP)是测试装配问题的数学表示,它寻找统计上最优的解决方案。因为MIP是一种数学表示,所以对测试装配问题的更改通常只涉及对编程的微小更改。本文重点比较了两个免费和开源的R混合整数线性规划包:inlinelpSolveAPI和inlineompr。编程风格(提供代码)、易用性、运行时和其他考虑因素将被检查。来自其他开源平台(如Python、Julia)的求解器也将被讨论。还提供了代码和示例数据。
{"title":"Comparison of R Packages for Automated Test Assembly with Mixed-Integer Linear Programming","authors":"Michael R. Peabody","doi":"10.1080/15366367.2022.2151081","DOIUrl":"https://doi.org/10.1080/15366367.2022.2151081","url":null,"abstract":"ABSTRACT Many organizations utilize some form of automation in the test assembly process; either fully algorithmic or heuristically constructed. However, one issue with heuristic models is that when the test assembly problem changes the entire model may need to be re-conceptualized and recoded. In contrast, mixed-integer programming (MIP) is a mathematical representation of the test assembly problem that looks for the statistically optimal solution. Because MIP is a mathematical representation, changes to the test assembly problem typically involve only minor changes to the programming. This review focuses on comparing two free and open-source R packages for mixed integer linear programming: inlinelpSolveAPI and inlineompr. Programming style (with code provided), ease of use, run time, and other considerations will be examined. Solvers from other open-source platforms (e.g. Python, Julia) will also be discussed. Code and sample data are also provided.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85055949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
There are Many Greater Lower Bounds than Cronbach’s α: A Monte Carlo Simulation Study 有许多比Cronbach α更大的下界:一个蒙特卡罗模拟研究
IF 1 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/15366367.2022.2031484
Josip Novak, B. Rebernjak
ABSTRACT A Monte Carlo simulation study was conducted to examine the performance of α, λ2, λ4, μ2, ωT, GLBMRFA, and GLBAlgebraic coefficients. Population reliability, distribution shape, sample size, test length, and number of response categories were varied simultaneously. The results indicate that α and λ2 perform the worst overall. However, the performance of α is improved if the population reliability is high. λ4 is relatively unbiased but the most imprecise. μ2 and ωT perform relatively well under most conditions. GLBAlgebraic outperforms other coefficients under many conditions. GLBMRFA is useful under few conditions if the population reliability is high. The results corroborate previous suggestions that large samples, longer tests, higher number of response categories, and normally distributed results can make reliability estimates more dependable. Some insights on the interaction of these factors are provided. We discuss the findings compared to previous research. The complete R code used for the simulation is provided in the online supplement.
摘要通过蒙特卡罗仿真研究了α、λ2、λ4、μ2、ωT、GLBMRFA和GLBAlgebraic系数的性能。总体信度、分布形状、样本量、测试长度和反应类别数量同时发生变化。结果表明,α和λ2的综合性能最差。而种群可靠性越高,α的性能越好。λ4相对无偏,但最不精确。μ2和ωT在大多数条件下表现相对较好。在许多情况下,GLBAlgebraic优于其他系数。如果种群可靠性高,GLBMRFA在少数条件下是有用的。结果证实了先前的建议,即大样本,更长的测试,更多的响应类别和正态分布的结果可以使可靠性估计更可靠。对这些因素的相互作用提供了一些见解。我们将这些发现与之前的研究进行比较。用于模拟的完整R代码在在线补充中提供。
{"title":"There are Many Greater Lower Bounds than Cronbach’s α: A Monte Carlo Simulation Study","authors":"Josip Novak, B. Rebernjak","doi":"10.1080/15366367.2022.2031484","DOIUrl":"https://doi.org/10.1080/15366367.2022.2031484","url":null,"abstract":"ABSTRACT A Monte Carlo simulation study was conducted to examine the performance of α, λ2, λ4, μ2, ωT, GLBMRFA, and GLBAlgebraic coefficients. Population reliability, distribution shape, sample size, test length, and number of response categories were varied simultaneously. The results indicate that α and λ2 perform the worst overall. However, the performance of α is improved if the population reliability is high. λ4 is relatively unbiased but the most imprecise. μ2 and ωT perform relatively well under most conditions. GLBAlgebraic outperforms other coefficients under many conditions. GLBMRFA is useful under few conditions if the population reliability is high. The results corroborate previous suggestions that large samples, longer tests, higher number of response categories, and normally distributed results can make reliability estimates more dependable. Some insights on the interaction of these factors are provided. We discuss the findings compared to previous research. The complete R code used for the simulation is provided in the online supplement.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88547175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the Discrepancy Between Scale Reliability and Cronbach’s Coefficient Alpha Using Latent Variable Modeling 用潜在变量模型评估量表信度与Cronbach系数α的差异
IF 1 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/15366367.2022.2031485
T. Raykov, G. Marcoulides
ABSTRACT This article outlines a readily applicable procedure for point and interval estimation of the population discrepancy between reliability and the popular Cronbach’s coefficient alpha for unidimensional multi-component measuring instruments with uncorrelated errors, which are widely used in behavioral and social research. The method is developed within the latent variable modeling framework and can be used to evaluate the degree to which coefficient alpha underestimates scale reliability in empirical measurement research employing such instruments. The approach is straight-forwardly utilized with readily available software and is illustrated using a numerical example.
摘要:本文概述了一种易于应用的方法,对具有不相关误差的一维多分量测量仪器的总体信度与流行的Cronbach系数之间的总体差异进行点和区间估计,这种方法广泛应用于行为和社会研究。该方法是在潜在变量建模框架内开发的,可用于评估使用此类工具的实证测量研究中系数α低估量表可靠性的程度。该方法可以直接使用现成的软件,并通过一个数值例子进行说明。
{"title":"Evaluating the Discrepancy Between Scale Reliability and Cronbach’s Coefficient Alpha Using Latent Variable Modeling","authors":"T. Raykov, G. Marcoulides","doi":"10.1080/15366367.2022.2031485","DOIUrl":"https://doi.org/10.1080/15366367.2022.2031485","url":null,"abstract":"ABSTRACT This article outlines a readily applicable procedure for point and interval estimation of the population discrepancy between reliability and the popular Cronbach’s coefficient alpha for unidimensional multi-component measuring instruments with uncorrelated errors, which are widely used in behavioral and social research. The method is developed within the latent variable modeling framework and can be used to evaluate the degree to which coefficient alpha underestimates scale reliability in empirical measurement research employing such instruments. The approach is straight-forwardly utilized with readily available software and is illustrated using a numerical example.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81764480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examining the Relationships between Feedback Practices and Learning Motivation 研究反馈实践与学习动机之间的关系
IF 1 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/15366367.2022.2061236
Zhengdong Gan, Jinbo He, L. Zhang, R. Schumacker
ABSTRACT While classroom feedback has been shown to be a key mediating factor in students’ learning process and performance, the bulk of current research on feedback in the field of foreign language education has largely focused on how teachers respond to students’ linguistic errors. Published research on how students in a foreign language context respond to different kinds of classroom feedback practice has been sparse. Even less frequently reported is how different forms of classroom feedback practice may cater to students’ motivation in learning. Taking stock of theoretical perspectives concerning feedback and motivation in both educational psychology and language acquisition, this study intends to fill these gaps by investigating what classroom feedback practices tertiary foreign language students experienced, and how these feedback practices were associated with student foreign language learning motivation. Student self-feedback was found to be the most powerful predictor of their motivation for English learning. The results suggest that there is a need for a qualitative change in feedback practices in university foreign language classrooms in order that feedback processes can be deployed more effectively to benefit students’ learning.
虽然课堂反馈已被证明是学生学习过程和表现的关键中介因素,但目前外语教育领域关于反馈的大部分研究都集中在教师如何应对学生的语言错误上。已发表的关于学生在外语环境下对不同类型的课堂反馈练习的反应的研究很少。更少报道的是,不同形式的课堂反馈实践如何迎合学生的学习动机。本研究在回顾教育心理学和语言习得中有关反馈和动机的理论观点的基础上,通过调查高等外语学生的课堂反馈实践,以及这些反馈实践如何与学生的外语学习动机相关联,来填补这些空白。学生的自我反馈被发现是他们英语学习动机的最有力的预测因子。结果表明,大学外语课堂的反馈实践有必要发生质的变化,以便更有效地利用反馈过程,使学生的学习受益。
{"title":"Examining the Relationships between Feedback Practices and Learning Motivation","authors":"Zhengdong Gan, Jinbo He, L. Zhang, R. Schumacker","doi":"10.1080/15366367.2022.2061236","DOIUrl":"https://doi.org/10.1080/15366367.2022.2061236","url":null,"abstract":"ABSTRACT While classroom feedback has been shown to be a key mediating factor in students’ learning process and performance, the bulk of current research on feedback in the field of foreign language education has largely focused on how teachers respond to students’ linguistic errors. Published research on how students in a foreign language context respond to different kinds of classroom feedback practice has been sparse. Even less frequently reported is how different forms of classroom feedback practice may cater to students’ motivation in learning. Taking stock of theoretical perspectives concerning feedback and motivation in both educational psychology and language acquisition, this study intends to fill these gaps by investigating what classroom feedback practices tertiary foreign language students experienced, and how these feedback practices were associated with student foreign language learning motivation. Student self-feedback was found to be the most powerful predictor of their motivation for English learning. The results suggest that there is a need for a qualitative change in feedback practices in university foreign language classrooms in order that feedback processes can be deployed more effectively to benefit students’ learning.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":null,"pages":null},"PeriodicalIF":1.0,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76016043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Measurement-Interdisciplinary Research and Perspectives
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1