Pub Date : 2023-09-01Epub Date: 2022-12-06DOI: 10.1080/00273171.2022.2142189
Vasiliki Bountziouka, Samantha Johnson, Bradley N Manktelow
The use of the lambda-mu-sigma (LMS) method for estimating centiles and producing reference ranges has received much interest in clinical practice, especially for assessing growth in childhood. However, this method may not be directly applicable where measures are based on a score calculated from question response categories that is bounded within finite intervals, for example, in psychometrics. In such cases, the main assumption of normality of the conditional distribution of the transformed response measurement is violated due to the presence of ceiling (and floor) effects, leading to biased fitted centiles when derived using the common LMS method. This paper describes the methodology for constructing reference intervals when the response variable is bounded and explores different distribution families for the centile estimation, using a score derived from a parent-completed assessment of cognitive and language development in 24 month-old children. Results indicated that the z-scores, and thus the extracted centiles, improved when kurtosis was also modeled and that the ceiling effect was addressed with the use of the inflated binomial distribution. Therefore, the selection of the appropriate distribution when constructing centile curves is crucial.
{"title":"Methods for Constructing Normalised Reference Scores: An Application for Assessing Child Development at 24 Months of Age.","authors":"Vasiliki Bountziouka, Samantha Johnson, Bradley N Manktelow","doi":"10.1080/00273171.2022.2142189","DOIUrl":"10.1080/00273171.2022.2142189","url":null,"abstract":"<p><p>The use of the lambda-mu-sigma (LMS) method for estimating centiles and producing reference ranges has received much interest in clinical practice, especially for assessing growth in childhood. However, this method may not be directly applicable where measures are based on a score calculated from question response categories that is bounded within finite intervals, for example, in psychometrics. In such cases, the main assumption of normality of the conditional distribution of the transformed response measurement is violated due to the presence of ceiling (and floor) effects, leading to biased fitted centiles when derived using the common LMS method. This paper describes the methodology for constructing reference intervals when the response variable is bounded and explores different distribution families for the centile estimation, using a score derived from a parent-completed assessment of cognitive and language development in 24 month-old children. Results indicated that the z-scores, and thus the extracted centiles, improved when kurtosis was also modeled and that the ceiling effect was addressed with the use of the inflated binomial distribution. Therefore, the selection of the appropriate distribution when constructing centile curves is crucial.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35256314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2022-12-10DOI: 10.1080/00273171.2022.2141675
Fei Gu, Yiu-Fai Yung, Mike W-L Cheung, Baek-Kyoo Brian Joo, Kim Nimon
Redundancy analysis (RA) is a multivariate method that maximizes the mean variance of a set of criterion variables explained by a small number of redundancy variates (i.e., linear combinations of a set of predictor variables). However, two challenges exist in RA. First, inferential information for the RA estimates might not be readily available. Second, the existing methods addressing the dimensionality problem in RA are limited for various reasons. To aid the applications of RA, we propose a direct covariance structure modeling approach to RA. The proposed approach (1) provides inferential information for the RA estimates, and (2) allows the researcher to use a simple yet practical criterion to address the dimensionality problem in RA. We illustrate our approach with an artificial example, validate some standard error estimates by simulations, and demonstrate our new criterion in a real example. Finally, we conclude with future research topics.
{"title":"Statistical Inference in Redundancy Analysis: A Direct Covariance Structure Modeling Approach.","authors":"Fei Gu, Yiu-Fai Yung, Mike W-L Cheung, Baek-Kyoo Brian Joo, Kim Nimon","doi":"10.1080/00273171.2022.2141675","DOIUrl":"10.1080/00273171.2022.2141675","url":null,"abstract":"<p><p>Redundancy analysis (RA) is a multivariate method that maximizes the mean variance of a set of criterion variables explained by a small number of redundancy variates (i.e., linear combinations of a set of predictor variables). However, two challenges exist in RA. First, inferential information for the RA estimates might not be readily available. Second, the existing methods addressing the dimensionality problem in RA are limited for various reasons. To aid the applications of RA, we propose a direct covariance structure modeling approach to RA. The proposed approach (1) provides inferential information for the RA estimates, and (2) allows the researcher to use a simple yet practical criterion to address the dimensionality problem in RA. We illustrate our approach with an artificial example, validate some standard error estimates by simulations, and demonstrate our new criterion in a real example. Finally, we conclude with future research topics.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9489378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-01-09DOI: 10.1080/00273171.2022.2149449
Donna L Coffman, John J Dziak, Kaylee Litson, Yajnaseni Chakraborti, Megan E Piper, Runze Li
The increase in the use of mobile and wearable devices now allows dense assessment of mediating processes over time. For example, a pharmacological intervention may have an effect on smoking cessation via reductions in momentary withdrawal symptoms. We define and identify the causal direct and indirect effects in terms of potential outcomes on the mean difference and odds ratio scales, and present a method for estimating and testing the indirect effect of a randomized treatment on a distal binary variable as mediated by the nonparametric trajectory of an intensively measured longitudinal variable (e.g., from ecological momentary assessment). Coverage of a bootstrap test for the indirect effect is demonstrated via simulation. An empirical example is presented based on estimating later smoking abstinence from patterns of craving during smoking cessation treatment. We provide an R package, funmediation, available on CRAN at https://cran.r-project.org/web/packages/funmediation/index.html, to conveniently apply this technique. We conclude by discussing possible extensions to multiple mediators and directions for future research.
{"title":"A Causal Approach to Functional Mediation Analysis with Application to a Smoking Cessation Intervention.","authors":"Donna L Coffman, John J Dziak, Kaylee Litson, Yajnaseni Chakraborti, Megan E Piper, Runze Li","doi":"10.1080/00273171.2022.2149449","DOIUrl":"10.1080/00273171.2022.2149449","url":null,"abstract":"<p><p>The increase in the use of mobile and wearable devices now allows dense assessment of mediating processes over time. For example, a pharmacological intervention may have an effect on smoking cessation via reductions in momentary withdrawal symptoms. We define and identify the causal direct and indirect effects in terms of potential outcomes on the mean difference and odds ratio scales, and present a method for estimating and testing the indirect effect of a randomized treatment on a distal binary variable as mediated by the nonparametric trajectory of an intensively measured longitudinal variable (e.g., from ecological momentary assessment). Coverage of a bootstrap test for the indirect effect is demonstrated via simulation. An empirical example is presented based on estimating later smoking abstinence from patterns of craving during smoking cessation treatment. We provide an R package, funmediation, available on CRAN at https://cran.r-project.org/web/packages/funmediation/index.html, to conveniently apply this technique. We conclude by discussing possible extensions to multiple mediators and directions for future research.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10966971/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9258786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recent advances in technology contribute to a fast-growing number of studies utilizing intensive longitudinal data, and call for more flexible methods to address the demands that come with them. One issue that arises from collecting longitudinal data from multiple units in time is nested data, where the variability observed in such data is a mixture of within-unit changes and between-unit differences. This article aims to provide a model-fitting approach that simultaneously models the within-unit changes with differential equation models and accounts for between-unit differences with mixed effects. This approach combines a variant of the Kalman filter, the continuous-discrete extended Kalman filter (CDEKF), and the Markov chain Monte Carlo method often employed in the Bayesian framework through the platform Stan. At the same time, it utilizes Stan's functionality of numerical solvers for the implementation of CDEKF. For an empirical illustration, we applied this method in the context of differential equation models to an empirical dataset to explore the physiological dynamics and co-regulation between couples.
{"title":"Fitting Bayesian Stochastic Differential Equation Models with Mixed Effects through a Filtering Approach.","authors":"Meng Chen, Sy-Miin Chow, Zita Oravecz, Emilio Ferrer","doi":"10.1080/00273171.2023.2171354","DOIUrl":"10.1080/00273171.2023.2171354","url":null,"abstract":"<p><p>Recent advances in technology contribute to a fast-growing number of studies utilizing intensive longitudinal data, and call for more flexible methods to address the demands that come with them. One issue that arises from collecting longitudinal data from multiple units in time is nested data, where the variability observed in such data is a mixture of within-unit changes and between-unit differences. This article aims to provide a model-fitting approach that simultaneously models the within-unit changes with differential equation models and accounts for between-unit differences with mixed effects. This approach combines a variant of the Kalman filter, the continuous-discrete extended Kalman filter (CDEKF), and the Markov chain Monte Carlo method often employed in the Bayesian framework through the platform Stan. At the same time, it utilizes Stan's functionality of numerical solvers for the implementation of CDEKF. For an empirical illustration, we applied this method in the context of differential equation models to an empirical dataset to explore the physiological dynamics and co-regulation between couples.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10460464/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10095641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-01-05DOI: 10.1080/00273171.2022.2147049
Brian T Keller, Craig K Enders
A growing body of literature has focused on missing data methods that factorize the joint distribution into a part representing the analysis model of interest and a part representing the distributions of the incomplete predictors. Relatively little is known about the utility of this method for multilevel models with interactive effects. This study presents a series of Monte Carlo computer simulations that investigates Bayesian and multiple imputation strategies based on factored regressions. When the model's distributional assumptions are satisfied, these methods generally produce nearly unbiased estimates and good coverage, with few exceptions. Severe misspecifications that arise from substantially non-normal distributions can introduce biased estimates and poor coverage. Follow-up simulations suggest that a Yeo-Johnson transformation can mitigate these biases. A real data example illustrates the methodology, and the paper suggests several avenues for future research.
{"title":"An Investigation of Factored Regression Missing Data Methods for Multilevel Models with Cross-Level Interactions.","authors":"Brian T Keller, Craig K Enders","doi":"10.1080/00273171.2022.2147049","DOIUrl":"10.1080/00273171.2022.2147049","url":null,"abstract":"<p><p>A growing body of literature has focused on missing data methods that factorize the joint distribution into a part representing the analysis model of interest and a part representing the distributions of the incomplete predictors. Relatively little is known about the utility of this method for multilevel models with interactive effects. This study presents a series of Monte Carlo computer simulations that investigates Bayesian and multiple imputation strategies based on factored regressions. When the model's distributional assumptions are satisfied, these methods generally produce nearly unbiased estimates and good coverage, with few exceptions. Severe misspecifications that arise from substantially non-normal distributions can introduce biased estimates and poor coverage. Follow-up simulations suggest that a Yeo-Johnson transformation can mitigate these biases. A real data example illustrates the methodology, and the paper suggests several avenues for future research.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10480692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-01-04DOI: 10.1080/00273171.2022.2158776
Brenna Gomer, Ke-Hai Yuan
The impact of missing data on statistical inference varies depending on several factors such as the proportion of missingness, missing-data mechanism, and method employed to handle missing values. While these topics have been extensively studied, most recommendations have been made assuming that all missing values are from the same missing-data mechanism. In reality, it is very likely that a mixture of missing-data mechanisms is responsible for missing values in a dataset and even within the same pattern of missingness. Although a mixture of missing-data mechanisms and causes within a dataset is a likely scenario, the performance of popular missing-data methods under these circumstances is unknown. This study provides a realistic evaluation of methods for handling missing data in this setting using Monte Carlo simulation in the context of regression. This study also seeks to identify acceptable proportions of missing values that violate the missing-data mechanism assumed by the method used to handle missing values. Results indicate that multiple imputation (MI) performs better than other principled or ad-hoc methods. Different missing-data methods are also compared via the analysis of a real dataset in which mixtures of missingness mechanisms are created. Recommendations are provided for the use of different methods in practice.
{"title":"A Realistic Evaluation of Methods for Handling Missing Data When There is a Mixture of MCAR, MAR, and MNAR Mechanisms in the Same Dataset.","authors":"Brenna Gomer, Ke-Hai Yuan","doi":"10.1080/00273171.2022.2158776","DOIUrl":"10.1080/00273171.2022.2158776","url":null,"abstract":"<p><p>The impact of missing data on statistical inference varies depending on several factors such as the proportion of missingness, missing-data mechanism, and method employed to handle missing values. While these topics have been extensively studied, most recommendations have been made assuming that all missing values are from the same missing-data mechanism. In reality, it is very likely that a mixture of missing-data mechanisms is responsible for missing values in a dataset and even within the same pattern of missingness. Although a mixture of missing-data mechanisms and causes within a dataset is a likely scenario, the performance of popular missing-data methods under these circumstances is unknown. This study provides a realistic evaluation of methods for handling missing data in this setting using Monte Carlo simulation in the context of regression. This study also seeks to identify acceptable proportions of missing values that violate the missing-data mechanism assumed by the method used to handle missing values. Results indicate that multiple imputation (MI) performs better than other principled or ad-hoc methods. Different missing-data methods are also compared via the analysis of a real dataset in which mixtures of missingness mechanisms are created. Recommendations are provided for the use of different methods in practice.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10537653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-01-05DOI: 10.1080/00273171.2022.2148089
Shu Fai Cheung, Ivan Jacob Agaloos Pesigan
The results in a structural equation modeling (SEM) analysis can be influenced by just a few observations, called influential cases. Tools have been developed for users of R to identify them. However, similar tools are not available for AMOS, which is also a popular SEM software package. We introduce the FINDOUT toolset, a group of SPSS extension commands, and an AMOS plugin, to identify influential cases and examine how these cases influence the results. The SPSS commands can be used either as syntax commands or as custom dialogs from pull-down menus, and the AMOS plugin can be run from AMOS pull-down menu. We believe these tools can help researchers to examine the robustness of their findings to influential cases.
{"title":"FINDOUT: Using Either SPSS Commands or Graphical User Interface to Identify Influential Cases in Structural Equation Modeling in AMOS.","authors":"Shu Fai Cheung, Ivan Jacob Agaloos Pesigan","doi":"10.1080/00273171.2022.2148089","DOIUrl":"10.1080/00273171.2022.2148089","url":null,"abstract":"<p><p>The results in a structural equation modeling (SEM) analysis can be influenced by just a few observations, called <i>influential cases</i>. Tools have been developed for users of R to identify them. However, similar tools are not available for AMOS, which is also a popular SEM software package. We introduce the FINDOUT toolset, a group of SPSS extension commands, and an AMOS plugin, to identify influential cases and examine how these cases influence the results. The SPSS commands can be used either as syntax commands or as custom dialogs from pull-down menus, and the AMOS plugin can be run from AMOS pull-down menu. We believe these tools can help researchers to examine the robustness of their findings to influential cases.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10480693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-09-11DOI: 10.1080/00273171.2023.2256547
{"title":"2022 List of Reviewers.","authors":"","doi":"10.1080/00273171.2023.2256547","DOIUrl":"10.1080/00273171.2023.2256547","url":null,"abstract":"","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50163742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Diffusion-based item response theory models are measurement models that link parameters of the diffusion model (drift rate, boundary separation) to latent traits of test takers. Similar to standard latent trait models, they assume the invariance of the test takers' latent traits during a test. Previous research, however, suggests that traits change as test takers learn or decrease their effort. In this paper, we combine the diffusion-based item response theory model with a latent growth curve model. In the model, the latent traits of each test taker are allowed to change during the test until a stable level is reached. As different change processes are assumed for different traits, different aspects of change can be separated. We discuss different versions of the model that make different assumptions about the form (linear versus quadratic) and rate (fixed versus individual-specific) of change. In order to fit the model to data, we propose a Bayes estimator. Parameter recovery is investigated in a simulation study. The study suggests that parameter recovery is good under certain conditions. We illustrate the application of the model to data measuring visuo-spatial perspective-taking.
{"title":"Disentangling Different Aspects of Change in Tests with the D-Diffusion Model.","authors":"Jochen Ranger, Anett Wolgast, Sören Much, Augustin Mutak, Robert Krause, Steffi Pohl","doi":"10.1080/00273171.2023.2171356","DOIUrl":"10.1080/00273171.2023.2171356","url":null,"abstract":"<p><p>Diffusion-based item response theory models are measurement models that link parameters of the diffusion model (drift rate, boundary separation) to latent traits of test takers. Similar to standard latent trait models, they assume the invariance of the test takers' latent traits during a test. Previous research, however, suggests that traits change as test takers learn or decrease their effort. In this paper, we combine the diffusion-based item response theory model with a latent growth curve model. In the model, the latent traits of each test taker are allowed to change during the test until a stable level is reached. As different change processes are assumed for different traits, different aspects of change can be separated. We discuss different versions of the model that make different assumptions about the form (linear versus quadratic) and rate (fixed versus individual-specific) of change. In order to fit the model to data, we propose a Bayes estimator. Parameter recovery is investigated in a simulation study. The study suggests that parameter recovery is good under certain conditions. We illustrate the application of the model to data measuring visuo-spatial perspective-taking.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9342992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-01Epub Date: 2023-01-09DOI: 10.1080/00273171.2022.2157788
Kangjun Liang, Dongbo Tu, Yan Cai
With the advance of computer-based assessments, many process data, such as response times (RTs), action sequences, Eye-tracking data, the log data for collaborative problem-solving (CPS) and mouse click/drag becomes readily available. Findings from previous studies (e.g., Peng et al., Multivariate Behavioral Research, 1-20, 2021; Xu, The British Journal of Mathematical and Statistical Psychology, 73(3), 474-505, 2020; He & von Davier, Handbook of research on technology tools for real-world skill development (pp. 750-777). IGI Global, 2016; Man & Harring, Educational and Psychological Measurement, 81(3), 441-465, 2021) suggest a substantial relationship between this human-computer interactive process information and proficiency, which means these process data were potentially useful variables for psychological and educational measurement. To make full use of the process data, this paper aims to combine two useful and easily available types of process data, including the mouse click/drag traces and the response times, to the conventional cognitive diagnostic model (CDM) to better understand individual's response behavior and improve the classification accuracy of existing CDM. Then the full Bayesian analysis using Markov chain Monte Carlo (MCMC) was employed to estimate the proposed model parameters. The viability of the proposed model was investigated by an empirical data and two simulation studies. Results indicated the proposed model combing both types of process data could not only improve the attribute classification reliability in real data analysis, but also provide an improvement on item parameters recovery and person classification accuracy.
随着基于计算机的评估的进步,许多过程数据,如响应时间(RT)、动作序列、眼动追踪数据、协作解决问题的日志数据(CPS)和鼠标点击/拖动,变得随时可用。先前研究的结果(例如,彭等人,多变量行为研究,2021年1月20日;徐,《英国数学与统计心理学杂志》,73(3),474-5052020;He和von Davier,《现实世界技能发展技术工具研究手册》(第750-777页)。IGI Global,2016;Man&Harring,Educational and Psychological Measurement,81(3),441-4652021)表明,这种人机交互过程信息与熟练程度之间存在实质性关系,这意味着这些过程数据是心理和教育测量的潜在有用变量。为了充分利用过程数据,本文旨在将两种有用且易于获得的过程数据(包括鼠标点击/拖动轨迹和响应时间)与传统的认知诊断模型(CDM)相结合,以更好地了解个体的响应行为,提高现有CDM的分类准确性。然后利用马尔可夫链蒙特卡罗(MCMC)进行全贝叶斯分析来估计所提出的模型参数。通过一个经验数据和两个模拟研究对所提出的模型的可行性进行了研究。结果表明,该模型将两种类型的过程数据相结合,不仅可以提高真实数据分析中属性分类的可靠性,还可以提高项目参数的恢复和人员分类的准确性。
{"title":"Using Process Data to Improve Classification Accuracy of Cognitive Diagnosis Model.","authors":"Kangjun Liang, Dongbo Tu, Yan Cai","doi":"10.1080/00273171.2022.2157788","DOIUrl":"10.1080/00273171.2022.2157788","url":null,"abstract":"<p><p>With the advance of computer-based assessments, many process data, such as response times (RTs), action sequences, Eye-tracking data, the log data for collaborative problem-solving (CPS) and mouse click/drag becomes readily available. Findings from previous studies (e.g., Peng et al., <i>Multivariate Behavioral Research</i>, 1-20, 2021; Xu, <i>The British Journal of Mathematical and Statistical Psychology</i>, 73(3), 474-505, 2020; He & von Davier, <i>Handbook of research on technology tools for real-world skill development</i> (pp. 750-777). IGI Global, 2016; Man & Harring, <i>Educational and Psychological Measurement</i>, 81(3), 441-465, 2021) suggest a substantial relationship between this human-computer interactive process information and proficiency, which means these process data were potentially useful variables for psychological and educational measurement. To make full use of the process data, this paper aims to combine two useful and easily available types of process data, including the mouse click/drag traces and the response times, to the conventional cognitive diagnostic model (CDM) to better understand individual's response behavior and improve the classification accuracy of existing CDM. Then the full Bayesian analysis using Markov chain Monte Carlo (MCMC) was employed to estimate the proposed model parameters. The viability of the proposed model was investigated by an empirical data and two simulation studies. Results indicated the proposed model combing both types of process data could not only improve the attribute classification reliability in real data analysis, but also provide an improvement on item parameters recovery and person classification accuracy.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":null,"pages":null},"PeriodicalIF":3.8,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10488509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}