Delving into the Complexity of Analogical Reasoning: A Detailed Exploration with the Generalized Multicomponent Latent Trait Model for Diagnosis.

Abstract

Research on analogical reasoning has facilitated the understanding of response processes such as pattern identification and creative problem solving, emerging as an intelligence predictor. While analogical tests traditionally combine various composition rules for item generation, current statistical models like the Logistic Latent Trait Model (LLTM) and Embretson's Multicomponent Latent Trait Model for Diagnosis (MLTM-D) face limitations in handling the inherent complexity of these processes, resulting in suboptimal model fit and interpretation. The primary aim of this research was to extend Embretson's MLTM-D to encompass complex multidimensional models that allow the estimation of item parameters. Concretely, we developed a three-parameter (3PL) version of the MLTM-D that provides more informative interpretations of participant response processes. We developed the Generalized Multicomponent Latent Trait Model for Diagnosis (GMLTM-D), which is a statistical model that extends Embretson's multicomponent model to explore complex analogical theories. The GMLTM-D was compared with LLTM and MLTM-D using data from a previous study of a figural analogical reasoning test composed of 27 items based on five composition rules: figure rotation, trapezoidal rotation, reflection, segment subtraction, and point movement. Additionally, we provide an R package (GMLTM) for conducting Bayesian estimation of the models mentioned. The GMLTM-D more accurately replicated the observed data compared to the Bayesian versions of LLTM and MLTM-D, demonstrating a better model fit and superior predictive accuracy. Therefore, the GMLTM-D is a reliable model for analyzing analogical reasoning data and calibrating intelligence tests. The GMLTM-D embraces the complexity of real data and enhances the understanding of examinees' response processes.