Behavior Research Methods最新文献

The tendency for individuals to mind wander is often measured using experience sampling methods in which probe questions embedded within computerized cognitive tasks attempt to catch episodes of off-task thought at random intervals during task performance. However, mind-wandering probe questions and response options are often chosen ad hoc and vary between studies with extant little guidance as to the psychometric consequences of these methodological decisions. In the present study, we examined the psychometric properties of several common approaches for assessing mind wandering using methods from item response theory (IRT). IRT latent modeling demonstrated that measurement information was generally distributed across the range of trait estimates according to when probes were presented in time. Probes presented earlier in time provided more information about individuals with greater tendency to mind wandering than probes presented later. Furthermore, mind-wandering ratings made on a continuous scale or using multiple categorical rating options provided more information about individuals' latent mind-wandering tendency - across a broader range of the trait continuum - than ratings dichotomized into on-task and off-task categories. In addition, IRT provided evidence that reports of "task-related thoughts" contribute to the task-focused dimension of the construct continuum, providing justification for studies conceptualizing these responses as a kind of task-related focus. Together, we hope these findings will help guide researchers hoping to maximize the measurement precision of their mind wandering assessment procedures.

Mixed-format tests, which typically include dichotomous items and polytomously scored tasks, are employed to assess a wider range of knowledge and skills. Recent behavioral and educational studies have highlighted their practical importance and methodological developments, particularly within the context of multivariate generalizability theory. However, the diverse response types and complex designs of these tests pose significant analytical challenges when modeling data simultaneously. Current methods often struggle to yield reliable results, either due to the inappropriate treatment of different types of response data separately or the imposition of identical covariates across various response types. Moreover, there are few software packages or programs that offer customized solutions for modeling mixed-format tests, addressing these limitations. This tutorial provides a detailed example of using a Bayesian approach to model data collected from a mixed-format test, comprising multiple-choice questions and free-response tasks. The modeling was conducted using the Stan software within the R programming system, with Stan codes tailored to the structure of the test design, following the principles of multivariate generalizability theory. By further examining the effects of prior distributions in this example, this study demonstrates how the adaptability of Bayesian models to diverse test formats, coupled with their potential for nuanced analysis, can significantly advance the field of psychometric modeling.

Observational studies of human behaviour often require the annotation of objects in video recordings. Automatic object detection has been facilitated strongly by the development of YOLO ('you only look once') and particularly by YOLOv8 from Ultralytics, which is easy to use. The present study examines the conditions required for accurate object detection with YOLOv8. The results show almost perfect object detection even when the model was trained on a small dataset (100 to 350 images). The detector, however, does not extrapolate well to the same object in other backgrounds. By training the detector on images from a variety of backgrounds, excellent object detection can be restored. YOLOv8 could be a game changer for behavioural research that requires object annotation in video recordings.

Generalized linear mixed models (GLMMs) have great potential to deal with count data in single-case experimental designs (SCEDs). However, applied researchers have faced challenges in making various statistical decisions when using such advanced statistical techniques in their own research. This study focused on a critical issue by investigating the selection of an appropriate distribution to handle different types of count data in SCEDs due to overdispersion and/or zero-inflation. To achieve this, I proposed two model selection frameworks, one based on calculating information criteria (AIC and BIC) and another based on utilizing a multistage-model selection procedure. Four data scenarios were simulated including Poisson, negative binominal (NB), zero-inflated Poisson (ZIP), and zero-inflated negative binomial (ZINB). The same set of models (i.e., Poisson, NB, ZIP, and ZINB) were fitted for each scenario. In the simulation, I evaluated 10 model selection strategies within the two frameworks by assessing the model selection bias and its consequences on the accuracy of the treatment effect estimates and inferential statistics. Based on the simulation results and previous work, I provide recommendations regarding which model selection methods should be adopted in different scenarios. The implications, limitations, and future research directions are also discussed.

Investigating how infants first establish relationships between words is a necessary step towards understanding how an interconnected network of semantic relationships develops in the adult lexical-semantic system. Stimuli selection for these child studies is critical since words must be both familiar and highly imageable. However, there has been a reliance on adult word association norms to inform stimuli selection in English infant studies to date, as no resource currently exists for child-specific word associations. We present three experiments that explore the strength of word-word relationships in 3-year-olds. Experiment 1 collected children's word associations (WA) (N = 150; female = 84, L1 = British English) and compared them to adult associative norms (Moss & Older, 1996; Nelson et al., 2004 (Behavior Research Methods, Instruments, & Computers, 36(3), 402-407)). Experiment 2 replicated WAs from Experiment 1 in an online adaptation of the task (N = 24: 13 female, L1 = British English). Both experiments indicated a high proportion of child-specific WAs not represented in adult norms (Moss & Older, 1996; Nelson et al., 2004 (Behavior Research Methods, Instruments, & Computers, 36(3), 402-407)). Experiment 3 tested noun-noun WAs from these responses in an online semantic priming study (N = 40: 19 female, L1 = British English) and found that association type modulated priming (F(2.57, 100.1) = 13.13, p <. 0001, generalized η² = .19). This research presents a resource of child-specific imageable noun-noun word pair stimuli suitable for testing young children in word recognition and semantic priming studies.

Rating scales are susceptible to response styles that undermine the scale quality. Optimizing a rating scale can tailor it to individuals' cognitive abilities, thereby preventing the occurrence of response styles related to a suboptimal response format. However, the discrimination ability of individuals in a sample may vary, suggesting that different rating scales may be appropriate for different individuals. This study aims to examine (1) whether response styles can be avoided when individuals are allowed to choose a rating scale and (2) whether the psychometric properties of self-chosen rating scales improve compared to given rating scales. To address these objectives, data from the flourishing scale were used as an illustrative example. MTurk workers from Amazon's Mechanical Turk platform (N = 7042) completed an eight-item flourishing scale twice: (1) using a randomly assigned four-, six-, or 11-point rating scale, and (2) using a self-chosen rating scale. Applying the restrictive mixed generalized partial credit model (rmGPCM) allowed examination of category use across the conditions. Correlations with external variables were calculated to assess the effects of the rating scales on criterion validity. The results revealed consistent use of self-chosen rating scales, with approximately equal proportions of the three response styles. Ordinary response behavior was observed in 55-58% of individuals, which was an increase of 12-15% compared to assigned rating scales. The self-chosen rating scales also exhibited superior psychometric properties. The implications of these findings are discussed.

In the last decade, scientists investigating human social cognition have started bringing traditional laboratory paradigms more "into the wild" to examine how socio-cognitive mechanisms of the human brain work in real-life settings. As this implies transferring 2D observational paradigms to 3D interactive environments, there is a risk of compromising experimental control. In this context, we propose a methodological approach which uses humanoid robots as proxies of social interaction partners and embeds them in experimental protocols that adapt classical paradigms of cognitive psychology to interactive scenarios. This allows for a relatively high degree of "naturalness" of interaction and excellent experimental control at the same time. Here, we present two case studies where our methods and tools were applied and replicated across two different laboratories, namely the Italian Institute of Technology in Genova (Italy) and the Agency for Science, Technology and Research in Singapore. In the first case study, we present a replication of an interactive version of a gaze-cueing paradigm reported in Kompatsiari et al. (J Exp Psychol Gen 151(1):121-136, 2022). The second case study presents a replication of a "shared experience" paradigm reported in Marchesi et al. (Technol Mind Behav 3(3):11, 2022). As both studies replicate results across labs and different cultures, we argue that our methods allow for reliable and replicable setups, even though the protocols are complex and involve social interaction. We conclude that our approach can be of benefit to the research field of social cognition and grant higher replicability, for example, in cross-cultural comparisons of social cognition mechanisms.

Body-object interaction (BOI) measures the ease with which the human body can interact with the concept represented by a word. This research focuses on two main objectives: first, to establish French norms for the psycholinguistic variable BOI, and second, to investigate the contribution of BOI to language processing in French. We collected BOI ratings for 3600 French nouns from participants through an online platform. The inter- and intrastudy reliability of these new ratings indicate that the ratings are robust. We then aimed to determine the role of BOI in word recognition. A hierarchical regression analysis was conducted using lexical decision reaction times (RTs) as the dependent variable. BOI was found to be a significant predictor of lexical decision latencies, beyond the contribution of word length, frequency, orthographic distinctiveness, and imageability. Contrary to previous findings in English, higher BOI values were associated with longer RTs in French, indicating an inhibitory effect of BOI on French word processing. Methodological differences may account for this divergent result. Taken together, the results of this study show the independent contribution of BOI to word recognition in French. This supports the notion that sensorimotor information is a crucial component of language processing. By providing a reliable and sizable BOI database for French nouns, we offer a valuable resource for psycholinguistic and language processing research. This research underscores the complex relationship between language, cognition, and sensorimotor experiences, advancing our comprehension of language processing mechanisms.