Pub Date : 2024-03-29DOI: 10.1016/j.intell.2024.101827
Louis D. Matzel
{"title":"An endless cycle of ignorance is the consequence of not offering classes on IQ and human intelligence","authors":"Louis D. Matzel","doi":"10.1016/j.intell.2024.101827","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101827","url":null,"abstract":"","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"104 ","pages":"Article 101827"},"PeriodicalIF":3.0,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140320770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-27DOI: 10.1016/j.intell.2024.101818
Jeffrey M. Cucina , Scott K. Burtnick , Maria E. De la Flor Musso , Philip T. Walmsley , Kimberly J. Wilson
A meta-analysis of the criterion-related validity of U.S. military enlistment cognitive ability tests was conducted using hands-on performance tests (HOPTs) as the criterion. In a HOPT, incumbents perform a representative sample of the tasks for a position and are evaluated by trained raters. We found operational validities in the .40s to .50s. Our meta-analytic database allowed us to investigate concerns regarding overcorrections (via use of multivariate corrections with credible applicant covariances) and provides a direct measure of job proficiency.
{"title":"Meta-analytic validity of cognitive ability for hands-on military job proficiency","authors":"Jeffrey M. Cucina , Scott K. Burtnick , Maria E. De la Flor Musso , Philip T. Walmsley , Kimberly J. Wilson","doi":"10.1016/j.intell.2024.101818","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101818","url":null,"abstract":"<div><p>A meta-analysis of the criterion-related validity of U.S. military enlistment cognitive ability tests was conducted using hands-on performance tests (HOPTs) as the criterion. In a HOPT, incumbents perform a representative sample of the tasks for a position and are evaluated by trained raters. We found operational validities in the .40s to .50s. Our meta-analytic database allowed us to investigate concerns regarding overcorrections (via use of multivariate corrections with credible applicant covariances) and provides a direct measure of job proficiency.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"104 ","pages":"Article 101818"},"PeriodicalIF":3.0,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140296398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-13DOI: 10.1016/j.intell.2024.101817
Dror Garbi , Nachshon Meiran
Working memory (WM) serves not just for remembering facts (“declarative WM”) but also for controlling action and thought (“procedural WM”, pWM) by holding and manipulating task rules and task control parameters such as goals. Yet, the structure of individual differences in pWM is underexplored. The present work compared between two highly similar (in the number of stimulus response rules, stimuli, responses, and scoring method) pWM challenges: Rule WM (rWM) - loading WM with novel arbitrary stimulus response rules, and Task switching between familiar rules. A series of confirmatory bi-factor models fitted to results from two separate highly variable samples (N = 544, 520) support the existence of a common (to Switching and rWM) ability as well as the distinction between rWM and Switching. Latent regression models in which correlated latent variables of Switching, Speed and rWM predicted Reasoning and Anti-saccade performance indicate a different pattern of variance sharing for switching and rWM: Specific rWM and the rWM-Speed variance overlap predicted Reasoning, whereas specific Switch did not. Switch was predictive of Anti-saccade and Reasoning only through its overlap with the rWM (for Reasoning) and with both Speed and rWM (for both outcomes). Together, these results support the conclusion that the ability to meet a switching challenge and the ability to meet a challenge of having many rules to remember (rWM) constitute partly separable sources of individual differences.
{"title":"The structure of individual differences in procedural working memory: Comparing task switching and stimulus response rule information load","authors":"Dror Garbi , Nachshon Meiran","doi":"10.1016/j.intell.2024.101817","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101817","url":null,"abstract":"<div><p>Working memory (WM) serves not just for remembering facts (“declarative WM”) but also for controlling action and thought (“procedural WM”, pWM) by holding and manipulating task rules and task control parameters such as goals. Yet, the structure of individual differences in pWM is underexplored. The present work compared between two highly similar (in the number of stimulus response rules, stimuli, responses, and scoring method) pWM challenges: Rule WM (rWM) - loading WM with novel arbitrary stimulus response rules, and Task switching between familiar rules. A series of confirmatory bi-factor models fitted to results from two separate highly variable samples (<em>N</em> = 544, 520) support the existence of a common (to Switching and rWM) ability as well as the distinction between rWM and Switching. Latent regression models in which correlated latent variables of Switching, Speed and rWM predicted Reasoning and Anti-saccade performance indicate a different pattern of variance sharing for switching and rWM: Specific rWM and the rWM-Speed variance overlap predicted Reasoning, whereas specific Switch did not. Switch was predictive of Anti-saccade and Reasoning only through its overlap with the rWM (for Reasoning) and with both Speed and rWM (for both outcomes). Together, these results support the conclusion that the ability to meet a switching challenge and the ability to meet a challenge of having many rules to remember (rWM) constitute partly separable sources of individual differences.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"104 ","pages":"Article 101817"},"PeriodicalIF":3.0,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140122563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-21DOI: 10.1016/j.intell.2024.101816
Moritz Breit, Vsevolod Scherrer, Franzis Preckel
Many intelligence tests measure multiple specific cognitive abilities. Practitioners use these specific ability scores, which encompass both specific ability and general intelligence variance, and the resulting intelligence profiles to make counseling and intervention decisions. In the present study, we investigated the temporal stability of eight specific abilities and their profiles over one school year, as well as their incremental validity in the prediction of school grades with German grade 7 to 9 students (N = 326 at T1; N = 311 at T2; N = 257 with IQ data at both times of measurement). The mean rank-order stability was 0.80 and ranged from 0.71 to 0.85. Intelligence profiles replicated significantly above chance levels (Mdnκ = 0.31). The incremental validity coefficients were mostly small, but the Reasoning score substantially contributed to the prediction of math grades (ΔR2 = 0.07–0.09), the Verbal Ability score to the prediction of German grades (ΔR2 = 0.05–0.09), and the Crystallized Intelligence score to the prediction of geography grades (ΔR2 = 0.03–0.08) beyond the general intelligence score. Our study of specific ability scores indicated moderate to high rank-order stability, fair to moderate profile stability, and substantial incremental validity for some specific ability scores.
{"title":"How useful are specific cognitive ability scores? An investigation of their stability and incremental validity beyond general intelligence","authors":"Moritz Breit, Vsevolod Scherrer, Franzis Preckel","doi":"10.1016/j.intell.2024.101816","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101816","url":null,"abstract":"<div><p>Many intelligence tests measure multiple specific cognitive abilities. Practitioners use these specific ability scores, which encompass both specific ability and general intelligence variance, and the resulting intelligence profiles to make counseling and intervention decisions. In the present study, we investigated the temporal stability of eight specific abilities and their profiles over one school year, as well as their incremental validity in the prediction of school grades with German grade 7 to 9 students (<em>N</em> = 326 at T1; <em>N</em> = 311 at T2; <em>N</em> = 257 with IQ data at both times of measurement). The mean rank-order stability was 0.80 and ranged from 0.71 to 0.85. Intelligence profiles replicated significantly above chance levels (<em>Mdn</em><sub><em>κ</em></sub> = 0.31). The incremental validity coefficients were mostly small, but the Reasoning score substantially contributed to the prediction of math grades (<em>ΔR</em><sup><em>2</em></sup> = 0.07–0.09), the Verbal Ability score to the prediction of German grades (<em>ΔR</em><sup><em>2</em></sup> = 0.05–0.09), and the Crystallized Intelligence score to the prediction of geography grades (<em>ΔR</em><sup><em>2</em></sup> = 0.03–0.08) beyond the general intelligence score. Our study of specific ability scores indicated moderate to high rank-order stability, fair to moderate profile stability, and substantial incremental validity for some specific ability scores.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"103 ","pages":"Article 101816"},"PeriodicalIF":3.0,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0160289624000102/pdfft?md5=656736e6fe2b4fd1c6f179e0ab473742&pid=1-s2.0-S0160289624000102-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139915362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-19DOI: 10.1016/j.intell.2024.101808
Gilles E. Gignac, Elizabeth M. Stevens
In a recent meta-analysis, financial literacy – understanding basic financial terms and concepts – was significantly correlated with general intelligence (r ≈ 0.62). However, this correlation may be underestimated, as few studies employed robust measures of both intelligence (more than one subtest) and financial literacy (>12 items). Additionally, cognitive reflection has not been investigated for its unique capacity at predicting financial literacy, an important consideration, as cognitive reflection has been suggested to be a measure of financial cognition. Beyond cognitive factors, non-cognitive predictors like need for cognition and attitude toward numbers (comfort with numerical concepts) may also influence financial literacy. In our study of 688 young adults (17–40 years), we administered four intelligence subtests (including a measure of cognitive reflection), a financial literacy test, and questionnaires assessing need for cognition and attitude toward numbers - the first to investigate all of these dimensions simultaneously. Results revealed a stronger latent correlation (0.76) between general intelligence and financial literacy than previously reported. Cognitive reflection was found to yield some incremental predictive variance in predicting financial literacy beyond general intelligence. Finally, attitude toward numbers and need for cognition both correlated positively with both general intelligence and financial literacy, however, only attitude toward numbers uniquely predicted financial literacy in a structural equation model. These findings suggest that financial literacy shares closer to 50–60% of its variance with general intelligence. They also highlight the potential value of fostering a positive numerical attitude alongside financial knowledge in educational interventions.
{"title":"Attitude toward numbers: A better predictor of financial literacy and intelligence than need for cognition","authors":"Gilles E. Gignac, Elizabeth M. Stevens","doi":"10.1016/j.intell.2024.101808","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101808","url":null,"abstract":"<div><p>In a recent meta-analysis, financial literacy – understanding basic financial terms and concepts – was significantly correlated with general intelligence (<em>r</em> ≈ 0.62). However, this correlation may be underestimated, as few studies employed robust measures of both intelligence (more than one subtest) and financial literacy (>12 items). Additionally, cognitive reflection has not been investigated for its unique capacity at predicting financial literacy, an important consideration, as cognitive reflection has been suggested to be a measure of financial cognition. Beyond cognitive factors, non-cognitive predictors like need for cognition and attitude toward numbers (comfort with numerical concepts) may also influence financial literacy. In our study of 688 young adults (17–40 years), we administered four intelligence subtests (including a measure of cognitive reflection), a financial literacy test, and questionnaires assessing need for cognition and attitude toward numbers - the first to investigate all of these dimensions simultaneously. Results revealed a stronger latent correlation (0.76) between general intelligence and financial literacy than previously reported. Cognitive reflection was found to yield some incremental predictive variance in predicting financial literacy beyond general intelligence. Finally, attitude toward numbers and need for cognition both correlated positively with both general intelligence and financial literacy, however, only attitude toward numbers uniquely predicted financial literacy in a structural equation model. These findings suggest that financial literacy shares closer to 50–60% of its variance with general intelligence. They also highlight the potential value of fostering a positive numerical attitude alongside financial knowledge in educational interventions.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"103 ","pages":"Article 101808"},"PeriodicalIF":3.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0160289624000023/pdfft?md5=5b1fe7e1aae827a7037f0efcbe14ed33&pid=1-s2.0-S0160289624000023-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139494202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-14DOI: 10.1016/j.intell.2024.101807
Riley Zurrin , Samantha Tze Sum Wong , Meighen M. Roes , Chantal M. Percival , Abhijit Chinchani , Leo Arreaza , Mavis Kusi , Ava Momeni , Maiya Rasheed , Zhaoyi Mo , Vina M. Goghari , Todd S. Woodward
A dimensionality reduction method was used to determine the task-timing-related functional brain networks underlying the Raven's Standard Progressive Matrices (RSPM), a non-verbal estimate of fluid intelligence (Gf). We identified five macro-scale task-based blood‑oxygen-level-dependent (BOLD)-signal brain networks and interpreted their network-level task-induced BOLD changes to provide functional interpretations separately for each network. This led to new observations about the brain networks underlying the RSPM: (1) the multiple demand network (MDN) for solution searching peaked early in the trial (∼9 s peak), followed by response (RESP) for response selection (∼12 s), and re-evaluation (RE-EV) for solution checking (∼18 s peak), (2) high activity in the MDN was correlated with high activity in the later-peaking RE-EV network, proposed to underpin cooperative solution searching (MDN) and checking (RE-EV) processes, and (3) high activity in the MDN in all conditions was associated with low accuracy in the hard RSPM condition, suggesting that those with lower performance on hard problems allocate more resources into solution-searching across all conditions. These findings corroborate the MDN's significance in Gf solution searching, and add the RE-EV network as playing an important checking role, providing overlap with the proposed abstraction/elaboration and hypothesis testing phases of the Parieto-Frontal Integration Theory (P-FIT). Therefore, this set of results not only supports past theoretical work on the brain networks underlying Gf and the RSPM task, but extends it by providing more complete anatomical, temporal, and functional information based on a set of brain task-based networks which replicate over many tasks.
{"title":"Functional brain networks involved in the Raven's standard progressive matrices task and their relation to theories of fluid intelligence","authors":"Riley Zurrin , Samantha Tze Sum Wong , Meighen M. Roes , Chantal M. Percival , Abhijit Chinchani , Leo Arreaza , Mavis Kusi , Ava Momeni , Maiya Rasheed , Zhaoyi Mo , Vina M. Goghari , Todd S. Woodward","doi":"10.1016/j.intell.2024.101807","DOIUrl":"https://doi.org/10.1016/j.intell.2024.101807","url":null,"abstract":"<div><p>A dimensionality reduction method was used to determine the task-timing-related functional brain networks underlying the Raven's Standard Progressive Matrices (RSPM), a non-verbal estimate of fluid intelligence (Gf). We identified five macro-scale task-based blood‑oxygen-level-dependent (BOLD)-signal brain networks and interpreted their network-level task-induced BOLD changes to provide functional interpretations separately for each network. This led to new observations about the brain networks underlying the RSPM: (1) the multiple demand network (MDN) for solution searching peaked early in the trial (∼9 s peak), followed by response (RESP) for response selection (∼12 s), and re-evaluation (RE-EV) for solution checking (∼18 s peak), (2) high activity in the MDN was correlated with high activity in the later-peaking RE-EV network, proposed to underpin cooperative solution searching (MDN) and checking (RE-EV) processes, and (3) high activity in the MDN in all conditions was associated with low accuracy in the hard RSPM condition, suggesting that those with lower performance on hard problems allocate more resources into solution-searching across all conditions. These findings corroborate the MDN's significance in Gf solution searching, and add the RE-EV network as playing an important checking role, providing overlap with the proposed abstraction/elaboration and hypothesis testing phases of the Parieto-Frontal Integration Theory (P-FIT). Therefore, this set of results not only supports past theoretical work on the brain networks underlying Gf and the RSPM task, but extends it by providing more complete anatomical, temporal, and functional information based on a set of brain task-based networks which replicate over many tasks.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"103 ","pages":"Article 101807"},"PeriodicalIF":3.0,"publicationDate":"2024-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0160289624000011/pdfft?md5=a8fbc296343facb0eebf1caee31dc972&pid=1-s2.0-S0160289624000011-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139436218","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-01DOI: 10.1016/j.intell.2023.101805
Ksenia Bartseva , Maxim Likhanov , Elina Tsigeman , Evgenia Alenina , Ivan Reznichenko , Elena Soldatova , Yulia Kovas
The study examines how intensive hockey training is linked with spatial ability and academic performance. Participants were hockey players from top junior teams (N = 225, mean age = 14.25, all boys) and their unselected peers (N = 278, mean age = 15.47, all boys). Compared to the unselected group, hockey players showed lower results in 10 small-scale spatial tests (Cohen's d ranging from 0.42 to 1.04), Raven's Progressive Matrices (d = 0.41), and 12 school subjects (d for the sum of grades = 1.17). The differences in spatial ability remained significant after controlling for Raven's (d varying from 0.26 to 1.03). The absence of spatial advantage in athletes suggests that effects of sports on cognition are complex: spatial ability facet-specific, sport-specific, professional and intensity level-specific. Moreover, these effects might be confounded by differences in academic engagement, investment of effort and psychological and physiological effects of intensive sports engagement.
{"title":"No spatial advantage in adolescent hockey players? Exploring measure specificity and masked effects","authors":"Ksenia Bartseva , Maxim Likhanov , Elina Tsigeman , Evgenia Alenina , Ivan Reznichenko , Elena Soldatova , Yulia Kovas","doi":"10.1016/j.intell.2023.101805","DOIUrl":"10.1016/j.intell.2023.101805","url":null,"abstract":"<div><p>The study examines how intensive hockey training is linked with spatial ability and academic performance. Participants were hockey players from top junior teams (<em>N</em> = 225, mean age = 14.25, all boys) and their unselected peers (<em>N</em> = 278, mean age = 15.47, all boys). Compared to the unselected group, hockey players showed lower results in 10 small-scale spatial tests (Cohen's d ranging from 0.42 to 1.04), Raven's Progressive Matrices (d = 0.41), and 12 school subjects (d for the sum of grades = 1.17). The differences in spatial ability remained significant after controlling for Raven's (d varying from 0.26 to 1.03). The absence of spatial advantage in athletes suggests that effects of sports on cognition are complex: spatial ability facet-specific, sport-specific, professional and intensity level-specific. Moreover, these effects might be confounded by differences in academic engagement, investment of effort and psychological and physiological effects of intensive sports engagement.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"102 ","pages":"Article 101805"},"PeriodicalIF":3.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0160289623000867/pdfft?md5=f09603cbe20f2ad4088d8ef7a46dc517&pid=1-s2.0-S0160289623000867-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139070868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-01DOI: 10.1016/j.intell.2023.101806
Noah Carl, Michael A. Woodley of Menie
Jackson Jr. and Winston (2021) claim there is no taboo against research on race and intelligence. We argue, to the contrary, that there is a taboo against such research. We begin by addressing Jackson Jr. and Winston's arguments concerning expert surveys, as well as their criticisms of our published database of controversies. We then provide additional evidence of the taboo, and explain why it would be expected given the features of academic social science in Western countries. We also point out that Jackson Jr. and Winston's paper exemplifies the very taboo they claim does not exist.
{"title":"The taboo remains: Responding to a critical commentary","authors":"Noah Carl, Michael A. Woodley of Menie","doi":"10.1016/j.intell.2023.101806","DOIUrl":"https://doi.org/10.1016/j.intell.2023.101806","url":null,"abstract":"<div><p>Jackson Jr. and Winston (2021) claim there is no taboo against research on race and intelligence. We argue, to the contrary, that there is a taboo against such research. We begin by addressing Jackson Jr. and Winston's arguments concerning expert surveys, as well as their criticisms of our published database of controversies. We then provide additional evidence of the taboo, and explain why it would be expected given the features of academic social science in Western countries. We also point out that Jackson Jr. and Winston's paper exemplifies the very taboo they claim does not exist.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"102 ","pages":"Article 101806"},"PeriodicalIF":3.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139099536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-05DOI: 10.1016/j.intell.2023.101804
Anna-Lena Schubert , Christoph Löffler , Clara Wiebel , Florian Kaulhausen , Tanja Gabriele Baudson
The rise of large-scale collaborative panel studies has generated a need for fast, reliable, and valid assessments of cognitive abilities. In these studies, a detailed characterization of participants' cognitive abilities is often unnecessary, leading to the selection of tests based on convenience, duration, and feasibility. This often results in the use of abbreviated measures or proxies, potentially compromising their reliability and validity. Here we evaluate the mini-q (Baudson & Preckel, 2016), a three-minute speeded reasoning test, as a brief assessment of general cognitive abilities. The mini-q exhibited excellent reliability (0.96–0.99) and a substantial correlation with general cognitive abilities measured with a comprehensive test battery (r = 0.57; age-corrected r = 0.50), supporting its potential as a brief screening of cognitive abilities. Working memory capacity accounted for the majority (54%) of the association between test performance and general cognitive abilities, whereas individual differences in processing speed did not contribute to this relationship. Our results support the notion that the mini-q can be used as a brief, reliable, and valid assessment of general cognitive abilities. We therefore developed a computer-based version, ensuring its adaptability for large-scale panel studies. The paper- and computer-based versions demonstrated scalar measurement invariance and can therefore be used interchangeably. We provide norm data for young (18 to 30 years) and middle-aged (31 to 60 years) adults and provide recommendations for incorporating the mini-q in panel studies. Additionally, we address potential challenges stemming from language diversity, wide age ranges, and online testing in such studies.
{"title":"Don't waste your time measuring intelligence: Further evidence for the validity of a three-minute speeded reasoning test","authors":"Anna-Lena Schubert , Christoph Löffler , Clara Wiebel , Florian Kaulhausen , Tanja Gabriele Baudson","doi":"10.1016/j.intell.2023.101804","DOIUrl":"https://doi.org/10.1016/j.intell.2023.101804","url":null,"abstract":"<div><p>The rise of large-scale collaborative panel studies has generated a need for fast, reliable, and valid assessments of cognitive abilities. In these studies, a detailed characterization of participants' cognitive abilities is often unnecessary, leading to the selection of tests based on convenience, duration, and feasibility. This often results in the use of abbreviated measures or proxies, potentially compromising their reliability and validity. Here we evaluate the mini-q (Baudson & Preckel, 2016), a three-minute speeded reasoning test, as a brief assessment of general cognitive abilities. The mini-q exhibited excellent reliability (0.96–0.99) and a substantial correlation with general cognitive abilities measured with a comprehensive test battery (<em>r</em> = 0.57; age-corrected <em>r</em> = 0.50), supporting its potential as a brief screening of cognitive abilities. Working memory capacity accounted for the majority (54%) of the association between test performance and general cognitive abilities, whereas individual differences in processing speed did not contribute to this relationship. Our results support the notion that the mini-q can be used as a brief, reliable, and valid assessment of general cognitive abilities. We therefore developed a computer-based version, ensuring its adaptability for large-scale panel studies. The paper- and computer-based versions demonstrated scalar measurement invariance and can therefore be used interchangeably. We provide norm data for young (18 to 30 years) and middle-aged (31 to 60 years) adults and provide recommendations for incorporating the mini-q in panel studies. Additionally, we address potential challenges stemming from language diversity, wide age ranges, and online testing in such studies.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"102 ","pages":"Article 101804"},"PeriodicalIF":3.0,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0160289623000855/pdfft?md5=bd0207bc1befe85ebaa4b91bf6f31d69&pid=1-s2.0-S0160289623000855-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138490454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-01DOI: 10.1016/j.intell.2023.101793
Björn Nicolay , Florian Krieger , Jörg-Tobias Kuhn , Arthur C. Graesser , Dirk Ifenthaler , Ryan Baker , Samuel Greiff
Complex problem solving (CPS) is a key competence in educational contexts with strong conceptual links to students' overall intelligence. However, the mechanisms underlying successful CPS are not fully understood. Therefore, this study investigated several factors presumed to be relevant to CPS success using log file data to code each individual student action during six CPS tasks with different characteristics (N = 1276). We coded individual strategy combinations per student for each item for different strategy combinations of vary-one-thing-at-a-time (VOTAT), hold-one-thing-at-a-time (HOTAT), vary-no-thing-at-a-time (NOTAT), and change-all (CA). Results from generalized linear mixed models showed that CPS success was likely to be achieved by using VOTAT. However, there was an increased chance of solving an item when additional strategies, such as NOTAT or NOTAT plus HOTAT were used. This result was moderated by the presence/absence of eigendynamics as an important determinant of item difficulty. Strategy combinations of VOTAT together with other strategies (all including NOTAT) showed higher chances of CPS success when eigendynamics were present. Additionally, higher chances of solving an item when using VOTAT with additional strategies was demonstrated for items without eigendynamics. Overall, our results suggest that flexibility in strategy application is the driving force for successful CPS performance. Implications are discussed in light of the presumed benefit of pedagogically relevant metacognitive skills, such as planning, monitoring and reflecting, for CPS success. Based on our findings, we provide specific recommendations for the development of computer-based learning simulations to train CPS and related competencies, ultimately enhancing students' skills in educational contexts.
{"title":"Unsuccessful and successful complex problem solvers – A log file analysis of complex problem solving strategies across multiple tasks","authors":"Björn Nicolay , Florian Krieger , Jörg-Tobias Kuhn , Arthur C. Graesser , Dirk Ifenthaler , Ryan Baker , Samuel Greiff","doi":"10.1016/j.intell.2023.101793","DOIUrl":"https://doi.org/10.1016/j.intell.2023.101793","url":null,"abstract":"<div><p>Complex problem solving (CPS) is a key competence in educational contexts with strong conceptual links to students' overall intelligence. However, the mechanisms underlying successful CPS are not fully understood. Therefore, this study investigated several factors presumed to be relevant to CPS success using log file data to code each individual student action during six CPS tasks with different characteristics (<em>N</em> = 1276). We coded individual strategy combinations per student for each item for different strategy combinations of vary-one-thing-at-a-time (VOTAT), hold-one-thing-at-a-time (HOTAT), vary-no-thing-at-a-time (NOTAT), and change-all (CA). Results from generalized linear mixed models showed that CPS success was likely to be achieved by using VOTAT. However, there was an increased chance of solving an item when additional strategies, such as NOTAT or NOTAT plus HOTAT were used. This result was moderated by the presence/absence of eigendynamics as an important determinant of item difficulty. Strategy combinations of VOTAT together with other strategies (all including NOTAT) showed higher chances of CPS success when eigendynamics were present. Additionally, higher chances of solving an item when using VOTAT with additional strategies was demonstrated for items without eigendynamics. Overall, our results suggest that flexibility in strategy application is the driving force for successful CPS performance. Implications are discussed in light of the presumed benefit of pedagogically relevant metacognitive skills, such as planning, monitoring and reflecting, for CPS success. Based on our findings, we provide specific recommendations for the development of computer-based learning simulations to train CPS and related competencies, ultimately enhancing students' skills in educational contexts.</p></div>","PeriodicalId":13862,"journal":{"name":"Intelligence","volume":"101 ","pages":"Article 101793"},"PeriodicalIF":3.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91992119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}