Marc Yangüez, Benoit Bediou, Julien Chanal, Daphne Bavelier
{"title":"寻求更好的执行功能评估方法:方法问题和潜在解决方案。","authors":"Marc Yangüez, Benoit Bediou, Julien Chanal, Daphne Bavelier","doi":"10.1037/rev0000434","DOIUrl":null,"url":null,"abstract":"<p><p>The multicomponent nature of executive functions (EF) has long been recognized, pushing for a better understanding of both the commonalities and the diversity between EF components. Despite the advances made, the operationalization of performance in EF tasks remains rather heterogeneous, and the structure of EF as modeled by confirmatory factor analyses (CFA) is still a topic of debate (Karr et al., 2018). The present work demonstrates these two issues are related, showing how different operationalizations in task-based performance indicators impact the resulting models of EF structure with CFA. Using bootstrapped data from 294 children (8-12 years old) and nine EF tasks (tapping inhibition, working memory, and cognitive flexibility), we first show improved model convergence and acceptance when operationalizing EF through single tasks' scores (e.g., incongruent trials, Flanker task) relative to difference scores (e.g., incongruent minus congruent trials, Flanker task). Furthermore, we show that response times exhibit poor model convergence and acceptance compared not only to accuracy but also drift rate. The latter, a well-known indicator in drift-diffusion models, is found to present the best trade-off between convergence and acceptance to model EF with CFA. Finally, we examine how various operationalizations of performance in EF tasks impact CFA model comparison in the assessment of EF structure and discuss the theoretical foundations for these results. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":21016,"journal":{"name":"Psychological review","volume":" ","pages":"402-430"},"PeriodicalIF":5.1000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"In search of better practice in executive functions assessment: Methodological issues and potential solutions.\",\"authors\":\"Marc Yangüez, Benoit Bediou, Julien Chanal, Daphne Bavelier\",\"doi\":\"10.1037/rev0000434\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The multicomponent nature of executive functions (EF) has long been recognized, pushing for a better understanding of both the commonalities and the diversity between EF components. Despite the advances made, the operationalization of performance in EF tasks remains rather heterogeneous, and the structure of EF as modeled by confirmatory factor analyses (CFA) is still a topic of debate (Karr et al., 2018). The present work demonstrates these two issues are related, showing how different operationalizations in task-based performance indicators impact the resulting models of EF structure with CFA. Using bootstrapped data from 294 children (8-12 years old) and nine EF tasks (tapping inhibition, working memory, and cognitive flexibility), we first show improved model convergence and acceptance when operationalizing EF through single tasks' scores (e.g., incongruent trials, Flanker task) relative to difference scores (e.g., incongruent minus congruent trials, Flanker task). Furthermore, we show that response times exhibit poor model convergence and acceptance compared not only to accuracy but also drift rate. The latter, a well-known indicator in drift-diffusion models, is found to present the best trade-off between convergence and acceptance to model EF with CFA. Finally, we examine how various operationalizations of performance in EF tasks impact CFA model comparison in the assessment of EF structure and discuss the theoretical foundations for these results. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>\",\"PeriodicalId\":21016,\"journal\":{\"name\":\"Psychological review\",\"volume\":\" \",\"pages\":\"402-430\"},\"PeriodicalIF\":5.1000,\"publicationDate\":\"2024-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Psychological review\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/rev0000434\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/8/24 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological review","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/rev0000434","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/8/24 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
人们早已认识到执行功能(EF)的多成分性,这促使人们更好地理解EF成分之间的共性和多样性。尽管取得了进展,但EF任务中表现的操作化仍然相当不统一,而通过确证因子分析(CFA)建模的EF结构仍然是一个争论不休的话题(Karr等人,2018)。本研究证明了这两个问题之间的关联,展示了基于任务的绩效指标的不同操作方法如何影响CFA得出的EF结构模型。利用来自 294 名儿童(8-12 岁)的引导数据和九项 EF 任务(挖掘抑制、工作记忆和认知灵活性),我们首先展示了通过单一任务得分(如不一致试验、Flanker 任务)来操作 EF 时,相对于差异得分(如不一致试验减去一致试验、Flanker 任务),模型的收敛性和接受度有所提高。此外,我们还发现,与准确率和漂移率相比,反应时间表现出较低的模型收敛性和接受性。漂移率是漂移扩散模型中的一个著名指标,我们发现它在收敛性和接受性之间做出了最佳权衡,从而可以用 CFA 建立 EF 模型。最后,我们研究了在评估 EF 结构时,EF 任务中各种绩效操作对 CFA 模型比较的影响,并讨论了这些结果的理论基础。(PsycInfo Database Record (c) 2024 APA, 版权所有)。
In search of better practice in executive functions assessment: Methodological issues and potential solutions.
The multicomponent nature of executive functions (EF) has long been recognized, pushing for a better understanding of both the commonalities and the diversity between EF components. Despite the advances made, the operationalization of performance in EF tasks remains rather heterogeneous, and the structure of EF as modeled by confirmatory factor analyses (CFA) is still a topic of debate (Karr et al., 2018). The present work demonstrates these two issues are related, showing how different operationalizations in task-based performance indicators impact the resulting models of EF structure with CFA. Using bootstrapped data from 294 children (8-12 years old) and nine EF tasks (tapping inhibition, working memory, and cognitive flexibility), we first show improved model convergence and acceptance when operationalizing EF through single tasks' scores (e.g., incongruent trials, Flanker task) relative to difference scores (e.g., incongruent minus congruent trials, Flanker task). Furthermore, we show that response times exhibit poor model convergence and acceptance compared not only to accuracy but also drift rate. The latter, a well-known indicator in drift-diffusion models, is found to present the best trade-off between convergence and acceptance to model EF with CFA. Finally, we examine how various operationalizations of performance in EF tasks impact CFA model comparison in the assessment of EF structure and discuss the theoretical foundations for these results. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
期刊介绍:
Psychological Review publishes articles that make important theoretical contributions to any area of scientific psychology, including systematic evaluation of alternative theories.