Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi
{"title":"将言语配对联想和视觉再现识别试验的分类准确性复制为嵌入式性能有效性测试。","authors":"Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi","doi":"10.1037/neu0000934","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.</p><p><strong>Method: </strong>Archival data were collected from a mixed clinical sample of 119 adults (<i>M</i><sub>Age</sub> = 42.5, <i>M</i><sub>Education</sub> = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.</p><p><strong>Results: </strong>Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.</p><p><strong>Conclusions: </strong>Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":19205,"journal":{"name":"Neuropsychology","volume":" ","pages":"281-292"},"PeriodicalIF":2.6000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.\",\"authors\":\"Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi\",\"doi\":\"10.1037/neu0000934\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.</p><p><strong>Method: </strong>Archival data were collected from a mixed clinical sample of 119 adults (<i>M</i><sub>Age</sub> = 42.5, <i>M</i><sub>Education</sub> = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.</p><p><strong>Results: </strong>Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.</p><p><strong>Conclusions: </strong>Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>\",\"PeriodicalId\":19205,\"journal\":{\"name\":\"Neuropsychology\",\"volume\":\" \",\"pages\":\"281-292\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neuropsychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/neu0000934\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/11/2 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/neu0000934","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/11/2 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.
Objective: This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.
Method: Archival data were collected from a mixed clinical sample of 119 adults (MAge = 42.5, MEducation = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.
Results: Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.
Conclusions: Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
期刊介绍:
Neuropsychology publishes original, empirical research; systematic reviews and meta-analyses; and theoretical articles on the relation between brain and human cognitive, emotional, and behavioral function.