The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample.

IF 1.8 4区 心理学 Q3 CLINICAL NEUROLOGY Journal of clinical and experimental neuropsychology Pub Date : 2024-02-01 Epub Date: 2024-02-14 DOI:10.1080/13803395.2024.2314737
John H Denning, Michael David Horner
{"title":"The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample.","authors":"John H Denning, Michael David Horner","doi":"10.1080/13803395.2024.2314737","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>It is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples.</p><p><strong>Methods: </strong>Veterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (<i>n</i> = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated.</p><p><strong>Results: </strong>Failure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race.</p><p><strong>Conclusions: </strong>Individual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.</p>","PeriodicalId":15382,"journal":{"name":"Journal of clinical and experimental neuropsychology","volume":" ","pages":"25-35"},"PeriodicalIF":1.8000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of clinical and experimental neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/13803395.2024.2314737","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/2/14 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Introduction: It is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples.

Methods: Veterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (n = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated.

Results: Failure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race.

Conclusions: Individual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
在退伍军人样本中,种族和其他人口因素对五种嵌入式性能效度测试(PVT)假阳性率的影响。
介绍:在神经心理学评估过程中,为了保持认知测试结果解释的准确性,通常会根据种族进行常模调整。然而,嵌入式成绩效度测试(PVT)并不针对这些种族差异进行调整,因此可能会导致非裔美国人/黑人(AA)样本的假阳性率高于欧裔美国人/白人(EA)样本:没有重大神经认知障碍的退伍军人完成了门诊神经心理评估,并被认为表现有效(例如,通过了记忆错觉测试 1 (TOMM1) 和医学症状有效性测试 (MSVT),(n = 531,EA = 473,AA = 58)。对所有患者进行了五次嵌入式 PVT:WAIS-III/IV处理速度指数(PSI)、简明视觉空间记忆测验-修订版:辨别指数(BVMT-R)、TMT-A(秒)、加州言语学习测验-II(CVLT-II)强迫选择和 WAIS-III/IV 数字跨度评分。计算了单项 PVT 假阳性率以及两项或两项以上嵌入式 PVT 不及格率:结果:在 AA 样本中,两项嵌入式 PVT(PSI、TMT-A)的不及格率和不及格的 PVT 总数均较高。在考虑了年龄、教育程度、性别和是否患有轻度神经认知障碍后,PSI 和 TMT-A 仍然受到种族的显著影响。两组的 PVT 失败率均超过 10%(被视为假阳性)(AA:PSI、TMT-A 和 BVMT-R,12-24%;EA:BVMT-R,17%)。2 次或更多次 PVT 不及格(AA = 9%,EA = 4%)受教育程度和轻度神经认知障碍的影响,但不受种族的影响:即使考虑了人口统计学因素和轻度神经认知障碍诊断,AA 样本中单项(定时)PVT 的假阳性率仍较高。要求 2 次或 2 次以上嵌入式 PVT 不及格可将两个群体的假阳性率降低到可接受的水平(10% 或更低),并且不受种族的显著影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
3.20
自引率
4.50%
发文量
52
审稿时长
6-12 weeks
期刊介绍: Journal of Clinical and Experimental Neuropsychology ( JCEN) publishes research on the neuropsychological consequences of brain disease, disorders, and dysfunction, and aims to promote the integration of theories, methods, and research findings in clinical and experimental neuropsychology. The primary emphasis of JCEN is to publish original empirical research pertaining to brain-behavior relationships and neuropsychological manifestations of brain disease. Theoretical and methodological papers, critical reviews of content areas, and theoretically-relevant case studies are also welcome.
期刊最新文献
Usability of the Mayo Test Drive remote self-administered web-based cognitive screening battery in adults aged 35-100 with and without cognitive impairment. An embedded, event-based prospective memory task administered via telephone is associated with everyday functioning in healthy younger and older adults. Validity and reliability of the online useful field of view test among community-dwelling older adults. Challenges and opportunities for a new era of neuropsychology training: a trainee survey study. Trail making test - part B discontinuation is associated with worse performance across multiple cognitive domains, but not with psychological distress.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1