Pub Date : 2024-08-01Epub Date: 2024-07-01DOI: 10.1080/13854046.2024.2371007
Amy J Jak, Victoria C Merritt, Michael L Thomas, Cody Witten, Leah Talbert, Amma Agyemang, Mary Jo Pugh
Objective: This study investigated influence of biological sex on postconcussive symptoms (PCS) following concussion using the Federal Interagency Traumatic Brain Injury Research (FITBIR) database. Method: All studies with publicly released data as of 4/7/21 that included both males and females, enough information to determine severity of injury consistent with concussion, a measure of PCS, and objective measures of neurocognitive functioning were used. This resulted in 6 studies with a total of 9890 participants (3206 females, 6684 males); 815 participants completed the Neurobehavioral Symptom Inventory (NSI), 471 completed the Rivermead Post-Concussion Symptoms Questionnaire (RPSQ), and 8604 completed the Sport Concussion Assessment Tool-3rd Edition (SCAT 3). Questionnaires were harmonized and the following symptom composite scores were computed: total score, somatic, cognitive, and affective. Data were analyzed using linear mixed-effects models. Results: Females endorsed higher total symptoms relative to males and that military personnel endorsed higher symptoms relative to civilians. Additionally, there was a small but significant interaction effect, such that female military personnel endorsed even higher symptoms than would be predicted by the main effects. Similar patterns were observed for somatic, cognitive, and affective symptom domains. Conclusions: Further understanding sex differences in PCS reporting is key to informing the most appropriate treatment options. Future work will need to examine whether sex differences in symptom reporting is due to sex differences in endorsement styles or genuine differences in symptom presentation, as well as the relationship between study population (e.g., military, civilian, sport) and sex on objective cognitive functioning and other functional outcomes.
{"title":"Sex differences in postconcussive symptom reporting in those with history of concussion: Findings from the federal interagency traumatic brain injury research (FITBIR) database.","authors":"Amy J Jak, Victoria C Merritt, Michael L Thomas, Cody Witten, Leah Talbert, Amma Agyemang, Mary Jo Pugh","doi":"10.1080/13854046.2024.2371007","DOIUrl":"10.1080/13854046.2024.2371007","url":null,"abstract":"<p><p><b>Objective:</b> This study investigated influence of biological sex on postconcussive symptoms (PCS) following concussion using the Federal Interagency Traumatic Brain Injury Research (FITBIR) database. <b>Method:</b> All studies with publicly released data as of 4/7/21 that included both males and females, enough information to determine severity of injury consistent with concussion, a measure of PCS, and objective measures of neurocognitive functioning were used. This resulted in 6 studies with a total of 9890 participants (3206 females, 6684 males); 815 participants completed the Neurobehavioral Symptom Inventory (NSI), 471 completed the Rivermead Post-Concussion Symptoms Questionnaire (RPSQ), and 8604 completed the Sport Concussion Assessment Tool-3rd Edition (SCAT 3). Questionnaires were harmonized and the following symptom composite scores were computed: total score, somatic, cognitive, and affective. Data were analyzed using linear mixed-effects models. <b>Results:</b> Females endorsed higher total symptoms relative to males and that military personnel endorsed higher symptoms relative to civilians. Additionally, there was a small but significant interaction effect, such that female military personnel endorsed even higher symptoms than would be predicted by the main effects. Similar patterns were observed for somatic, cognitive, and affective symptom domains. <b>Conclusions:</b> Further understanding sex differences in PCS reporting is key to informing the most appropriate treatment options. Future work will need to examine whether sex differences in symptom reporting is due to sex differences in endorsement styles or genuine differences in symptom presentation, as well as the relationship between study population (e.g., military, civilian, sport) and sex on objective cognitive functioning and other functional outcomes.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1468-1480"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141478021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-31DOI: 10.1080/13854046.2024.2378521
Daniel Pankowski, Kinga Wytrychiewicz-Pankowska, Ewa Pisula, Andrzej M Fal
ObjectiveThis study aimed to evaluate prevalence rates (PRs) of neurocognitive impairment and its potential moderators among patients with rheumatoid arthritis (RA). MethodA systematic review of the available literature and data extraction was undertaken on 6 August 2021, with the update by 14 September 2023, by two reviewers independently. Literature was screened for reported rates of prevalence of neurocognitive impairment in RA patients. The meta-analysis was performed using RStudio with the "meta" library. ResultsTwenty-two studies that fulfilled all selection criteria were carefully analyzed. The PR of neurocognitive impairment was 0.49 [0.38-0.61] across all studies included in the review; 0.75 [0.54-0.88] for the MoCA; 0.56 [0.40-0.72] for the MMSE; and 0.26 [0.16-0.38] for comprehensive batteries. The meta-regression results indicated that, depending on the measurement method, the percentage of subjects with positive rheumatoid factor, women ratio, mean age of participants, mean duration of RA, and percentage of domains that had to be impaired to diagnose neurocognitive impairment turned out to be statistically significant moderators. ConclusionsNeurocognitive impairment is a clinically relevant condition in many RA patients, and its prevalence is alarming high.
{"title":"Prevalence of neurocognitive impairment in patients with rheumatoid arthritis - a systematic review and meta-analysis.","authors":"Daniel Pankowski, Kinga Wytrychiewicz-Pankowska, Ewa Pisula, Andrzej M Fal","doi":"10.1080/13854046.2024.2378521","DOIUrl":"https://doi.org/10.1080/13854046.2024.2378521","url":null,"abstract":"<p><p><b>Objective</b>This study aimed to evaluate prevalence rates (PRs) of neurocognitive impairment and its potential moderators among patients with rheumatoid arthritis (RA). <b>Method</b>A systematic review of the available literature and data extraction was undertaken on 6 August 2021, with the update by 14 September 2023, by two reviewers independently. Literature was screened for reported rates of prevalence of neurocognitive impairment in RA patients. The meta-analysis was performed using RStudio with the \"meta\" library. <b>Results</b>Twenty-two studies that fulfilled all selection criteria were carefully analyzed. The PR of neurocognitive impairment was 0.49 [0.38-0.61] across all studies included in the review; 0.75 [0.54-0.88] for the MoCA; 0.56 [0.40-0.72] for the MMSE; and 0.26 [0.16-0.38] for comprehensive batteries. The meta-regression results indicated that, depending on the measurement method, the percentage of subjects with positive rheumatoid factor, women ratio, mean age of participants, mean duration of RA, and percentage of domains that had to be impaired to diagnose neurocognitive impairment turned out to be statistically significant moderators. <b>Conclusions</b>Neurocognitive impairment is a clinically relevant condition in many RA patients, and its prevalence is alarming high.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-21"},"PeriodicalIF":3.0,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141861738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-26DOI: 10.1080/13854046.2024.2382340
Jeroen J Roor, Brechje Dandachi-FitzGerald, Maarten J V Peters, Rudolf W H M Ponds
Objective: Performance below the actual abilities of the examinee can be measured using performance validity tests (PVTs). PVT failure negatively impacts the quality of the neuropsychological assessment. In our study, we addressed this issue by providing a brief corrective statement regarding invalidity to improve test-taking behavior. Methods: This study is a multisite single-blind randomized controlled trial in a consecutive sample of clinically referred adult patients (N = 196) in a general hospital setting. Patients who failed a PVT (n = 71) were randomly allocated to a corrective statement approach (CS; n = 39), in which a brief verbal corrective statement was given by the technician, or received no corrective statement upon indications of invalid performance (NO-CS; n = 32). Both groups (CS and NO-CS) were provided with the same subsequently repeated and newly administered tests. Results: There were no group (CS vs. NO-CS) differences on both the repeated and single-administered PVTs and standard cognitive tests. Furthermore, invalid performing participants benefited significantly less from the repeated test administration compared to the valid performing group. Conclusions: Our study found that a brief corrective within-session statement, to address PVT failure and improve test-taking behavior, did not improve consequent test performance. These results suggest limited value of a brief verbal corrective statement to influence performance below best of capabilities. It highlights the need for more research to identify more effective approaches that can enhance patients test-taking behavior. Ultimately, such efforts are critical in ensuring accurate diagnosis and effective treatment recommendations for patients.
{"title":"Providing a brief corrective statement does not improve test performance in patients invalidating testing: A multisite, single-blind randomized controlled trial.","authors":"Jeroen J Roor, Brechje Dandachi-FitzGerald, Maarten J V Peters, Rudolf W H M Ponds","doi":"10.1080/13854046.2024.2382340","DOIUrl":"https://doi.org/10.1080/13854046.2024.2382340","url":null,"abstract":"<p><p><b>Objective:</b> Performance below the actual abilities of the examinee can be measured using performance validity tests (PVTs). PVT failure negatively impacts the quality of the neuropsychological assessment. In our study, we addressed this issue by providing a brief corrective statement regarding invalidity to improve test-taking behavior. <b>Methods:</b> This study is a multisite single-blind randomized controlled trial in a consecutive sample of clinically referred adult patients (<i>N</i> = 196) in a general hospital setting. Patients who failed a PVT (<i>n</i> = 71) were randomly allocated to a corrective statement approach (CS; <i>n</i> = 39), in which a brief verbal corrective statement was given by the technician, or received no corrective statement upon indications of invalid performance (NO-CS; <i>n</i> = 32). Both groups (CS and NO-CS) were provided with the same subsequently repeated and newly administered tests. <b>Results:</b> There were no group (CS vs. NO-CS) differences on both the repeated and single-administered PVTs and standard cognitive tests. Furthermore, invalid performing participants benefited significantly less from the repeated test administration compared to the valid performing group. <b>Conclusions:</b> Our study found that a brief corrective within-session statement, to address PVT failure and improve test-taking behavior, did not improve consequent test performance. These results suggest limited value of a brief verbal corrective statement to influence performance below best of capabilities. It highlights the need for more research to identify more effective approaches that can enhance patients test-taking behavior. Ultimately, such efforts are critical in ensuring accurate diagnosis and effective treatment recommendations for patients.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-23"},"PeriodicalIF":3.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141762782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-26DOI: 10.1080/13854046.2024.2378526
Aaron C Lim, Gali H Weissberger, Jenna Axelrod, Laura Mosqueda, Annie L Nguyen, Laura Fenton, Daisy Noriega, Camille E Erdman, S Duke Han
Objective: Reports of financial exploitation have steadily increased among older adults. Few studies have examined neuropsychological profiles for individuals vulnerable to financial exploitation, and existing studies have focused on susceptibility to scams, one specific type of financial exploitation. The current study therefore examines whether a general measure of financial exploitation vulnerability is associated with neuropsychological performance in a community sample. Methods: A sample (n = 116) of adults aged 50 or older without dementia completed a laboratory visit that measures physical and psychological functioning and a neuropsychological assessment, the Uniform Data Set-3 (UDS-3) and California Verbal Learning Test-II. Results: After covarying for demographics, current medical problems, financial literacy, and a global cognition screen, financial exploitation vulnerability was negatively associated with scores on the Multilingual Naming Test, Craft Story Recall and Delayed Recall, California Verbal Learning Test-II Delayed Recall and Recognition Discriminability, Phonemic Fluency, and Trails B. Financial exploitation vulnerability was not associated with performance on Digit Span, Semantic Fluency, Benson Complex Figure Recall, or Trails A. Conclusions: Among older adults without dementia, individuals at higher risk for financial exploitation demonstrated worse verbal memory, confrontation naming, phonemic fluency, and set-shifting. These tests are generally sensitive to Default Mode Network functioning and Alzheimer's Disease neuropathology. Longitudinal studies in more impaired samples are warranted to further corroborate and elucidate these relationships.
{"title":"Neuropsychological profile associated with financial exploitation vulnerability in older adults without dementia.","authors":"Aaron C Lim, Gali H Weissberger, Jenna Axelrod, Laura Mosqueda, Annie L Nguyen, Laura Fenton, Daisy Noriega, Camille E Erdman, S Duke Han","doi":"10.1080/13854046.2024.2378526","DOIUrl":"10.1080/13854046.2024.2378526","url":null,"abstract":"<p><p><b>Objective:</b> Reports of financial exploitation have steadily increased among older adults. Few studies have examined neuropsychological profiles for individuals vulnerable to financial exploitation, and existing studies have focused on susceptibility to scams, one specific type of financial exploitation. The current study therefore examines whether a general measure of financial exploitation vulnerability is associated with neuropsychological performance in a community sample. <b>Methods</b>: A sample (<i>n</i> = 116) of adults aged 50 or older without dementia completed a laboratory visit that measures physical and psychological functioning and a neuropsychological assessment, the Uniform Data Set-3 (UDS-3) and California Verbal Learning Test-II. <b>Results:</b> After covarying for demographics, current medical problems, financial literacy, and a global cognition screen, financial exploitation vulnerability was negatively associated with scores on the Multilingual Naming Test, Craft Story Recall and Delayed Recall, California Verbal Learning Test-II Delayed Recall and Recognition Discriminability, Phonemic Fluency, and Trails B. Financial exploitation vulnerability was not associated with performance on Digit Span, Semantic Fluency, Benson Complex Figure Recall, or Trails A. <b>Conclusions:</b> Among older adults without dementia, individuals at higher risk for financial exploitation demonstrated worse verbal memory, confrontation naming, phonemic fluency, and set-shifting. These tests are generally sensitive to Default Mode Network functioning and Alzheimer's Disease neuropathology. Longitudinal studies in more impaired samples are warranted to further corroborate and elucidate these relationships.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-17"},"PeriodicalIF":3.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141768113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-26DOI: 10.1080/13854046.2024.2383333
Sawyer Harmon, Courtney G Kocum, Rylea M Ranum, Greta Hermann, Sarah Tomaszewski Farias, Andrew M Kiselica
Objective: Subjective cognitive decline (SCD) is an important part of the aging process and may be a sign of neurodegenerative disease. Current measures of SCD are subject to the limits of retrospective recall of symptoms over a long span of time, which might be addressed by using ecological momentary assessment (EMA) methods. However, there are no currently available measures of SCD validated for use in EMA. Thus, our goal was to develop and pilot test the mobile Everyday Cognition Scale (mECog). Method: 31 community-dwelling older adults completed in lab measures of cognition and mental health symptoms, followed by daily mECog ratings on a smart phone for 28 days. Results: Most participants completed at least 75% of mECog assessments (n = 27, 87%), and the average number of assessments completed was 22. Further, respondents rated the mobile assessment platform and measures as easy to use and non-interfering with daily life. Test-retest reliability of mECog scores was very strong (RKRN = .99), and within-person reliability was moderate (RCN = .41). mECog scores demonstrated strong positive associations with scores from the original ECog (ρ = .62-69, p < .001) and short form ECog (ρ = .63-.69, p < .001) and non-significant associations with demographics (ρ = -0.25-.04, p = .21-.94) and mental health symptoms (ρ = -0.06-.34, p = .08-.99). mECog scores also exhibited small-to-moderate negative correlations with objective cognitive test scores, though these relationships did not reach statistical significance (ρ = -0.32 to -0.22, p = .10-.27). Conclusions: Results suggest that mobile assessment of SCD via the mECog is feasible and acceptable. Further, mECog scores demonstrated good psychometric properties, including evidence of strong reliability, convergent validity, and divergent validity.
{"title":"The mobile everyday cognition scale (mECog): development and pilot testing.","authors":"Sawyer Harmon, Courtney G Kocum, Rylea M Ranum, Greta Hermann, Sarah Tomaszewski Farias, Andrew M Kiselica","doi":"10.1080/13854046.2024.2383333","DOIUrl":"10.1080/13854046.2024.2383333","url":null,"abstract":"<p><p><b>Objective:</b> Subjective cognitive decline (SCD) is an important part of the aging process and may be a sign of neurodegenerative disease. Current measures of SCD are subject to the limits of retrospective recall of symptoms over a long span of time, which might be addressed by using ecological momentary assessment (EMA) methods. However, there are no currently available measures of SCD validated for use in EMA. Thus, our goal was to develop and pilot test the mobile Everyday Cognition Scale (mECog). <b>Method:</b> 31 community-dwelling older adults completed in lab measures of cognition and mental health symptoms, followed by daily mECog ratings on a smart phone for 28 days. <b>Results:</b> Most participants completed at least 75% of mECog assessments (<i>n</i> = 27, 87%), and the average number of assessments completed was 22. Further, respondents rated the mobile assessment platform and measures as easy to use and non-interfering with daily life. Test-retest reliability of mECog scores was very strong (<i>R<sub>KRN</sub></i> = .99), and within-person reliability was moderate (<i>R<sub>CN</sub></i> = .41). mECog scores demonstrated strong positive associations with scores from the original ECog (<i>ρ</i> = .62-69, <i>p</i> < .001) and short form ECog (<i>ρ</i> = .63-.69, <i>p</i> < .001) and non-significant associations with demographics (<i>ρ</i> = -0.25-.04, <i>p</i> = .21-.94) and mental health symptoms (<i>ρ</i> = -0.06-.34, <i>p</i> = .08-.99). mECog scores also exhibited small-to-moderate negative correlations with objective cognitive test scores, though these relationships did not reach statistical significance (<i>ρ</i> = -0.32 to -0.22, <i>p</i> = .10-.27). <b>Conclusions:</b> Results suggest that mobile assessment of SCD <i>via</i> the mECog is feasible and acceptable. Further, mECog scores demonstrated good psychometric properties, including evidence of strong reliability, convergent validity, and divergent validity.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-20"},"PeriodicalIF":3.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141768025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-23DOI: 10.1080/13854046.2024.2372877
Rosalia Costello, Beatriz MacDonald, Jaclyn L Papadakis, Lizabeth L Jordan
Objective: The pediatric patient populations in the United States are becoming increasingly diverse in culture. In addition to medical factors, a variety of sociocultural factors (including educational systems, language, immigration status, etc.) can impact a child's cognitive development, performance on traditional neuropsychological measures, provider interactions, differential diagnosis, and recommendations. A culturally-informed neuropsychological evaluation aims to understand the impact of sociocultural factors and integrate them into the assessment approach. Fujii's ECLECTIC framework (acronym for Education & Literacy, Culture/Acculturation, Language, Economic Issues, Communication Style, Testing Situation, Intelligence Conceptualization, and Context of Immigration) can be used to guide culturally-informed neuropsychological evaluations of children with complex medical conditions. Method: Using the ECLECTIC framework, this paper describes clinical considerations and offers practical solutions for providing culturally-informed pediatric neuropsychology evaluations. Four diverse patients with spina bifida are reviewed. Results: The case presentations highlight the application of the ECLECTIC framework within a medically complex pediatric patient population. Conclusions: Spina bifida is one example of a pediatric medical population in which both medical and sociocultural factors can impact cognitive development and the evaluation process. The ECLECTIC framework defines a variety of sociocultural factors that can influence cognitive development and multiple aspects of a pediatric neuropsychological evaluation. Pediatric neuropsychologists should use the ECLECTIC framework to provide culturally-informed evaluations for our increasingly diverse patient populations.
{"title":"Culturally-informed neuropsychological evaluations of patients with spina bifida: Application of the ECLECTIC framework to a complex pediatric medical condition.","authors":"Rosalia Costello, Beatriz MacDonald, Jaclyn L Papadakis, Lizabeth L Jordan","doi":"10.1080/13854046.2024.2372877","DOIUrl":"https://doi.org/10.1080/13854046.2024.2372877","url":null,"abstract":"<p><p><b>Objective:</b> The pediatric patient populations in the United States are becoming increasingly diverse in culture. In addition to medical factors, a variety of sociocultural factors (including educational systems, language, immigration status, etc.) can impact a child's cognitive development, performance on traditional neuropsychological measures, provider interactions, differential diagnosis, and recommendations. A culturally-informed neuropsychological evaluation aims to understand the impact of sociocultural factors and integrate them into the assessment approach. Fujii's ECLECTIC framework (acronym for Education & Literacy, Culture/Acculturation, Language, Economic Issues, Communication Style, Testing Situation, Intelligence Conceptualization, and Context of Immigration) can be used to guide culturally-informed neuropsychological evaluations of children with complex medical conditions. <b>Method:</b> Using the ECLECTIC framework, this paper describes clinical considerations and offers practical solutions for providing culturally-informed pediatric neuropsychology evaluations. Four diverse patients with spina bifida are reviewed. <b>Results:</b> The case presentations highlight the application of the ECLECTIC framework within a medically complex pediatric patient population. <b>Conclusions:</b> Spina bifida is one example of a pediatric medical population in which both medical and sociocultural factors can impact cognitive development and the evaluation process. The ECLECTIC framework defines a variety of sociocultural factors that can influence cognitive development and multiple aspects of a pediatric neuropsychological evaluation. Pediatric neuropsychologists should use the ECLECTIC framework to provide culturally-informed evaluations for our increasingly diverse patient populations.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-27"},"PeriodicalIF":3.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-21DOI: 10.1080/13854046.2024.2379023
Shannon Lavigne, Anthony Rios, Jeremy J Davis
Objective: We examined the performance validity test (PVT) security risk presented by artificial intelligence (AI) chatbots asking questions about neuropsychological evaluation and PVTs on two popular generative AI sites.
Method: In 2023 and 2024, multiple questions were posed to ChatGPT-3 and Bard (now Gemini). One set started generally and refined follow-up questions based on AI responses. A second set asked how to feign, fake, or cheat. Responses were aggregated and independently rated for inaccuracy and threat. Responses not identified as inaccurate were assigned a four-level threat rating (no, mild, moderate, or high threat). Combined inaccuracy and threat ratings were examined cross-sectionally and longitudinally.
Results: Combined inaccuracy rating percentages were 35 to 42% in 2023 and 16 to 28% in 2024. Combined moderate/high threat ratings were observed in 24 to 41% of responses in 2023 and in 17 to 31% of responses in 2024. More ChatGPT-3 responses were rated moderate or high threat compared to Bard/Gemini responses. Over time, ChatGPT-3 responses became more accurate with a similar threat level, but Bard/Gemini responses did not change in accuracy or threat. Responses to how to feign queries demonstrated ethical opposition to feigning. Responses to similar queries in 2024 showed even stronger ethical opposition.
Conclusions: AI chatbots are a threat to PVT test security. A proportion of responses were rated as moderate or high threat. Although ethical opposition to feigning guidance increased over time, the natural language interface and the volume of AI chatbot responses represent a potentially greater threat than traditional search engines.
{"title":"Does generative artificial intelligence pose a risk to performance validity test security?","authors":"Shannon Lavigne, Anthony Rios, Jeremy J Davis","doi":"10.1080/13854046.2024.2379023","DOIUrl":"10.1080/13854046.2024.2379023","url":null,"abstract":"<p><strong>Objective: </strong>We examined the performance validity test (PVT) security risk presented by artificial intelligence (AI) chatbots asking questions about neuropsychological evaluation and PVTs on two popular generative AI sites.</p><p><strong>Method: </strong>In 2023 and 2024, multiple questions were posed to ChatGPT-3 and Bard (now Gemini). One set started generally and refined follow-up questions based on AI responses. A second set asked how to feign, fake, or cheat. Responses were aggregated and independently rated for inaccuracy and threat. Responses not identified as inaccurate were assigned a four-level threat rating (no, mild, moderate, or high threat). Combined inaccuracy and threat ratings were examined cross-sectionally and longitudinally.</p><p><strong>Results: </strong>Combined inaccuracy rating percentages were 35 to 42% in 2023 and 16 to 28% in 2024. Combined moderate/high threat ratings were observed in 24 to 41% of responses in 2023 and in 17 to 31% of responses in 2024. More ChatGPT-3 responses were rated moderate or high threat compared to Bard/Gemini responses. Over time, ChatGPT-3 responses became more accurate with a similar threat level, but Bard/Gemini responses did not change in accuracy or threat. Responses to how to feign queries demonstrated ethical opposition to feigning. Responses to similar queries in 2024 showed even stronger ethical opposition.</p><p><strong>Conclusions: </strong>AI chatbots are a threat to PVT test security. A proportion of responses were rated as moderate or high threat. Although ethical opposition to feigning guidance increased over time, the natural language interface and the volume of AI chatbot responses represent a potentially greater threat than traditional search engines.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-14"},"PeriodicalIF":3.0,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141735742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-17DOI: 10.1080/13854046.2024.2379508
Anouk Verveen, Sander C J Verfaillie, Denise Visser, Dook W Koch, Esmée Verwijk, Gert J Geurtsen, Jeroen Roor, Brent Appelman, Ronald Boellaard, Caroline M van Heugten, Janneke Horn, Hanneke E Hulst, Menno D de Jong, Tanja A Kuut, Tessa van der Maaden, Yvonne M G van Os, Maria Prins, Johanna M A Visser-Meily, Michele van Vugt, Cees C van den Wijngaard, Pythia T Nieuwkerk, Bart van Berckel, Nelleke Tolboom, Hans Knoop
Objective: It is unclear how self-reported severe fatigue and difficulty concentrating after SARS-CoV-2 infection relate to objective neuropsychological functioning. The study aimed to compare neuropsychological functioning between individuals with and without these persistent subjective complaints. Method: Individuals with and without persistent severe fatigue (Checklist Individual Strength (CIS) fatigue ≥ 35) and difficulty concentrating (CIS concentration ≥ 18) at least 3 months after SARS-CoV-2 infection were included. Neuropsychological assessment was performed on overall cognitive functioning, attention, processing speed, executive functioning, memory, visuo-construction, and language (18 tests). T-scores -1.5 SD below population normative data (T ≤ 35) were classified as "impaired". Results: 230 participants were included in the study, of whom 22 were excluded from the analysis due to invalid performance. Of the participants included in the analysis, 111 reported persistent complaints of severe fatigue and difficulty concentrating and 97 did not. Median age was 54 years, 59% (n = 126) were female, and participants were assessed a median of 23 months after first infection (IQR: 16-28). With bivariate logistic regression, individuals with persistent complaints had an increased likelihood of slower information processing speed performance on the Stroop word reading (OR = 2.45, 95%CI = 1.02-5.84) compared to those without persistent complaints. Demographic or clinical covariates (e.g. hospitalization) did not influence this association. With linear regression techniques, persistent complaints were associated with lower t-scores on the D2 CP, TMT B, and TMT B|A. There were no differences in performance on the other neuropsychological tests. Conclusions: Individuals with subjective severe fatigue and difficulty concentrating after COVID-19 do not typically demonstrate cognitive impairment on extensive neuropsychological testing.
{"title":"Neuropsychological functioning after COVID-19: minor differences between individuals with and without persistent complaints after SARS-CoV-2 infection.","authors":"Anouk Verveen, Sander C J Verfaillie, Denise Visser, Dook W Koch, Esmée Verwijk, Gert J Geurtsen, Jeroen Roor, Brent Appelman, Ronald Boellaard, Caroline M van Heugten, Janneke Horn, Hanneke E Hulst, Menno D de Jong, Tanja A Kuut, Tessa van der Maaden, Yvonne M G van Os, Maria Prins, Johanna M A Visser-Meily, Michele van Vugt, Cees C van den Wijngaard, Pythia T Nieuwkerk, Bart van Berckel, Nelleke Tolboom, Hans Knoop","doi":"10.1080/13854046.2024.2379508","DOIUrl":"10.1080/13854046.2024.2379508","url":null,"abstract":"<p><p><b>Objective:</b> It is unclear how self-reported severe fatigue and difficulty concentrating after SARS-CoV-2 infection relate to objective neuropsychological functioning. The study aimed to compare neuropsychological functioning between individuals with and without these persistent subjective complaints. <b>Method</b>: Individuals with and without persistent severe fatigue (Checklist Individual Strength (CIS) fatigue ≥ 35) and difficulty concentrating (CIS concentration ≥ 18) at least 3 months after SARS-CoV-2 infection were included. Neuropsychological assessment was performed on overall cognitive functioning, attention, processing speed, executive functioning, memory, visuo-construction, and language (18 tests). T-scores -1.5 SD below population normative data (<i>T</i> ≤ 35) were classified as \"impaired\". <b>Results:</b> 230 participants were included in the study, of whom 22 were excluded from the analysis due to invalid performance. Of the participants included in the analysis, 111 reported persistent complaints of severe fatigue and difficulty concentrating and 97 did not. Median age was 54 years, 59% (<i>n</i> = 126) were female, and participants were assessed a median of 23 months after first infection (IQR: 16-28). With bivariate logistic regression, individuals with persistent complaints had an increased likelihood of slower information processing speed performance on the Stroop word reading (OR = 2.45, 95%CI = 1.02-5.84) compared to those without persistent complaints. Demographic or clinical covariates (e.g. hospitalization) did not influence this association. With linear regression techniques, persistent complaints were associated with lower t-scores on the D2 CP, TMT B, and TMT B|A. There were no differences in performance on the other neuropsychological tests. <b>Conclusions:</b> Individuals with subjective severe fatigue and difficulty concentrating after COVID-19 do not typically demonstrate cognitive impairment on extensive neuropsychological testing.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-16"},"PeriodicalIF":3.0,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141629329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-12DOI: 10.1080/13854046.2024.2375801
Jillian Lemke, Alena Sorensen D'Alessio, Farren B S Briggs, Christopher Bailey
Introduction: Social determinants of health and adversity, including poverty, maltreatment, and neighborhood deprivation, are individual-level factors that may significantly affect baseline neurocognitive testing and management that have yet to be thoroughly explored within the computerized neurocognitive assessment.Objectives: Examine individual-level experiences of poverty, abuse, neighborhood deprivation, and social mobility on computerized cognitive testing.Methods: The sample included 3,845 student-athletes who completed a baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) and were enrolled in the Child-Household Integrated Longitudinal Data database. Multivariable linear regressions were used to assess independent variables of Supplemental Nutrition Assistance Program enrollment, abuse or neglect cases, Area Deprivation Index scores, and other demographic factors on four baseline ImPACT composite scores: verbal and visual memory, visuomotor, and reaction time.Results: Individual-level factors of persistent poverty and neighborhood deprivation were associated with lower composite scores; however, upward social mobility was not significantly associated with cognitive performance. The effects of mother's race on computerized cognitive testing performance were attenuated when accounting for measures of adversity.Conclusion: Findings highlight the importance of social determinants of health in computerized neurocognitive testing to ensure more culturally sensitive and precise understanding of athletic baselines.
{"title":"Influence of social determinants of health and adversity on computerized neurocognitive assessment.","authors":"Jillian Lemke, Alena Sorensen D'Alessio, Farren B S Briggs, Christopher Bailey","doi":"10.1080/13854046.2024.2375801","DOIUrl":"https://doi.org/10.1080/13854046.2024.2375801","url":null,"abstract":"<p><p><b>Introduction:</b> Social determinants of health and adversity, including poverty, maltreatment, and neighborhood deprivation, are individual-level factors that may significantly affect baseline neurocognitive testing and management that have yet to be thoroughly explored within the computerized neurocognitive assessment.<b>Objectives:</b> Examine individual-level experiences of poverty, abuse, neighborhood deprivation, and social mobility on computerized cognitive testing.<b>Methods:</b> The sample included 3,845 student-athletes who completed a baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) and were enrolled in the Child-Household Integrated Longitudinal Data database. Multivariable linear regressions were used to assess independent variables of Supplemental Nutrition Assistance Program enrollment, abuse or neglect cases, Area Deprivation Index scores, and other demographic factors on four baseline ImPACT composite scores: verbal and visual memory, visuomotor, and reaction time.<b>Results:</b> Individual-level factors of persistent poverty and neighborhood deprivation were associated with lower composite scores; however, upward social mobility was not significantly associated with cognitive performance. The effects of mother's race on computerized cognitive testing performance were attenuated when accounting for measures of adversity.<b>Conclusion:</b> Findings highlight the importance of social determinants of health in computerized neurocognitive testing to ensure more culturally sensitive and precise understanding of athletic baselines.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-20"},"PeriodicalIF":3.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141592228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-12DOI: 10.1080/13854046.2024.2374894
Gelan Ying, Ambar Perez-Lao, Tamare Adrien, Demetrius Maraganore, David Marra, Glenn Smith
Objective: To (1) examine the distribution of Telephone Interview for Cognitive Status modified (TICS-m) scores in oldest-old individuals (age 85 and above) identified as cognitively healthy by a previously validated electronic health records-based computable phenotype (CP) and (2) to compare different cutoff scores for cognitive impairment in this population. Method: CP identified 24,024 persons, 470 were contacted and 252 consented and completed the assessment. Associations of TICS-m score with age, sex, and educational categories (<10 years, 11-15 years, and >16 years) were examined. The number of participants perceived as impaired was studied with commonly used cutoff scores (27-31). Results: TICS-m score ranged from 18 to 44 with a mean of 32.6 (SD = 4.7) in older adults aged 85-99 years old. A linear regression model including (range-restricted) age, education, and sex, showed beta estimates comparable to previous findings. Different cutoff scores (27 to 31) generated slightly lower MCI and dementia prevalence rates of participants meeting the criteria for the impairments than studies of younger elderly using traditional recruitment methods. Conclusions: The use of validated computable phenotype to identify a normative cohort generated a normative distribution for the TICS-m consistent with prior findings from more effortful approaches to cohort identification and established expected TICS-m performance in the oldest-old population.
{"title":"TICS-M scores in an oldest-old normative cohort identified by computable phenotype.","authors":"Gelan Ying, Ambar Perez-Lao, Tamare Adrien, Demetrius Maraganore, David Marra, Glenn Smith","doi":"10.1080/13854046.2024.2374894","DOIUrl":"https://doi.org/10.1080/13854046.2024.2374894","url":null,"abstract":"<p><p><b>Objective:</b> To (1) examine the distribution of Telephone Interview for Cognitive Status modified (TICS-m) scores in oldest-old individuals (age 85 and above) identified as cognitively healthy by a previously validated electronic health records-based computable phenotype (CP) and (2) to compare different cutoff scores for cognitive impairment in this population. <b>Method:</b> CP identified 24,024 persons, 470 were contacted and 252 consented and completed the assessment. Associations of TICS-m score with age, sex, and educational categories (<10 years, 11-15 years, and >16 years) were examined. The number of participants perceived as impaired was studied with commonly used cutoff scores (27-31). <b>Results:</b> TICS-m score ranged from 18 to 44 with a mean of 32.6 (SD = 4.7) in older adults aged 85-99 years old. A linear regression model including (range-restricted) age, education, and sex, showed beta estimates comparable to previous findings. Different cutoff scores (27 to 31) generated slightly lower MCI and dementia prevalence rates of participants meeting the criteria for the impairments than studies of younger elderly using traditional recruitment methods. <b>Conclusions:</b> The use of validated computable phenotype to identify a normative cohort generated a normative distribution for the TICS-m consistent with prior findings from more effortful approaches to cohort identification and established expected TICS-m performance in the oldest-old population.</p>","PeriodicalId":55250,"journal":{"name":"Clinical Neuropsychologist","volume":" ","pages":"1-12"},"PeriodicalIF":3.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}