Daniel Hahnsam Seok, Hee Won Yang, Ji Won Han, Jin Hwan Lim, Seon Hyeok Kim, Eun Young Kim, Ki Woong Kim
{"title":"Reliability and Validity of a Tablet-Based Neuropsychological Test (the Hellocog) for Screening Dementia.","authors":"Daniel Hahnsam Seok, Hee Won Yang, Ji Won Han, Jin Hwan Lim, Seon Hyeok Kim, Eun Young Kim, Ki Woong Kim","doi":"10.30773/pi.2023.0388","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To address the gap in timely diagnosis of dementia due to limited screening tools, we investigated the validity and reliability of the Hellocog, computerized neuropsychological test based on tablets for screening dementia. The higher the probability score on the Hellocog, the higher the likelihood of dementia.</p><p><strong>Methods: </strong>This study included 100 patients with dementia and 100 individuals with normal cognition who were aged 60 years or older and free of other major psychiatric, neurological, or medical conditions. They administered the Hellocog on a tablet under the supervision of a neuropsychologist. To determine test-retest reliability, 20 took the Hellocog again after 4 weeks. Diagnostic performance was assessed using the receiver operator characteristics (ROC) analysis.</p><p><strong>Results: </strong>The Hellocog showed adequate internal consistency (Cronbach's alpha=0.69) and good test-retest reliability (intraclass correlation coefficient=0.86, p<0.001). Participants with dementia scored higher on the Hellocog than those with normal cognition (p<0.001), confirming its high criterion validity. Strong correlations with the Mini-Mental Status Examination (MMSE) score and the total score of the Consortium to Establish a Registry for Alzheimer's Disease Neuropsychological Assessment Battery (CERAD-TS) highlight the concurrent validity of the Hellocog. The area under the ROC curve for dementia of the Hellocog was excellent (0.971) and comparable to that of the MMSE and CERAD-TS. The sensitivity and specificity for dementia were 0.945 and 0.872%, respectively, which were slightly better than those of the MMSE and CERAD-TS.</p><p><strong>Conclusion: </strong>Hellocog stands out as a valid and reliable tool for self-administered dementia screening, with promise for improving early detection of dementia.</p>","PeriodicalId":21164,"journal":{"name":"Psychiatry Investigation","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11222082/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychiatry Investigation","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.30773/pi.2023.0388","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/24 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: To address the gap in timely diagnosis of dementia due to limited screening tools, we investigated the validity and reliability of the Hellocog, computerized neuropsychological test based on tablets for screening dementia. The higher the probability score on the Hellocog, the higher the likelihood of dementia.
Methods: This study included 100 patients with dementia and 100 individuals with normal cognition who were aged 60 years or older and free of other major psychiatric, neurological, or medical conditions. They administered the Hellocog on a tablet under the supervision of a neuropsychologist. To determine test-retest reliability, 20 took the Hellocog again after 4 weeks. Diagnostic performance was assessed using the receiver operator characteristics (ROC) analysis.
Results: The Hellocog showed adequate internal consistency (Cronbach's alpha=0.69) and good test-retest reliability (intraclass correlation coefficient=0.86, p<0.001). Participants with dementia scored higher on the Hellocog than those with normal cognition (p<0.001), confirming its high criterion validity. Strong correlations with the Mini-Mental Status Examination (MMSE) score and the total score of the Consortium to Establish a Registry for Alzheimer's Disease Neuropsychological Assessment Battery (CERAD-TS) highlight the concurrent validity of the Hellocog. The area under the ROC curve for dementia of the Hellocog was excellent (0.971) and comparable to that of the MMSE and CERAD-TS. The sensitivity and specificity for dementia were 0.945 and 0.872%, respectively, which were slightly better than those of the MMSE and CERAD-TS.
Conclusion: Hellocog stands out as a valid and reliable tool for self-administered dementia screening, with promise for improving early detection of dementia.
期刊介绍:
The Psychiatry Investigation is published on the 25th day of every month in English by the Korean Neuropsychiatric Association (KNPA). The Journal covers the whole range of psychiatry and neuroscience. Both basic and clinical contributions are encouraged from all disciplines and research areas relevant to the pathophysiology and management of neuropsychiatric disorders and symptoms, as well as researches related to cross cultural psychiatry and ethnic issues in psychiatry. The Journal publishes editorials, review articles, original articles, brief reports, viewpoints and correspondences. All research articles are peer reviewed. Contributions are accepted for publication on the condition that their substance has not been published or submitted for publication elsewhere. Authors submitting papers to the Journal (serially or otherwise) with a common theme or using data derived from the same sample (or a subset thereof) must send details of all relevant previous publications and simultaneous submissions. The Journal is not responsible for statements made by contributors. Material in the Journal does not necessarily reflect the views of the Editor or of the KNPA. Manuscripts accepted for publication are copy-edited to improve readability and to ensure conformity with house style.