Test-retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool.

Abstract

The present study aimed to establish test-retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self-administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20-79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test-retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main-scores and 33 sub-scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in-laboratory) and baseline performance for 12 main-scores and nine sub-scores. Test-retest reliability was good for 11 main-scores (≥0.70), satisfactory for five (0.60-0.69), and minimal for six (<0.60) albeit three having satisfactory sub-scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test-retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment.