Evidence Supports the Validity and Reliability of Response Times from a Brief Survey as a Digital Biomarker for Processing Speed in a Large Panel Study.
Raymond Hernandez, Arthur A Stone, Elizabeth Zelinski, Erik Meijer, Titus Galama, Jessica Faul, Arie Kapteyn, Doerte U Junghaenel, Haomiao Jin, Margaret Gatz, Pey-Jiuan Lee, Daniel Maupin, Hongxin Gao, Bart Orriens, Stefan Schneider
{"title":"Evidence Supports the Validity and Reliability of Response Times from a Brief Survey as a Digital Biomarker for Processing Speed in a Large Panel Study.","authors":"Raymond Hernandez, Arthur A Stone, Elizabeth Zelinski, Erik Meijer, Titus Galama, Jessica Faul, Arie Kapteyn, Doerte U Junghaenel, Haomiao Jin, Margaret Gatz, Pey-Jiuan Lee, Daniel Maupin, Hongxin Gao, Bart Orriens, Stefan Schneider","doi":"10.1093/aje/kwae478","DOIUrl":null,"url":null,"abstract":"<p><p>Survey response times (RTs) have hitherto untapped potential to allow researchers to gain more detailed insights into the cognitive performance of participants in online panel studies. We examined if RTs recorded from a brief online survey could serve as a digital biomarker for processing speed. Data from 9,893 adults enrolled in the nationally representative Understanding America Study were used in the analyses. Hypotheses included that people's average survey RTs would have a large correlation with an established processing speed test, small to moderate correlations with other cognitive tests, and associations with functional impairment. We also hypothesized that survey RTs would have sensitivity to various participant characteristics comparable to the established processing speed test's sensitivity (e.g., similar standardized means by gender). Overall, results support the validity and reliability of people's average RTs to survey items as a digital biomarker for processing speed. The correlation between survey RTs (reverse scored) and the formal processing speed test was 0.61 (p<0.001), and small to moderate associations with most other cognitive and functional status measures were observed. Sensitivity of survey RTs to various participant characteristics was nearly identical to the formal processing speed test. Survey RTs may be useful as proxies for processing speed.</p>","PeriodicalId":7472,"journal":{"name":"American journal of epidemiology","volume":" ","pages":""},"PeriodicalIF":5.0000,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/aje/kwae478","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
Survey response times (RTs) have hitherto untapped potential to allow researchers to gain more detailed insights into the cognitive performance of participants in online panel studies. We examined if RTs recorded from a brief online survey could serve as a digital biomarker for processing speed. Data from 9,893 adults enrolled in the nationally representative Understanding America Study were used in the analyses. Hypotheses included that people's average survey RTs would have a large correlation with an established processing speed test, small to moderate correlations with other cognitive tests, and associations with functional impairment. We also hypothesized that survey RTs would have sensitivity to various participant characteristics comparable to the established processing speed test's sensitivity (e.g., similar standardized means by gender). Overall, results support the validity and reliability of people's average RTs to survey items as a digital biomarker for processing speed. The correlation between survey RTs (reverse scored) and the formal processing speed test was 0.61 (p<0.001), and small to moderate associations with most other cognitive and functional status measures were observed. Sensitivity of survey RTs to various participant characteristics was nearly identical to the formal processing speed test. Survey RTs may be useful as proxies for processing speed.
期刊介绍:
The American Journal of Epidemiology is the oldest and one of the premier epidemiologic journals devoted to the publication of empirical research findings, opinion pieces, and methodological developments in the field of epidemiologic research.
It is a peer-reviewed journal aimed at both fellow epidemiologists and those who use epidemiologic data, including public health workers and clinicians.