Validation of the Remote Automated ki:e Speech Biomarker for Cognition in Mild Cognitive Impairment: Verification and Validation following DiME V3 Framework.
Johannes Tröger, Ebru Baykara, Jian Zhao, Daphne Ter Huurne, Nina Possemis, Elisa Mallick, Simona Schäfer, Louisa Schwed, Mario Mina, Nicklas Linz, Inez Ramakers, Craig Ritchie
{"title":"Validation of the Remote Automated ki:e Speech Biomarker for Cognition in Mild Cognitive Impairment: Verification and Validation following DiME V3 Framework.","authors":"Johannes Tröger, Ebru Baykara, Jian Zhao, Daphne Ter Huurne, Nina Possemis, Elisa Mallick, Simona Schäfer, Louisa Schwed, Mario Mina, Nicklas Linz, Inez Ramakers, Craig Ritchie","doi":"10.1159/000526471","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Progressive cognitive decline is the cardinal behavioral symptom in most dementia-causing diseases such as Alzheimer's disease. While most well-established measures for cognition might not fit tomorrow's decentralized remote clinical trials, digital cognitive assessments will gain importance. We present the evaluation of a novel digital speech biomarker for cognition (SB-C) following the Digital Medicine Society's V3 framework: verification, analytical validation, and clinical validation.</p><p><strong>Methods: </strong>Evaluation was done in two independent clinical samples: the Dutch DeepSpA (<i>N</i> = 69 subjective cognitive impairment [SCI], <i>N</i> = 52 mild cognitive impairment [MCI], and <i>N</i> = 13 dementia) and the Scottish SPeAk datasets (<i>N</i> = 25, healthy controls). For validation, two anchor scores were used: the Mini-Mental State Examination (MMSE) and the Clinical Dementia Rating (CDR) scale.</p><p><strong>Results: </strong><i>Verification</i>: The SB-C could be reliably extracted for both languages using an automatic speech processing pipeline. <i>Analytical Validation</i>: In both languages, the SB-C was strongly correlated with MMSE scores. <i>Clinical Validation:</i> The SB-C significantly differed between clinical groups (including MCI and dementia), was strongly correlated with the CDR, and could track the clinically meaningful decline.</p><p><strong>Conclusion: </strong>Our results suggest that the ki:e SB-C is an objective, scalable, and reliable indicator of cognitive decline, fit for purpose as a remote assessment in clinical early dementia trials.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"6 3","pages":"107-116"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/22/f9/dib-0006-0107.PMC9710455.pdf","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Biomarkers","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1159/000526471","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/9/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 4
Abstract
Introduction: Progressive cognitive decline is the cardinal behavioral symptom in most dementia-causing diseases such as Alzheimer's disease. While most well-established measures for cognition might not fit tomorrow's decentralized remote clinical trials, digital cognitive assessments will gain importance. We present the evaluation of a novel digital speech biomarker for cognition (SB-C) following the Digital Medicine Society's V3 framework: verification, analytical validation, and clinical validation.
Methods: Evaluation was done in two independent clinical samples: the Dutch DeepSpA (N = 69 subjective cognitive impairment [SCI], N = 52 mild cognitive impairment [MCI], and N = 13 dementia) and the Scottish SPeAk datasets (N = 25, healthy controls). For validation, two anchor scores were used: the Mini-Mental State Examination (MMSE) and the Clinical Dementia Rating (CDR) scale.
Results: Verification: The SB-C could be reliably extracted for both languages using an automatic speech processing pipeline. Analytical Validation: In both languages, the SB-C was strongly correlated with MMSE scores. Clinical Validation: The SB-C significantly differed between clinical groups (including MCI and dementia), was strongly correlated with the CDR, and could track the clinically meaningful decline.
Conclusion: Our results suggest that the ki:e SB-C is an objective, scalable, and reliable indicator of cognitive decline, fit for purpose as a remote assessment in clinical early dementia trials.