Kelly L Sloane, Joel A Mefford, Zilong Zhao, Man Xu, Guifeng Zhou, Rachel Fabian, Amy E Wright, Shenly Glenn
{"title":"Validation of a Mobile, Sensor-based Neurobehavioral Assessment With Digital Signal Processing and Machine-learning Analytics.","authors":"Kelly L Sloane, Joel A Mefford, Zilong Zhao, Man Xu, Guifeng Zhou, Rachel Fabian, Amy E Wright, Shenly Glenn","doi":"10.1097/WNN.0000000000000308","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The Miro Health Mobile Assessment Platform consists of self-administered neurobehavioral and cognitive assessments that measure behaviors typically measured by specialized clinicians.</p><p><strong>Objective: </strong>To evaluate the Miro Health Mobile Assessment Platform's concurrent validity, test-retest reliability, and mild cognitive impairment (MCI) classification performance.</p><p><strong>Method: </strong>Sixty study participants were evaluated with Miro Health version V.2. Healthy controls (HC), amnestic MCI (aMCI), and nonamnestic MCI (naMCI) ages 64-85 were evaluated with version V.3. Additional participants were recruited at Johns Hopkins Hospital to represent clinic patients, with wider ranges of age and diagnosis. In all, 90 HC, 21 aMCI, 17 naMCI, and 15 other cases were evaluated with V.3. Concurrent validity of the Miro Health variables and legacy neuropsychological test scores was assessed with Spearman correlations. Reliability was quantified with the scores' intraclass correlations. A machine-learning algorithm combined Miro Health variable scores into a Risk score to differentiate HC from MCI or MCI subtypes.</p><p><strong>Results: </strong>In HC, correlations of Miro Health variables with legacy test scores ranged 0.27-0.68. Test-retest reliabilities ranged 0.25-0.79, with minimal learning effects. The Risk score differentiated individuals with aMCI from HC with an area under the receiver operator curve (AUROC) of 0.97; naMCI from HC with an AUROC of 0.80; combined MCI from HC with an AUROC of 0.89; and aMCI from naMCI with an AUROC of 0.83.</p><p><strong>Conclusion: </strong>The Miro Health Mobile Assessment Platform provides valid and reliable assessment of neurobehavioral and cognitive status, effectively distinguishes between HC and MCI, and differentiates aMCI from naMCI.</p>","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":" ","pages":"169-178"},"PeriodicalIF":17.7000,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/WNN.0000000000000308","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 1
Abstract
Background: The Miro Health Mobile Assessment Platform consists of self-administered neurobehavioral and cognitive assessments that measure behaviors typically measured by specialized clinicians.
Objective: To evaluate the Miro Health Mobile Assessment Platform's concurrent validity, test-retest reliability, and mild cognitive impairment (MCI) classification performance.
Method: Sixty study participants were evaluated with Miro Health version V.2. Healthy controls (HC), amnestic MCI (aMCI), and nonamnestic MCI (naMCI) ages 64-85 were evaluated with version V.3. Additional participants were recruited at Johns Hopkins Hospital to represent clinic patients, with wider ranges of age and diagnosis. In all, 90 HC, 21 aMCI, 17 naMCI, and 15 other cases were evaluated with V.3. Concurrent validity of the Miro Health variables and legacy neuropsychological test scores was assessed with Spearman correlations. Reliability was quantified with the scores' intraclass correlations. A machine-learning algorithm combined Miro Health variable scores into a Risk score to differentiate HC from MCI or MCI subtypes.
Results: In HC, correlations of Miro Health variables with legacy test scores ranged 0.27-0.68. Test-retest reliabilities ranged 0.25-0.79, with minimal learning effects. The Risk score differentiated individuals with aMCI from HC with an area under the receiver operator curve (AUROC) of 0.97; naMCI from HC with an AUROC of 0.80; combined MCI from HC with an AUROC of 0.89; and aMCI from naMCI with an AUROC of 0.83.
Conclusion: The Miro Health Mobile Assessment Platform provides valid and reliable assessment of neurobehavioral and cognitive status, effectively distinguishes between HC and MCI, and differentiates aMCI from naMCI.
期刊介绍:
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.