Miriam A Novack, Stephanie Ruth Young, Elizabeth M Dworak, Aaron J Kaat, Jerry Slotkin, Cindy Nowinski, Lihua Yao, Hubert Adam, Jordan Stoeger, Zahra Hosseinian, Saki Amagai, Sarah Pila, Maria Varela Diaz, Anyelo Almonte Correa, Keith Alperin, Sonia Carlson, Michael Kellen, Larsson Omberg, Monica R Camacho, Bernard Landavazo, Rachel L Nosheny, Michael W Weiner, Richard C Gershon
{"title":"Mobile toolbox (MTB) remote measures of executive function and processing speed: development and validation.","authors":"Miriam A Novack, Stephanie Ruth Young, Elizabeth M Dworak, Aaron J Kaat, Jerry Slotkin, Cindy Nowinski, Lihua Yao, Hubert Adam, Jordan Stoeger, Zahra Hosseinian, Saki Amagai, Sarah Pila, Maria Varela Diaz, Anyelo Almonte Correa, Keith Alperin, Sonia Carlson, Michael Kellen, Larsson Omberg, Monica R Camacho, Bernard Landavazo, Rachel L Nosheny, Michael W Weiner, Richard C Gershon","doi":"10.1017/S1355617724000225","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties.</p><p><strong>Method: </strong>MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (<i>N</i> = 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (<i>N</i> = 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (<i>N</i> = 168), participants completed MTB measures twice remotely, two weeks apart.</p><p><strong>Results: </strong>All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability.</p><p><strong>Conclusions: </strong>Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.</p>","PeriodicalId":49995,"journal":{"name":"Journal of the International Neuropsychological Society","volume":" ","pages":"680-688"},"PeriodicalIF":2.6000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the International Neuropsychological Society","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/S1355617724000225","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/11 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties.
Method: MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (N = 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (N = 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (N = 168), participants completed MTB measures twice remotely, two weeks apart.
Results: All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability.
Conclusions: Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.
期刊介绍:
The Journal of the International Neuropsychological Society is the official journal of the International Neuropsychological Society, an organization of over 4,500 international members from a variety of disciplines. The Journal of the International Neuropsychological Society welcomes original, creative, high quality research papers covering all areas of neuropsychology. The focus of articles may be primarily experimental, applied, or clinical. Contributions will broadly reflect the interest of all areas of neuropsychology, including but not limited to: development of cognitive processes, brain-behavior relationships, adult and pediatric neuropsychology, neurobehavioral syndromes (such as aphasia or apraxia), and the interfaces of neuropsychology with related areas such as behavioral neurology, neuropsychiatry, genetics, and cognitive neuroscience. Papers that utilize behavioral, neuroimaging, and electrophysiological measures are appropriate.
To assure maximum flexibility and to promote diverse mechanisms of scholarly communication, the following formats are available in addition to a Regular Research Article: Brief Communication is a shorter research article; Rapid Communication is intended for "fast breaking" new work that does not yet justify a full length article and is placed on a fast review track; Case Report is a theoretically important and unique case study; Critical Review and Short Review are thoughtful considerations of topics of importance to neuropsychology and include meta-analyses; Dialogue provides a forum for publishing two distinct positions on controversial issues in a point-counterpoint format; Special Issue and Special Section consist of several articles linked thematically; Letter to the Editor responds to recent articles published in the Journal of the International Neuropsychological Society; and Book Review, which is considered but is no longer solicited.