Stephanie Ruth Young, Elizabeth M Dworak, Aaron J Kaat, Hubert Adam, Miriam A Novack, Jerry Slotkin, Jordan Stoeger, Cindy J Nowinski, Zahra Hosseinian, Saki Amagai, Sarah Pila, Maria Varela Diaz, Anyelo Almonte Correa, Keith Alperin, Larsson Omberg, Michael Kellen, Monica R Camacho, Bernard Landavazo, Rachel L Nosheny, Michael W Weiner, Richard M Gershon
{"title":"Development and Validation of a Vocabulary Measure in the Mobile Toolbox.","authors":"Stephanie Ruth Young, Elizabeth M Dworak, Aaron J Kaat, Hubert Adam, Miriam A Novack, Jerry Slotkin, Jordan Stoeger, Cindy J Nowinski, Zahra Hosseinian, Saki Amagai, Sarah Pila, Maria Varela Diaz, Anyelo Almonte Correa, Keith Alperin, Larsson Omberg, Michael Kellen, Monica R Camacho, Bernard Landavazo, Rachel L Nosheny, Michael W Weiner, Richard M Gershon","doi":"10.1093/arclin/acae010","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies.</p><p><strong>Method: </strong>Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones.</p><p><strong>Results: </strong>The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001).</p><p><strong>Conclusion: </strong>The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.</p>","PeriodicalId":8176,"journal":{"name":"Archives of Clinical Neuropsychology","volume":" ","pages":"714-723"},"PeriodicalIF":2.1000,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Archives of Clinical Neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1093/arclin/acae010","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies.
Method: Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones.
Results: The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001).
Conclusion: The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.
期刊介绍：
The journal publishes original contributions dealing with psychological aspects of the etiology, diagnosis, and treatment of disorders arising out of dysfunction of the central nervous system. Archives of Clinical Neuropsychology will also consider manuscripts involving the established principles of the profession of neuropsychology: (a) delivery and evaluation of services, (b) ethical and legal issues, and (c) approaches to education and training. Preference will be given to empirical reports and key reviews. Brief research reports, case studies, and commentaries on published articles (not exceeding two printed pages) will also be considered. At the discretion of the editor, rebuttals to commentaries may be invited. Occasional papers of a theoretical nature will be considered.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
