African American Preschoolers' Performance on Norm-Referenced Language Assessments: Examining the Effect of Dialect Density and the Use of Scoring Modifications.
Nancy C Marencin, Ashley A Edwards, Nicole Patton Terry
{"title":"African American Preschoolers' Performance on Norm-Referenced Language Assessments: Examining the Effect of Dialect Density and the Use of Scoring Modifications.","authors":"Nancy C Marencin, Ashley A Edwards, Nicole Patton Terry","doi":"10.1044/2024_LSHSS-23-00134","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>We investigated and compared the outcomes from two standardized, norm-referenced screening assessments of language (i.e., Clinical Evaluation of Language Fundamentals Preschool-Second Edition [CELFP-2], Diagnostic Evaluation of Language Variation-Screening Test [DELV-ST]) with African American preschoolers whose spoken dialect differed from that of General American English (GAE). We (a) described preschoolers' performance on the CELFP-2 Core Language Index (CLI) and its subtests with consideration of degree of dialect variation (DVAR) observed, (b) investigated how the application of dialect-sensitive scoring modifications to the expressive morphology and syntax Word Structure (WS) subtest affected CELFP-2 CLI scores, and (c) evaluated the screening classification agreement rates between the DELV-ST and the CELFP-2 CLI.</p><p><strong>Method: </strong>African American preschoolers (<i>N</i> = 284) completed the CELFP-2 CLI subtests (i.e., Sentence Structure, WS, Expressive Vocabulary) and the DELV-ST. Density of spoken dialect use was estimated with the DELV-ST Part I Language Variation Status, and percentage of DVAR was calculated. The CELFP-2 WS subtest was scored with and without dialect-sensitive scoring modifications.</p><p><strong>Results: </strong>Planned comparisons of CELFP-2 CLI performance indicated statistically significant differences in performance based on DELV-ST-determined degree of language variation groupings. Scoring modifications applied to the WS subtest increased subtest scaled scores and CLI composite standard scores. However, preschoolers who demonstrated strong variation from GAE continued to demonstrate significantly lower performance than preschoolers who demonstrated little to no language variation. Affected-status agreement rates between assessments (modified and unmodified CELFP-2 CLI scores and DELV-ST Part II Diagnostic Risk Status) were extremely low.</p><p><strong>Conclusions: </strong>The application of dialect-specific scoring modifications to standardized, norm-referenced assessments of language must be simultaneously viewed through the lenses of equity, practicality, and psychometry. The results of our multistage study reiterate the need for reliable methods of identifying risk for developmental language disorder within children who speak American English dialects other than GAE.</p><p><strong>Supplemental material: </strong>https://doi.org/10.23641/asha.26017978.</p>","PeriodicalId":54326,"journal":{"name":"Language Speech and Hearing Services in Schools","volume":" ","pages":"918-937"},"PeriodicalIF":2.2000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language Speech and Hearing Services in Schools","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1044/2024_LSHSS-23-00134","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/18 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: We investigated and compared the outcomes from two standardized, norm-referenced screening assessments of language (i.e., Clinical Evaluation of Language Fundamentals Preschool-Second Edition [CELFP-2], Diagnostic Evaluation of Language Variation-Screening Test [DELV-ST]) with African American preschoolers whose spoken dialect differed from that of General American English (GAE). We (a) described preschoolers' performance on the CELFP-2 Core Language Index (CLI) and its subtests with consideration of degree of dialect variation (DVAR) observed, (b) investigated how the application of dialect-sensitive scoring modifications to the expressive morphology and syntax Word Structure (WS) subtest affected CELFP-2 CLI scores, and (c) evaluated the screening classification agreement rates between the DELV-ST and the CELFP-2 CLI.
Method: African American preschoolers (N = 284) completed the CELFP-2 CLI subtests (i.e., Sentence Structure, WS, Expressive Vocabulary) and the DELV-ST. Density of spoken dialect use was estimated with the DELV-ST Part I Language Variation Status, and percentage of DVAR was calculated. The CELFP-2 WS subtest was scored with and without dialect-sensitive scoring modifications.
Results: Planned comparisons of CELFP-2 CLI performance indicated statistically significant differences in performance based on DELV-ST-determined degree of language variation groupings. Scoring modifications applied to the WS subtest increased subtest scaled scores and CLI composite standard scores. However, preschoolers who demonstrated strong variation from GAE continued to demonstrate significantly lower performance than preschoolers who demonstrated little to no language variation. Affected-status agreement rates between assessments (modified and unmodified CELFP-2 CLI scores and DELV-ST Part II Diagnostic Risk Status) were extremely low.
Conclusions: The application of dialect-specific scoring modifications to standardized, norm-referenced assessments of language must be simultaneously viewed through the lenses of equity, practicality, and psychometry. The results of our multistage study reiterate the need for reliable methods of identifying risk for developmental language disorder within children who speak American English dialects other than GAE.
期刊介绍:
Mission: LSHSS publishes peer-reviewed research and other scholarly articles pertaining to the practice of audiology and speech-language pathology in the schools, focusing on children and adolescents. The journal is an international outlet for clinical research and is designed to promote development and analysis of approaches concerning the delivery of services to the school-aged population. LSHSS seeks to advance evidence-based practice by disseminating the results of new studies as well as providing a forum for critical reviews and meta-analyses of previously published work.
Scope: The broad field of audiology and speech-language pathology as practiced in schools, including aural rehabilitation; augmentative and alternative communication; childhood apraxia of speech; classroom acoustics; cognitive impairment; craniofacial disorders; fluency disorders; hearing-assistive technology; language disorders; literacy disorders including reading, writing, and spelling; motor speech disorders; speech sound disorders; swallowing, dysphagia, and feeding disorders; voice disorders.