首页 > 最新文献

ASSESSMENT FOR EFFECTIVE INTERVENTION最新文献

英文 中文
Measuring Engagement in Early Education: Preliminary Evidence for the Behavioral Observation of Students in Schools–Early Education: 早期教育中敬业度的测量:学校早期教育学生行为观察的初步证据
IF 1.3 Q2 Social Sciences Pub Date : 2020-09-01 DOI: 10.25384/SAGE.C.4348757.V1
Robin L. Hojnoski, Kristen Missall, Brenna K. Wood
Engagement in early childhood is defined as a child’s level of participation with the environment. Engagement is an important construct in assessment and intervention of social and early learning c...
幼儿期的参与被定义为儿童对环境的参与程度。参与是社会和早期学习评估和干预的重要组成部分。
{"title":"Measuring Engagement in Early Education: Preliminary Evidence for the Behavioral Observation of Students in Schools–Early Education:","authors":"Robin L. Hojnoski, Kristen Missall, Brenna K. Wood","doi":"10.25384/SAGE.C.4348757.V1","DOIUrl":"https://doi.org/10.25384/SAGE.C.4348757.V1","url":null,"abstract":"Engagement in early childhood is defined as a child’s level of participation with the environment. Engagement is an important construct in assessment and intervention of social and early learning c...","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45514271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Measuring Engagement in Early Education: Preliminary Evidence for the Behavioral Observation of Students in Schools–Early Education 衡量早期教育的参与度:学校学生行为观察的初步证据——早期教育
IF 1.3 Q2 Social Sciences Pub Date : 2020-09-01 DOI: 10.1177/1534508418820125
Robin L. Hojnoski, Kristen Missall, Brenna K. Wood
Engagement in early childhood is defined as a child’s level of participation with the environment. Engagement is an important construct in assessment and intervention of social and early learning competence given its link to school achievement. Few tools exist to assess engagement of young children in early education, and there is a need for a systematic direct observation tool that can be applied universally (e.g., with all young children) in these settings. This article describes preliminary evidence of validity and reliability for the Behavioral Observation of Students in Schools–Early Education (BOSS-EE). Specifically, the article describes results from a survey of experts and practitioners in which feedback was solicited on target behaviors and operational definitions, presents reliability data (i.e., interobserver and test–retest), examines correlations with a criterion measure, and describes variability across settings, sites, and methods (i.e., video vs. in vivo). Next steps in measurement development are discussed with attention to the challenges of producing a tool that can be used in a range of early education settings with diverse groups of young children.
幼儿期的参与被定义为儿童对环境的参与程度。参与是评估和干预社会和早期学习能力的一个重要结构,因为它与学校成绩有关。很少有工具可以评估幼儿参与早期教育的情况,需要一种系统的直接观察工具,可以在这些环境中普遍应用(例如,对所有幼儿)。本文描述了《学校学生行为观察-早期教育》(BOSS-EE)的有效性和可靠性的初步证据。具体而言,这篇文章描述了对专家和从业者的调查结果,其中征求了对目标行为和操作定义的反馈,提供了可靠性数据(即观察者间和测试-重新测试),检查了与标准测量的相关性,并描述了不同设置、地点和方法的可变性(即视频与体内)。讨论了测量开发的下一步,并注意到制作一种可用于各种幼儿群体的早期教育环境的工具所面临的挑战。
{"title":"Measuring Engagement in Early Education: Preliminary Evidence for the Behavioral Observation of Students in Schools–Early Education","authors":"Robin L. Hojnoski, Kristen Missall, Brenna K. Wood","doi":"10.1177/1534508418820125","DOIUrl":"https://doi.org/10.1177/1534508418820125","url":null,"abstract":"Engagement in early childhood is defined as a child’s level of participation with the environment. Engagement is an important construct in assessment and intervention of social and early learning competence given its link to school achievement. Few tools exist to assess engagement of young children in early education, and there is a need for a systematic direct observation tool that can be applied universally (e.g., with all young children) in these settings. This article describes preliminary evidence of validity and reliability for the Behavioral Observation of Students in Schools–Early Education (BOSS-EE). Specifically, the article describes results from a survey of experts and practitioners in which feedback was solicited on target behaviors and operational definitions, presents reliability data (i.e., interobserver and test–retest), examines correlations with a criterion measure, and describes variability across settings, sites, and methods (i.e., video vs. in vivo). Next steps in measurement development are discussed with attention to the challenges of producing a tool that can be used in a range of early education settings with diverse groups of young children.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508418820125","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45491672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Aspects of Technical Adequacy of an Early-Writing Measure for English Language Learners in Grades 1 to 3 一至三年级英语学习者早期写作测量的技术充分性方面
IF 1.3 Q2 Social Sciences Pub Date : 2020-08-17 DOI: 10.1177/1534508420947157
R. A. Smith, E. Lembke
This study examined the technical adequacy of Picture Word, a type of Writing Curriculum-Based Measurement, with 73 English learners (ELs) with beginning to intermediate English language proficiency in Grades 1, 2, and 3. The ELs in this study attended schools in one midwestern U.S. school district employing an English-only model of instruction and spoke a variety of native languages. ELs completed two forms of Picture Word in the fall, winter, and spring. The criterion measure, a common English language proficiency assessment, was administered in the winter. Results indicated that Picture Word was not appropriate for the first-grade EL participants but showed promise for second- and third-grade ELs.
本研究以73名英语学习者为研究对象,考察了一种基于写作课程的测量方法Picture Word在技术上的充分性,这些英语学习者的英语语言水平分别为1、2和3年级。在这项研究中,学习英语的学生就读于美国中西部的一个学区,采用纯英语教学模式,讲多种母语。我们分别在秋天、冬天和春天完成了两种形式的Picture Word。标准测量是一项通用英语语言能力评估,在冬季进行。结果表明,图片词不适合一年级学生,但适合二年级和三年级学生。
{"title":"Aspects of Technical Adequacy of an Early-Writing Measure for English Language Learners in Grades 1 to 3","authors":"R. A. Smith, E. Lembke","doi":"10.1177/1534508420947157","DOIUrl":"https://doi.org/10.1177/1534508420947157","url":null,"abstract":"This study examined the technical adequacy of Picture Word, a type of Writing Curriculum-Based Measurement, with 73 English learners (ELs) with beginning to intermediate English language proficiency in Grades 1, 2, and 3. The ELs in this study attended schools in one midwestern U.S. school district employing an English-only model of instruction and spoke a variety of native languages. ELs completed two forms of Picture Word in the fall, winter, and spring. The criterion measure, a common English language proficiency assessment, was administered in the winter. Results indicated that Picture Word was not appropriate for the first-grade EL participants but showed promise for second- and third-grade ELs.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420947157","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45842540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relative Contribution of Verbal Working Memory and Attention to Child Language 言语工作记忆与注意对儿童语言的相对贡献
IF 1.3 Q2 Social Sciences Pub Date : 2020-08-04 DOI: 10.1177/1534508420946361
Jason C. Chow, E. Ekholm, Christine L. Bae
It is common in intervention research to use measures of working memory either as an explanatory or a control variable. This study examines the contribution of cognitive abilities, including verbal working memory (WM) and attention, to language performance in first- and second-grade children. We assessed children (N = 414) on two forms of verbal WM, one attention, and two standardized assessments of language. Scores from all three measures of cognitive abilities significantly predicted latent language (64% variance). Both verbal WM measures were stronger predictors of a latent language variable compared to attention. Exploratory analyses revealed differences in the role of cognitive variables to language subdomains. The findings deepen our understanding of the relative associations between verbal WM, attention, and language. We conclude that it is important to consider the language demands of tasks when making decisions about assessment of verbal WM, specifically in the context of intervention research in domains that require language.
在干预研究中,使用工作记忆的测量作为解释变量或控制变量是很常见的。本研究考察了认知能力,包括言语工作记忆(WM)和注意力,对一年级和二年级儿童语言表现的贡献。我们对儿童(N=414)进行了两种形式的言语WM、一种注意力和两种语言标准化评估。所有三项认知能力指标的得分都能显著预测潜在语言(64%的方差)。与注意力相比,两种言语WM测量都是潜在语言变量的更强预测因素。探索性分析揭示了认知变量对语言子域作用的差异。这些发现加深了我们对言语WM、注意力和语言之间的相对联系的理解。我们得出的结论是,在决定言语WM的评估时,特别是在需要语言的领域的干预研究中,考虑任务的语言需求是很重要的。
{"title":"Relative Contribution of Verbal Working Memory and Attention to Child Language","authors":"Jason C. Chow, E. Ekholm, Christine L. Bae","doi":"10.1177/1534508420946361","DOIUrl":"https://doi.org/10.1177/1534508420946361","url":null,"abstract":"It is common in intervention research to use measures of working memory either as an explanatory or a control variable. This study examines the contribution of cognitive abilities, including verbal working memory (WM) and attention, to language performance in first- and second-grade children. We assessed children (N = 414) on two forms of verbal WM, one attention, and two standardized assessments of language. Scores from all three measures of cognitive abilities significantly predicted latent language (64% variance). Both verbal WM measures were stronger predictors of a latent language variable compared to attention. Exploratory analyses revealed differences in the role of cognitive variables to language subdomains. The findings deepen our understanding of the relative associations between verbal WM, attention, and language. We conclude that it is important to consider the language demands of tasks when making decisions about assessment of verbal WM, specifically in the context of intervention research in domains that require language.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420946361","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49457998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A Comparison of Teacher and Student Ratings in a Self-Monitoring Intervention 自我监控干预中教师和学生评分的比较
IF 1.3 Q2 Social Sciences Pub Date : 2020-08-04 DOI: 10.1177/1534508420944231
A. Bruhn, Sheila Barron, Bailey A. Copeland, Sara Estrapala, A. Rila, J. Wehby
Self-monitoring interventions for students with challenging behavior are often teacher-managed rather than self-managed. Teachers direct these interventions by completing parallel monitoring procedures, providing feedback, and delivering contingent reinforcement to students when they monitor accurately. However, within self-monitoring interventions, the degree to which teachers and students agree in their assessment of students’ behavior is unknown. In this study, a self-monitoring intervention in which both teachers and students rated the students’ behavior, we analyzed 249 fixed interval ratings of behavior from 19 student/teacher pairs to determine the relationship between ratings within and across teacher/student pairs. We found a strong correlation overall (r =.91), although variability existed within individual pairs and student ratings tended to be higher than teacher ratings. We discuss implications for practice, limitations, and future directions.
针对具有挑战性行为的学生的自我监控干预措施通常由教师管理,而不是自我管理。教师通过完成平行的监测程序、提供反馈以及在学生准确监测时向他们提供临时增援来指导这些干预措施。然而,在自我监控干预中,教师和学生在评估学生行为时的一致程度是未知的。在这项自我监测干预研究中,教师和学生都对学生的行为进行了评分,我们分析了19对学生/教师的249个固定区间行为评分,以确定教师/学生对内和跨教师/学生组的评分之间的关系。我们发现总体上有很强的相关性(r=.91),尽管个别配对中存在差异,学生评分往往高于教师评分。我们讨论了对实践、局限性和未来方向的影响。
{"title":"A Comparison of Teacher and Student Ratings in a Self-Monitoring Intervention","authors":"A. Bruhn, Sheila Barron, Bailey A. Copeland, Sara Estrapala, A. Rila, J. Wehby","doi":"10.1177/1534508420944231","DOIUrl":"https://doi.org/10.1177/1534508420944231","url":null,"abstract":"Self-monitoring interventions for students with challenging behavior are often teacher-managed rather than self-managed. Teachers direct these interventions by completing parallel monitoring procedures, providing feedback, and delivering contingent reinforcement to students when they monitor accurately. However, within self-monitoring interventions, the degree to which teachers and students agree in their assessment of students’ behavior is unknown. In this study, a self-monitoring intervention in which both teachers and students rated the students’ behavior, we analyzed 249 fixed interval ratings of behavior from 19 student/teacher pairs to determine the relationship between ratings within and across teacher/student pairs. We found a strong correlation overall (r =.91), although variability existed within individual pairs and student ratings tended to be higher than teacher ratings. We discuss implications for practice, limitations, and future directions.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420944231","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47266120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Using Interactive E-Book User Log Variables to Track Reading Processes and Predict Digital Learning Outcomes 使用交互式电子书用户日志变量跟踪阅读过程并预测数字学习结果
IF 1.3 Q2 Social Sciences Pub Date : 2020-07-27 DOI: 10.1177/1534508420941935
Dandan Yang, Elham Zargar, A. Adams, Stephanie L. Day, C. Connor
Stealth assessment has been successfully embedded in educational games to measure students’ learning in an unobtrusive and supportive way. This study explored the possibility of applying stealth assessment in a digital reading platform and sought to identify potential in-system indicators of students’ digital learning outcomes. Utilizing the user log data from third- to fifth-grade students (n = 573) who read an interactive Word Knowledge E-Book, we examined various user log variables and their associations with word knowledge and strategic reading outcomes. Descriptive analysis provided a depiction of the real-time reading processes and behaviors in which students engaged while digitally reading. Multiple regression analysis with classroom fixed effects demonstrated that user log variables relevant to answering questions and making decisions (i.e., percentage of embedded questions answered correctly; number of attempts to answer the questions; and making implausible decisions) were significantly associated with students’ word knowledge and strategic reading outcomes. Variables indicating reading time and frequency, however, were not significantly associated with these outcomes. This study highlights the potential of interactive e-books as another digital learning environment to establish stealth assessment, which may allow researchers and educators to track students’ reading processes and predict reading outcomes while supporting digital learning.
隐形评估已经成功地嵌入到教育游戏中,以一种不引人注目和支持性的方式衡量学生的学习情况。本研究探讨了在数字阅读平台中应用隐形评估的可能性,并试图确定学生数字学习成果的潜在系统指标。利用阅读交互式单词知识电子书的三至五年级学生(n=573)的用户日志数据,我们研究了各种用户日志变量及其与单词知识和策略阅读结果的关系。描述性分析描述了学生在数字阅读时的实时阅读过程和行为。具有课堂固定效应的多元回归分析表明,与回答问题和决策相关的用户日志变量(即正确回答嵌入问题的百分比;回答问题的尝试次数;以及做出令人难以置信的决策)与学生的单词知识和策略阅读结果显著相关。然而,指示阅读时间和频率的变量与这些结果没有显著关联。这项研究强调了互动电子书作为另一种建立隐形评估的数字学习环境的潜力,这可能使研究人员和教育工作者能够跟踪学生的阅读过程并预测阅读结果,同时支持数字学习。
{"title":"Using Interactive E-Book User Log Variables to Track Reading Processes and Predict Digital Learning Outcomes","authors":"Dandan Yang, Elham Zargar, A. Adams, Stephanie L. Day, C. Connor","doi":"10.1177/1534508420941935","DOIUrl":"https://doi.org/10.1177/1534508420941935","url":null,"abstract":"Stealth assessment has been successfully embedded in educational games to measure students’ learning in an unobtrusive and supportive way. This study explored the possibility of applying stealth assessment in a digital reading platform and sought to identify potential in-system indicators of students’ digital learning outcomes. Utilizing the user log data from third- to fifth-grade students (n = 573) who read an interactive Word Knowledge E-Book, we examined various user log variables and their associations with word knowledge and strategic reading outcomes. Descriptive analysis provided a depiction of the real-time reading processes and behaviors in which students engaged while digitally reading. Multiple regression analysis with classroom fixed effects demonstrated that user log variables relevant to answering questions and making decisions (i.e., percentage of embedded questions answered correctly; number of attempts to answer the questions; and making implausible decisions) were significantly associated with students’ word knowledge and strategic reading outcomes. Variables indicating reading time and frequency, however, were not significantly associated with these outcomes. This study highlights the potential of interactive e-books as another digital learning environment to establish stealth assessment, which may allow researchers and educators to track students’ reading processes and predict reading outcomes while supporting digital learning.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420941935","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48535805","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Development and Validation of the Minnesota Inference Assessment 明尼苏达推理评估的发展与验证
IF 1.3 Q2 Social Sciences Pub Date : 2020-07-14 DOI: 10.1177/1534508420937781
Panayiota Kendeou, Kristen L. McMaster, Reese Butterfuss, Jasmine Kim, S. Slater, O. Bulut
The overall aim of the current investigation was to develop and validate the initial version of the Minnesota Inference Assessment (MIA). MIA is a web-based measure of inference processes in Grades K–2. MIA leverages the affordances of different media to evaluate inference processes in a nonreading context, using age-appropriate fiction and nonfiction videos coupled with questioning. We evaluated MIA’s technical adequacy in a proof-of-concept study. Taken together, the results support the interpretation that MIA shows promise as a valid and reliable measure of inferencing in a nonreading context for students in Grades K–2. Future directions involve further development of multiple, parallel forms that can be used for progress monitoring in K–2.
当前调查的总体目的是开发和验证明尼苏达州推理评估(MIA)的初始版本。MIA是基于网络的K-2年级推理过程的测量。MIA利用不同媒体的可视性来评估非阅读情境下的推理过程,使用适合年龄的小说和非小说视频以及提问。我们在概念验证研究中评估了MIA的技术充分性。综上所述,研究结果支持以下解释,即MIA有望成为K-2年级学生在非阅读情境下进行推理的有效和可靠的衡量标准。未来的方向包括进一步发展可用于K-2进度监测的多种并行表格。
{"title":"Development and Validation of the Minnesota Inference Assessment","authors":"Panayiota Kendeou, Kristen L. McMaster, Reese Butterfuss, Jasmine Kim, S. Slater, O. Bulut","doi":"10.1177/1534508420937781","DOIUrl":"https://doi.org/10.1177/1534508420937781","url":null,"abstract":"The overall aim of the current investigation was to develop and validate the initial version of the Minnesota Inference Assessment (MIA). MIA is a web-based measure of inference processes in Grades K–2. MIA leverages the affordances of different media to evaluate inference processes in a nonreading context, using age-appropriate fiction and nonfiction videos coupled with questioning. We evaluated MIA’s technical adequacy in a proof-of-concept study. Taken together, the results support the interpretation that MIA shows promise as a valid and reliable measure of inferencing in a nonreading context for students in Grades K–2. Future directions involve further development of multiple, parallel forms that can be used for progress monitoring in K–2.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420937781","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47937220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Addressing the Large Standard Error of Traditional CBM-R: Estimating the Conditional Standard Error of a Model-Based Estimate of CBM-R 解决传统CBM-R的大标准误差:估计基于模型的CBM-R估计的条件标准误差
IF 1.3 Q2 Social Sciences Pub Date : 2020-07-02 DOI: 10.1177/1534508420937801
Joseph F. T. Nese, Akihito Kamata
Curriculum-based measurement of oral reading fluency (CBM-R) is widely used across the country as a quick measure of reading proficiency that also serves as a good predictor of comprehension and overall reading achievement, but it has several practical and technical inadequacies, including a large standard error of measurement (SEM). Reducing the SEM of CBM-R scores has positive implications for educators using these measures to screen or monitor student growth. The purpose of this study was to compare the SEM of traditional CBM-R words correct per minute (WCPM) fluency scores and the conditional SEM (CSEM) of model-based WCPM estimates, particularly for students with or at risk of poor reading outcomes. We found (a) the average CSEM for the model-based WCPM estimates was substantially smaller than the reported SEMs of traditional CBM-R systems, especially for scores at/below the 25th percentile, and (b) a large proportion (84%) of sample scores, and an even larger proportion of scores at/below the 25th percentile (about 99%) had a smaller CSEM than the reported SEMs of traditional CBM-R systems.
基于课程的口语阅读流利度测量(CBM-R)在全国范围内广泛使用,作为阅读熟练程度的快速测量,也可以作为理解和整体阅读成绩的良好预测指标,但它存在一些实际和技术上的不足,包括测量的大标准误差(SEM)。降低CBM-R分数的SEM对教育者使用这些措施来筛选或监测学生的成长具有积极意义。本研究的目的是比较传统的CBM-R每分钟字数正确(WCPM)流畅性分数的SEM和基于模型的WCPM估计的条件SEM (CSEM),特别是对于阅读结果较差或有阅读结果风险的学生。我们发现(a)基于模型的WCPM估计的平均CSEM比传统CBM-R系统报告的ssem小得多,特别是在25百分位/以下的分数上;(b)大部分(84%)样本分数,甚至更大比例的25百分位/以下分数(约99%)的CSEM比传统CBM-R系统报告的ssem小。
{"title":"Addressing the Large Standard Error of Traditional CBM-R: Estimating the Conditional Standard Error of a Model-Based Estimate of CBM-R","authors":"Joseph F. T. Nese, Akihito Kamata","doi":"10.1177/1534508420937801","DOIUrl":"https://doi.org/10.1177/1534508420937801","url":null,"abstract":"Curriculum-based measurement of oral reading fluency (CBM-R) is widely used across the country as a quick measure of reading proficiency that also serves as a good predictor of comprehension and overall reading achievement, but it has several practical and technical inadequacies, including a large standard error of measurement (SEM). Reducing the SEM of CBM-R scores has positive implications for educators using these measures to screen or monitor student growth. The purpose of this study was to compare the SEM of traditional CBM-R words correct per minute (WCPM) fluency scores and the conditional SEM (CSEM) of model-based WCPM estimates, particularly for students with or at risk of poor reading outcomes. We found (a) the average CSEM for the model-based WCPM estimates was substantially smaller than the reported SEMs of traditional CBM-R systems, especially for scores at/below the 25th percentile, and (b) a large proportion (84%) of sample scores, and an even larger proportion of scores at/below the 25th percentile (about 99%) had a smaller CSEM than the reported SEMs of traditional CBM-R systems.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420937801","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44178479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
SSIS Performance Screening Guide as an Indicator of Behavior and Academics: A Meta-Analysis SSIS绩效筛选指南作为行为和学术指标的Meta分析
IF 1.3 Q2 Social Sciences Pub Date : 2020-06-03 DOI: 10.1177/1534508420926584
J. Sullivan, Victor Villarreal, Evette Flores, A. Gomez, Blaire S. Warren
This article documents the results of a meta-analysis of available correlational validity evidence for the Social Skills Improvement System Performance Screening Guide (SSIS-PSG), which is a brief teacher-completed rating scale designed to be used as part of universal screening procedures. Article inclusion criteria included (a) published in English in a peer-reviewed journal, (b) administration of the PSG, and (c) provided validity evidence representative of the relationship between PSG scores and scores on related variables. Ten studies yielding 147 correlation coefficients met criteria for inclusion. Data were extracted following established procedures in validity generalization and meta-analytic research. Extracted coefficients were of the expected direction and magnitude with theoretically aligned constructs, thereby providing evidence of convergent validity (e.g., PSG Math and Reading items were most strongly correlated with academic performance and academic behavior variables, with effect sizes ranging from .708 to .740; PSG Prosocial Behavior and Motivation to Learn items were most strongly correlated with broadband externalizing/internalizing problems, with effect sizes ranging from −.706 to −.717), although Prosocial Behavior and Motivation to Learn were not as effective at discriminating among divergent constructs. These results generally support the utility of the PSG in correlating with academic and social/behavioral outcomes in the schools.
本文记录了社会技能改进系统绩效筛选指南(SSIS-PSG)现有相关效度证据的荟萃分析结果,该指南是一个简短的教师完成的评分量表,旨在作为通用筛选程序的一部分。文章纳入标准包括(a)以英文发表在同行评议期刊上,(b) PSG管理,以及(c)提供代表PSG分数与相关变量分数之间关系的效度证据。有10项研究得出147个相关系数符合纳入标准。数据提取遵循既定程序的有效性推广和荟萃分析研究。提取的系数具有预期的方向和大小,理论构念一致,从而提供了收敛效度的证据(例如,PSG数学和阅读项目与学习成绩和学习行为变量的相关性最强,效应量范围为0.708至0.740;亲社会行为和学习动机项目与宽频外化/内化问题的相关性最强,效应值范围为-。706至- 0.717),尽管亲社会行为和学习动机在区分不同构念方面并不有效。这些结果普遍支持PSG与学校学业和社会/行为结果相关的效用。
{"title":"SSIS Performance Screening Guide as an Indicator of Behavior and Academics: A Meta-Analysis","authors":"J. Sullivan, Victor Villarreal, Evette Flores, A. Gomez, Blaire S. Warren","doi":"10.1177/1534508420926584","DOIUrl":"https://doi.org/10.1177/1534508420926584","url":null,"abstract":"This article documents the results of a meta-analysis of available correlational validity evidence for the Social Skills Improvement System Performance Screening Guide (SSIS-PSG), which is a brief teacher-completed rating scale designed to be used as part of universal screening procedures. Article inclusion criteria included (a) published in English in a peer-reviewed journal, (b) administration of the PSG, and (c) provided validity evidence representative of the relationship between PSG scores and scores on related variables. Ten studies yielding 147 correlation coefficients met criteria for inclusion. Data were extracted following established procedures in validity generalization and meta-analytic research. Extracted coefficients were of the expected direction and magnitude with theoretically aligned constructs, thereby providing evidence of convergent validity (e.g., PSG Math and Reading items were most strongly correlated with academic performance and academic behavior variables, with effect sizes ranging from .708 to .740; PSG Prosocial Behavior and Motivation to Learn items were most strongly correlated with broadband externalizing/internalizing problems, with effect sizes ranging from −.706 to −.717), although Prosocial Behavior and Motivation to Learn were not as effective at discriminating among divergent constructs. These results generally support the utility of the PSG in correlating with academic and social/behavioral outcomes in the schools.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420926584","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47677500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Development and Psychometric Report of a Middle-School Mathematics Vocabulary Measure 中学数学词汇量表的编制与心理测量报告
IF 1.3 Q2 Social Sciences Pub Date : 2020-06-01 DOI: 10.1177/1534508418820116
Elizabeth M. Hughes, S. R. Powell, Joo-young Lee
Proficiency with mathematics requires an understanding of mathematical language. Students are required to make sense of both spoken and written mathematical terms. An essential component of mathematical language involves the understanding of the vocabulary of mathematics in which students connect vocabulary terms to mathematical concepts or procedures. In this brief psychometric report, we developed and tested a measure of mathematics vocabulary for students in the late middle-school grades (i.e., Grades 7 and 8) to determine the reliability of such a measure and to learn how students answer questions about mathematics vocabulary terms. The vocabulary terms on the measure were those terms determined as essential by middle-school teachers for success with middle-school mathematical language. Analysis indicates the measure demonstrated high reliability and validity. Student scores were widely distributed and students, on average, only answered two-thirds of vocabulary terms correctly.
精通数学需要理解数学语言。要求学生理解口语和书面数学术语。数学语言的一个重要组成部分是理解数学词汇,学生将词汇术语与数学概念或过程联系起来。在这份简短的心理测量报告中,我们为中学后期(即7年级和8年级)的学生开发并测试了一种数学词汇测量方法,以确定这种测量方法的可靠性,并了解学生如何回答有关数学词汇的问题。测量中的词汇术语是那些被中学教师确定为成功使用中学数学语言所必需的术语。分析表明,该方法具有较高的信度和有效性。学生的成绩分布广泛,平均而言,学生只答对了三分之二的词汇。
{"title":"Development and Psychometric Report of a Middle-School Mathematics Vocabulary Measure","authors":"Elizabeth M. Hughes, S. R. Powell, Joo-young Lee","doi":"10.1177/1534508418820116","DOIUrl":"https://doi.org/10.1177/1534508418820116","url":null,"abstract":"Proficiency with mathematics requires an understanding of mathematical language. Students are required to make sense of both spoken and written mathematical terms. An essential component of mathematical language involves the understanding of the vocabulary of mathematics in which students connect vocabulary terms to mathematical concepts or procedures. In this brief psychometric report, we developed and tested a measure of mathematics vocabulary for students in the late middle-school grades (i.e., Grades 7 and 8) to determine the reliability of such a measure and to learn how students answer questions about mathematics vocabulary terms. The vocabulary terms on the measure were those terms determined as essential by middle-school teachers for success with middle-school mathematical language. Analysis indicates the measure demonstrated high reliability and validity. Student scores were widely distributed and students, on average, only answered two-thirds of vocabulary terms correctly.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508418820116","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48608217","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
期刊
ASSESSMENT FOR EFFECTIVE INTERVENTION
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1