首页 > 最新文献

ASSESSMENT FOR EFFECTIVE INTERVENTION最新文献

英文 中文
A Psychometric Analysis of the Early Identification System–Student Report in a Sample of Southwestern U.S. Students 早期识别系统的心理测量学分析——以美国西南部学生为样本
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-16 DOI: 10.1177/15345084231180224
Steven L. Powell
The Early Identification System–Student Report (EIS-SR) is a 34-item measure of social-emotional functioning that is designed to be a low-cost universal screening tool. To date, studies of the EIS-SR demonstrate promising psychometric properties, but these properties have not yet been assessed in groups of children from historically underrepresented populations. The current study seeks to help close this gap in the literature by examining the evidence of validity related to the internal structure of the EIS-SR in a sample of Grades 3 through 8 students in the southwestern United States. Analyses indicated mixed findings regarding the model fit of the EIS-SR in the obtained sample, which implies that more data regarding its measurement invariance across diverse populations are needed.
早期识别系统-学生报告(EIS-SR)是一项包含34个项目的社会情感功能测量,旨在成为一种低成本的普遍筛查工具。迄今为止,EIS-SR的研究显示了有希望的心理测量特性,但这些特性尚未在历史上代表性不足的人群中对儿童群体进行评估。目前的研究试图通过在美国西南部的3至8年级学生样本中检查与EIS-SR内部结构相关的有效性证据来帮助缩小文献中的这一差距。分析表明,在获得的样本中,关于EIS-SR的模型拟合的结果是混合的,这意味着需要更多关于其在不同人群中的测量不变性的数据。
{"title":"A Psychometric Analysis of the Early Identification System–Student Report in a Sample of Southwestern U.S. Students","authors":"Steven L. Powell","doi":"10.1177/15345084231180224","DOIUrl":"https://doi.org/10.1177/15345084231180224","url":null,"abstract":"The Early Identification System–Student Report (EIS-SR) is a 34-item measure of social-emotional functioning that is designed to be a low-cost universal screening tool. To date, studies of the EIS-SR demonstrate promising psychometric properties, but these properties have not yet been assessed in groups of children from historically underrepresented populations. The current study seeks to help close this gap in the literature by examining the evidence of validity related to the internal structure of the EIS-SR in a sample of Grades 3 through 8 students in the southwestern United States. Analyses indicated mixed findings regarding the model fit of the EIS-SR in the obtained sample, which implies that more data regarding its measurement invariance across diverse populations are needed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"217 - 222"},"PeriodicalIF":1.3,"publicationDate":"2023-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42727950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Components of a Successful Classroom: A Factor Analysis for Initial Validation of a Measure Assessing Tier One Classroom Management 成功课堂的组成部分:评估一级课堂管理措施初步验证的因素分析
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-15 DOI: 10.1177/15345084231180477
Anniette F. Maldonado, A. Fischer, Hannah Michael Wright, Rylee L. Jensen, Ashley Coombs, Sara N. Mathis, Keely M. Lundy, Alyson Funn, Leanne S. Hawken, Keith C. Radley, Lauren Perez
The literature has identified the use of data-based, problem-solving as an essential element in the promotion of positive behavior interventions and supports (PBIS) within the classroom. The Components of a Successful Classroom (CSC) tool is an instrument which has undergone initial validation to support its use for measuring critical features of Tier 1. This study provides initial support for the validation of this classroom management observation tool as part of a problem-solving consultation framework by examining the extent to which items on the CSC tool sample the constructs of interest in classroom management. Behavioral consultants utilized the tool to evaluate Tier 1 behavior management strategies implemented by teachers in the classroom. An exploratory factor analysis (EFA) was conducted to determine factor structure of the classroom management observation tool. Findings of the EFA supported a unidimensional construct best measured with three factors (i.e., preventive supports, feedback provision and engagement, and expectations and consequences). Currently, this tool may be useful to practitioners by guiding general education consultation after identifying main concerns in teacher’s implementation of Tier 1 supports and supporting implementation of PBIS practices in the classroom.
文献已经确定使用基于数据的、解决问题的方法是在课堂中促进积极行为干预和支持(PBIS)的基本要素。成功课堂的组成部分(CSC)工具是一种经过初步验证的工具,以支持其用于测量第1层的关键特征。本研究通过检验CSC工具上的项目在多大程度上抽样了课堂管理中感兴趣的构式,为课堂管理观察工具作为问题解决咨询框架的一部分的有效性提供了初步支持。行为咨询师使用该工具来评估教师在课堂上实施的第一级行为管理策略。采用探索性因素分析(EFA)确定课堂管理观察工具的因素结构。全民教育的调查结果支持一个单维结构,最好用三个因素来衡量(即,预防性支持、反馈提供和参与、期望和后果)。目前,在确定教师实施第一级支持和支持在课堂上实施PBIS实践的主要关注点后,该工具可能对从业者有用,可以指导通识教育咨询。
{"title":"Components of a Successful Classroom: A Factor Analysis for Initial Validation of a Measure Assessing Tier One Classroom Management","authors":"Anniette F. Maldonado, A. Fischer, Hannah Michael Wright, Rylee L. Jensen, Ashley Coombs, Sara N. Mathis, Keely M. Lundy, Alyson Funn, Leanne S. Hawken, Keith C. Radley, Lauren Perez","doi":"10.1177/15345084231180477","DOIUrl":"https://doi.org/10.1177/15345084231180477","url":null,"abstract":"The literature has identified the use of data-based, problem-solving as an essential element in the promotion of positive behavior interventions and supports (PBIS) within the classroom. The Components of a Successful Classroom (CSC) tool is an instrument which has undergone initial validation to support its use for measuring critical features of Tier 1. This study provides initial support for the validation of this classroom management observation tool as part of a problem-solving consultation framework by examining the extent to which items on the CSC tool sample the constructs of interest in classroom management. Behavioral consultants utilized the tool to evaluate Tier 1 behavior management strategies implemented by teachers in the classroom. An exploratory factor analysis (EFA) was conducted to determine factor structure of the classroom management observation tool. Findings of the EFA supported a unidimensional construct best measured with three factors (i.e., preventive supports, feedback provision and engagement, and expectations and consequences). Currently, this tool may be useful to practitioners by guiding general education consultation after identifying main concerns in teacher’s implementation of Tier 1 supports and supporting implementation of PBIS practices in the classroom.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42321018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring Curriculum-Based Measurement in Elementary Science: Investigating Two Vocabulary-Matching Formats 基础科学课程测量的探索:两种词汇匹配形式的考察
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-15 DOI: 10.1177/15345084231179442
Sarah J. Conoyer, Kyle Wagner, Kristen K. Janssen, Jeremy D. Jewell, Elizabeth L. W. McKenney
As content literacy intervention is expanded in schools, data-based decision-making practices need to also advance, especially in the areas of science. Vocabulary-matching curriculum-based measures (VM-CBM) may allow educators to identify students needing additional support in science vocabulary to assist with using and comprehending disciplinary language. Typically, VM-CBMs have been given in a one-page format, but there has been little investigation of modified presentation of VM items. Participants were 77 fourth grade students from a U.S. Midwestern rural school district. Students from four different classrooms were administered either typical one-page or multipage VM-CBM forms. Multipage forms produced strong alternate form reliability (r = .92, 95% confidence interval [CI] = [.85, .96]). Typical forms produced a moderate reliability coefficient (r = .58, 95% CI = [.32, .76]). Regarding concurrent validity, multipage forms were also strongly correlated (r = .71, 95% CI = [.50, .84]; r = .72, 95% CI = [.51, .85]) while typical forms were weakly correlated (r = .40, 95% CI = [.10, .64]; r = .47, 95% CI = [.17, .69]) with a standardized state science assessment. The multipage format appears promising; however, further item level analysis is needed to determine the most efficient way to screen and support students in elementary science literacy.
随着学校内容扫盲干预的扩大,基于数据的决策实践也需要推进,尤其是在科学领域。基于词汇匹配课程的测量(VM-CBM)可以让教育工作者识别出需要在科学词汇方面获得额外支持的学生,以帮助他们使用和理解学科语言。通常,VM CBM是以一页的格式给出的,但对VM项目的修改表示的研究很少。参与者是来自美国中西部农村学区的77名四年级学生。来自四个不同教室的学生接受了典型的一页或多页VM-CBM表格的管理。多阶段表格产生了很强的替代表格可靠性(r=.92,95%置信区间[CI]=[.85,.96])。典型表格产生了中等的可靠性系数(r=.58,95%可信区间=[.32,.76])。关于并发有效性,多页形式也与标准化的国家科学评估强相关(r=.71,95%CI=[0.50,.84];r=.72,95%CI=[51,.85]),而典型形式与标准化国家科学评估弱相关(r=.40,95%CI=[10,.64];r=.47,95%CI=[17,.69])。多页格式似乎很有前景;然而,还需要进一步的项目层面分析,以确定筛选和支持学生基础科学素养的最有效方法。
{"title":"Exploring Curriculum-Based Measurement in Elementary Science: Investigating Two Vocabulary-Matching Formats","authors":"Sarah J. Conoyer, Kyle Wagner, Kristen K. Janssen, Jeremy D. Jewell, Elizabeth L. W. McKenney","doi":"10.1177/15345084231179442","DOIUrl":"https://doi.org/10.1177/15345084231179442","url":null,"abstract":"As content literacy intervention is expanded in schools, data-based decision-making practices need to also advance, especially in the areas of science. Vocabulary-matching curriculum-based measures (VM-CBM) may allow educators to identify students needing additional support in science vocabulary to assist with using and comprehending disciplinary language. Typically, VM-CBMs have been given in a one-page format, but there has been little investigation of modified presentation of VM items. Participants were 77 fourth grade students from a U.S. Midwestern rural school district. Students from four different classrooms were administered either typical one-page or multipage VM-CBM forms. Multipage forms produced strong alternate form reliability (r = .92, 95% confidence interval [CI] = [.85, .96]). Typical forms produced a moderate reliability coefficient (r = .58, 95% CI = [.32, .76]). Regarding concurrent validity, multipage forms were also strongly correlated (r = .71, 95% CI = [.50, .84]; r = .72, 95% CI = [.51, .85]) while typical forms were weakly correlated (r = .40, 95% CI = [.10, .64]; r = .47, 95% CI = [.17, .69]) with a standardized state science assessment. The multipage format appears promising; however, further item level analysis is needed to determine the most efficient way to screen and support students in elementary science literacy.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"211 - 216"},"PeriodicalIF":1.3,"publicationDate":"2023-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42622029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Interventions to Increase Test Access: An Alternative to Accommodations? 使用干预措施增加考试机会:住宿的另一种选择?
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-12 DOI: 10.1177/15345084231178794
Benjamin J. Lovett, Daniel M. Fienup
Students with disabilities are often given accommodations in testing situations (e.g., extended testing time). However, for many students with high-incidence disabilities, interventions can reduce the need for these accommodations, or serve as a helpful supplement to accommodations. Applied behavior analysis provides a framework for understanding how accommodations alter testing settings, as well as for developing related interventions. We review research on evidence-based interventions that can reduce the need for five common testing accommodations: extended testing time, separate room administration, test breaks, read-aloud, and dictated response. We conclude with suggestions for changes to school-based practice as well as remaining research needs.
在考试情况下,残疾学生通常会得到一些便利(例如,延长考试时间)。然而,对于许多残疾发生率高的学生来说,干预措施可以减少对这些住宿的需求,或者作为住宿的有益补充。应用行为分析为理解住宿如何改变测试环境以及开发相关干预措施提供了一个框架。我们回顾了基于证据的干预措施的研究,这些干预措施可以减少对五种常见测试设施的需求:延长测试时间、单独的房间管理、测试休息、大声朗读和听写回答。最后,我们提出了改变校本实践的建议以及剩余的研究需求。
{"title":"Using Interventions to Increase Test Access: An Alternative to Accommodations?","authors":"Benjamin J. Lovett, Daniel M. Fienup","doi":"10.1177/15345084231178794","DOIUrl":"https://doi.org/10.1177/15345084231178794","url":null,"abstract":"Students with disabilities are often given accommodations in testing situations (e.g., extended testing time). However, for many students with high-incidence disabilities, interventions can reduce the need for these accommodations, or serve as a helpful supplement to accommodations. Applied behavior analysis provides a framework for understanding how accommodations alter testing settings, as well as for developing related interventions. We review research on evidence-based interventions that can reduce the need for five common testing accommodations: extended testing time, separate room administration, test breaks, read-aloud, and dictated response. We conclude with suggestions for changes to school-based practice as well as remaining research needs.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45811643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Assessment for Equity: Exploring How Secondary Educators’ Utilize Classroom Management and Assessment Practices to Sustain Student Identities 公平评估:探索中等教育者如何利用课堂管理和评估实践来维持学生身份
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-04 DOI: 10.1177/15345084231178788
Lindsay E. Romano
Disparities in school discipline across lines of race and disability status represent one of the most pressing issues in the field of education today. While there are many factors that perpetuate these disparities, teachers and their approaches to classroom management likely play a role. As evidence emerges on the relationship between race, disability status, and the use of punitive discipline at a national level, less is known about the ways in which teachers’ approaches to classroom management and classroom management assessment influence these trends at the classroom level. This article addresses this by exploring findings from a qualitative study examining classroom management approaches across five focus groups consisting of 25 educators to identify how educators’ management and assessment practices sustain the identities of their students. Based on these findings, recommendations for future research and practice are discussed.
不同种族和残疾状况的学校纪律差异是当今教育领域最紧迫的问题之一。虽然有许多因素使这些差异长期存在,但教师及其课堂管理方法可能会发挥作用。随着种族、残疾状况和国家层面惩罚性纪律使用之间关系的证据出现,人们对教师的课堂管理和课堂管理评估方法在课堂层面影响这些趋势的方式知之甚少。本文通过探索一项定性研究的结果来解决这一问题,该研究考察了由25名教育工作者组成的五个重点小组的课堂管理方法,以确定教育工作者的管理和评估实践如何维持学生的身份。基于这些发现,讨论了未来研究和实践的建议。
{"title":"Assessment for Equity: Exploring How Secondary Educators’ Utilize Classroom Management and Assessment Practices to Sustain Student Identities","authors":"Lindsay E. Romano","doi":"10.1177/15345084231178788","DOIUrl":"https://doi.org/10.1177/15345084231178788","url":null,"abstract":"Disparities in school discipline across lines of race and disability status represent one of the most pressing issues in the field of education today. While there are many factors that perpetuate these disparities, teachers and their approaches to classroom management likely play a role. As evidence emerges on the relationship between race, disability status, and the use of punitive discipline at a national level, less is known about the ways in which teachers’ approaches to classroom management and classroom management assessment influence these trends at the classroom level. This article addresses this by exploring findings from a qualitative study examining classroom management approaches across five focus groups consisting of 25 educators to identify how educators’ management and assessment practices sustain the identities of their students. Based on these findings, recommendations for future research and practice are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"1 1","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41916713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Preliminary Investigation of a Brief Tier 1 Classroom Management Measure 浅谈一级课堂管理措施
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-06-03 DOI: 10.1177/15345084231175511
Allison F. Gilmour, J. Wehby, J. Boyle, Howard P. Wills, Paul Caldarella
Multitiered systems for supporting students’ behavior in schools rely on teachers using generally effective classroom management strategies, Tier 1 practices. However, few tools exist to easily assess classwide Tier 1 practices. In this brief report, we describe one potential tool, the Classroom Atmosphere Rating Scale–Brief (CARS-B), and assess the properties of the tool using item response theory and multilevel models. We found that most items on the CARS-B had acceptable discriminations and difficulty estimates. Teachers’ CARS-B latent scores were positively associated with student group on-task. We discuss potential changes to the CARS-B and its use in research and practice.
支持学校学生行为的多层系统依赖于教师使用普遍有效的课堂管理策略,即第一层实践。然而,很少有工具能够轻松地评估类范围内的Tier 1实践。在这篇简短的报告中,我们描述了一个潜在的工具,课堂气氛评定量表-简要(CARS-B),并使用项目反应理论和多层次模型评估该工具的特性。我们发现CARS-B上的大多数项目具有可接受的区分和难度估计。教师的CARS-B潜分与学生组的任务正相关。我们讨论了car - b的潜在变化及其在研究和实践中的应用。
{"title":"A Preliminary Investigation of a Brief Tier 1 Classroom Management Measure","authors":"Allison F. Gilmour, J. Wehby, J. Boyle, Howard P. Wills, Paul Caldarella","doi":"10.1177/15345084231175511","DOIUrl":"https://doi.org/10.1177/15345084231175511","url":null,"abstract":"Multitiered systems for supporting students’ behavior in schools rely on teachers using generally effective classroom management strategies, Tier 1 practices. However, few tools exist to easily assess classwide Tier 1 practices. In this brief report, we describe one potential tool, the Classroom Atmosphere Rating Scale–Brief (CARS-B), and assess the properties of the tool using item response theory and multilevel models. We found that most items on the CARS-B had acceptable discriminations and difficulty estimates. Teachers’ CARS-B latent scores were positively associated with student group on-task. We discuss potential changes to the CARS-B and its use in research and practice.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45308454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examining the Psychometric Integrity of the Social Skills Improvement System Teacher Rating Scale Scores for a Sample of Preschool-Age Children 检验学前儿童社会技能改善系统教师评定量表得分的心理测量完整性
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-05-22 DOI: 10.1177/15345084231174924
Ke Huang, M. Conroy, Patricia A. Snyder, David I. Miller, K. Sutherland
The Social Skills Improvement System–Teacher Rating Scale (SSIS-TRS) has been widely used to measure the social skills and behaviors of children and adolescents that are challenging. Studies examining the psychometric properties of the SSIS-TRS have been conducted, but the dimensional structure and item properties of the SSIS-TRS have not been extensively examined with samples of preschool-age children at risk for social-emotional and behavioral difficulties. This current study was designed to examine (a) the dimensional structure of the Social Skills scale and Problem Behaviors scale of the SSIS-TRS and (b) the item function of the SSIS-TRS using item response theory analyses with data collected from teachers of a sample of 469 preschool-age children at risk for social–emotional and behavioral difficulties. A four-dimensional structure (i.e., Cooperation, Empathy and Relationship, Engagement and Interaction, and Self-Control) and a three-dimensional structure (i.e., Aggression and Defiance, Disruptiveness and Stereotypy, and Withdrawal) were identified for the Social Skills and Problem Behaviors scales, respectively. Item parameters of the SSIS-TRS were estimated using the generalized partial credit model. Item information curves were plotted for individual items; behavior indicators providing higher information for measuring corresponding social skills and problem behaviors constructs were identified. The limitations and implications for the present study are discussed.
社会技能改进系统-教师评定量表(SSIS-TRS)已被广泛用于衡量儿童和青少年具有挑战性的社会技能和行为。已经对SSIS-TRS的心理测量特性进行了研究,但尚未对有社交情绪和行为困难风险的学龄前儿童的样本进行广泛的SSIS-TRS的维度结构和项目特性检查。本研究旨在检验(a)SSIS-TRS的社会技能量表和问题行为量表的维度结构,以及(b)SSIS-TRS的项目功能,使用项目反应理论分析,从469名有社交-情绪和行为困难风险的学龄前儿童的教师样本中收集数据。社交技能和问题行为量表分别确定了四维结构(即合作、同理心和关系、参与和互动以及自我控制)和三维结构(即攻击和蔑视、破坏性和刻板印象以及退缩)。SSIS-TRS的项目参数使用广义部分信用模型进行估计。为单个项目绘制了项目信息曲线;行为指标为测量相应的社会技能和问题行为结构提供了更高的信息。讨论了本研究的局限性和意义。
{"title":"Examining the Psychometric Integrity of the Social Skills Improvement System Teacher Rating Scale Scores for a Sample of Preschool-Age Children","authors":"Ke Huang, M. Conroy, Patricia A. Snyder, David I. Miller, K. Sutherland","doi":"10.1177/15345084231174924","DOIUrl":"https://doi.org/10.1177/15345084231174924","url":null,"abstract":"The Social Skills Improvement System–Teacher Rating Scale (SSIS-TRS) has been widely used to measure the social skills and behaviors of children and adolescents that are challenging. Studies examining the psychometric properties of the SSIS-TRS have been conducted, but the dimensional structure and item properties of the SSIS-TRS have not been extensively examined with samples of preschool-age children at risk for social-emotional and behavioral difficulties. This current study was designed to examine (a) the dimensional structure of the Social Skills scale and Problem Behaviors scale of the SSIS-TRS and (b) the item function of the SSIS-TRS using item response theory analyses with data collected from teachers of a sample of 469 preschool-age children at risk for social–emotional and behavioral difficulties. A four-dimensional structure (i.e., Cooperation, Empathy and Relationship, Engagement and Interaction, and Self-Control) and a three-dimensional structure (i.e., Aggression and Defiance, Disruptiveness and Stereotypy, and Withdrawal) were identified for the Social Skills and Problem Behaviors scales, respectively. Item parameters of the SSIS-TRS were estimated using the generalized partial credit model. Item information curves were plotted for individual items; behavior indicators providing higher information for measuring corresponding social skills and problem behaviors constructs were identified. The limitations and implications for the present study are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"190 - 200"},"PeriodicalIF":1.3,"publicationDate":"2023-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41706817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Universally Designed Accommodations on a Reading Comprehension Test: What Do They Accomplish? 阅读理解测试中通用设计的辅助工具:它们实现了什么?
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-04-28 DOI: 10.1177/15345084231170317
Leah Dembitzer, Ryan J. Kettler
To investigate the impact of universal testing accommodations on a computer-based reading comprehension test, accessibility, reliability, and validity were evaluated. Tests with and without accommodations were administered to 131 twelfth-grade students in three schools. Scores on Curriculum-Based Measurement probes determined groups of Students Without Functional Impairment ( n = 83) and Students With Functional Impairment ( n = 44) in the access skill of reading fluency. Results indicated that ability in access skills is associated with use of accommodations, and that high accessibility can assist in removing the impact of construct-irrelevant skill. No score boost or differential boost was found; validity evaluation offered meaningful results. No reliability change was found. The results of this study support child study team members individualizing accommodations to target deficits in access skills, selecting accommodations on criteria other than differential boost, and offering appropriate accommodations more universally.
为了研究通用测试对基于计算机的阅读理解测试的影响,评估了可及性、信度和效度。对三所学校的131名十二年级学生进行了有和没有住宿的测试。基于课程的测量探针的分数确定了无功能障碍学生(n = 83)和功能障碍学生(n = 44)阅读流畅性获取技能组。结果表明,获取技能的能力与住宿的使用有关,高可达性有助于消除与构建无关技能的影响。没有发现分数提升或差异提升;效度评价结果有意义。没有发现可靠性改变。本研究的结果支持儿童研究小组成员个性化住宿,针对访问技能的缺陷,根据标准选择住宿,而不是差异促进,并提供更普遍的适当住宿。
{"title":"Universally Designed Accommodations on a Reading Comprehension Test: What Do They Accomplish?","authors":"Leah Dembitzer, Ryan J. Kettler","doi":"10.1177/15345084231170317","DOIUrl":"https://doi.org/10.1177/15345084231170317","url":null,"abstract":"To investigate the impact of universal testing accommodations on a computer-based reading comprehension test, accessibility, reliability, and validity were evaluated. Tests with and without accommodations were administered to 131 twelfth-grade students in three schools. Scores on Curriculum-Based Measurement probes determined groups of Students Without Functional Impairment ( n = 83) and Students With Functional Impairment ( n = 44) in the access skill of reading fluency. Results indicated that ability in access skills is associated with use of accommodations, and that high accessibility can assist in removing the impact of construct-irrelevant skill. No score boost or differential boost was found; validity evaluation offered meaningful results. No reliability change was found. The results of this study support child study team members individualizing accommodations to target deficits in access skills, selecting accommodations on criteria other than differential boost, and offering appropriate accommodations more universally.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"1 1","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65474645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Using Audio Recordings to Reliably and Efficiently Observe Teacher Behavior Related to Explicit Instruction 利用录音可靠有效地观察教师显性教学行为
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-02-02 DOI: 10.1177/15345084221148202
L. Didion, Marissa J. Filderman, G. Roberts, Sarah A. Benz, Cassandra L. Olmstead
Rubric-based observations of pre- and inservice teachers are common practice in schools. Popular observation tools often result in minimal variation in ratings between teachers, require extensive training and time demands for raters, and provide minimal feedback for professional development. Alternatively, direct observation methods are evidenced to effectively measure instructional behaviors. Applying direct observation to audio recordings would produce quantitative scores and provide valuable feedback to teachers about their instruction. As such, the purpose of the present pilot study was to examine the reliability and efficiency of using audio recordings to measure practices related to explicit instruction. Fleiss’s kappa was modeled to determine the reliability of multiple raters. Regression and correlation examined the strength and direction of the relationship between the full length of a teacher’s lesson and the first 20 min of the lesson. Results indicate that using audio recordings is reliable with kappas ranging from .45 to .80. Based on regression analyses, the first 20 min of a teacher’s lesson is predictive of the rates of behaviors observed in a full lesson. Correlations suggest large, positive relationships between rates of behaviors in the first 20 min and the full lesson. Recommendations for future studies of audio-recorded observations and progress monitoring teacher behavior are discussed.
对在职前和在职教师的评估是学校的常见做法。流行的观察工具通常会使教师之间的评分变化最小,需要对评分者进行广泛的培训和时间需求,并为专业发展提供最少的反馈。或者,直接观察方法被证明可以有效地测量教学行为。将直接观察应用于录音将产生定量分数,并为教师提供有关其教学的宝贵反馈。因此,本试点研究的目的是检验使用录音来衡量与明确教学相关的实践的可靠性和效率。Fleiss的kappa被建模以确定多个评分者的可靠性。回归和相关性检验了教师课程的全长和课程的前20分钟之间关系的强度和方向。结果表明,使用音频记录是可靠的,kappas范围从.45到.80。基于回归分析,教师课程的前20分钟可以预测整个课程中观察到的行为率。相关性表明,前20分钟的行为率与整个课程的行为率之间存在很大的正相关关系。讨论了对未来研究录音观察和进度监控教师行为的建议。
{"title":"Using Audio Recordings to Reliably and Efficiently Observe Teacher Behavior Related to Explicit Instruction","authors":"L. Didion, Marissa J. Filderman, G. Roberts, Sarah A. Benz, Cassandra L. Olmstead","doi":"10.1177/15345084221148202","DOIUrl":"https://doi.org/10.1177/15345084221148202","url":null,"abstract":"Rubric-based observations of pre- and inservice teachers are common practice in schools. Popular observation tools often result in minimal variation in ratings between teachers, require extensive training and time demands for raters, and provide minimal feedback for professional development. Alternatively, direct observation methods are evidenced to effectively measure instructional behaviors. Applying direct observation to audio recordings would produce quantitative scores and provide valuable feedback to teachers about their instruction. As such, the purpose of the present pilot study was to examine the reliability and efficiency of using audio recordings to measure practices related to explicit instruction. Fleiss’s kappa was modeled to determine the reliability of multiple raters. Regression and correlation examined the strength and direction of the relationship between the full length of a teacher’s lesson and the first 20 min of the lesson. Results indicate that using audio recordings is reliable with kappas ranging from .45 to .80. Based on regression analyses, the first 20 min of a teacher’s lesson is predictive of the rates of behaviors observed in a full lesson. Correlations suggest large, positive relationships between rates of behaviors in the first 20 min and the full lesson. Recommendations for future studies of audio-recorded observations and progress monitoring teacher behavior are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"179 - 189"},"PeriodicalIF":1.3,"publicationDate":"2023-02-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48571737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predictors of Accessibility Tool Use on a Low-Stakes Computer-Based Math Test 可访问性工具在低风险计算机数学考试中的使用预测
IF 1.3 Q2 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2023-01-29 DOI: 10.1177/15345084231152477
S. Witmer, Emily C. Bouck
One perceived advantage of computer-based testing is that accessibility tools can be embedded within the testing format, allowing students with disabilities to use them when necessary to remove unique barriers within testing. However, an important assumption is that students activate and use the tools when needed. Initial data from large-scale computer-based testing suggest many students with disabilities are not using them; information is needed to understand why. Both computer skills and motivation are likely necessary for students to use accessibility tools; therefore, we explored whether prior computer use, math motivation, and test motivation predicted accessibility tool use on a national math test. We further explored the relationship between accessibility tool use and test performance. Accessibility tool use was relatively infrequent. Test motivation was weakly associated with text-to-speech use. Use of eliminate choice and scratchwork tools were weakly associated with performance. When combined with related empirical work, findings suggest a potential need to improve student test motivation and corresponding use of accessibility tools to improve validity of low-stakes test scores. However, given the weak relationships identified between tool use and performance, evidence-based math interventions are anticipated to be more helpful for improving math performance than mere promotion of accessibility tool use.
基于计算机的测试的一个明显优势是,无障碍工具可以嵌入测试格式中,让残疾学生在必要时使用它们来消除测试中的独特障碍。然而,一个重要的假设是,学生在需要时激活并使用这些工具。大规模计算机测试的初步数据表明,许多残疾学生没有使用它们;需要了解原因的信息。学生使用无障碍工具可能需要计算机技能和动机;因此,我们探讨了先前的计算机使用、数学动机和测试动机是否预测了国家数学测试中可访问工具的使用。我们进一步探讨了可访问性工具的使用与测试性能之间的关系。可访问性工具的使用相对较少。测试动机与语篇转换使用的相关性较弱。使用淘汰选择和scratchwork工具与性能的相关性较弱。当与相关的实证研究相结合时,研究结果表明,可能需要提高学生的考试动机,并相应地使用可访问性工具来提高低风险考试成绩的有效性。然而,鉴于工具使用和绩效之间的薄弱关系,基于证据的数学干预措施预计比仅仅促进无障碍工具的使用更有助于提高数学绩效。
{"title":"Predictors of Accessibility Tool Use on a Low-Stakes Computer-Based Math Test","authors":"S. Witmer, Emily C. Bouck","doi":"10.1177/15345084231152477","DOIUrl":"https://doi.org/10.1177/15345084231152477","url":null,"abstract":"One perceived advantage of computer-based testing is that accessibility tools can be embedded within the testing format, allowing students with disabilities to use them when necessary to remove unique barriers within testing. However, an important assumption is that students activate and use the tools when needed. Initial data from large-scale computer-based testing suggest many students with disabilities are not using them; information is needed to understand why. Both computer skills and motivation are likely necessary for students to use accessibility tools; therefore, we explored whether prior computer use, math motivation, and test motivation predicted accessibility tool use on a national math test. We further explored the relationship between accessibility tool use and test performance. Accessibility tool use was relatively infrequent. Test motivation was weakly associated with text-to-speech use. Use of eliminate choice and scratchwork tools were weakly associated with performance. When combined with related empirical work, findings suggest a potential need to improve student test motivation and corresponding use of accessibility tools to improve validity of low-stakes test scores. However, given the weak relationships identified between tool use and performance, evidence-based math interventions are anticipated to be more helpful for improving math performance than mere promotion of accessibility tool use.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46286659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
ASSESSMENT FOR EFFECTIVE INTERVENTION
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1