首页 > 最新文献

ASSESSMENT FOR EFFECTIVE INTERVENTION最新文献

英文 中文
Effects of Providing Teachers With Tools for Implementing Assessment-Based Differentiated Reading Instruction in Second Grade 为二年级教师提供工具实施基于评估的差异化阅读教学的效果
IF 1.3 Q2 Social Sciences Pub Date : 2021-05-20 DOI: 10.1177/15345084211014926
Martin T. Peters, Karin Hebbecker, Elmar Souvignier
Monitoring learning progress enables teachers to address students’ interindividual differences and to adapt instruction to students’ needs. We investigated whether using learning progress assessment (LPA) or using a combination of LPA and prepared material to help teachers implement assessment-based differentiated instruction resulted in improved reading skills for students. The study was conducted in second-grade classrooms in general primary education, and participants (N = 33 teachers and N = 619 students) were assigned to one of three conditions: a control group (CG); a first intervention group (LPA), which received LPA only; or a second intervention group (LPA-RS), which received a combination of LPA and material for differentiated reading instruction (the “reading sportsman”). At the beginning and the end of one school year, students’ reading fluency and reading comprehension were assessed. Compared with business-as-usual reading instruction (the CG), providing teachers with LPA or both LPA and prepared material did not lead to higher gains in reading competence. Furthermore, no significant differences between the LPA and LPA-RS conditions were found. Corresponding analyses for lower- and higher-achieving students also revealed no differences between the treatment groups. Results are discussed regarding the implementation of LPA and reading instruction in general education.
监测学习进度使教师能够处理学生的个体间差异,并使教学适应学生的需要。我们调查了使用学习进度评估(LPA)或LPA与准备材料的结合来帮助教师实施基于评估的差异化教学是否能提高学生的阅读技能。该研究在普通小学二年级的教室进行,参与者(N = 33名教师和N = 619名学生)被分配到三种情况中的一种:对照组(CG);第一干预组(LPA),只接受LPA;第二个干预组(LPA- rs),接受LPA和差异化阅读指导材料的组合(“阅读运动员”)。在一个学年开始和结束时,对学生的阅读流畅性和阅读理解能力进行评估。与常规阅读教学(CG)相比,为教师提供LPA或LPA和准备好的材料并没有导致阅读能力的更高提高。此外,LPA和LPA- rs条件之间没有显着差异。对成绩较差和较高的学生的相应分析也显示,在治疗组之间没有差异。讨论了在通识教育中实施LPA与阅读教学的结果。
{"title":"Effects of Providing Teachers With Tools for Implementing Assessment-Based Differentiated Reading Instruction in Second Grade","authors":"Martin T. Peters, Karin Hebbecker, Elmar Souvignier","doi":"10.1177/15345084211014926","DOIUrl":"https://doi.org/10.1177/15345084211014926","url":null,"abstract":"Monitoring learning progress enables teachers to address students’ interindividual differences and to adapt instruction to students’ needs. We investigated whether using learning progress assessment (LPA) or using a combination of LPA and prepared material to help teachers implement assessment-based differentiated instruction resulted in improved reading skills for students. The study was conducted in second-grade classrooms in general primary education, and participants (N = 33 teachers and N = 619 students) were assigned to one of three conditions: a control group (CG); a first intervention group (LPA), which received LPA only; or a second intervention group (LPA-RS), which received a combination of LPA and material for differentiated reading instruction (the “reading sportsman”). At the beginning and the end of one school year, students’ reading fluency and reading comprehension were assessed. Compared with business-as-usual reading instruction (the CG), providing teachers with LPA or both LPA and prepared material did not lead to higher gains in reading competence. Furthermore, no significant differences between the LPA and LPA-RS conditions were found. Corresponding analyses for lower- and higher-achieving students also revealed no differences between the treatment groups. Results are discussed regarding the implementation of LPA and reading instruction in general education.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2021-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/15345084211014926","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47190712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Why Does Construct Validity Matter in Measuring Implementation Fidelity? A Methodological Case Study 为什么结构有效性在衡量实现保真度中很重要?方法论案例研究
IF 1.3 Q2 Social Sciences Pub Date : 2021-03-15 DOI: 10.1177/1534508421998772
W. van Dijk, A. Huggins-Manley, Nicholas A. Gage, Holly B. Lane, Michael D. Coyne
In reading intervention research, implementation fidelity is assumed to be positively related to student outcomes, but the methods used to measure fidelity are often treated as an afterthought. Fidelity has been conceptualized and measured in many different ways, suggesting a lack of construct validity. One aspect of construct validity is the fidelity index of a measure. This methodological case study examined how different decisions in fidelity indices influence relative rank ordering of individuals on the construct of interest and influence our perception of the relation between the construct and intervention outcomes. Data for this study came from a large state-funded project to implement multi-tiered systems of support for early reading instruction. Analyses were conducted to determine whether the different fidelity indices are stable in relative rank ordering participants and if fidelity indices of dosage and adherence data influence researcher decisions on model building within a multilevel modeling framework. Results indicated that the fidelity indices resulted in different relations to outcomes with the most commonly used fidelity indices for both dosage and adherence being the worst performing. The choice of index to use should receive considerable thought during the design phase of an intervention study.
在阅读干预研究中,实施保真度被认为与学生成绩呈正相关,但用于测量保真度的方法往往被视为事后的想法。保真度已被概念化和测量在许多不同的方式,表明缺乏结构效度。构念效度的一个方面是测量的保真度指数。本方法学案例研究考察了保真度指数的不同决策如何影响个体对兴趣构念的相对等级排序,以及影响我们对兴趣构念与干预结果之间关系的感知。本研究的数据来自一个大型的国家资助项目,该项目旨在实施多层次的早期阅读教学支持系统。分析确定不同的保真度指数在相对等级排序的参与者中是否稳定,以及剂量和依从性数据的保真度指数是否影响研究者在多层次建模框架内建立模型的决策。结果表明,保真度指数与结果的关系不同,最常用的剂量和依从性保真度指数表现最差。在干预研究的设计阶段,使用指标的选择应得到充分的考虑。
{"title":"Why Does Construct Validity Matter in Measuring Implementation Fidelity? A Methodological Case Study","authors":"W. van Dijk, A. Huggins-Manley, Nicholas A. Gage, Holly B. Lane, Michael D. Coyne","doi":"10.1177/1534508421998772","DOIUrl":"https://doi.org/10.1177/1534508421998772","url":null,"abstract":"In reading intervention research, implementation fidelity is assumed to be positively related to student outcomes, but the methods used to measure fidelity are often treated as an afterthought. Fidelity has been conceptualized and measured in many different ways, suggesting a lack of construct validity. One aspect of construct validity is the fidelity index of a measure. This methodological case study examined how different decisions in fidelity indices influence relative rank ordering of individuals on the construct of interest and influence our perception of the relation between the construct and intervention outcomes. Data for this study came from a large state-funded project to implement multi-tiered systems of support for early reading instruction. Analyses were conducted to determine whether the different fidelity indices are stable in relative rank ordering participants and if fidelity indices of dosage and adherence data influence researcher decisions on model building within a multilevel modeling framework. Results indicated that the fidelity indices resulted in different relations to outcomes with the most commonly used fidelity indices for both dosage and adherence being the worst performing. The choice of index to use should receive considerable thought during the design phase of an intervention study.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2021-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508421998772","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46447335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Investigating the Psychometric Properties of the Social-Emotional Learning Scale 社会情绪学习量表的心理测量特性研究
IF 1.3 Q2 Social Sciences Pub Date : 2021-01-06 DOI: 10.1177/1534508420984522
Christopher L. Thomas, Staci M. Zolkoski, S. Sass
Educators and educational support staff are becoming increasingly aware of the importance of systematic efforts to support students’ social and emotional growth. Logically, the success of social-emotional learning programs depends upon the ability of educators to assess student’s ability to process and utilize social-emotional information and use data to guide programmatic revisions. Therefore, the purpose of the current examination was to provide evidence of the structural validity of the Social-Emotional Learning Scale (SELS), a freely available measure of social-emotional learning, within Grades 6 to 12. Students (N = 289, 48% female, 43.35% male, 61% Caucasian) completed the SELS and the Strengths and Difficulties Questionnaire. Confirmatory factor analyses of the SELS failed to support a multidimensional factor structure identified in prior investigations. The results of an exploratory factor analysis suggest a reduced 16-item version of the SELS captures a unidimensional social-emotional construct. Furthermore, our results provide evidence of the internal consistency and concurrent validity of the reduced-length version of the instrument. Our discussion highlights the implications of the findings to social and emotional learning educational efforts and promoting evidence-based practice.
教育工作者和教育支持人员越来越意识到系统努力支持学生社交和情感成长的重要性。从逻辑上讲,社会情感学习计划的成功取决于教育工作者评估学生处理和利用社会情感信息的能力,以及使用数据指导计划修订的能力。因此,本次考试的目的是为6至12年级的社会情绪学习量表(SELS)的结构有效性提供证据,SELS是一种免费提供的社会情绪学测量方法。学生(N=289,48%为女性,43.35%为男性,61%为高加索人)完成了SELS和优势与困难问卷。SELS的验证性因素分析未能支持先前调查中确定的多维因素结构。探索性因素分析的结果表明,SELS的16项缩减版本捕捉到了一维的社会情感结构。此外,我们的研究结果为该工具的缩短长度版本的内部一致性和并发有效性提供了证据。我们的讨论强调了研究结果对社会和情感学习教育工作以及促进循证实践的影响。
{"title":"Investigating the Psychometric Properties of the Social-Emotional Learning Scale","authors":"Christopher L. Thomas, Staci M. Zolkoski, S. Sass","doi":"10.1177/1534508420984522","DOIUrl":"https://doi.org/10.1177/1534508420984522","url":null,"abstract":"Educators and educational support staff are becoming increasingly aware of the importance of systematic efforts to support students’ social and emotional growth. Logically, the success of social-emotional learning programs depends upon the ability of educators to assess student’s ability to process and utilize social-emotional information and use data to guide programmatic revisions. Therefore, the purpose of the current examination was to provide evidence of the structural validity of the Social-Emotional Learning Scale (SELS), a freely available measure of social-emotional learning, within Grades 6 to 12. Students (N = 289, 48% female, 43.35% male, 61% Caucasian) completed the SELS and the Strengths and Difficulties Questionnaire. Confirmatory factor analyses of the SELS failed to support a multidimensional factor structure identified in prior investigations. The results of an exploratory factor analysis suggest a reduced 16-item version of the SELS captures a unidimensional social-emotional construct. Furthermore, our results provide evidence of the internal consistency and concurrent validity of the reduced-length version of the instrument. Our discussion highlights the implications of the findings to social and emotional learning educational efforts and promoting evidence-based practice.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2021-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420984522","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46107581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Meta-Analysis of Validity and Review of Alternate Form Reliability and Slope for Curriculum-Based Measurement in Science and Social Studies 科学与社会研究课程测量中替代形式信度和斜率的有效性Meta分析与评价
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-14 DOI: 10.1177/1534508420978457
Sarah J. Conoyer, W. Therrien, Kristen K. White
Meta-analysis was used to examine curriculum-based measurement in the content areas of social studies and science. Nineteen studies between the years of 1998 and 2020 were reviewed to determine overall mean correlation for criterion validity and examine alternate-form reliability and slope coefficients. An overall mean correlation of .59 was found for criterion validity; however, there was significant heterogeneity across studies, suggesting curriculum-based measure (CBM) format or content area may affect findings. Low to high alternative form reliability correlation coefficients were reported across CBM formats between .21 and .89. Studies investigating slopes included mostly vocabulary-matching formats and reported a range from .12 to .65 correct items per week with a mean of .34. Our findings suggest that additional research in the development of these measures in validity, reliability, and slope is warranted.
元分析用于检验社会研究和科学内容领域基于课程的测量。回顾了1998年至2020年的19项研究,以确定标准有效性的总体平均相关性,并检查替代形式的可靠性和斜率系数。标准有效性的总体平均相关性为.59;然而,研究之间存在显著的异质性,这表明基于课程的测量(CBM)格式或内容领域可能会影响研究结果。CBM格式中报告的从低到高的替代形式可靠性相关系数介于.21和.89之间。调查斜率的研究主要包括词汇匹配格式,每周报告的正确项目从.12到.65,平均值为.34。我们的研究结果表明,有必要对这些测量的有效性、可靠性和斜率进行进一步的研究。
{"title":"Meta-Analysis of Validity and Review of Alternate Form Reliability and Slope for Curriculum-Based Measurement in Science and Social Studies","authors":"Sarah J. Conoyer, W. Therrien, Kristen K. White","doi":"10.1177/1534508420978457","DOIUrl":"https://doi.org/10.1177/1534508420978457","url":null,"abstract":"Meta-analysis was used to examine curriculum-based measurement in the content areas of social studies and science. Nineteen studies between the years of 1998 and 2020 were reviewed to determine overall mean correlation for criterion validity and examine alternate-form reliability and slope coefficients. An overall mean correlation of .59 was found for criterion validity; however, there was significant heterogeneity across studies, suggesting curriculum-based measure (CBM) format or content area may affect findings. Low to high alternative form reliability correlation coefficients were reported across CBM formats between .21 and .89. Studies investigating slopes included mostly vocabulary-matching formats and reported a range from .12 to .65 correct items per week with a mean of .34. Our findings suggest that additional research in the development of these measures in validity, reliability, and slope is warranted.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420978457","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47043950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Differential Item and Test Functioning of the SRSS-IE12 Across Race, Ethnicity, Gender, and Elementary Level SRSS-IE12在种族、民族、性别和小学水平上的差异项目和测试功能
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-04 DOI: 10.1177/1534508420976830
Brian Barger, Emily C. Graybill, Andrew T. Roach, K. Lane
This study used item response theory (IRT) methods to investigate group differences in responses to the 12-item Student Risk Screening Scale–Internalizing and Externalizing (SRSS-IE12) in a sample of 3,837 U.S. elementary school students. Using factor analysis and graded response models from IRT methods, we examined the factor structure and the item and test functioning of the SRSS-IE12. The SRSS-IE12 internalizing and externalizing factors reflected the hypothesized two-factor model. IRT analyses indicated that SRSS-IE12 items and tests measure internalizing and externalizing traits similarly across students from different race, ethnicity, gender, and elementary level (K–Grade 2 vs. Grades 3–5) groups. Moreover, the mostly negligible differential item functioning (DIF) and differential test functioning (DTF) observed suggest these scales render equitable trait ratings. Collectively, the results provide further support for the SRSS-IE12 for universal screening in racially diverse elementary schools.
本研究采用项目反应理论(IRT)方法,以3837名美国小学生为样本,调查了对12个项目的学生风险筛查量表(SRSS-IE12)反应的群体差异。使用因子分析和IRT方法的分级反应模型,我们检查了SRSS-IE12的因子结构、项目和测试功能。SRSS-IE12的内化和外化因素反映了假设的双因素模型。IRT分析表明,SRSS-IE12项目和测试对来自不同种族、民族、性别和小学水平(K-2年级与3-5年级)的学生的内化和外化特征进行了类似的测量。此外,观察到的差异项目功能(DIF)和差异测试功能(DTF)大多可以忽略不计,这表明这些量表提供了公平的特质评级。总的来说,研究结果为SRSS-IE12在种族多样的小学进行普遍筛查提供了进一步的支持。
{"title":"Differential Item and Test Functioning of the SRSS-IE12 Across Race, Ethnicity, Gender, and Elementary Level","authors":"Brian Barger, Emily C. Graybill, Andrew T. Roach, K. Lane","doi":"10.1177/1534508420976830","DOIUrl":"https://doi.org/10.1177/1534508420976830","url":null,"abstract":"This study used item response theory (IRT) methods to investigate group differences in responses to the 12-item Student Risk Screening Scale–Internalizing and Externalizing (SRSS-IE12) in a sample of 3,837 U.S. elementary school students. Using factor analysis and graded response models from IRT methods, we examined the factor structure and the item and test functioning of the SRSS-IE12. The SRSS-IE12 internalizing and externalizing factors reflected the hypothesized two-factor model. IRT analyses indicated that SRSS-IE12 items and tests measure internalizing and externalizing traits similarly across students from different race, ethnicity, gender, and elementary level (K–Grade 2 vs. Grades 3–5) groups. Moreover, the mostly negligible differential item functioning (DIF) and differential test functioning (DTF) observed suggest these scales render equitable trait ratings. Collectively, the results provide further support for the SRSS-IE12 for universal screening in racially diverse elementary schools.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508420976830","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44364242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Outcome Measurement of School-Based SEL Intervention Follow-Up Studies 基于学校的SEL干预随访研究的结果测量
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-01 DOI: 10.1177/1534508419862619
Sarah K. Ura, Sara Castro-Olivo, A. d’Abreu
Recent meta-analyses confirm that social–emotional learning (SEL) interventions are effective in increasing academic, social, and emotional outcomes via direct skills instruction. With skill development serving as a primary mechanism of change in SEL interventions, we argue for the accurate measurement of skills as an important component of SEL research. Using the Collaborative for Academic, Social, and Emotional Learning (CASEL) model, we evaluate 111 studies included in a recent meta-analysis to determine the match between constructs targeted in interventions and SEL skill competency, as well as the measurement of skills and instruments used to evaluate programs. Findings indicate a general trend in the measurement of broad outcomes, rather than skills taught in programs, and limited measurement across CASEL five-competency model. Utility of measuring outcomes specific to competencies taught in intervention across SEL domains are discussed.
最近的荟萃分析证实,社会-情感学习(SEL)干预措施通过直接的技能指导有效地提高了学术、社会和情感成果。由于技能发展是SEL干预措施变化的主要机制,我们主张将技能的准确测量作为SEL研究的重要组成部分。使用学术、社会和情感学习协作(CASEL)模型,我们评估了最近一项荟萃分析中的111项研究,以确定干预措施中的目标结构与SEL技能能力之间的匹配,以及用于评估项目的技能和工具的测量。研究结果表明,衡量广泛成果的总体趋势,而不是项目中教授的技能,并且在CASEL五种能力模型中的衡量有限。讨论了在SEL领域的干预中测量特定于能力的结果的效用。
{"title":"Outcome Measurement of School-Based SEL Intervention Follow-Up Studies","authors":"Sarah K. Ura, Sara Castro-Olivo, A. d’Abreu","doi":"10.1177/1534508419862619","DOIUrl":"https://doi.org/10.1177/1534508419862619","url":null,"abstract":"Recent meta-analyses confirm that social–emotional learning (SEL) interventions are effective in increasing academic, social, and emotional outcomes via direct skills instruction. With skill development serving as a primary mechanism of change in SEL interventions, we argue for the accurate measurement of skills as an important component of SEL research. Using the Collaborative for Academic, Social, and Emotional Learning (CASEL) model, we evaluate 111 studies included in a recent meta-analysis to determine the match between constructs targeted in interventions and SEL skill competency, as well as the measurement of skills and instruments used to evaluate programs. Findings indicate a general trend in the measurement of broad outcomes, rather than skills taught in programs, and limited measurement across CASEL five-competency model. Utility of measuring outcomes specific to competencies taught in intervention across SEL domains are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508419862619","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46305877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener 检查社会,学术和情感行为风险筛查的技术充分性
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-01 DOI: 10.1177/1534508419857225
S. Whitley, Yojanna Cuenca-Carlino
Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.
许多学校试图在多层支持系统(MTSS)中识别和服务有不良心理健康结果风险的学生。MTSS内的普遍筛查需要技术上足够的工具。社会、学术和情感行为风险筛查(SAEBRS)已经作为一种技术上足够的筛查提出。研究人员考察了SAEBRS数据的因素结构、诊断准确性、标准有效性和内部一致性。然而,以往的研究并没有检验其时间稳定性,也没有在不同种族/民族的城市小学样本中复制标准效度结果。本研究以某城市小学一至五年级多种族学生为研究对象,考察了教师完成的SAEBRS量表的重测信度、收敛效度和预测效度。信度分析导致所有SAEBRS量表在四周内的重测信度系数显著。此外,配对样本t检验不显著,除了三年级情绪分量表。效度分析显示,SAEBRS评分、口语阅读流畅性和办公室纪律转诊之间存在显著的并行和预测性Pearson相关系数。讨论了研究结果的局限性和意义。
{"title":"Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener","authors":"S. Whitley, Yojanna Cuenca-Carlino","doi":"10.1177/1534508419857225","DOIUrl":"https://doi.org/10.1177/1534508419857225","url":null,"abstract":"Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508419857225","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43432366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Exploring the Influences of Assessment Method, Intervention Steps, Intervention Sessions, and Observation Timing on Treatment Fidelity Estimates 探讨评估方法、干预步骤、干预疗程及观察时间对治疗保真度估计的影响
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-01 DOI: 10.1177/1534508419857228
Melissa A. Collier‐Meek, L. Sanetti, Lindsay M. Fallon, Sandra M. Chafouleas
Treatment fidelity data are critical to evaluate intervention effectiveness, yet there are only general guidelines regarding treatment fidelity measurement. Initial investigations have found treatment fidelity data collected via direct observation to be more reliable than data collected via permanent product or self-report. However, the comparison of assessment methods is complicated by the intervention steps accounted for, observation timing, and intervention sessions accounted for, which may impact treatment fidelity estimates. In this study, we compared direct observation and permanent product data to evaluate these varied assessment and data collection decisions on treatment fidelity data estimates in three classrooms engaged in a group contingency intervention. Findings revealed that treatment fidelity estimates, in addition to being different across assessment method, are, in fact, different depending on the intervention steps assessed, intervention sessions accounted for, and observation timing. Implications for treatment fidelity assessment research, reporting in intervention research broadly, and implementation assessment in practice are described.
治疗保真度数据对评估干预效果至关重要,但目前只有关于治疗保真度测量的通用指南。初步调查发现,通过直接观察收集的治疗保真度数据比通过永久产品或自我报告收集的数据更可靠。然而,评估方法的比较由于所考虑的干预步骤、观察时间和干预疗程而变得复杂,这可能会影响治疗保真度的估计。在这项研究中,我们比较了直接观察和永久产品数据,以评估在三个参与集体应急干预的教室中对治疗保真度数据估计的各种评估和数据收集决策。研究结果显示,治疗保真度估计值除了在不同的评估方法中有所不同外,事实上也有所不同,这取决于评估的干预步骤、干预疗程和观察时间。描述了对治疗保真度评估研究、广泛干预研究中的报告以及实践中的实施评估的意义。
{"title":"Exploring the Influences of Assessment Method, Intervention Steps, Intervention Sessions, and Observation Timing on Treatment Fidelity Estimates","authors":"Melissa A. Collier‐Meek, L. Sanetti, Lindsay M. Fallon, Sandra M. Chafouleas","doi":"10.1177/1534508419857228","DOIUrl":"https://doi.org/10.1177/1534508419857228","url":null,"abstract":"Treatment fidelity data are critical to evaluate intervention effectiveness, yet there are only general guidelines regarding treatment fidelity measurement. Initial investigations have found treatment fidelity data collected via direct observation to be more reliable than data collected via permanent product or self-report. However, the comparison of assessment methods is complicated by the intervention steps accounted for, observation timing, and intervention sessions accounted for, which may impact treatment fidelity estimates. In this study, we compared direct observation and permanent product data to evaluate these varied assessment and data collection decisions on treatment fidelity data estimates in three classrooms engaged in a group contingency intervention. Findings revealed that treatment fidelity estimates, in addition to being different across assessment method, are, in fact, different depending on the intervention steps assessed, intervention sessions accounted for, and observation timing. Implications for treatment fidelity assessment research, reporting in intervention research broadly, and implementation assessment in practice are described.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508419857228","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43750273","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Distinct and Overlapping Dimensions of Reading Motivation in Commonly Used Measures in Schools 学校常用测量方法中阅读动机的不同维度和重叠维度
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-01 DOI: 10.1177/1534508418819793
S. Neugebauer, Ken A. Fujimoto
The current investigation addresses critiques about motivation terminology and instrumentation by examining together three commonly used reading motivation assessments in schools. This study explores the distinctiveness and redundancies of the constructs operationalized in these reading motivation assessments with 222 middle school students, using item response theory. Results support distinctions between constructs grounded in self-determination theory, social cognitive theory, and expectancy-value theory as well as conceptual overlap, among constructs associated with competence beliefs and social sources of motivation across different theoretical traditions. Educational benefits of multidimensional and unidimensional interpretations of reading motivation constructs covered in these instruments are discussed.
当前的调查通过检查学校中常用的三种阅读动机评估来解决对动机术语和工具的批评。本研究以222名中学生为研究对象,运用项目反应理论,探讨阅读动机评价中构念的独特性和冗余性。结果支持基于自我决定理论、社会认知理论和期望价值理论的构念之间的区别,以及不同理论传统中与能力信念和社会动机来源相关的构念之间的概念重叠。讨论了这些工具所涵盖的阅读动机结构的多维和一维解释的教育效益。
{"title":"Distinct and Overlapping Dimensions of Reading Motivation in Commonly Used Measures in Schools","authors":"S. Neugebauer, Ken A. Fujimoto","doi":"10.1177/1534508418819793","DOIUrl":"https://doi.org/10.1177/1534508418819793","url":null,"abstract":"The current investigation addresses critiques about motivation terminology and instrumentation by examining together three commonly used reading motivation assessments in schools. This study explores the distinctiveness and redundancies of the constructs operationalized in these reading motivation assessments with 222 middle school students, using item response theory. Results support distinctions between constructs grounded in self-determination theory, social cognitive theory, and expectancy-value theory as well as conceptual overlap, among constructs associated with competence beliefs and social sources of motivation across different theoretical traditions. Educational benefits of multidimensional and unidimensional interpretations of reading motivation constructs covered in these instruments are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508418819793","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41420811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Is a Picture Worth 1,000 Words? Investigating Fraction Magnitude Knowledge Through Analysis of Student Representations 一张图片抵得上千言万语吗?通过分析学生表征调查分数量级知识
IF 1.3 Q2 Social Sciences Pub Date : 2020-12-01 DOI: 10.1177/1534508418820697
Stephanie Morano, P. Riccomini
The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction knowledge are also investigated. Results show that students used circular area models most frequently to represent the NAEP item, but used bar models most accurately. Based on results, bar models may be the most efficient and effective area model VRs for use in fractions instruction. Representation quality was associated with problem-solving accuracy, as well as with performance on fraction number line estimation and fraction magnitude comparison. Implications for practice are discussed.
本研究考察了有学习障碍和数学困难的中学生对国家教育进步评估(NAEP)中一个公开分数项目的视觉表征的特征和质量。虚拟现实质量与分数知识的其他措施得分之间的关系也进行了调查。结果表明,学生最常使用圆形面积模型来表示NAEP项目,但最准确地使用条形模型。基于结果,条形模型可能是在分数教学中使用的最有效的面积模型vr。表征质量与解决问题的准确性以及分数数轴估计和分数大小比较的表现有关。讨论了对实践的启示。
{"title":"Is a Picture Worth 1,000 Words? Investigating Fraction Magnitude Knowledge Through Analysis of Student Representations","authors":"Stephanie Morano, P. Riccomini","doi":"10.1177/1534508418820697","DOIUrl":"https://doi.org/10.1177/1534508418820697","url":null,"abstract":"The present study examines the features and quality of visual representations (VRs) created by middle school students with learning disabilities and difficulties in mathematics in response to a released fraction item from the National Assessment of Educational Progress (NAEP). Relations between VR quality and scores on other measures of fraction knowledge are also investigated. Results show that students used circular area models most frequently to represent the NAEP item, but used bar models most accurately. Based on results, bar models may be the most efficient and effective area model VRs for use in fractions instruction. Representation quality was associated with problem-solving accuracy, as well as with performance on fraction number line estimation and fraction magnitude comparison. Implications for practice are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1534508418820697","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44378502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
期刊
ASSESSMENT FOR EFFECTIVE INTERVENTION
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1