Pub Date : 2023-02-02DOI: 10.1177/15345084221148202
L. Didion, Marissa J. Filderman, G. Roberts, Sarah A. Benz, Cassandra L. Olmstead
Rubric-based observations of pre- and inservice teachers are common practice in schools. Popular observation tools often result in minimal variation in ratings between teachers, require extensive training and time demands for raters, and provide minimal feedback for professional development. Alternatively, direct observation methods are evidenced to effectively measure instructional behaviors. Applying direct observation to audio recordings would produce quantitative scores and provide valuable feedback to teachers about their instruction. As such, the purpose of the present pilot study was to examine the reliability and efficiency of using audio recordings to measure practices related to explicit instruction. Fleiss’s kappa was modeled to determine the reliability of multiple raters. Regression and correlation examined the strength and direction of the relationship between the full length of a teacher’s lesson and the first 20 min of the lesson. Results indicate that using audio recordings is reliable with kappas ranging from .45 to .80. Based on regression analyses, the first 20 min of a teacher’s lesson is predictive of the rates of behaviors observed in a full lesson. Correlations suggest large, positive relationships between rates of behaviors in the first 20 min and the full lesson. Recommendations for future studies of audio-recorded observations and progress monitoring teacher behavior are discussed.
{"title":"Using Audio Recordings to Reliably and Efficiently Observe Teacher Behavior Related to Explicit Instruction","authors":"L. Didion, Marissa J. Filderman, G. Roberts, Sarah A. Benz, Cassandra L. Olmstead","doi":"10.1177/15345084221148202","DOIUrl":"https://doi.org/10.1177/15345084221148202","url":null,"abstract":"Rubric-based observations of pre- and inservice teachers are common practice in schools. Popular observation tools often result in minimal variation in ratings between teachers, require extensive training and time demands for raters, and provide minimal feedback for professional development. Alternatively, direct observation methods are evidenced to effectively measure instructional behaviors. Applying direct observation to audio recordings would produce quantitative scores and provide valuable feedback to teachers about their instruction. As such, the purpose of the present pilot study was to examine the reliability and efficiency of using audio recordings to measure practices related to explicit instruction. Fleiss’s kappa was modeled to determine the reliability of multiple raters. Regression and correlation examined the strength and direction of the relationship between the full length of a teacher’s lesson and the first 20 min of the lesson. Results indicate that using audio recordings is reliable with kappas ranging from .45 to .80. Based on regression analyses, the first 20 min of a teacher’s lesson is predictive of the rates of behaviors observed in a full lesson. Correlations suggest large, positive relationships between rates of behaviors in the first 20 min and the full lesson. Recommendations for future studies of audio-recorded observations and progress monitoring teacher behavior are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2023-02-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48571737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-29DOI: 10.1177/15345084231152477
S. Witmer, Emily C. Bouck
One perceived advantage of computer-based testing is that accessibility tools can be embedded within the testing format, allowing students with disabilities to use them when necessary to remove unique barriers within testing. However, an important assumption is that students activate and use the tools when needed. Initial data from large-scale computer-based testing suggest many students with disabilities are not using them; information is needed to understand why. Both computer skills and motivation are likely necessary for students to use accessibility tools; therefore, we explored whether prior computer use, math motivation, and test motivation predicted accessibility tool use on a national math test. We further explored the relationship between accessibility tool use and test performance. Accessibility tool use was relatively infrequent. Test motivation was weakly associated with text-to-speech use. Use of eliminate choice and scratchwork tools were weakly associated with performance. When combined with related empirical work, findings suggest a potential need to improve student test motivation and corresponding use of accessibility tools to improve validity of low-stakes test scores. However, given the weak relationships identified between tool use and performance, evidence-based math interventions are anticipated to be more helpful for improving math performance than mere promotion of accessibility tool use.
{"title":"Predictors of Accessibility Tool Use on a Low-Stakes Computer-Based Math Test","authors":"S. Witmer, Emily C. Bouck","doi":"10.1177/15345084231152477","DOIUrl":"https://doi.org/10.1177/15345084231152477","url":null,"abstract":"One perceived advantage of computer-based testing is that accessibility tools can be embedded within the testing format, allowing students with disabilities to use them when necessary to remove unique barriers within testing. However, an important assumption is that students activate and use the tools when needed. Initial data from large-scale computer-based testing suggest many students with disabilities are not using them; information is needed to understand why. Both computer skills and motivation are likely necessary for students to use accessibility tools; therefore, we explored whether prior computer use, math motivation, and test motivation predicted accessibility tool use on a national math test. We further explored the relationship between accessibility tool use and test performance. Accessibility tool use was relatively infrequent. Test motivation was weakly associated with text-to-speech use. Use of eliminate choice and scratchwork tools were weakly associated with performance. When combined with related empirical work, findings suggest a potential need to improve student test motivation and corresponding use of accessibility tools to improve validity of low-stakes test scores. However, given the weak relationships identified between tool use and performance, evidence-based math interventions are anticipated to be more helpful for improving math performance than mere promotion of accessibility tool use.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2023-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46286659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-23DOI: 10.1177/15345084221138947
E. Dowdy, M. Furlong, Karen Nylund-Gibson, Dina A N Arch, T. Hinton, D. Carter
The original Social Emotional Distress Survey–Secondary (SEDS-S) assesses adolescents’ past month’s experiences of psychological distress. Given the continued need for and use of brief measures of student social-emotional distress, this study examined a five-item version (SEDS-S-Brief) to evaluate its use for surveillance of adolescents’ wellness in schools. Three samples completed the SEDS-S-Brief. Sample 1 was a cross-sectional sample of 105,771 students from 113 California secondary schools; responses were used to examine validity evidence based on internal structure. Sample 2 consisted of 10,770 secondary students who also completed the Social Emotional Health Survey-Secondary-2020, Mental Health Continuum–Short Form, Multidimensional Student Life Satisfaction Scale, and selected Youth Risk Behavior Surveillance items (chronic sadness and suicidal ideation). Sample 2 responses examined validity evidence based on relations to other variables. Sample 3 consisted of 773 secondary students who completed the SEDS-S-Brief annually for 3 years, providing response stability coefficients. The SEDS-S-Brief was invariant across students based on sex, grade level, and Latinx status, supporting its use across diverse groups in schools. Additional analyses indicated moderate to strong convergent and discriminant validity characteristics and 1- and 2-year temporal stability. The findings advance the field toward comprehensive mental health surveillance practices to inform services for youth in schools.
最初的社会情绪困扰调查-二级(SEDS-S)评估青少年过去一个月的心理困扰经历。鉴于对学生社会情绪困扰的简短测量的持续需求和使用，本研究检验了一个五项版本(SEDS-S-Brief)来评估其在学校青少年健康监测中的应用。三个样本完成了SEDS-S-Brief。样本1是来自113所加州中学的105771名学生的横截面样本;回应被用来检验基于内部结构的效度证据。样本2由10770名中学生组成，他们还完成了《社会情绪健康调查-中学-2020》、《心理健康连续简表》、《多维学生生活满意度量表》和选定的青少年危险行为监测项目(慢性悲伤和自杀意念)。样本2的回答基于与其他变量的关系来检验有效性证据。样本3由773名中学生组成，他们连续3年每年完成sds - s - brief，提供响应稳定性系数。SEDS-S-Brief在性别、年级水平和拉丁裔学生中是不变的，支持在学校不同群体中使用。额外的分析表明，中度到强的收敛和判别效度特征和1年和2年的时间稳定性。研究结果推动了该领域全面的心理健康监测实践，为学校青少年服务提供信息。
{"title":"Validating a Brief Student Distress Measure For Schoolwide Wellness Surveillance","authors":"E. Dowdy, M. Furlong, Karen Nylund-Gibson, Dina A N Arch, T. Hinton, D. Carter","doi":"10.1177/15345084221138947","DOIUrl":"https://doi.org/10.1177/15345084221138947","url":null,"abstract":"The original Social Emotional Distress Survey–Secondary (SEDS-S) assesses adolescents’ past month’s experiences of psychological distress. Given the continued need for and use of brief measures of student social-emotional distress, this study examined a five-item version (SEDS-S-Brief) to evaluate its use for surveillance of adolescents’ wellness in schools. Three samples completed the SEDS-S-Brief. Sample 1 was a cross-sectional sample of 105,771 students from 113 California secondary schools; responses were used to examine validity evidence based on internal structure. Sample 2 consisted of 10,770 secondary students who also completed the Social Emotional Health Survey-Secondary-2020, Mental Health Continuum–Short Form, Multidimensional Student Life Satisfaction Scale, and selected Youth Risk Behavior Surveillance items (chronic sadness and suicidal ideation). Sample 2 responses examined validity evidence based on relations to other variables. Sample 3 consisted of 773 secondary students who completed the SEDS-S-Brief annually for 3 years, providing response stability coefficients. The SEDS-S-Brief was invariant across students based on sex, grade level, and Latinx status, supporting its use across diverse groups in schools. Additional analyses indicated moderate to strong convergent and discriminant validity characteristics and 1- and 2-year temporal stability. The findings advance the field toward comprehensive mental health surveillance practices to inform services for youth in schools.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42155197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-03DOI: 10.1177/15345084221133730
Erica N. Mason, E. Lembke
Replication studies in special education are necessary to strengthen the foundation upon which instruction and intervention for students with disabilities are built. J. Jenkins et al. (2017) found intermittent reading fluency progress monitoring schedules did not delay decision-making and were similar in decision-making accuracy to the traditional weekly progress monitoring schedule. Results of the current pilot study, although underpowered, conceptually replicated the original claims and extended their work by investigating their questions in the area of mathematics computation. Implications for research and practice are shared.
{"title":"Weekly Versus Intermittent Progress Monitoring in Mathematics: A Conceptual Replication and Pilot Study","authors":"Erica N. Mason, E. Lembke","doi":"10.1177/15345084221133730","DOIUrl":"https://doi.org/10.1177/15345084221133730","url":null,"abstract":"Replication studies in special education are necessary to strengthen the foundation upon which instruction and intervention for students with disabilities are built. J. Jenkins et al. (2017) found intermittent reading fluency progress monitoring schedules did not delay decision-making and were similar in decision-making accuracy to the traditional weekly progress monitoring schedule. Results of the current pilot study, although underpowered, conceptually replicated the original claims and extended their work by investigating their questions in the area of mathematics computation. Implications for research and practice are shared.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44892945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-11-02DOI: 10.1177/15345084221133559
Milena A. Keller-Margulis, M. Matta, Lindsey Landry Pierce, Katherine Zopatti, Erin K. Reid, G. T. Schanding
Measuring and identifying risk for reading difficulties at the kindergarten level is necessary for providing intervention as early as possible. The purpose of this study was to examine concurrent validity evidence of two kindergarten reading screeners, Acadience Reading and Texas Primary Reading Inventory (TPRI), as well as diagnostic accuracy at different performance levels on the Woodcock-Johnson IV (WJ IV) Reading Cluster and across (N = 96) emergent bilingual and monolingual English learners in kindergarten. Findings indicated moderate correlations between Acadience Reading and TPRI with the WJ IV. Diagnostic accuracy results showed screening measures were inadequate when predicting WJ IV performance above 90 SS (standard score), but results improved for almost all measures and student groups when the threshold for performance was lowered to 80 SS. Acadience Reading Below Benchmark (AR BB) offered the lowest overall accuracy for emerging bilingual (EB) students. Implications for efficient and accurate use of reading screeners in schools are discussed.
在幼儿园阶段测量和识别阅读困难的风险对于尽早提供干预是必要的。本研究的目的是检验两种幼儿园阅读筛选器——学术阅读和德州初级阅读量表(TPRI)的并发效度证据，以及在Woodcock-Johnson IV (WJ IV)阅读聚类和(N = 96)幼儿园新兴双语和单语英语学习者不同表现水平上的诊断准确性。研究结果表明，学术阅读和TPRI与WJ IV之间存在中度相关性。诊断准确性结果显示，在预测WJ IV成绩高于90分(标准分数)时，筛选措施是不充分的，但当表现阈值降低到80分时，几乎所有措施和学生群体的结果都有所改善。学术阅读低于基准(AR BB)为新兴双语(EB)学生提供了最低的总体准确性。讨论了在学校中有效和准确地使用阅读筛选器的意义。
{"title":"A Comparison of Reading Screeners in Kindergarten: The Texas Primary Reading Inventory and Acadience Reading With English Learners and Monolingual English Speakers","authors":"Milena A. Keller-Margulis, M. Matta, Lindsey Landry Pierce, Katherine Zopatti, Erin K. Reid, G. T. Schanding","doi":"10.1177/15345084221133559","DOIUrl":"https://doi.org/10.1177/15345084221133559","url":null,"abstract":"Measuring and identifying risk for reading difficulties at the kindergarten level is necessary for providing intervention as early as possible. The purpose of this study was to examine concurrent validity evidence of two kindergarten reading screeners, Acadience Reading and Texas Primary Reading Inventory (TPRI), as well as diagnostic accuracy at different performance levels on the Woodcock-Johnson IV (WJ IV) Reading Cluster and across (N = 96) emergent bilingual and monolingual English learners in kindergarten. Findings indicated moderate correlations between Acadience Reading and TPRI with the WJ IV. Diagnostic accuracy results showed screening measures were inadequate when predicting WJ IV performance above 90 SS (standard score), but results improved for almost all measures and student groups when the threshold for performance was lowered to 80 SS. Acadience Reading Below Benchmark (AR BB) offered the lowest overall accuracy for emerging bilingual (EB) students. Implications for efficient and accurate use of reading screeners in schools are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43365295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-09-02DOI: 10.1177/15345084221119418
Michael W. Bahr, Mary Edwin, Kara A. Long
This study focused on the development of the Multi-Tiered Systems of Support–Sustainability Scale (MTSS-SS). Review of the literature identified factors associated with sustainability for multi-tie...
{"title":"Development of a Brief Measure for MTSS Sustainability","authors":"Michael W. Bahr, Mary Edwin, Kara A. Long","doi":"10.1177/15345084221119418","DOIUrl":"https://doi.org/10.1177/15345084221119418","url":null,"abstract":"This study focused on the development of the Multi-Tiered Systems of Support–Sustainability Scale (MTSS-SS). Review of the literature identified factors associated with sustainability for multi-tie...","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138540412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-25DOI: 10.1177/15345084221118316
Wesley A. Sims, Rondy Yu, Kathleen R King, Danielle Zahn, Nina Mandracchia, Elissa M. Monteiro, Melissa Klaib
Classroom management (CM) practices have a well-established, intuitive, and empirical connection with student academic, social, emotional, and behavioral outcomes. CM, defined as educator practices used to create supportive classroom environments, may be the implementation factor that is most impactful of the universal Tier I supports. Recognizing the importance of CM and existing deficiencies in pre- and in-service training for teachers, schools are increasingly turning to data-driven professional development activities as a solution. The current study continues the validation process of the Direct Behavior Rating-Classroom Management (DBR-CM), an efficient and flexible measure of teacher CM practices in secondary school settings. Data were collected from 140 U.S. Midwest middle and high school classrooms. Results found DBR-CM scores to be significantly correlated with several scores on concurrently completed measures of CM, including those that rely on systematic direct observation and rating scales. Findings continue the accumulation of validity evidence to address extrapolation, generalization, and theory-based inferences underlying the interpretation and intended uses of the DBR-CM. Results are promising and build on previous DBR-CM validation work. Limitations and implications are discussed.
{"title":"Measuring Classroom Management in Secondary Settings: Ongoing Validation of the Direct Behavior Rating-Classroom Management","authors":"Wesley A. Sims, Rondy Yu, Kathleen R King, Danielle Zahn, Nina Mandracchia, Elissa M. Monteiro, Melissa Klaib","doi":"10.1177/15345084221118316","DOIUrl":"https://doi.org/10.1177/15345084221118316","url":null,"abstract":"Classroom management (CM) practices have a well-established, intuitive, and empirical connection with student academic, social, emotional, and behavioral outcomes. CM, defined as educator practices used to create supportive classroom environments, may be the implementation factor that is most impactful of the universal Tier I supports. Recognizing the importance of CM and existing deficiencies in pre- and in-service training for teachers, schools are increasingly turning to data-driven professional development activities as a solution. The current study continues the validation process of the Direct Behavior Rating-Classroom Management (DBR-CM), an efficient and flexible measure of teacher CM practices in secondary school settings. Data were collected from 140 U.S. Midwest middle and high school classrooms. Results found DBR-CM scores to be significantly correlated with several scores on concurrently completed measures of CM, including those that rely on systematic direct observation and rating scales. Findings continue the accumulation of validity evidence to address extrapolation, generalization, and theory-based inferences underlying the interpretation and intended uses of the DBR-CM. Results are promising and build on previous DBR-CM validation work. Limitations and implications are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41547591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-16DOI: 10.1177/15345084221118090
M. Santiago-Rosario, K. McIntosh, Sara A. Whitcomb
This study examined the self-reports of 33 Grades K–6 teachers from the Culturally Responsive Classroom Management Self-Efficacy Scale (CRCMSE) in relation to observed classroom management practices (praise, opportunities to respond, and reprimands) and classroom-level student outcomes (correct academic responses, disruptive behavior, and office discipline referrals). Additionally, we explored the relation between CRCMSE ratings, observed classroom management practices, and racial equity in school discipline. Results showed that on average, teachers rated their culturally responsive competencies moderately high. There were no significant associations between CRCMSE ratings and observed classroom practices or racial equity in discipline. However, the delivery of praise statements was strongly associated with racial equity. Possible implications for measuring cultural responsiveness using self-report are also discussed.
{"title":"Examining Teachers’ Culturally Responsive Classroom Management Self-Efficacy","authors":"M. Santiago-Rosario, K. McIntosh, Sara A. Whitcomb","doi":"10.1177/15345084221118090","DOIUrl":"https://doi.org/10.1177/15345084221118090","url":null,"abstract":"This study examined the self-reports of 33 Grades K–6 teachers from the Culturally Responsive Classroom Management Self-Efficacy Scale (CRCMSE) in relation to observed classroom management practices (praise, opportunities to respond, and reprimands) and classroom-level student outcomes (correct academic responses, disruptive behavior, and office discipline referrals). Additionally, we explored the relation between CRCMSE ratings, observed classroom management practices, and racial equity in school discipline. Results showed that on average, teachers rated their culturally responsive competencies moderately high. There were no significant associations between CRCMSE ratings and observed classroom practices or racial equity in discipline. However, the delivery of praise statements was strongly associated with racial equity. Possible implications for measuring cultural responsiveness using self-report are also discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47453233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-08-07DOI: 10.1177/15345084221111338
Lindsay M. Fallon, Sadie C. Cathcart, Austin H. Johnson, T. Minami, Breda V. O’Keeffe, Emily R. DeFouw, G. Sugai
When students require support to improve outcomes in a variety of domains, educators provide youth with school-based intervention. When educators require support to improve their professional practice, school leaders and support personnel (e.g., school psychologists) provide teachers with professional development (PD), consultation, and coaching. This multi-study article describes how the Assessment of Culturally and Contextually Relevant Supports (ACCReS) was developed with the purpose of assessment driving intervention for teachers in need of support to engage in culturally responsive practice. Items for the ACCReS were created via a multi-step process including review by both expert and practitioner panels. Then, results of an exploratory factor analysis with a national sample of U.S. teachers (N = 500) in Study 1 yielded three subscales. A confirmatory factor analysis conducted with a separate sample of teachers (N = 400) in Study 2 produced adequate model fit. In Study 3, analyses with another final sample of teachers (N = 99) indicated preliminary evidence of convergent validity between the ACCReS and two measures of teacher self-efficacy of culturally responsive practice. Data from the ACCReS can shape the content of educator intervention (e.g., PD) and promote more equitable student outcomes for youth.
{"title":"A Teacher Self-Assessment of Culturally Relevant Practice to Inform Educator Professional Development Decisions in MTSS Contexts","authors":"Lindsay M. Fallon, Sadie C. Cathcart, Austin H. Johnson, T. Minami, Breda V. O’Keeffe, Emily R. DeFouw, G. Sugai","doi":"10.1177/15345084221111338","DOIUrl":"https://doi.org/10.1177/15345084221111338","url":null,"abstract":"When students require support to improve outcomes in a variety of domains, educators provide youth with school-based intervention. When educators require support to improve their professional practice, school leaders and support personnel (e.g., school psychologists) provide teachers with professional development (PD), consultation, and coaching. This multi-study article describes how the Assessment of Culturally and Contextually Relevant Supports (ACCReS) was developed with the purpose of assessment driving intervention for teachers in need of support to engage in culturally responsive practice. Items for the ACCReS were created via a multi-step process including review by both expert and practitioner panels. Then, results of an exploratory factor analysis with a national sample of U.S. teachers (N = 500) in Study 1 yielded three subscales. A confirmatory factor analysis conducted with a separate sample of teachers (N = 400) in Study 2 produced adequate model fit. In Study 3, analyses with another final sample of teachers (N = 99) indicated preliminary evidence of convergent validity between the ACCReS and two measures of teacher self-efficacy of culturally responsive practice. Data from the ACCReS can shape the content of educator intervention (e.g., PD) and promote more equitable student outcomes for youth.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43059626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-29DOI: 10.1177/15345084221112858
Nicole B. Wiggs, L. Reddy, Ryan J. Kettler, Anh N. Hua, C. Dudek, Adam J. Lekwa, B. Bronstein
The Classroom Strategies Assessment System (CSAS) is a multi-rater, multi-method (direct observation and rating scale methodology) assessment of teachers’ use of research-based instructional and behavior management strategies. The present study investigated the association between teacher self-report and school administrator ratings using the CSAS Teacher (CSAS-T) and Observer (CSAS-O) Forms in 15 high-poverty U.S. charter schools. The CSAS-T and CSAS-O were designed to be used concurrently as a valid formative assessment of teacher practice. Findings include small, but statistically significant correlations between the CSAS-T and CSAS-O. Analysis of a multi-trait–multi-method (MTMM) matrix found teachers and observers to be measuring different constructs. No mean score differences were found between teacher self-reported instruction and behavior management strategy use compared with school administrators’ observed ratings. Furthermore, school administrators and teachers have similar ratings of overall effectiveness, with the majority of teachers in the sample being rated at or above effective. Overall, findings offer support for using the CSAS-O and CSAS-T for guiding professional development conversations.
{"title":"Convergence Between Teacher Self-Report and School Administrator Observation Ratings Using the Classroom Strategies Assessment System","authors":"Nicole B. Wiggs, L. Reddy, Ryan J. Kettler, Anh N. Hua, C. Dudek, Adam J. Lekwa, B. Bronstein","doi":"10.1177/15345084221112858","DOIUrl":"https://doi.org/10.1177/15345084221112858","url":null,"abstract":"The Classroom Strategies Assessment System (CSAS) is a multi-rater, multi-method (direct observation and rating scale methodology) assessment of teachers’ use of research-based instructional and behavior management strategies. The present study investigated the association between teacher self-report and school administrator ratings using the CSAS Teacher (CSAS-T) and Observer (CSAS-O) Forms in 15 high-poverty U.S. charter schools. The CSAS-T and CSAS-O were designed to be used concurrently as a valid formative assessment of teacher practice. Findings include small, but statistically significant correlations between the CSAS-T and CSAS-O. Analysis of a multi-trait–multi-method (MTMM) matrix found teachers and observers to be measuring different constructs. No mean score differences were found between teacher self-reported instruction and behavior management strategy use compared with school administrators’ observed ratings. Furthermore, school administrators and teachers have similar ratings of overall effectiveness, with the majority of teachers in the sample being rated at or above effective. Overall, findings offer support for using the CSAS-O and CSAS-T for guiding professional development conversations.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":null,"pages":null},"PeriodicalIF":1.3,"publicationDate":"2022-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45240107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：