Ryan J. Kettler, Anh N. Hua, C. Dudek, L. Reddy, Ilona Arnold-Berkovits, Nicole B. Wiggs, Adam J. Lekwa, Alexander Kurz
{"title":"Improving Measurement of Teacher Performance: Alternative Scoring for Classroom-Based Observational Systems","authors":"Ryan J. Kettler, Anh N. Hua, C. Dudek, L. Reddy, Ilona Arnold-Berkovits, Nicole B. Wiggs, Adam J. Lekwa, Alexander Kurz","doi":"10.1080/10627197.2022.2088494","DOIUrl":null,"url":null,"abstract":"ABSTRACT The study examines reliability and validity evidence of observational systems for evaluating teacher effectiveness and fostering professional development conversations in schools. Specifically, this study compared the Framework for Teaching’s (FFT) validity evidence using the traditional scoring approach with a new composite scoring approach that averages the components nested within each domain. The study was conducted with a sample of 85 teachers and 10 school administrators from five high-poverty charter schools. Overall, the findings build on previous research, offering additional evidence for using alternative scoring methods for the classroom observational measures. The FFT composite scores are internally consistent at the domain and total levels, as well as more stable across time compared to the traditional scoring approach. Implications for research and practice are discussed.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"27 1","pages":"269 - 284"},"PeriodicalIF":2.1000,"publicationDate":"2022-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Assessment","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/10627197.2022.2088494","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 1
Abstract
ABSTRACT The study examines reliability and validity evidence of observational systems for evaluating teacher effectiveness and fostering professional development conversations in schools. Specifically, this study compared the Framework for Teaching’s (FFT) validity evidence using the traditional scoring approach with a new composite scoring approach that averages the components nested within each domain. The study was conducted with a sample of 85 teachers and 10 school administrators from five high-poverty charter schools. Overall, the findings build on previous research, offering additional evidence for using alternative scoring methods for the classroom observational measures. The FFT composite scores are internally consistent at the domain and total levels, as well as more stable across time compared to the traditional scoring approach. Implications for research and practice are discussed.
期刊介绍:
Educational Assessment publishes original research and scholarship on the assessment of individuals, groups, and programs in educational settings. It includes theory, methodological approaches and empirical research in the appraisal of the learning and achievement of students and teachers, young children and adults, and novices and experts. The journal reports on current large-scale testing practices, discusses alternative approaches, presents scholarship on classroom assessment practices and includes assessment topics debated at the national level. It welcomes both conceptual and empirical pieces and encourages articles that provide a strong bridge between theory and/or empirical research and the implications for educational policy and/or practice.