Eija Pakarinen, L. Malmberg, A. Poikkeus, Martti Siekkinen, Marja‐Kristiina Lerkkanen
{"title":"Investigating applicability of ratings of indicators of the CLASS Pre-K instrument","authors":"Eija Pakarinen, L. Malmberg, A. Poikkeus, Martti Siekkinen, Marja‐Kristiina Lerkkanen","doi":"10.1080/1743727X.2022.2128741","DOIUrl":null,"url":null,"abstract":"ABSTRACT When classroom observations are increasingly used for accountability and evaluation purposes, a deeper understanding of the psychometric properties of such measurement tools is needed. The present study took a unique approach to examine the psychometric properties of a commonly used classroom observation measure by testing the reliability of indicators for higher-order constructs (i.e. dimensions). We investigated the reliability of indicator ratings of the Classroom Assessment Scoring System (CLASS) Pre-K instrument in Finnish kindergarten and first grade classrooms. Twenty-one observer pairs rated 838 segments identified from the 413 lessons of 48 teachers. Variance components models were specified to investigate variance proportions of each indicator and dimension. The results showed that most observer disagreement was found for the instructional support domain. Observers disagreed relatively more depending on the teacher they observed. There is a clear need for additional understanding on how observers process information on the complex elements of classroom interaction in order to improve training programmes and the reliability and accuracy of the assessment procedure.","PeriodicalId":51655,"journal":{"name":"International Journal of Research & Method in Education","volume":"46 1","pages":"231 - 247"},"PeriodicalIF":1.5000,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Research & Method in Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/1743727X.2022.2128741","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
ABSTRACT When classroom observations are increasingly used for accountability and evaluation purposes, a deeper understanding of the psychometric properties of such measurement tools is needed. The present study took a unique approach to examine the psychometric properties of a commonly used classroom observation measure by testing the reliability of indicators for higher-order constructs (i.e. dimensions). We investigated the reliability of indicator ratings of the Classroom Assessment Scoring System (CLASS) Pre-K instrument in Finnish kindergarten and first grade classrooms. Twenty-one observer pairs rated 838 segments identified from the 413 lessons of 48 teachers. Variance components models were specified to investigate variance proportions of each indicator and dimension. The results showed that most observer disagreement was found for the instructional support domain. Observers disagreed relatively more depending on the teacher they observed. There is a clear need for additional understanding on how observers process information on the complex elements of classroom interaction in order to improve training programmes and the reliability and accuracy of the assessment procedure.
期刊介绍：
The International Journal of Research & Method in Education is an interdisciplinary, peer-reviewed journal that draws contributions from a wide community of international researchers. Contributions are expected to develop and further international discourse in educational research with a particular focus on method and methodological issues. The journal welcomes papers engaging with methods from within a qualitative or quantitative framework, or from frameworks which cut across and or challenge this duality. Papers should not solely focus on the practice of education; there must be a contribution to methodology. International Journal of Research & Method in Education is committed to publishing scholarly research that discusses conceptual, theoretical and methodological issues, provides evidence, support for or informed critique of unusual or new methodologies within educational research and provides innovative, new perspectives and examinations of key research findings. The journal’s enthusiasm to foster debate is also recognised in a keenness to include engaged, thought-provoking response papers to previously published articles. The journal is also interested in papers that discuss issues in the teaching of research methods for educational researchers. Contributors to International Journal of Research & Method in Education should take care to communicate their findings or arguments in a succinct, accessible manner to an international readership of researchers, policy-makers and practitioners from a range of disciplines including but not limited to philosophy, sociology, economics, psychology, and history of education. The Co-Editors welcome suggested topics for future Special Issues. Initial ideas should be discussed by email with the Co-Editors before a formal proposal is submitted for consideration.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
