Pub Date : 2025-11-21DOI: 10.1016/j.stueduc.2025.101537
Steffen Wild
Evidence for the ordering of the effect between interest and achievement remains an unresolved issue. Previous studies in this field predominantly rely on data from school contexts and STEM disciplines. The aim of this research is to analyse reciprocal effects between subject interest and achievement, focusing on long-term effects among students in higher education programmes. Data is used from a three-year longitudinal design with three annual measurements, based on cooperative education, involving 1828 participants. A random intercept cross-lagged panel model was used to test hypotheses. The analyses reveal positive reciprocal effects across subsequent time lags: from achievement to subject interest, and then from subject interest to achievement. However, these effects are not consistent and depend on specific conditions, including time-dependent factors, such as the phase of the study programme. Further research using other study formats and research designs is necessary to examine the robustness of the results.
{"title":"Searching for long-term reciprocal effects between achievement and interest in cooperative education programme","authors":"Steffen Wild","doi":"10.1016/j.stueduc.2025.101537","DOIUrl":"10.1016/j.stueduc.2025.101537","url":null,"abstract":"<div><div>Evidence for the ordering of the effect between interest and achievement remains an unresolved issue. Previous studies in this field predominantly rely on data from school contexts and STEM disciplines. The aim of this research is to analyse reciprocal effects between subject interest and achievement, focusing on long-term effects among students in higher education programmes. Data is used from a three-year longitudinal design with three annual measurements, based on cooperative education, involving 1828 participants. A random intercept cross-lagged panel model was used to test hypotheses. The analyses reveal positive reciprocal effects across subsequent time lags: from achievement to subject interest, and then from subject interest to achievement. However, these effects are not consistent and depend on specific conditions, including time-dependent factors, such as the phase of the study programme. Further research using other study formats and research designs is necessary to examine the robustness of the results.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101537"},"PeriodicalIF":2.6,"publicationDate":"2025-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145568618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-21DOI: 10.1016/j.stueduc.2025.101536
Shaofeng Wang , Hao Zhang
This study investigates the effectiveness and determinants of Metaverse-based learning environments in higher education through a comprehensive evaluation framework. Using a mixed-methods approach, we examined how system quality, information quality, service quality, and university support affect learning outcomes in Metaverse environments. Data were collected from 201 university students through questionnaires and supplemented with in-depth interviews from 20 participants. Structural equation modeling revealed that institutional quality factors significantly influence students' perceived usefulness, ease of use, and satisfaction with Metaverse learning platforms. Personal innovativeness emerged as a crucial moderator, enhancing the relationship between perceived usefulness and learning outcomes. Qualitative findings have highlighted the importance of institutional support mechanisms and technical infrastructure for effective Metaverse-based learning. The study provides empirical evidence to guide evaluation frameworks for emerging educational technologies and offers practical, evidence-based guidance for decision-making in higher education institutions.
{"title":"Evaluating the determinants of Metaverse learning benefits in higher education: A mixed-methods investigation of system quality, institutional support, and personal innovativeness","authors":"Shaofeng Wang , Hao Zhang","doi":"10.1016/j.stueduc.2025.101536","DOIUrl":"10.1016/j.stueduc.2025.101536","url":null,"abstract":"<div><div>This study investigates the effectiveness and determinants of Metaverse-based learning environments in higher education through a comprehensive evaluation framework. Using a mixed-methods approach, we examined how system quality, information quality, service quality, and university support affect learning outcomes in Metaverse environments. Data were collected from 201 university students through questionnaires and supplemented with in-depth interviews from 20 participants. Structural equation modeling revealed that institutional quality factors significantly influence students' perceived usefulness, ease of use, and satisfaction with Metaverse learning platforms. Personal innovativeness emerged as a crucial moderator, enhancing the relationship between perceived usefulness and learning outcomes. Qualitative findings have highlighted the importance of institutional support mechanisms and technical infrastructure for effective Metaverse-based learning. The study provides empirical evidence to guide evaluation frameworks for emerging educational technologies and offers practical, evidence-based guidance for decision-making in higher education institutions.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101536"},"PeriodicalIF":2.6,"publicationDate":"2025-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145568617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-15DOI: 10.1016/j.stueduc.2025.101534
Lucas Silva-Didier , Kim Schildkamp , Adrie J. Visscher , Roel J. Bosker
Although the use of student perceptions of teaching quality has been promoted as a tool for instructional improvement, its adoption in practice remains challenging. Teachers’ beliefs play a key role in whether such data is embraced or resisted. This study examined the implementation and effects of a teacher professional development program on teachers’ beliefs about using student perceptions of teaching quality data. In 15 Chilean schools, teachers worked in professional learning communities. Pre and post-surveys with 39 teachers assessed affective and instrumental attitudes, perceived controllability, and self-efficacy. Implementation of key activities (e.g., discussing student perceptions of teaching quality data with students) was limited, and beliefs did not change significantly during the program. Correlational analyses indicated that participants with higher baseline beliefs were more likely to show decreases after the program. High pre-test scores, short duration, and partial implementation constrained the program’s outcomes.
{"title":"Improving teachers' beliefs about using student feedback: Can professional learning communities make a difference?","authors":"Lucas Silva-Didier , Kim Schildkamp , Adrie J. Visscher , Roel J. Bosker","doi":"10.1016/j.stueduc.2025.101534","DOIUrl":"10.1016/j.stueduc.2025.101534","url":null,"abstract":"<div><div>Although the use of student perceptions of teaching quality has been promoted as a tool for instructional improvement, its adoption in practice remains challenging. Teachers’ beliefs play a key role in whether such data is embraced or resisted. This study examined the implementation and effects of a teacher professional development program on teachers’ beliefs about using student perceptions of teaching quality data. In 15 Chilean schools, teachers worked in professional learning communities. Pre and post-surveys with 39 teachers assessed affective and instrumental attitudes, perceived controllability, and self-efficacy. Implementation of key activities (e.g., discussing student perceptions of teaching quality data with students) was limited, and beliefs did not change significantly during the program. Correlational analyses indicated that participants with higher baseline beliefs were more likely to show decreases after the program. High pre-test scores, short duration, and partial implementation constrained the program’s outcomes.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101534"},"PeriodicalIF":2.6,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This cross-cultural study investigated the factorial structure and the measurement invariance of the Teacher-Child Dependency Scale (TCDS) and Student-Teacher Relationship Scale (STRS-SF) in Greece and China. The sample consisted of 346 children (Greece: 170, China: 176) and 44 teachers across 18 Early Childhood Education and Care (ECEC) settings. A two-factor structure of the TCDS - emotional dependency and physical dependency was supported and found to be invariant across cultures. Chinese teachers reported higher levels of closeness and physical dependency than their Greek counterparts, whereas emotional dependency was similar across countries. Teacher-child closeness negatively predicted internalizing and externalizing problems in both contexts. However, cultural differences emerged: emotional dependency significantly predicted behavioral issues in Greek children, whereas physical dependency played a more prominent role in internalizing issues for Chinese children. These results highlight the role of cultural contexts in shaping teacher-child relationships and suggest the need for culturally tailored practices and interventions in ECEC.
{"title":"Cross-cultural examination of teacher-child dependency and relationship quality across Greece and China","authors":"Anastasia Vatou , Weiyi Xie , Katerina Krousorati , Xiao Zhang , Athanasios Gregoriadis","doi":"10.1016/j.stueduc.2025.101533","DOIUrl":"10.1016/j.stueduc.2025.101533","url":null,"abstract":"<div><div>This cross-cultural study investigated the factorial structure and the measurement invariance of the Teacher-Child Dependency Scale (TCDS) and Student-Teacher Relationship Scale (STRS-SF) in Greece and China. The sample consisted of 346 children (Greece: 170, China: 176) and 44 teachers across 18 Early Childhood Education and Care (ECEC) settings. A two-factor structure of the TCDS - emotional dependency and physical dependency was supported and found to be invariant across cultures. Chinese teachers reported higher levels of closeness and physical dependency than their Greek counterparts, whereas emotional dependency was similar across countries. Teacher-child closeness negatively predicted internalizing and externalizing problems in both contexts. However, cultural differences emerged: emotional dependency significantly predicted behavioral issues in Greek children, whereas physical dependency played a more prominent role in internalizing issues for Chinese children. These results highlight the role of cultural contexts in shaping teacher-child relationships and suggest the need for culturally tailored practices and interventions in ECEC.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101533"},"PeriodicalIF":2.6,"publicationDate":"2025-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-14DOI: 10.1016/j.stueduc.2025.101535
Esther López-Martín, Eva Expósito-Casas, Ana Patricia Fernández-Suárez, Belén Gutiérrez-de-Rozas
This paper examines teachers' and school leaders' perceptions of the competencies that are crucial for secondary-education teachers to meet students' needs, evaluates the training received to enhance these competencies and identifies the most effective methods for their development. A non-experimental, ex post facto study was conducted with 683 teachers (including 157 school leaders) from secondary education centres in Spain. The results show that both pedagogical and personal competencies are highly valued, indicating that participants perceive the teaching profession as highly demanding. The study also reveals a gap between the importance of these competencies and the training received by teachers. Additionally, teachers view practical experience as the most effective method of developing these competencies, followed by continuous training, with initial training being the least effective. These findings underscore the need for a comprehensive competence framework for secondary-education teachers to guide teacher selection, performance evaluation, career development and training.
{"title":"The competency profile of secondary-school teachers: Importance and development of teaching competencies","authors":"Esther López-Martín, Eva Expósito-Casas, Ana Patricia Fernández-Suárez, Belén Gutiérrez-de-Rozas","doi":"10.1016/j.stueduc.2025.101535","DOIUrl":"10.1016/j.stueduc.2025.101535","url":null,"abstract":"<div><div>This paper examines teachers' and school leaders' perceptions of the competencies that are crucial for secondary-education teachers to meet students' needs, evaluates the training received to enhance these competencies and identifies the most effective methods for their development. A non-experimental, ex post facto study was conducted with 683 teachers (including 157 school leaders) from secondary education centres in Spain. The results show that both pedagogical and personal competencies are highly valued, indicating that participants perceive the teaching profession as highly demanding. The study also reveals a gap between the importance of these competencies and the training received by teachers. Additionally, teachers view practical experience as the most effective method of developing these competencies, followed by continuous training, with initial training being the least effective. These findings underscore the need for a comprehensive competence framework for secondary-education teachers to guide teacher selection, performance evaluation, career development and training.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101535"},"PeriodicalIF":2.6,"publicationDate":"2025-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-12DOI: 10.1016/j.stueduc.2025.101528
Susanne Spiele , Jeroen J.H.M. Janssen , Kim Schildkamp , Cindy L. Poortman
This meta-analysis combined with a qualitative analysis focused on effective data use professional development interventions and intervention design characteristics for teachers. The 27 included studies had a total of 86 effect sizes and used student achievement as outcome measure. Intervention design characteristics and study design characteristics were included as moderator variables. A random-effects multilevel meta-analysis showed a medium-sized positive effect on student achievement (g =.41) with significant heterogeneity. Moderator analysis showed that when study design was controlled for, intervention design characteristics did not significantly affect student achievement. A moderate to strong correlation was found between intervention design and study design (i.e., studies with a theoretically more effective intervention design tended to have a higher possibility of methodological bias). However, the qualitative analysis showed that data use-specific intervention and school (implementation) characteristics were associated with higher effect sizes.
{"title":"The effect of teacher data use professional development interventions on student achievement: A meta-analysis and qualitative comparative analysis","authors":"Susanne Spiele , Jeroen J.H.M. Janssen , Kim Schildkamp , Cindy L. Poortman","doi":"10.1016/j.stueduc.2025.101528","DOIUrl":"10.1016/j.stueduc.2025.101528","url":null,"abstract":"<div><div>This meta-analysis combined with a qualitative analysis focused on effective data use professional development interventions and intervention design characteristics for teachers. The 27 included studies had a total of 86 effect sizes and used student achievement as outcome measure. Intervention design characteristics and study design characteristics were included as moderator variables. A random-effects multilevel meta-analysis showed a medium-sized positive effect on student achievement (<em>g</em> =.41) with significant heterogeneity. Moderator analysis showed that when study design was controlled for, intervention design characteristics did not significantly affect student achievement. A moderate to strong correlation was found between intervention design and study design (i.e., studies with a theoretically more effective intervention design tended to have a higher possibility of methodological bias). However, the qualitative analysis showed that data use-specific intervention and school (implementation) characteristics were associated with higher effect sizes.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101528"},"PeriodicalIF":2.6,"publicationDate":"2025-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-11DOI: 10.1016/j.stueduc.2025.101531
María Sánchez-Munilla , Enrique Navarro Asencio , José Luis Gaviria Soto
Metacognition significantly influences students' academic performance, underscoring the need for reliable assessment instruments. This systematic review synthesizes the bibliometric, sample, and assessment characteristics of quantitative metacognition evaluation tools used in secondary school students over three decades. The study followed the PRISMA protocol (Page et al., 2021) using Dialnet, Scopus, ERIC, and PsycInfo databases. 359 studies were selected from 5703 identified. Bibliometric findings reveal a growing body of research on metacognition over the years. The sample is balanced in terms of gender, country, and age, though sample sizes are generally small. Regarding assessment, traditional measures predominate, primarily comprising self-report questionnaires administered in a pencil-and-paper format, with the most utilized tools originating from the 1990s. Several assessment tools appraise specific metacognitive dimensions, with no single instrument encompassing a comprehensive evaluation of metacognitive processes. The study concludes with implications and limitations, along with recommendations for future research.
元认知显着影响学生的学习成绩,强调需要可靠的评估工具。本系统综述综合了三十年来用于中学生的定量元认知评估工具的文献计量学、样本和评估特征。该研究遵循PRISMA协议(Page et al., 2021),使用Dialnet、Scopus、ERIC和PsycInfo数据库。从5703项研究中选择了359项。文献计量学的发现揭示了近年来元认知研究的增长。样本在性别、国家和年龄方面是平衡的,尽管样本量通常很小。关于评估,传统措施占主导地位,主要包括以纸笔形式填写的自我报告问卷,使用最多的工具源自1990年代。一些评估工具评估特定的元认知维度,没有一个单一的工具包括元认知过程的全面评估。该研究总结了影响和局限性,以及对未来研究的建议。
{"title":"A systematic review of key assessment tools applied to assess metacognition in secondary school students","authors":"María Sánchez-Munilla , Enrique Navarro Asencio , José Luis Gaviria Soto","doi":"10.1016/j.stueduc.2025.101531","DOIUrl":"10.1016/j.stueduc.2025.101531","url":null,"abstract":"<div><div>Metacognition significantly influences students' academic performance, underscoring the need for reliable assessment instruments. This systematic review synthesizes the bibliometric, sample, and assessment characteristics of quantitative metacognition evaluation tools used in secondary school students over three decades. The study followed the PRISMA protocol (Page et al., 2021) using Dialnet, Scopus, ERIC, and PsycInfo databases. 359 studies were selected from 5703 identified. Bibliometric findings reveal a growing body of research on metacognition over the years. The sample is balanced in terms of gender, country, and age, though sample sizes are generally small. Regarding assessment, traditional measures predominate, primarily comprising self-report questionnaires administered in a pencil-and-paper format, with the most utilized tools originating from the 1990s. Several assessment tools appraise specific metacognitive dimensions, with no single instrument encompassing a comprehensive evaluation of metacognitive processes. The study concludes with implications and limitations, along with recommendations for future research.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101531"},"PeriodicalIF":2.6,"publicationDate":"2025-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-10DOI: 10.1016/j.stueduc.2025.101532
Wenqing Chen, Stephen Gorard
The effectiveness of using research evidence in improving teaching remains underexplored. This study reports on a randomised controlled trial in China evaluating the impacts of teachers’ use of research evidence for students’ Chinese literacy, with 153 teachers and 6791 students participating. The study indicated a modest improvement in students’ Chinese test scores from the intervention (+0.07), coupled with a slight reduction in the time spent on Chinese literacy homework (-0.06). While the impact is small, teachers’ use of research evidence in teaching has been shown to be feasible and cost-effective in Chinese teaching contexts. This allows for wider implementation even within limited budgets.
{"title":"Evaluation of teachers’ use of research evidence for primary school students’ literacy outcomes: A randomised controlled trial in China","authors":"Wenqing Chen, Stephen Gorard","doi":"10.1016/j.stueduc.2025.101532","DOIUrl":"10.1016/j.stueduc.2025.101532","url":null,"abstract":"<div><div>The effectiveness of using research evidence in improving teaching remains underexplored. This study reports on a randomised controlled trial in China evaluating the impacts of teachers’ use of research evidence for students’ Chinese literacy, with 153 teachers and 6791 students participating. The study indicated a modest improvement in students’ Chinese test scores from the intervention (+0.07), coupled with a slight reduction in the time spent on Chinese literacy homework (-0.06). While the impact is small, teachers’ use of research evidence in teaching has been shown to be feasible and cost-effective in Chinese teaching contexts. This allows for wider implementation even within limited budgets.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101532"},"PeriodicalIF":2.6,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-10DOI: 10.1016/j.stueduc.2025.101530
Barbara Brown, Sharon Friesen
This cross-sectional study evaluated the implementation of a professional practice standard for teaching over four years in a top-performing Canadian education system with 62 school districts and approximately 35,000 teachers in the system. Using a convergent mixed methods research design, quantitative data were generated from online surveys with 5536 teachers and qualitative data were gathered through focus group interviews with teachers (n = 193). Results from the study have been used to inform an update to the Teaching Effectiveness Framework (Friesen, 2009) and provide insights into a model for advancing teaching effectiveness. Conceptual stages were developed to illustrate teacher progression from routine to adaptive expertise, measured on a four-point scale. The scale is introduced as a resource to support the integration of policy initiatives into actionable practices and professional learning. Results underscore the value of integrating research literature with teacher and student perspectives to conceptualize and advance teaching effectiveness principles.
{"title":"Stages of teaching expertise from routine to adaptive: A model for advancing teaching effectiveness","authors":"Barbara Brown, Sharon Friesen","doi":"10.1016/j.stueduc.2025.101530","DOIUrl":"10.1016/j.stueduc.2025.101530","url":null,"abstract":"<div><div>This cross-sectional study evaluated the implementation of a professional practice standard for teaching over four years in a top-performing Canadian education system with 62 school districts and approximately 35,000 teachers in the system. Using a convergent mixed methods research design, quantitative data were generated from online surveys with 5536 teachers and qualitative data were gathered through focus group interviews with teachers (<em>n</em> = 193). Results from the study have been used to inform an update to the Teaching Effectiveness Framework (Friesen, 2009) and provide insights into a model for advancing teaching effectiveness. Conceptual stages were developed to illustrate teacher progression from routine to adaptive expertise, measured on a four-point scale. The scale is introduced as a resource to support the integration of policy initiatives into actionable practices and professional learning. Results underscore the value of integrating research literature with teacher and student perspectives to conceptualize and advance teaching effectiveness principles.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101530"},"PeriodicalIF":2.6,"publicationDate":"2025-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-11-08DOI: 10.1016/j.stueduc.2025.101529
Yuriko K. Sosa Paredes , Björn Andersson
International comparative assessments are crucial for examining country-level educational changes over time, but requires a comparable achievement scale. This study develops a unified science achievement scale that links the First and Second International Science Studies with the Trends in International Mathematics and Science Study for upper primary school students. The science measures in each study are analyzed with respect to construct consistency, inferences, population differences, and test conditions. Analyses showed that, despite some evolution in frameworks and a transition from age-based to grade-based definitions, the core constructs remain consistent, enabling similar inferences. By identifying common items among the three studies, we rigorously assessed measurement invariance using item response modeling, with partial invariance models supporting reliable long-term comparisons. We applied latent regression models using contextual student data, creating imputed scale scores for each student. These results enable vast further research to investigate long-term inequalities in educational outcomes.
{"title":"Linking the first, second and third IEA science studies","authors":"Yuriko K. Sosa Paredes , Björn Andersson","doi":"10.1016/j.stueduc.2025.101529","DOIUrl":"10.1016/j.stueduc.2025.101529","url":null,"abstract":"<div><div>International comparative assessments are crucial for examining country-level educational changes over time, but requires a comparable achievement scale. This study develops a unified science achievement scale that links the First and Second International Science Studies with the Trends in International Mathematics and Science Study for upper primary school students. The science measures in each study are analyzed with respect to construct consistency, inferences, population differences, and test conditions. Analyses showed that, despite some evolution in frameworks and a transition from age-based to grade-based definitions, the core constructs remain consistent, enabling similar inferences. By identifying common items among the three studies, we rigorously assessed measurement invariance using item response modeling, with partial invariance models supporting reliable long-term comparisons. We applied latent regression models using contextual student data, creating imputed scale scores for each student. These results enable vast further research to investigate long-term inequalities in educational outcomes.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101529"},"PeriodicalIF":2.6,"publicationDate":"2025-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}