首页 > 最新文献

Studies in Educational Evaluation最新文献

英文 中文
The short- and long-term impact of teacher formal certification on students’ school outcomes: A propensity weighting approach 教师正规认证对学生学业成绩的短期和长期影响:倾向加权法
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-27 DOI: 10.1016/j.stueduc.2026.101567
Kajsa Yang Hansen , Stefan Johansson
Establishing a causal link between teachers’ formal certification and students’ academic achievement presents persistent methodological challenges. Although several studies have reported positive associations, many have been limited by weak designs, while those employing more rigorous methods have yielded mixed or null findings (e.g., Pontoppidan et al., 2018). This study applied a propensity score weighting approach to examine whether teacher certification causally influences students’ PIRLS reading achievement in Grade 4 and school outcomes in Grade 6 and 9 in Sweden. Integrated PIRLS 2016 and national register data was used. The findings suggested that teacher certification has a substantial impact on both short- and long-term development of students’ school outcomes, where differences in knowledge and assessment practices between certified and uncertified teachers may play a crucial role.
在教师的正式认证和学生的学习成绩之间建立因果关系,在方法论上提出了持续的挑战。尽管有几项研究报告了积极的关联,但许多研究受到薄弱设计的限制,而那些采用更严格方法的研究则产生了混合或无效的结果(例如,Pontoppidan等人,2018)。本研究采用倾向得分加权法来检验教师资格证书是否会对瑞典四年级学生的PIRLS阅读成绩以及六年级和九年级学生的学业成绩产生因果影响。综合PIRLS 2016和国家登记数据。研究结果表明,教师认证对学生学业成果的短期和长期发展都有重大影响,其中认证教师和未认证教师之间的知识和评估实践差异可能起着至关重要的作用。
{"title":"The short- and long-term impact of teacher formal certification on students’ school outcomes: A propensity weighting approach","authors":"Kajsa Yang Hansen ,&nbsp;Stefan Johansson","doi":"10.1016/j.stueduc.2026.101567","DOIUrl":"10.1016/j.stueduc.2026.101567","url":null,"abstract":"<div><div>Establishing a causal link between teachers’ formal certification and students’ academic achievement presents persistent methodological challenges. Although several studies have reported positive associations, many have been limited by weak designs, while those employing more rigorous methods have yielded mixed or null findings (e.g., Pontoppidan et al., 2018). This study applied a propensity score weighting approach to examine whether teacher certification causally influences students’ PIRLS reading achievement in Grade 4 and school outcomes in Grade 6 and 9 in Sweden. Integrated PIRLS 2016 and national register data was used. The findings suggested that teacher certification has a substantial impact on both short- and long-term development of students’ school outcomes, where differences in knowledge and assessment practices between certified and uncertified teachers may play a crucial role.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101567"},"PeriodicalIF":2.6,"publicationDate":"2026-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146077758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An exploratory network analysis of early care and education quality 早期照护与教育质量的探索性网络分析
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-23 DOI: 10.1016/j.stueduc.2026.101564
Fangfang Zhao , Ying Fang , Jinliang Qin
This study provides an exploratory examination of early care and education (ECE) quality in Eastern China from an interaction-dominant perspective. Using network analysis, the study maps the overall structure of ECE quality, capturing interdependence among dimensions both within the network and across classroom- and child-level sub-networks. Data were collected from 266 children across 16 classrooms in 6 childcare centers in Eastern China. Results indicated that the quality network was highly stable and showed strong validity. The classroom-level Program Structure emerged as the key dimension across the entire network, while the child-level Space and Furnishings dimension acted as a bridge between classroom- and child-level sub-networks. These findings provide preliminary support for the applicability of network analysis in the study of ECE quality and reveal structural features of quality that can guide future research with larger, culturally diverse, and geographically varied samples.
本研究从互动主导的视角对中国东部地区幼儿教育质量进行了探索性考察。使用网络分析,该研究绘制了欧洲经委会质量的总体结构,捕捉了网络内以及跨课堂和儿童级子网络各维度之间的相互依存关系。数据收集自中国东部6个托儿中心16个教室的266名儿童。结果表明,质量网络具有较高的稳定性和较强的效度。教室级的程序结构成为整个网络的关键维度,而儿童级的空间和家具维度充当了教室和儿童级子网络之间的桥梁。这些发现为网络分析在ECE质量研究中的适用性提供了初步支持,并揭示了质量的结构特征,可以指导未来对更大、文化多样性和地理多样性样本的研究。
{"title":"An exploratory network analysis of early care and education quality","authors":"Fangfang Zhao ,&nbsp;Ying Fang ,&nbsp;Jinliang Qin","doi":"10.1016/j.stueduc.2026.101564","DOIUrl":"10.1016/j.stueduc.2026.101564","url":null,"abstract":"<div><div>This study provides an exploratory examination of early care and education (ECE) quality in Eastern China from an interaction-dominant perspective. Using network analysis, the study maps the overall structure of ECE quality, capturing interdependence among dimensions both within the network and across classroom- and child-level sub-networks. Data were collected from 266 children across 16 classrooms in 6 childcare centers in Eastern China. Results indicated that the quality network was highly stable and showed strong validity. The classroom-level Program Structure emerged as the key dimension across the entire network, while the child-level Space and Furnishings dimension acted as a bridge between classroom- and child-level sub-networks. These findings provide preliminary support for the applicability of network analysis in the study of ECE quality and reveal structural features of quality that can guide future research with larger, culturally diverse, and geographically varied samples.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101564"},"PeriodicalIF":2.6,"publicationDate":"2026-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Master’s students’ perceptions of supervisory feedback and its links to engagement and learning: A mixed-methods study 硕士生对主管反馈的看法及其与参与和学习的联系:一项混合方法研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-22 DOI: 10.1016/j.stueduc.2026.101563
Kim-Daniel Vattøy
This concurrent mixed-methods study examined how master’s students (n = 179) perceive supervisory feedback and how these perceptions relate to feedback engagement and learning. Quantitative data from validated scales were analysed using factor, descriptive, correlation, and regression analyses, while qualitative responses underwent thematic analysis. All dimensions correlated positively with feedback engagement, but regression analysis showed that feedback engagement was most strongly predicted by perceived supervisor contribution to learning, followed by satisfaction with supervisor and task-focused feedback. Qualitative findings revealed four themes: supervisory support as a confidence anchor, negotiating clarity and consistency in feedback, adaptive feedback engagement through reflection and critical judgement, and coping with ambiguity and emotional strain in feedback use. These findings suggest that while task-focused feedback is important, relational support and clarity are critical for fostering adaptive feedback engagement. Implications include enhancing supervisor training to foster dialogic, learning-focused feedback that nurtures self-belief, autonomy, and resilience.
这项同时进行的混合方法研究考察了硕士生(n = 179)如何感知主管反馈,以及这些感知如何与反馈参与和学习联系起来。通过因子分析、描述分析、相关分析和回归分析对有效量表的定量数据进行分析,而定性反应则进行专题分析。所有维度都与反馈敬业度呈正相关,但回归分析显示,反馈敬业度最能被感知到的主管对学习的贡献所预测,其次是对主管的满意度和以任务为中心的反馈。定性研究结果揭示了四个主题:作为信心锚的监管支持,反馈的谈判清晰度和一致性,通过反思和批判性判断进行适应性反馈参与,以及应对反馈使用中的模糊性和情绪紧张。这些发现表明,虽然以任务为中心的反馈很重要,但关系支持和清晰度对于促进适应性反馈参与至关重要。其影响包括加强主管培训,以促进对话和以学习为重点的反馈,从而培养自信、自主和适应能力。
{"title":"Master’s students’ perceptions of supervisory feedback and its links to engagement and learning: A mixed-methods study","authors":"Kim-Daniel Vattøy","doi":"10.1016/j.stueduc.2026.101563","DOIUrl":"10.1016/j.stueduc.2026.101563","url":null,"abstract":"<div><div>This concurrent mixed-methods study examined how master’s students (<em>n</em> = 179) perceive supervisory feedback and how these perceptions relate to feedback engagement and learning. Quantitative data from validated scales were analysed using factor, descriptive, correlation, and regression analyses, while qualitative responses underwent thematic analysis. All dimensions correlated positively with feedback engagement, but regression analysis showed that feedback engagement was most strongly predicted by perceived supervisor contribution to learning, followed by satisfaction with supervisor and task-focused feedback. Qualitative findings revealed four themes: supervisory support as a confidence anchor, negotiating clarity and consistency in feedback, adaptive feedback engagement through reflection and critical judgement, and coping with ambiguity and emotional strain in feedback use. These findings suggest that while task-focused feedback is important, relational support and clarity are critical for fostering adaptive feedback engagement. Implications include enhancing supervisor training to foster dialogic, learning-focused feedback that nurtures self-belief, autonomy, and resilience.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101563"},"PeriodicalIF":2.6,"publicationDate":"2026-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Students’ willingness to engage with feedback from central tests: The influence of cognitive and non-cognitive student characteristics 学生参与中心测试反馈的意愿:认知和非认知学生特征的影响
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-20 DOI: 10.1016/j.stueduc.2026.101561
G. Molenberghs , R. Van Gasse , E. Goffin , S. De Maeyer , J. Vanhoof
In contemporary education, increasing attention is paid to the developmental use of central tests. While the usefulness of performance data for school improvement is widely acknowledged, students’ willingness to engage with individual feedback from low-stakes central tests has received less scrutiny. This study explores such willingness using survey data from 15526 students in Flemish education. Multilevel regression analyses examined relations with students’ cognitive attitudes, test-taking effort, ability, gender, and educational level. Overall, students’ willingness proved limited, yet variation emerged. A more positive cognitive attitude and greater test-taking effort related to higher willingness. Conversely, secondary school students and boys reported lower willingness, with effects varying across student characteristics. Findings highlight that students’ willingness cannot be assumed. To fully harness the potential of feedback from low-stakes central tests as an informational resource and a developmental learning tool for students, fostering students’ understanding of the value of both tests and feedback is crucial.
在当代教育中,越来越多的人关注中心测试的发展性使用。虽然成绩数据对学校改进的有用性得到了广泛认可,但学生从低风险的中心测试中获得个人反馈的意愿却受到较少的审查。本研究通过对佛兰德教育15526名学生的调查数据来探讨这种意愿。多水平回归分析考察了学生的认知态度、应试努力、能力、性别和受教育程度之间的关系。总体而言,学生的意愿有限,但出现了差异。更积极的认知态度和更大的应试努力与更高的意愿相关。相反,中学生和男生的意愿较低,其影响因学生特征而异。研究结果强调,学生的意愿是不能假设的。为了充分利用低风险中心测试反馈作为信息资源和学生发展学习工具的潜力,培养学生对测试和反馈的价值的理解至关重要。
{"title":"Students’ willingness to engage with feedback from central tests: The influence of cognitive and non-cognitive student characteristics","authors":"G. Molenberghs ,&nbsp;R. Van Gasse ,&nbsp;E. Goffin ,&nbsp;S. De Maeyer ,&nbsp;J. Vanhoof","doi":"10.1016/j.stueduc.2026.101561","DOIUrl":"10.1016/j.stueduc.2026.101561","url":null,"abstract":"<div><div>In contemporary education, increasing attention is paid to the developmental use of central tests. While the usefulness of performance data for school improvement is widely acknowledged, students’ willingness to engage with individual feedback from low-stakes central tests has received less scrutiny. This study explores such willingness using survey data from 15526 students in Flemish education. Multilevel regression analyses examined relations with students’ cognitive attitudes, test-taking effort, ability, gender, and educational level. Overall, students’ willingness proved limited, yet variation emerged. A more positive cognitive attitude and greater test-taking effort related to higher willingness. Conversely, secondary school students and boys reported lower willingness, with effects varying across student characteristics. Findings highlight that students’ willingness cannot be assumed. To fully harness the potential of feedback from low-stakes central tests as an informational resource and a developmental learning tool for students, fostering students’ understanding of the value of both tests and feedback is crucial.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101561"},"PeriodicalIF":2.6,"publicationDate":"2026-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An illustrative case study of researcher roles and challenges in a Dutch school-level research-practice partnership 荷兰学校研究实践伙伴关系中研究人员角色和挑战的说明性案例研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-19 DOI: 10.1016/j.stueduc.2026.101558
Brianna L. Kennedy , Semiha Bekir , Lotte Henrichs
Researchers at research-intensive universities may participate in research-practice partnerships (RPPs) to make their research activities more relevant and impacting. RPPs center equity as a goal, which means researchers and other stakeholders participate in defining and enacting equity through the partnership. Researchers must discern how to address equity goals while enacting the roles of knowledge broker, knowledge use facilitator, and knowledge development facilitator. Role enactment occurs as researchers face the challenges related to the content focus of the RPP and time demands. In this study, we examined artifacts (n = 50) from an RPP between a team of researchers and nine educators between 2021 and 2024 to understand how we, as researchers, enacted these roles and negotiated these challenges. Findings show how surface level consensus about the meaning and importance of equity work bought us time to develop the relational capital necessary to lead more authentic discussions about inequitable practices. We co-constructed a research focus to prioritize equity-in-process but thereby curtailed the full engagement of our research expertise. Findings imply that more robust focus on school- and classroom-level RPPs reveal additional dynamics and mechanisms that allow for sustained changes in classroom teaching that support equity.
研究密集型大学的研究人员可以参与研究实践伙伴关系(RPPs),以使他们的研究活动更具相关性和影响力。rpp以公平为目标,这意味着研究人员和其他利益相关者通过伙伴关系参与定义和制定公平。研究者必须在扮演知识中介、知识使用促进者和知识发展促进者角色的同时,明确如何实现公平目标。角色扮演发生在研究者面临与RPP的内容焦点和时间要求相关的挑战时。在这项研究中,我们检查了2021年至2024年间研究人员团队和9名教育工作者之间的RPP中的工件(n = 50),以了解我们作为研究人员如何扮演这些角色并应对这些挑战。研究结果表明,关于公平工作的意义和重要性的表层共识如何为我们赢得了时间,以发展必要的关系资本,从而引导有关不公平做法的更真实的讨论。我们共同构建了一个研究重点,以优先考虑过程中的股权,但因此限制了我们研究专业知识的充分参与。研究结果表明,对学校和课堂层面rpp的更强有力的关注揭示了额外的动态和机制,这些动态和机制允许课堂教学的持续变化,从而支持公平。
{"title":"An illustrative case study of researcher roles and challenges in a Dutch school-level research-practice partnership","authors":"Brianna L. Kennedy ,&nbsp;Semiha Bekir ,&nbsp;Lotte Henrichs","doi":"10.1016/j.stueduc.2026.101558","DOIUrl":"10.1016/j.stueduc.2026.101558","url":null,"abstract":"<div><div>Researchers at research-intensive universities may participate in research-practice partnerships (RPPs) to make their research activities more relevant and impacting. RPPs center equity as a goal, which means researchers and other stakeholders participate in defining and enacting equity through the partnership. Researchers must discern how to address equity goals while enacting the roles of knowledge broker, knowledge use facilitator, and knowledge development facilitator. Role enactment occurs as researchers face the challenges related to the content focus of the RPP and time demands. In this study, we examined artifacts (<em>n</em> = 50) from an RPP between a team of researchers and nine educators between 2021 and 2024 to understand how we, as researchers, enacted these roles and negotiated these challenges. Findings show how surface level consensus about the meaning and importance of equity work bought us time to develop the relational capital necessary to lead more authentic discussions about inequitable practices. We co-constructed a research focus to prioritize equity-in-process but thereby curtailed the full engagement of our research expertise. Findings imply that more robust focus on school- and classroom-level RPPs reveal additional dynamics and mechanisms that allow for sustained changes in classroom teaching that support equity.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101558"},"PeriodicalIF":2.6,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The interrelationships between reading achievement, online reading activities, and metacognitive skills: Findings from PISA data 阅读成绩、在线阅读活动和元认知技能之间的相互关系:来自PISA数据的发现
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-19 DOI: 10.1016/j.stueduc.2026.101559
Anubha Rohatgi , Ove E. Hatlevik
In today's digital society, it is important for young people to develop a metacognitive understanding of how to react to and respond to messages from strangers. This study explores the relationship between reading achievement, online reading activities, metacognitive skills, and socio-economic backgrounds. Analysis of PISA 2018 Nordic samples indicates a positive statistical association between metacognitive credibility-evaluation skills and reading achievement. Reading achievement is also associated with student background variables. Across the Nordic countries, the tested models explain between 17 % and 29 % of the variation in students’ metacognitive credibility evaluation skills within schools. However, not all students benefit equally as school-based digital skills instruction does not consistently support online metacognition. Addressing these disparities is key to supporting inclusive digital learning and enhancing students’ ability to assess information credibility.
在当今的数字社会中,对年轻人来说,培养对如何对陌生人的信息做出反应和回应的元认知理解非常重要。本研究探讨阅读成绩、在线阅读活动、元认知技能和社会经济背景之间的关系。对2018年PISA北欧样本的分析表明,元认知可信度评估技能与阅读成绩之间存在正相关的统计关系。阅读成绩也与学生的背景变量有关。在北欧国家,经过测试的模型解释了学校内学生元认知可信度评估技能差异的17% %至29% %。然而,并不是所有的学生都同样受益,因为基于学校的数字技能教学并没有始终如一地支持在线元认知。解决这些差异是支持包容性数字学习和提高学生评估信息可信度能力的关键。
{"title":"The interrelationships between reading achievement, online reading activities, and metacognitive skills: Findings from PISA data","authors":"Anubha Rohatgi ,&nbsp;Ove E. Hatlevik","doi":"10.1016/j.stueduc.2026.101559","DOIUrl":"10.1016/j.stueduc.2026.101559","url":null,"abstract":"<div><div>In today's digital society, it is important for young people to develop a metacognitive understanding of how to react to and respond to messages from strangers. This study explores the relationship between reading achievement, online reading activities, metacognitive skills, and socio-economic backgrounds. Analysis of PISA 2018 Nordic samples indicates a positive statistical association between metacognitive credibility-evaluation skills and reading achievement. Reading achievement is also associated with student background variables. Across the Nordic countries, the tested models explain between 17 % and 29 % of the variation in students’ metacognitive credibility evaluation skills within schools. However, not all students benefit equally as school-based digital skills instruction does not consistently support online metacognition. Addressing these disparities is key to supporting inclusive digital learning and enhancing students’ ability to assess information credibility.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101559"},"PeriodicalIF":2.6,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Construct validity of a mixed-worded mathematics confidence scale: Relations with mathematics achievement in TIMSS 2019 混合词数学信心量表的建构效度:与TIMSS 2019数学成绩的关系
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-19 DOI: 10.1016/j.stueduc.2026.101562
Lena Asp
This study examines the construct validity of the mathematics confidence scale in the Swedish TIMSS 2019 fourth-grade data, addressing a methodological gap in educational effectiveness research, conducting secondary analyses of international large-scale assessments (ILSAs). Previous research has operationalised the mathematics confidence construct in various ways. Although ISLA data provide robust measures, self-report scales require validation for method effects and linguistic equivalence across cultures. Using confirmatory factor analysis and bifactor exploratory structural equation modelling, this study examined the factorial structure and translation equivalence of the mathematics confidence scale to validate its operationalisation for further analyses. Results indicated method effects associated with mixed-worded items, suggesting that linguistic complexity may compromise validity. Structural equation models confirmed a significant relationship between mathematics confidence and achievement, yet model fit, and strength of relationships varied across operationalisations. The findings underscore the importance of construct validation in ILSA-based secondary analyses and call for greater attention to translation equivalence and item wording.
本研究考察了瑞典TIMSS 2019四年级数据中数学置信量表的结构效度,解决了教育有效性研究的方法差距,并对国际大规模评估(ILSAs)进行了二次分析。以前的研究已经以各种方式将数学信心结构操作化。尽管ISLA数据提供了可靠的测量方法,但自我报告量表需要对方法效果和跨文化语言等效性进行验证。利用验证性因子分析和双因子探索性结构方程模型,本研究检验了数学置信度量表的因子结构和翻译等效性,以验证其可操作性,以便进一步分析。结果表明,方法效应与混合词项目有关,表明语言复杂性可能损害效度。结构方程模型证实了数学信心和成就之间的重要关系,但模型拟合和关系的强度因操作化而异。研究结果强调了构建验证在基于ilsa的二次分析中的重要性,并呼吁更多地关注翻译等效性和项目措辞。
{"title":"Construct validity of a mixed-worded mathematics confidence scale: Relations with mathematics achievement in TIMSS 2019","authors":"Lena Asp","doi":"10.1016/j.stueduc.2026.101562","DOIUrl":"10.1016/j.stueduc.2026.101562","url":null,"abstract":"<div><div>This study examines the construct validity of the mathematics confidence scale in the Swedish TIMSS 2019 fourth-grade data, addressing a methodological gap in educational effectiveness research, conducting secondary analyses of international large-scale assessments (ILSAs). Previous research has operationalised the mathematics confidence construct in various ways. Although ISLA data provide robust measures, self-report scales require validation for method effects and linguistic equivalence across cultures. Using confirmatory factor analysis and bifactor exploratory structural equation modelling, this study examined the factorial structure and translation equivalence of the mathematics confidence scale to validate its operationalisation for further analyses. Results indicated method effects associated with mixed-worded items, suggesting that linguistic complexity may compromise validity. Structural equation models confirmed a significant relationship between mathematics confidence and achievement, yet model fit, and strength of relationships varied across operationalisations. The findings underscore the importance of construct validation in ILSA-based secondary analyses and call for greater attention to translation equivalence and item wording.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101562"},"PeriodicalIF":2.6,"publicationDate":"2026-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146022536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Larger immigrant-native academic achievement gaps in EU countries: A study of the PISA assessment from 2006 to 2022 欧盟国家移民与本土学生学业成绩差距较大:2006年至2022年PISA评估研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2026-01-07 DOI: 10.1016/j.stueduc.2025.101556
Qingke Guo , Xiaojie Xin
This study employs PISA data (2006–2022) to examine immigrant-native achievement gaps in EU and non-EU nations across three sub-studies. Study 1 reveals that immigrant disadvantage is not universal; in fact, immigrant students outperform their native peers in many non-EU and several EU nations. Study 2, focusing on stable EU member states, finds consistently larger achievement gaps in EU nations compared to non-EU nations. Study 3 utilizes latent growth modeling and identifies no significant divergence in gap trends between EU and non-EU education systems. According to existing literature, these differences may originate from factors such as migration policy selectivity, socioeconomic backgrounds, and institutional responsiveness. Although performance gaps persist, EU nations exhibit lower within-country score dispersion, pointing to greater internal equity. The study concludes with policy recommendations aimed at narrowing these gaps, including refining immigrant screening mechanisms, enhancing teacher preparation in multicultural education, and reforming early tracking systems.
本研究采用国际学生评估项目(PISA)数据(2006-2022年),通过三个子研究来检验欧盟和非欧盟国家移民与本土的成就差距。研究1表明,移民劣势并非普遍存在;事实上,在许多非欧盟国家和一些欧盟国家,移民学生的表现超过了本国学生。研究2聚焦于稳定的欧盟成员国,发现与非欧盟国家相比,欧盟国家的成就差距一直更大。研究3利用潜在增长模型,发现欧盟和非欧盟教育体系之间的差距趋势没有显著差异。根据现有文献,这些差异可能源于移民政策选择性、社会经济背景和制度响应等因素。尽管表现差距仍然存在,但欧盟国家表现出较低的国内得分差异,表明其内部公平程度更高。该研究最后提出了旨在缩小这些差距的政策建议,包括完善移民筛选机制,加强多元文化教育中的教师准备,改革早期跟踪系统。
{"title":"Larger immigrant-native academic achievement gaps in EU countries: A study of the PISA assessment from 2006 to 2022","authors":"Qingke Guo ,&nbsp;Xiaojie Xin","doi":"10.1016/j.stueduc.2025.101556","DOIUrl":"10.1016/j.stueduc.2025.101556","url":null,"abstract":"<div><div>This study employs PISA data (2006–2022) to examine immigrant-native achievement gaps in EU and non-EU nations across three sub-studies. Study 1 reveals that immigrant disadvantage is not universal; in fact, immigrant students outperform their native peers in many non-EU and several EU nations. Study 2, focusing on stable EU member states, finds consistently larger achievement gaps in EU nations compared to non-EU nations. Study 3 utilizes latent growth modeling and identifies no significant divergence in gap trends between EU and non-EU education systems. According to existing literature, these differences may originate from factors such as migration policy selectivity, socioeconomic backgrounds, and institutional responsiveness. Although performance gaps persist, EU nations exhibit lower within-country score dispersion, pointing to greater internal equity. The study concludes with policy recommendations aimed at narrowing these gaps, including refining immigrant screening mechanisms, enhancing teacher preparation in multicultural education, and reforming early tracking systems.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101556"},"PeriodicalIF":2.6,"publicationDate":"2026-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145925716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing school readiness domains in a large cohort of refugee children: Validation and links with family factors 评估大批难民儿童的入学准备领域:验证及其与家庭因素的联系
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-12-30 DOI: 10.1016/j.stueduc.2025.101557
Alexandra Cheah , Kimberley Kong , Jean Anne Heng , Katharina Ereky-Stevens , Iram Siraj
Despite the growing global presence of refugee populations, few validated tools exist to assess early learning and development in these contexts. This study examined the use of the International Development and Early Learning Assessment (IDELA) with a large sample of 1033 refugee children aged 4–6 years living in Malaysia, a non-resettlement, low- to middle-income country. Using Rasch modelling, we evaluated the psychometric properties of IDELA and found strong person and item reliability, acceptable item fit, and good evidence of unidimensionality, although some item redundancy was observed. Further, children's school readiness scores were significantly associated with child gender and age, as well as maternal and paternal demographic characteristics (age, education, literacy), but not father employment or occupation type. These findings provide preliminary validation for IDELA’s use in refugee settings and underscore its potential as a culturally adaptable, low-cost tool for assessing development in underserved populations.
尽管全球难民人数不断增加,但很少有有效的工具来评估这些背景下的早期学习和发展。本研究考察了国际发展和早期学习评估(IDELA)的使用情况,其中包括1033名生活在马来西亚的4-6岁难民儿童,马来西亚是一个非重新安置的中低收入国家。使用Rasch模型,我们评估了IDELA的心理测量特性,发现强大的人和项目可靠性,可接受的项目契合度,以及良好的单维性证据,尽管观察到一些项目冗余。此外,儿童的入学准备分数与儿童的性别和年龄以及母亲和父亲的人口统计学特征(年龄、教育程度、识字程度)显著相关,但与父亲的就业或职业类型无关。这些发现为IDELA在难民环境中的使用提供了初步验证,并强调了其作为评估服务不足人口发展的文化适应性低成本工具的潜力。
{"title":"Assessing school readiness domains in a large cohort of refugee children: Validation and links with family factors","authors":"Alexandra Cheah ,&nbsp;Kimberley Kong ,&nbsp;Jean Anne Heng ,&nbsp;Katharina Ereky-Stevens ,&nbsp;Iram Siraj","doi":"10.1016/j.stueduc.2025.101557","DOIUrl":"10.1016/j.stueduc.2025.101557","url":null,"abstract":"<div><div>Despite the growing global presence of refugee populations, few validated tools exist to assess early learning and development in these contexts. This study examined the use of the International Development and Early Learning Assessment (IDELA) with a large sample of 1033 refugee children aged 4–6 years living in Malaysia, a non-resettlement, low- to middle-income country. Using Rasch modelling, we evaluated the psychometric properties of IDELA and found strong person and item reliability, acceptable item fit, and good evidence of unidimensionality, although some item redundancy was observed. Further, children's school readiness scores were significantly associated with child gender and age, as well as maternal and paternal demographic characteristics (age, education, literacy), but not father employment or occupation type. These findings provide preliminary validation for IDELA’s use in refugee settings and underscore its potential as a culturally adaptable, low-cost tool for assessing development in underserved populations.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101557"},"PeriodicalIF":2.6,"publicationDate":"2025-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145884394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The predictive validity of PIRLS and ePIRLS on later academic achievement: Insights from Sweden, PIRLS和ePIRLS对后期学业成绩的预测效度:来自瑞典的见解
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-12-17 DOI: 10.1016/j.stueduc.2025.101554
Elpis Grammatikopoulou
The aim of this study was to investigate and compare how two reading assessments measured in Grade 4 predict later school grades. Specifically, the study explored how paper-based and digital reading scores were related to school grades in Grades 6 and 9. Data from the international assessment PIRLS 2016 and its digital counterpart ePIRLS 2016, along with Swedish register data were used. Regression results speak to the lasting effects of early reading achievement on later achievement in various subjects. Notably, digital test scores showed stronger associations with later grades, particularly in Grade 6. Although moderate in strength, the predictive validity of digital test scores was higher for subjects like English and mathematics, compared to paper-based test scores. These findings lend some credibility to the ongoing transition to digital assessment, indicating that digital reading measures may capture skills more relevant to later academic success.
本研究的目的是调查和比较四年级的两项阅读评估如何预测以后的学校成绩。具体来说,该研究探讨了六年级和九年级学生的纸质阅读和数字阅读分数与学校成绩的关系。使用了国际评估PIRLS 2016及其数字副本ePIRLS 2016的数据,以及瑞典注册数据。回归结果说明了早期阅读成绩对以后各科成绩的持久影响。值得注意的是,数字测试成绩与以后的成绩有更强的联系,尤其是在六年级。虽然强度适中,但与纸质考试成绩相比,数字考试成绩对英语和数学等科目的预测效度更高。这些发现为正在进行的向数字化评估的过渡提供了一定的可信度,表明数字化阅读测量可能会捕捉到与后来的学术成功更相关的技能。
{"title":"The predictive validity of PIRLS and ePIRLS on later academic achievement: Insights from Sweden,","authors":"Elpis Grammatikopoulou","doi":"10.1016/j.stueduc.2025.101554","DOIUrl":"10.1016/j.stueduc.2025.101554","url":null,"abstract":"<div><div>The aim of this study was to investigate and compare how two reading assessments measured in Grade 4 predict later school grades. Specifically, the study explored how paper-based and digital reading scores were related to school grades in Grades 6 and 9. Data from the international assessment PIRLS 2016 and its digital counterpart ePIRLS 2016, along with Swedish register data were used. Regression results speak to the lasting effects of early reading achievement on later achievement in various subjects. Notably, digital test scores showed stronger associations with later grades, particularly in Grade 6. Although moderate in strength, the predictive validity of digital test scores was higher for subjects like English and mathematics, compared to paper-based test scores. These findings lend some credibility to the ongoing transition to digital assessment, indicating that digital reading measures may capture skills more relevant to later academic success.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"88 ","pages":"Article 101554"},"PeriodicalIF":2.6,"publicationDate":"2025-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145790393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Studies in Educational Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1