首页 > 最新文献

Educational Research and Evaluation最新文献

英文 中文
Exploring the complex relationship between students’ reading skills and their performance in mathematics: a population-based study 探究学生阅读技能与数学成绩之间的复杂关系:一项基于人群的研究
IF 1.4 Q2 Social Sciences Pub Date : 2020-05-18 DOI: 10.1080/13803611.2021.1924790
C. Cascella
ABSTRACT Students’ attainment in mathematics is associated with several personal and contextual factors, but little research has been carried out to explore the intersectionality between them. The current paper aims to fill this gap. Census assessment data collected in Italy at Grade 10 (on average, 15-year-old students) by the Italian national institute for the evaluation of the educational system were analysed via a multilevel regression model to account for data hierarchy (422,865 students in 24,279 classrooms, in 3,950 schools). Census data in educational research allowed exploration of the intersectionality between independent variables at different levels of the model’s hierarchy. Results showed that reading skills mediate the relationship between students’ attainment in mathematics and their gender, citizenship status, and socioeconomic status (SES). Implications for policy and practice are discussed.
摘要:学生的数学成就与几个个人因素和情境因素有关,但很少有研究探讨它们之间的交叉性。目前的论文旨在填补这一空白。意大利国家教育系统评估研究所在意大利10年级(平均15岁学生)收集的人口普查评估数据通过多层次回归模型进行了分析,以说明数据层次(3950所学校24279间教室的422865名学生)。教育研究中的人口普查数据允许探索模型层次结构不同层次的自变量之间的交叉性。结果表明,阅读技能在学生的数学成就与性别、公民身份和社会经济地位之间起着中介作用。讨论了对政策和实践的影响。
{"title":"Exploring the complex relationship between students’ reading skills and their performance in mathematics: a population-based study","authors":"C. Cascella","doi":"10.1080/13803611.2021.1924790","DOIUrl":"https://doi.org/10.1080/13803611.2021.1924790","url":null,"abstract":"ABSTRACT Students’ attainment in mathematics is associated with several personal and contextual factors, but little research has been carried out to explore the intersectionality between them. The current paper aims to fill this gap. Census assessment data collected in Italy at Grade 10 (on average, 15-year-old students) by the Italian national institute for the evaluation of the educational system were analysed via a multilevel regression model to account for data hierarchy (422,865 students in 24,279 classrooms, in 3,950 schools). Census data in educational research allowed exploration of the intersectionality between independent variables at different levels of the model’s hierarchy. Results showed that reading skills mediate the relationship between students’ attainment in mathematics and their gender, citizenship status, and socioeconomic status (SES). Implications for policy and practice are discussed.","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1924790","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44951809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
The truth, the whole truth, and nothing but the truth 真相,全部真相,只有真相
IF 1.4 Q2 Social Sciences Pub Date : 2020-05-18 DOI: 10.1080/13803611.2021.1944998
Keith Morrison, G. P. van der Werf
The search for reliable and valid evidence from research in education concerning the “truth” of a matter is neither easy nor straightforward. What can we safely take from research findings? What kinds of studies can yield the most reliable and valid evidence? Do we go for close-grained detail or an overall generalization? How selective and biased are we in sifting through evidence and what it tells us? How much do we project our own tastes onto data and our interpretation of the messages coming from them? How can we overcome bias? The opening pages of Silver’s volume The Signal and the Noise (2012) include a disturbing and potentially disruptive comment. He argues that we live in an age when information floods out faster than we can cope with, and so, to survive, we look at it selectively and subjectively, mindless of the “distortions” of the “truth” that such behaviour risks (p. 17). Silver’s message reinforces Kahneman’s (2011) Thinking Fast and Slow, in which Kahneman indicates that, whilst “humans are not irrational” (p. 411), they often need help in making more accurate and rational judgements, decisions, and choices. We tend to see what we want to see, and we quietly, subconsciously look for information that will support our preconceptions and preferences, even if this contradicts what the evidence is actually telling us. None of this is new; consider Jane Austen’s quip in her novel Persuasion: “How quick come the reasons for approving what we like” (Austen, 1818/1993, p. 12). It is easy to mistake the “truth”. Add to this phenomenon Silver’s (2012) comment that the “truth” is the “signal” which arises out of the “noise”, whilst “noise” is that which “distracts us” from such “truth” (p. 17). “Noise” comprises contextual material and, indeed, research methods. But in the variable-dense, highly contingent, setting-specific, context-rich, conditional, and person-dependent world of education, how acceptable is it to consign contexts to being somehow separate, separable from, or somehow lesser than “signals” and “truths”. What if the reverse of Silver’s claim turns out to be the “truth”, and that, in reality, contextual “noise” is actually the “signal” that we should accept? How rational is it to seek and separate the “signal” from contextual “noise” in educational research? Surely research in education includes context as part of the “signal”? There is a compelling argument that suggests that research findings in education are, and should be, inescapably and symbiotically, constitutionally, wedded to context, contextually rooted in it and referenced to it. As the review of Biesta’s (2020) book Educational Research: An Unorthodox Introduction notes in this issue, researchers in education must “recover the constituent features of educational aspects of educational research: what makes educational research specifically educational”. Moreover, the conjectural nature of science makes it clear that what happens to come out of the “noise” of specific
从教育研究中寻找关于事物“真相”的可靠和有效的证据既不容易也不直接。我们可以安全地从研究结果中得出什么结论?什么样的研究可以产生最可靠和有效的证据?我们是追求细致的细节,还是追求整体的概括?我们在筛选证据和它告诉我们的东西时有多挑剔和偏见?我们在多大程度上把自己的品味投射到数据上,以及我们对来自数据的信息的解读上?我们如何克服偏见?西尔弗的《信号与噪音》(The Signal and The Noise, 2012)一书的开头几页包含了一条令人不安的、可能具有破坏性的评论。他认为,我们生活在一个信息泛滥速度超过我们应对能力的时代,因此,为了生存,我们有选择地、主观地看待信息,而不顾这种行为可能造成的“真相”的“扭曲”(第17页)。Silver的观点强化了Kahneman(2011)的《Thinking Fast and Slow》,Kahneman在书中指出,虽然“人类不是非理性的”(第411页),但他们在做出更准确、更理性的判断、决策和选择时往往需要帮助。我们倾向于看到我们想看到的东西,我们悄悄地、下意识地寻找能够支持我们先入为主的观念和偏好的信息,即使这与证据实际告诉我们的相矛盾。这些都不是新鲜事;想想简·奥斯汀在她的小说《劝导》中的妙语:“赞成我们喜欢的东西的理由多快啊”(奥斯汀,1818/1993,第12页)。人们很容易误解“真相”。对于这一现象,西尔弗(2012)的评论是,“真相”是从“噪音”中产生的“信号”,而“噪音”是“分散我们”对这种“真相”的注意力(第17页)。“噪音”包括语境材料和研究方法。但是,在变量密集、高度偶然、特定设置、上下文丰富、有条件和个人依赖的教育世界中,将上下文与“信号”和“真理”分开、可分离或比“信号”和“真理”小得多,这是如何被接受的呢?如果西尔弗主张的反面被证明是“真相”,而实际上,语境“噪音”实际上是我们应该接受的“信号”,那该怎么办?在教育研究中,从语境的“噪音”中寻找和分离“信号”有多理性?教育研究当然包括语境作为“信号”的一部分吗?有一个令人信服的论点表明,教育方面的研究成果是,也应该是,不可避免地,共生地,从本质上,与背景结合在一起,在背景中扎根并参考它。正如Biesta(2020)的《教育研究:非正统导论》(Educational Research: An non - orthodox Introduction)的书评在本期中所指出的那样,教育研究人员必须“恢复教育研究的教育方面的构成特征:是什么使教育研究具有特殊的教育意义”。此外,科学的推测性本质清楚地表明,从特定研究的“噪音”中产生的东西——“信号”——既不是无可争议的,也不是绝对的“真理”。科学“真理”的临时性质(即我们目前所知道的最好的)只是一个暂定的、最好是有证据的“最佳选择”(Major & Higgins, 2019)。非情境化的教育研究数据是否能够将教育工作者从情境的泥潭中解放出来?我们应该选择小规模、高粒度的游戏吗
{"title":"The truth, the whole truth, and nothing but the truth","authors":"Keith Morrison, G. P. van der Werf","doi":"10.1080/13803611.2021.1944998","DOIUrl":"https://doi.org/10.1080/13803611.2021.1944998","url":null,"abstract":"The search for reliable and valid evidence from research in education concerning the “truth” of a matter is neither easy nor straightforward. What can we safely take from research findings? What kinds of studies can yield the most reliable and valid evidence? Do we go for close-grained detail or an overall generalization? How selective and biased are we in sifting through evidence and what it tells us? How much do we project our own tastes onto data and our interpretation of the messages coming from them? How can we overcome bias? The opening pages of Silver’s volume The Signal and the Noise (2012) include a disturbing and potentially disruptive comment. He argues that we live in an age when information floods out faster than we can cope with, and so, to survive, we look at it selectively and subjectively, mindless of the “distortions” of the “truth” that such behaviour risks (p. 17). Silver’s message reinforces Kahneman’s (2011) Thinking Fast and Slow, in which Kahneman indicates that, whilst “humans are not irrational” (p. 411), they often need help in making more accurate and rational judgements, decisions, and choices. We tend to see what we want to see, and we quietly, subconsciously look for information that will support our preconceptions and preferences, even if this contradicts what the evidence is actually telling us. None of this is new; consider Jane Austen’s quip in her novel Persuasion: “How quick come the reasons for approving what we like” (Austen, 1818/1993, p. 12). It is easy to mistake the “truth”. Add to this phenomenon Silver’s (2012) comment that the “truth” is the “signal” which arises out of the “noise”, whilst “noise” is that which “distracts us” from such “truth” (p. 17). “Noise” comprises contextual material and, indeed, research methods. But in the variable-dense, highly contingent, setting-specific, context-rich, conditional, and person-dependent world of education, how acceptable is it to consign contexts to being somehow separate, separable from, or somehow lesser than “signals” and “truths”. What if the reverse of Silver’s claim turns out to be the “truth”, and that, in reality, contextual “noise” is actually the “signal” that we should accept? How rational is it to seek and separate the “signal” from contextual “noise” in educational research? Surely research in education includes context as part of the “signal”? There is a compelling argument that suggests that research findings in education are, and should be, inescapably and symbiotically, constitutionally, wedded to context, contextually rooted in it and referenced to it. As the review of Biesta’s (2020) book Educational Research: An Unorthodox Introduction notes in this issue, researchers in education must “recover the constituent features of educational aspects of educational research: what makes educational research specifically educational”. Moreover, the conjectural nature of science makes it clear that what happens to come out of the “noise” of specific ","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1944998","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45597806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Educational research: an unorthodox introduction 教育研究:一个非正统的介绍
IF 1.4 Q2 Social Sciences Pub Date : 2020-05-18 DOI: 10.1080/13803611.2021.1920212
K. Morrison
This book is a volume in which, without offence to the poet Yeats, “the ceremony of innocence is drowned”. Like it or not, educational research is inescapably not innocent; it is embedded in, and c...
在这本书中,诗人叶芝毫不冒犯地说,“天真的仪式被淹没了”。不管你喜不喜欢,教育研究不可避免地不是无辜的;它被嵌入,并且c。。。
{"title":"Educational research: an unorthodox introduction","authors":"K. Morrison","doi":"10.1080/13803611.2021.1920212","DOIUrl":"https://doi.org/10.1080/13803611.2021.1920212","url":null,"abstract":"This book is a volume in which, without offence to the poet Yeats, “the ceremony of innocence is drowned”. Like it or not, educational research is inescapably not innocent; it is embedded in, and c...","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1920212","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42374507","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The value of using classroom observations as part of a multi-methodological approach to evaluate student engagement in vocational agricultural education 将课堂观察作为评估学生参与农业职业教育的多种方法的一部分的价值
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1872390
Kevin Cunningham, M. Gorman, James A. Maher
ABSTRACT This paper discusses the value of using classroom observations as part of a multi-methodological approach to understand what influences student engagement in classroom settings. This action research aimed to gain insights into what influences students to participate in the classroom and was conducted in an Irish vocational agricultural college as part of an initiative aimed to enhance classroom engagement. Classroom observations were used to examine how students interact in classroom settings by observing student’s behavioural engagement as the cognitive and affective domains of engagement are more difficult to observe. The findings were triangulated and validated with data from the teacher interviews, student focus groups, and a student survey. This paper details the multi-methodological approach taken, how classroom observations were developed and used, and the value they brought to evaluate what impacted student engagement within this context.
摘要本文讨论了将课堂观察作为多种方法论方法的一部分来理解是什么影响了学生在课堂环境中的参与度的价值。这项行动研究旨在深入了解是什么影响了学生参与课堂,它是在爱尔兰一所农业职业学院进行的,是旨在提高课堂参与度的举措的一部分。课堂观察被用来通过观察学生的行为参与来检验学生在课堂环境中是如何互动的,因为参与的认知和情感领域更难观察。这些发现被三角化,并通过教师访谈、学生焦点小组和学生调查的数据进行了验证。本文详细介绍了所采取的多种方法,课堂观察是如何发展和使用的,以及它们在评估这种背景下对学生参与度的影响时所带来的价值。
{"title":"The value of using classroom observations as part of a multi-methodological approach to evaluate student engagement in vocational agricultural education","authors":"Kevin Cunningham, M. Gorman, James A. Maher","doi":"10.1080/13803611.2021.1872390","DOIUrl":"https://doi.org/10.1080/13803611.2021.1872390","url":null,"abstract":"ABSTRACT This paper discusses the value of using classroom observations as part of a multi-methodological approach to understand what influences student engagement in classroom settings. This action research aimed to gain insights into what influences students to participate in the classroom and was conducted in an Irish vocational agricultural college as part of an initiative aimed to enhance classroom engagement. Classroom observations were used to examine how students interact in classroom settings by observing student’s behavioural engagement as the cognitive and affective domains of engagement are more difficult to observe. The findings were triangulated and validated with data from the teacher interviews, student focus groups, and a student survey. This paper details the multi-methodological approach taken, how classroom observations were developed and used, and the value they brought to evaluate what impacted student engagement within this context.","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1872390","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48373984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Taming randomized controlled trials in education: exploring key claims, issues and debates 驯服教育中的随机对照试验:探索关键主张、问题和辩论
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1874089
E. Pogorskiy
Keith Morrison’s Taming Randomized Controlled Trials in Education provides a comprehensive theoretical and practical overview of randomised controlled trials (RCTs) as a source of evidence in education. This book is an important and timely contribution to the topic of evidence-based education, offering a provocative and challenging position while paying careful attention to detail and weighting key arguments for and against RCTs in educational research. Making informed and evidence-based decisions is, naturally, central to the methods of scientific investigation, and RCT as the result of an interdisciplinary effort to evaluating interventions includes practices and assumptions from and across various interacting fields. For instance, “evidence-based education” emerges from “evidence-based medicine”, as noted by Coe et al. (2000). Randomised controlled trial research design, in turn, emerged from experimental research in education and psychology (Oakley, 1998), and RCTs in medical and educational research have a range of similarities and differences, as noted by Morrison (p. 103). In the last 2 decades, attention to RCTs in education has surged. This particular research design has been implemented across a broad range of studies, including those concerned with improving learning (Elliott, 2001; C. J. Torgerson & Torgerson, 2001), supporting evidence-based policy in education (Gorard et al., 2017; Katsipataki & Higgins, 2016), and studies focusing on eliminating global poverty (Banerjee et al., 2015; Tollefson, 2015). In recent years, the superiority of RCTs has often been taken for granted and considered to be a methodological “gold standard”. Morrison, however, challenges this habitual assumption in his new book, at least when it comes to considering results from RCTs in an educational context. This book is an important contribution to resources on randomised control trials, such as those authored by D. J. Torgerson and Torgerson (2008) and Glennerster and Takavarasha (2013), which provide introductions to the topic, alongside practical advice on planning, conducting, and evaluating RCTs. Morrison’s newly published book, however, offers a unique critical perspective on RCT research design and its role
Keith Morrison的《驯服教育中的随机对照试验》提供了随机对照试验作为教育证据来源的全面理论和实践概述。这本书对循证教育这一主题做出了重要而及时的贡献,提供了一个具有挑衅性和挑战性的立场,同时在教育研究中仔细关注细节并权衡支持和反对随机对照试验的关键论点。做出知情和循证的决策自然是科学调查方法的核心,而随机对照试验作为评估干预措施的跨学科努力的结果,包括来自各个相互作用领域的实践和假设。例如,Coe等人(2000)指出,“循证教育”源于“循证医学”。随机对照试验研究设计反过来又出现在教育和心理学的实验研究中(Oakley,1998),正如Morrison所指出的,医学和教育研究中的随机对照试验有一系列相似之处和差异之处(第103页)。在过去的20年里,随机对照试验在教育中的关注度激增。这一特定的研究设计已在广泛的研究中实施,包括那些与改善学习有关的研究(Elliott,2001;C.J.Torgerson和Torgerson,2001),支持教育中的循证政策(Gorard等人,2017;Katsipataki和Higgins,2016),以及专注于消除全球贫困的研究(Banerjee等人,2015;Tollefson,2015)。近年来,随机对照试验的优越性往往被认为是理所当然的,并被认为是一种方法上的“黄金标准”。然而,Morrison在他的新书中挑战了这一习惯性假设,至少在教育背景下考虑随机对照试验的结果时是这样。这本书对随机对照试验的资源做出了重要贡献,例如D.J.Torgerson和Torgerson(2008)以及Glennerster和Takavarasha(2013)撰写的随机对照试验,这些随机对照试验介绍了该主题,并提供了关于随机对照试验规划、实施和评估的实用建议。然而,Morrison最新出版的书对随机对照试验的研究设计及其作用提供了独特的批判性视角
{"title":"Taming randomized controlled trials in education: exploring key claims, issues and debates","authors":"E. Pogorskiy","doi":"10.1080/13803611.2021.1874089","DOIUrl":"https://doi.org/10.1080/13803611.2021.1874089","url":null,"abstract":"Keith Morrison’s Taming Randomized Controlled Trials in Education provides a comprehensive theoretical and practical overview of randomised controlled trials (RCTs) as a source of evidence in education. This book is an important and timely contribution to the topic of evidence-based education, offering a provocative and challenging position while paying careful attention to detail and weighting key arguments for and against RCTs in educational research. Making informed and evidence-based decisions is, naturally, central to the methods of scientific investigation, and RCT as the result of an interdisciplinary effort to evaluating interventions includes practices and assumptions from and across various interacting fields. For instance, “evidence-based education” emerges from “evidence-based medicine”, as noted by Coe et al. (2000). Randomised controlled trial research design, in turn, emerged from experimental research in education and psychology (Oakley, 1998), and RCTs in medical and educational research have a range of similarities and differences, as noted by Morrison (p. 103). In the last 2 decades, attention to RCTs in education has surged. This particular research design has been implemented across a broad range of studies, including those concerned with improving learning (Elliott, 2001; C. J. Torgerson & Torgerson, 2001), supporting evidence-based policy in education (Gorard et al., 2017; Katsipataki & Higgins, 2016), and studies focusing on eliminating global poverty (Banerjee et al., 2015; Tollefson, 2015). In recent years, the superiority of RCTs has often been taken for granted and considered to be a methodological “gold standard”. Morrison, however, challenges this habitual assumption in his new book, at least when it comes to considering results from RCTs in an educational context. This book is an important contribution to resources on randomised control trials, such as those authored by D. J. Torgerson and Torgerson (2008) and Glennerster and Takavarasha (2013), which provide introductions to the topic, alongside practical advice on planning, conducting, and evaluating RCTs. Morrison’s newly published book, however, offers a unique critical perspective on RCT research design and its role","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1874089","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43357344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
The scalpel model of educational research 教育研究的手术刀模型
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1912894
K. Morrison, G. P. van der Werf
Many years ago, the late internationally renowned UK educationist, Harvey Goldstein, gave a thrilling keynote lecture on assessment. He calmly, politely, andwith surgical skill, wielded his intellectual scalpel with dazzling flashes of compelling brilliance, dissecting out and demolishing the then UK government’s policy on assessment in UK schools. It was a model of its kind. He set out, analysed, evaluated, critiqued, and judged the policy. He exposed its assumptions, aporias, and underlying ideology, implications, and consequences, drawing on a range of research evidence, weighing up its pros and cons, and leaving it all in ruins on the dissecting table, to the delight and spontaneous applause of the audience. Working like a filigree jeweller, he exposed it for what it was: dogma wrapped up in high-sounding, pejorative phrases. His forecast of consequences came true. By taking a sober, cool, unemotional, dispassionate, careful, perfectly paced, and measured analysis, he enabled his scalpel to do its work, step by step, and it worked wonders. There were no histrionics or one-sided statements. Instead, he let the argument speak for itself. In Habermasian style, the unforced force of the argument prevailed, drawing on a wealth of research evidence where relevant, generating light rather than the heat of a furnace of emotional noise, and persuading by the force of the argument alone, not its temperature. The deeper that Goldstein went into his analysis, the clearer it became that here was a topic – assessment in UK schools – whose features were complex rather than simple, unstraightforward rather than easily understood, multitextured, multidimensional, and multilevelled, a contested ideological terrain in many dimensions and levels, and not to be taken at face value. His analysis was an example par excellence of how researchers in education should operate, indicating not only that they have a duty to expose and unravel the complexity of an issue but also how to do it. The four papers in this issue illustrate the importance of researchers in education opening up and analysing their fields closely and carefully, exposing the complexities of the issues with which they are working, what their evidence suggests, and what are the boundaries of what can be taken from their research. This is their task, whatever fields of focus, methodologies, and methods they employ. For example, in this issue, Cunningham, Gorman, and Maher report action research using observational approaches to study student engagement, noting that “student engagement is a multidimensional and complex phenomenon”, and they indicate the limits of their research as being “too small to draw conclusive conclusions”. Kim and Lee, using survey data from the Measures of Effective Teaching project, conduct multilevel regression analysis to measure teacher effectiveness. They employ a value-added model that moves beyond averages and takes account of variance in teachers, in the name of equity in
多年前,已故国际知名英国教育家哈维·戈尔茨坦就评估问题作了一次激动人心的主题演讲。他冷静、礼貌、熟练地挥舞着他的智力手术刀,闪烁着耀眼的光彩,剖析并摧毁了当时英国政府对英国学校评估的政策。这是同类产品的典范。他阐述、分析、评估、批评和判断这项政策。他揭露了它的假设、寓言以及潜在的意识形态、含义和后果,引用了一系列研究证据,权衡了它的利弊,并将其全部放在解剖台上,引起了观众的高兴和自发的掌声。他像一个花丝珠宝商一样工作,揭露了它的本质:用冠冕堂皇的贬义短语包裹的教条。他对后果的预测成真了。通过冷静、冷静、冷静的分析,他使他的手术刀能够一步一步地完成任务,并创造了奇迹。没有表演或片面的陈述。相反,他让争论不言自明。在哈贝马斯的风格中,论点的非受迫性力量占了上风,在相关的情况下利用了大量的研究证据,产生了光而不是情绪噪音熔炉的热量,并仅凭论点的力量而不是温度来说服。戈尔茨坦的分析越深入,就越清楚地表明,这是一个主题——英国学校的评估——其特点是复杂而非简单,不直接而非易于理解,多纹理、多维度和多层次,是一个在许多维度和层面上有争议的意识形态领域,不能从表面上看。他的分析是教育研究人员应该如何运作的一个优秀例子,表明他们不仅有责任揭露和解开问题的复杂性,而且有责任如何去做。本期的四篇论文说明了研究人员在教育开放中的重要性,并仔细分析了他们的领域,揭示了他们正在研究的问题的复杂性,他们的证据表明了什么,以及可以从他们的研究中获得什么的界限是什么。这是他们的任务,无论他们关注的领域、方法和方法如何。例如,在本期文章中,Cunningham、Gorman和Maher报告了使用观察性方法研究学生参与度的行动研究,指出“学生参与度是一个多维而复杂的现象”,他们指出他们的研究局限性“太小,无法得出结论”。金和李利用有效教学测量项目的调查数据,进行了多层次回归分析,以测量教师的有效性。他们采用了一种超越平均值的增值模型,并以公平的名义考虑了教师的差异,以识别学生之间的差异。他们谨慎地包括“限制和警告”,并认识到“衡量教育公平教学实践的工具的限制”。
{"title":"The scalpel model of educational research","authors":"K. Morrison, G. P. van der Werf","doi":"10.1080/13803611.2021.1912894","DOIUrl":"https://doi.org/10.1080/13803611.2021.1912894","url":null,"abstract":"Many years ago, the late internationally renowned UK educationist, Harvey Goldstein, gave a thrilling keynote lecture on assessment. He calmly, politely, andwith surgical skill, wielded his intellectual scalpel with dazzling flashes of compelling brilliance, dissecting out and demolishing the then UK government’s policy on assessment in UK schools. It was a model of its kind. He set out, analysed, evaluated, critiqued, and judged the policy. He exposed its assumptions, aporias, and underlying ideology, implications, and consequences, drawing on a range of research evidence, weighing up its pros and cons, and leaving it all in ruins on the dissecting table, to the delight and spontaneous applause of the audience. Working like a filigree jeweller, he exposed it for what it was: dogma wrapped up in high-sounding, pejorative phrases. His forecast of consequences came true. By taking a sober, cool, unemotional, dispassionate, careful, perfectly paced, and measured analysis, he enabled his scalpel to do its work, step by step, and it worked wonders. There were no histrionics or one-sided statements. Instead, he let the argument speak for itself. In Habermasian style, the unforced force of the argument prevailed, drawing on a wealth of research evidence where relevant, generating light rather than the heat of a furnace of emotional noise, and persuading by the force of the argument alone, not its temperature. The deeper that Goldstein went into his analysis, the clearer it became that here was a topic – assessment in UK schools – whose features were complex rather than simple, unstraightforward rather than easily understood, multitextured, multidimensional, and multilevelled, a contested ideological terrain in many dimensions and levels, and not to be taken at face value. His analysis was an example par excellence of how researchers in education should operate, indicating not only that they have a duty to expose and unravel the complexity of an issue but also how to do it. The four papers in this issue illustrate the importance of researchers in education opening up and analysing their fields closely and carefully, exposing the complexities of the issues with which they are working, what their evidence suggests, and what are the boundaries of what can be taken from their research. This is their task, whatever fields of focus, methodologies, and methods they employ. For example, in this issue, Cunningham, Gorman, and Maher report action research using observational approaches to study student engagement, noting that “student engagement is a multidimensional and complex phenomenon”, and they indicate the limits of their research as being “too small to draw conclusive conclusions”. Kim and Lee, using survey data from the Measures of Effective Teaching project, conduct multilevel regression analysis to measure teacher effectiveness. They employ a value-added model that moves beyond averages and takes account of variance in teachers, in the name of equity in","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1912894","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44433710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Soft skills in education: putting the evidence in perspective 教育中的软技能:正确看待证据
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1882051
Randa K. El-Soufi
{"title":"Soft skills in education: putting the evidence in perspective","authors":"Randa K. El-Soufi","doi":"10.1080/13803611.2021.1882051","DOIUrl":"https://doi.org/10.1080/13803611.2021.1882051","url":null,"abstract":"","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1882051","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45325815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Linking personality to teachers’ literacy in classroom assessment: a cross-cultural study 课堂评估中人格与教师素养的联系:一项跨文化研究
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1902354
C. Schneider, Christopher DeLuca, M. Pozas, A. Coombs
ABSTRACT Educational assessment is a complex area of teacher professionalism involving negotiation of purposes and practices within sociocultural contexts. Developing teachers’ assessment literacy has thus become a priority across education systems. Additionally, student teachers’ assessment approaches and confidence in their assessment competence may be influenced by their personality and the prevailing educational cultures. This cross-cultural study on student teachers in Canada and Germany examined the relationship between personality traits and assessment literacy. Regression analyses revealed that self-rated assessment literacy was supported by sense of self-efficacy, suggesting that experiences of success in teacher education are important in developing assessment literacy. While summative approaches to assessment were not associated with personality, formative approaches were particularly influenced by personal values such as empathy and composure. Overall, the findings were fairly stable across the two educational contexts. Implications for teacher education in the field of assessment include an emphasis on leveraging student teachers’ values.
摘要教育评估是一个复杂的教师专业领域,涉及社会文化背景下的目标和实践协商。因此,发展教师的评估素养已成为整个教育系统的优先事项。此外,师生的评估方法和对其评估能力的信心可能受到其个性和主流教育文化的影响。这项针对加拿大和德国学生教师的跨文化研究考察了人格特征与评估素养之间的关系。回归分析显示,自我效能感支持了自评评估素养,这表明教师教育的成功经验对发展评估素养很重要。虽然总结性评估方法与个性无关,但形成性评估方法尤其受到移情和沉着等个人价值观的影响。总体而言,研究结果在两种教育背景下都相当稳定。评估领域对教师教育的影响包括强调利用师生的价值观。
{"title":"Linking personality to teachers’ literacy in classroom assessment: a cross-cultural study","authors":"C. Schneider, Christopher DeLuca, M. Pozas, A. Coombs","doi":"10.1080/13803611.2021.1902354","DOIUrl":"https://doi.org/10.1080/13803611.2021.1902354","url":null,"abstract":"ABSTRACT Educational assessment is a complex area of teacher professionalism involving negotiation of purposes and practices within sociocultural contexts. Developing teachers’ assessment literacy has thus become a priority across education systems. Additionally, student teachers’ assessment approaches and confidence in their assessment competence may be influenced by their personality and the prevailing educational cultures. This cross-cultural study on student teachers in Canada and Germany examined the relationship between personality traits and assessment literacy. Regression analyses revealed that self-rated assessment literacy was supported by sense of self-efficacy, suggesting that experiences of success in teacher education are important in developing assessment literacy. While summative approaches to assessment were not associated with personality, formative approaches were particularly influenced by personal values such as empathy and composure. Overall, the findings were fairly stable across the two educational contexts. Implications for teacher education in the field of assessment include an emphasis on leveraging student teachers’ values.","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1902354","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43435329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Group work and cultural characteristics in a Chinese school 中文学校的小组工作与文化特色
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1907202
K. Morrison, Alejandro Salcedo Garcia, Sin Teng Wong
ABSTRACT This paper reports a longitudinal case study of developing, implementing, and evaluating group work in a Chinese school in Macau, and instances the salience of Chinese cultural dimensions of schools, teachers, and students in understanding and developing group work in the Chinese school in question. It analyses group work in a case study school and finds that challenges in developing group work in the school are similar to those reported in non-Chinese schools, whilst, at the same time, embracing key aspects of Chinese culture. Group work here challenges one-sided interpretations of “the Chinese learner” and embraces both individualism and collectivism, collaboration and competition, and academic priorities and social priorities. Several elements of Chinese culture, pedagogical culture, and everyday contexts combine compatibly in understanding group work in this Chinese school.
摘要本文报告了澳门一所中文学校开展、实施和评估小组工作的纵向案例研究,并举例说明了学校、教师和学生在理解和开展小组工作方面的中国文化维度的显著性。它分析了一个案例研究学校的小组工作,发现在学校开展小组工作的挑战与在非中国学校报告的相似,同时,拥抱中国文化的关键方面。这里的小组学习挑战了对“中国学习者”的片面解释,同时包含了个人主义和集体主义、合作和竞争、学术优先和社会优先。在这所中国学校里,中国文化、教学文化和日常环境的几个元素在理解小组工作中相互兼容。
{"title":"Group work and cultural characteristics in a Chinese school","authors":"K. Morrison, Alejandro Salcedo Garcia, Sin Teng Wong","doi":"10.1080/13803611.2021.1907202","DOIUrl":"https://doi.org/10.1080/13803611.2021.1907202","url":null,"abstract":"ABSTRACT This paper reports a longitudinal case study of developing, implementing, and evaluating group work in a Chinese school in Macau, and instances the salience of Chinese cultural dimensions of schools, teachers, and students in understanding and developing group work in the Chinese school in question. It analyses group work in a case study school and finds that challenges in developing group work in the school are similar to those reported in non-Chinese schools, whilst, at the same time, embracing key aspects of Chinese culture. Group work here challenges one-sided interpretations of “the Chinese learner” and embraces both individualism and collectivism, collaboration and competition, and academic priorities and social priorities. Several elements of Chinese culture, pedagogical culture, and everyday contexts combine compatibly in understanding group work in this Chinese school.","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1907202","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43930112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring teacher effectiveness for equity: value-added model of teachers’ distributive effects on classroom achievement gaps 衡量教师公平有效性:教师分配效应对课堂成绩差距的增值模型
IF 1.4 Q2 Social Sciences Pub Date : 2020-02-17 DOI: 10.1080/13803611.2021.1906708
Taeyoung Kim, Jaekyung Lee
ABSTRACT Extending conventional value-added models (VAM) of teacher effects that focus on the estimation of average effects for excellence, this study examines “distributive” effects for equity. Using multilevel regression models, the study addresses two research questions to inform educational policy for teacher improvement and accountability. First, do more effective teachers contribute not only to improving student achievement overall (excellence) but also narrowing achievement gaps among student groups (equity)? The results show highly mixed relationships between average effect and distributive effects; effective teachers on average narrowed the achievement gaps among academic groups but not the gaps among racial and socioeconomic groups in their classrooms. Second, what attributes and practices of teachers are associated with desirable teacher effects for both excellence and equity? The conventional measures of teacher characteristics and practices help account for the average teacher effects but not the distributive effects. Implications are discussed for improving the measures of teacher effectiveness.
摘要本研究扩展了传统的教师效应增值模型(VAM),该模型侧重于估计卓越的平均效应,考察了公平的“分配”效应。本研究使用多层次回归模型,解决了两个研究问题,为教师改进和问责的教育政策提供信息。首先,更有效的教师不仅有助于提高学生的整体成绩(优秀),还有助于缩小学生群体之间的成绩差距(公平)吗?结果表明,平均效应和分配效应之间存在高度混合关系;有效的教师在课堂上平均缩小了学术群体之间的成绩差距,但没有缩小种族和社会经济群体之间的差距。第二,教师的哪些属性和实践与卓越和公平的理想教师效果有关?对教师特征和实践的传统测量有助于解释平均教师效应,但没有解释分配效应。讨论了对改进教师效能测量的启示。
{"title":"Measuring teacher effectiveness for equity: value-added model of teachers’ distributive effects on classroom achievement gaps","authors":"Taeyoung Kim, Jaekyung Lee","doi":"10.1080/13803611.2021.1906708","DOIUrl":"https://doi.org/10.1080/13803611.2021.1906708","url":null,"abstract":"ABSTRACT Extending conventional value-added models (VAM) of teacher effects that focus on the estimation of average effects for excellence, this study examines “distributive” effects for equity. Using multilevel regression models, the study addresses two research questions to inform educational policy for teacher improvement and accountability. First, do more effective teachers contribute not only to improving student achievement overall (excellence) but also narrowing achievement gaps among student groups (equity)? The results show highly mixed relationships between average effect and distributive effects; effective teachers on average narrowed the achievement gaps among academic groups but not the gaps among racial and socioeconomic groups in their classrooms. Second, what attributes and practices of teachers are associated with desirable teacher effects for both excellence and equity? The conventional measures of teacher characteristics and practices help account for the average teacher effects but not the distributive effects. Implications are discussed for improving the measures of teacher effectiveness.","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2020-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1906708","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46586020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Educational Research and Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1