{"title":"真相,全部真相,只有真相","authors":"Keith Morrison, G. P. van der Werf","doi":"10.1080/13803611.2021.1944998","DOIUrl":null,"url":null,"abstract":"The search for reliable and valid evidence from research in education concerning the “truth” of a matter is neither easy nor straightforward. What can we safely take from research findings? What kinds of studies can yield the most reliable and valid evidence? Do we go for close-grained detail or an overall generalization? How selective and biased are we in sifting through evidence and what it tells us? How much do we project our own tastes onto data and our interpretation of the messages coming from them? How can we overcome bias? The opening pages of Silver’s volume The Signal and the Noise (2012) include a disturbing and potentially disruptive comment. He argues that we live in an age when information floods out faster than we can cope with, and so, to survive, we look at it selectively and subjectively, mindless of the “distortions” of the “truth” that such behaviour risks (p. 17). Silver’s message reinforces Kahneman’s (2011) Thinking Fast and Slow, in which Kahneman indicates that, whilst “humans are not irrational” (p. 411), they often need help in making more accurate and rational judgements, decisions, and choices. We tend to see what we want to see, and we quietly, subconsciously look for information that will support our preconceptions and preferences, even if this contradicts what the evidence is actually telling us. None of this is new; consider Jane Austen’s quip in her novel Persuasion: “How quick come the reasons for approving what we like” (Austen, 1818/1993, p. 12). It is easy to mistake the “truth”. Add to this phenomenon Silver’s (2012) comment that the “truth” is the “signal” which arises out of the “noise”, whilst “noise” is that which “distracts us” from such “truth” (p. 17). “Noise” comprises contextual material and, indeed, research methods. But in the variable-dense, highly contingent, setting-specific, context-rich, conditional, and person-dependent world of education, how acceptable is it to consign contexts to being somehow separate, separable from, or somehow lesser than “signals” and “truths”. What if the reverse of Silver’s claim turns out to be the “truth”, and that, in reality, contextual “noise” is actually the “signal” that we should accept? How rational is it to seek and separate the “signal” from contextual “noise” in educational research? Surely research in education includes context as part of the “signal”? There is a compelling argument that suggests that research findings in education are, and should be, inescapably and symbiotically, constitutionally, wedded to context, contextually rooted in it and referenced to it. As the review of Biesta’s (2020) book Educational Research: An Unorthodox Introduction notes in this issue, researchers in education must “recover the constituent features of educational aspects of educational research: what makes educational research specifically educational”. Moreover, the conjectural nature of science makes it clear that what happens to come out of the “noise” of specific pieces of research – the “signal” – is neither incontrovertible nor an absolute “truth”. The provisional nature of scientific “truth” (qua the best that we currently know) is only a tentative, preferably evidence-informed “best bet” (Major & Higgins, 2019). Can and should decontextualized research data in education release educationists from the mire of contexts? Should we go for the small-scale, high granularity","PeriodicalId":47025,"journal":{"name":"Educational Research and Evaluation","volume":null,"pages":null},"PeriodicalIF":2.3000,"publicationDate":"2020-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/13803611.2021.1944998","citationCount":"0","resultStr":"{\"title\":\"The truth, the whole truth, and nothing but the truth\",\"authors\":\"Keith Morrison, G. P. van der Werf\",\"doi\":\"10.1080/13803611.2021.1944998\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The search for reliable and valid evidence from research in education concerning the “truth” of a matter is neither easy nor straightforward. What can we safely take from research findings? What kinds of studies can yield the most reliable and valid evidence? Do we go for close-grained detail or an overall generalization? How selective and biased are we in sifting through evidence and what it tells us? How much do we project our own tastes onto data and our interpretation of the messages coming from them? How can we overcome bias? The opening pages of Silver’s volume The Signal and the Noise (2012) include a disturbing and potentially disruptive comment. He argues that we live in an age when information floods out faster than we can cope with, and so, to survive, we look at it selectively and subjectively, mindless of the “distortions” of the “truth” that such behaviour risks (p. 17). Silver’s message reinforces Kahneman’s (2011) Thinking Fast and Slow, in which Kahneman indicates that, whilst “humans are not irrational” (p. 411), they often need help in making more accurate and rational judgements, decisions, and choices. We tend to see what we want to see, and we quietly, subconsciously look for information that will support our preconceptions and preferences, even if this contradicts what the evidence is actually telling us. None of this is new; consider Jane Austen’s quip in her novel Persuasion: “How quick come the reasons for approving what we like” (Austen, 1818/1993, p. 12). It is easy to mistake the “truth”. Add to this phenomenon Silver’s (2012) comment that the “truth” is the “signal” which arises out of the “noise”, whilst “noise” is that which “distracts us” from such “truth” (p. 17). “Noise” comprises contextual material and, indeed, research methods. But in the variable-dense, highly contingent, setting-specific, context-rich, conditional, and person-dependent world of education, how acceptable is it to consign contexts to being somehow separate, separable from, or somehow lesser than “signals” and “truths”. What if the reverse of Silver’s claim turns out to be the “truth”, and that, in reality, contextual “noise” is actually the “signal” that we should accept? How rational is it to seek and separate the “signal” from contextual “noise” in educational research? Surely research in education includes context as part of the “signal”? There is a compelling argument that suggests that research findings in education are, and should be, inescapably and symbiotically, constitutionally, wedded to context, contextually rooted in it and referenced to it. As the review of Biesta’s (2020) book Educational Research: An Unorthodox Introduction notes in this issue, researchers in education must “recover the constituent features of educational aspects of educational research: what makes educational research specifically educational”. Moreover, the conjectural nature of science makes it clear that what happens to come out of the “noise” of specific pieces of research – the “signal” – is neither incontrovertible nor an absolute “truth”. The provisional nature of scientific “truth” (qua the best that we currently know) is only a tentative, preferably evidence-informed “best bet” (Major & Higgins, 2019). Can and should decontextualized research data in education release educationists from the mire of contexts? Should we go for the small-scale, high granularity\",\"PeriodicalId\":47025,\"journal\":{\"name\":\"Educational Research and Evaluation\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2020-05-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1080/13803611.2021.1944998\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Educational Research and Evaluation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/13803611.2021.1944998\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Research and Evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/13803611.2021.1944998","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
摘要
从教育研究中寻找关于事物“真相”的可靠和有效的证据既不容易也不直接。我们可以安全地从研究结果中得出什么结论?什么样的研究可以产生最可靠和有效的证据?我们是追求细致的细节,还是追求整体的概括?我们在筛选证据和它告诉我们的东西时有多挑剔和偏见?我们在多大程度上把自己的品味投射到数据上,以及我们对来自数据的信息的解读上?我们如何克服偏见?西尔弗的《信号与噪音》(The Signal and The Noise, 2012)一书的开头几页包含了一条令人不安的、可能具有破坏性的评论。他认为,我们生活在一个信息泛滥速度超过我们应对能力的时代,因此,为了生存,我们有选择地、主观地看待信息,而不顾这种行为可能造成的“真相”的“扭曲”(第17页)。Silver的观点强化了Kahneman(2011)的《Thinking Fast and Slow》,Kahneman在书中指出,虽然“人类不是非理性的”(第411页),但他们在做出更准确、更理性的判断、决策和选择时往往需要帮助。我们倾向于看到我们想看到的东西,我们悄悄地、下意识地寻找能够支持我们先入为主的观念和偏好的信息,即使这与证据实际告诉我们的相矛盾。这些都不是新鲜事;想想简·奥斯汀在她的小说《劝导》中的妙语:“赞成我们喜欢的东西的理由多快啊”(奥斯汀,1818/1993,第12页)。人们很容易误解“真相”。对于这一现象,西尔弗(2012)的评论是,“真相”是从“噪音”中产生的“信号”,而“噪音”是“分散我们”对这种“真相”的注意力(第17页)。“噪音”包括语境材料和研究方法。但是,在变量密集、高度偶然、特定设置、上下文丰富、有条件和个人依赖的教育世界中,将上下文与“信号”和“真理”分开、可分离或比“信号”和“真理”小得多,这是如何被接受的呢?如果西尔弗主张的反面被证明是“真相”,而实际上,语境“噪音”实际上是我们应该接受的“信号”,那该怎么办?在教育研究中,从语境的“噪音”中寻找和分离“信号”有多理性?教育研究当然包括语境作为“信号”的一部分吗?有一个令人信服的论点表明,教育方面的研究成果是,也应该是,不可避免地,共生地,从本质上,与背景结合在一起,在背景中扎根并参考它。正如Biesta(2020)的《教育研究:非正统导论》(Educational Research: An non - orthodox Introduction)的书评在本期中所指出的那样,教育研究人员必须“恢复教育研究的教育方面的构成特征:是什么使教育研究具有特殊的教育意义”。此外,科学的推测性本质清楚地表明,从特定研究的“噪音”中产生的东西——“信号”——既不是无可争议的,也不是绝对的“真理”。科学“真理”的临时性质(即我们目前所知道的最好的)只是一个暂定的、最好是有证据的“最佳选择”(Major & Higgins, 2019)。非情境化的教育研究数据是否能够将教育工作者从情境的泥潭中解放出来?我们应该选择小规模、高粒度的游戏吗
The truth, the whole truth, and nothing but the truth
The search for reliable and valid evidence from research in education concerning the “truth” of a matter is neither easy nor straightforward. What can we safely take from research findings? What kinds of studies can yield the most reliable and valid evidence? Do we go for close-grained detail or an overall generalization? How selective and biased are we in sifting through evidence and what it tells us? How much do we project our own tastes onto data and our interpretation of the messages coming from them? How can we overcome bias? The opening pages of Silver’s volume The Signal and the Noise (2012) include a disturbing and potentially disruptive comment. He argues that we live in an age when information floods out faster than we can cope with, and so, to survive, we look at it selectively and subjectively, mindless of the “distortions” of the “truth” that such behaviour risks (p. 17). Silver’s message reinforces Kahneman’s (2011) Thinking Fast and Slow, in which Kahneman indicates that, whilst “humans are not irrational” (p. 411), they often need help in making more accurate and rational judgements, decisions, and choices. We tend to see what we want to see, and we quietly, subconsciously look for information that will support our preconceptions and preferences, even if this contradicts what the evidence is actually telling us. None of this is new; consider Jane Austen’s quip in her novel Persuasion: “How quick come the reasons for approving what we like” (Austen, 1818/1993, p. 12). It is easy to mistake the “truth”. Add to this phenomenon Silver’s (2012) comment that the “truth” is the “signal” which arises out of the “noise”, whilst “noise” is that which “distracts us” from such “truth” (p. 17). “Noise” comprises contextual material and, indeed, research methods. But in the variable-dense, highly contingent, setting-specific, context-rich, conditional, and person-dependent world of education, how acceptable is it to consign contexts to being somehow separate, separable from, or somehow lesser than “signals” and “truths”. What if the reverse of Silver’s claim turns out to be the “truth”, and that, in reality, contextual “noise” is actually the “signal” that we should accept? How rational is it to seek and separate the “signal” from contextual “noise” in educational research? Surely research in education includes context as part of the “signal”? There is a compelling argument that suggests that research findings in education are, and should be, inescapably and symbiotically, constitutionally, wedded to context, contextually rooted in it and referenced to it. As the review of Biesta’s (2020) book Educational Research: An Unorthodox Introduction notes in this issue, researchers in education must “recover the constituent features of educational aspects of educational research: what makes educational research specifically educational”. Moreover, the conjectural nature of science makes it clear that what happens to come out of the “noise” of specific pieces of research – the “signal” – is neither incontrovertible nor an absolute “truth”. The provisional nature of scientific “truth” (qua the best that we currently know) is only a tentative, preferably evidence-informed “best bet” (Major & Higgins, 2019). Can and should decontextualized research data in education release educationists from the mire of contexts? Should we go for the small-scale, high granularity
期刊介绍:
International, comparative and multidisciplinary in scope, Educational Research and Evaluation (ERE) publishes original, peer-reviewed academic articles dealing with research on issues of worldwide relevance in educational practice. The aim of the journal is to increase understanding of learning in pre-primary, primary, high school, college, university and adult education, and to contribute to the improvement of educational processes and outcomes. The journal seeks to promote cross-national and international comparative educational research by publishing findings relevant to the scholarly community, as well as to practitioners and others interested in education. The scope of the journal is deliberately broad in terms of both topics covered and disciplinary perspective.