首页 > 最新文献

International Review of Economics Education最新文献

英文 中文
Do humans identify AI-generated text better than machines? Evidence based on excerpts from German theses☆ 人类比机器更能识别人工智能生成的文本吗?证据基于德国论文的摘录
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2025-06-01 Epub Date: 2025-05-31 DOI: 10.1016/j.iree.2025.100321
Alexandra Fiedler , Jörg Döpke
We investigate whether human experts can identify AI-generated academic texts more accurately than current machine-based detectors. Conducted as a survey experiment at a German university of applied sciences, 63 lecturers in engineering, economics, and social sciences were asked to evaluate short excerpts (200–300 words) from both human-generated and AI-generated texts. These texts varied by discipline and writing level (student vs. professional) with the AI-generated content. The results show that both human evaluators and AI detectors correctly identified AI-generated texts only slightly better than chance, with humans achieving a recognition rate of 57 % for AI texts and 64 % for human-generated texts. There was no statistically significant difference between human and machine performance. Notably, professional-level AI texts were the most difficult to identify, with less than 20 % of respondents correctly classifying them. Regression analyses suggest that prior teaching experience slightly improves recognition accuracy, while subjective judgments of text quality were not influenced by actual or presumed authorship. These findings suggest that current written examination practices are increasingly vulnerable to undetected AI use. Both human judgment and existing AI detectors show high error rates, especially for high-quality AI-generated content. We conclude that a reconsideration of traditional assessment formats in academia is warranted.
我们研究人类专家是否能比目前基于机器的检测器更准确地识别人工智能生成的学术文本。德国一所应用科学大学进行了一项调查实验,要求63名工程、经济、社会科学讲师对人工生成和人工智能生成的文本中的200-300字的短文进行评价。这些文本因学科和写作水平(学生与专业)以及人工智能生成的内容而异。结果表明,人类评估者和人工智能检测器正确识别人工智能生成的文本仅略好于偶然,人类对人工智能文本的识别率为57 %,对人工生成文本的识别率为64 %。人和机器的表现没有统计学上的显著差异。值得注意的是,专业级别的人工智能文本最难识别,只有不到20% %的受访者正确地对它们进行了分类。回归分析表明,先前的教学经验略微提高了识别准确率,而对文本质量的主观判断不受实际作者或假定作者的影响。这些发现表明,目前的笔试实践越来越容易受到未被发现的人工智能使用的影响。人类的判断和现有的人工智能检测器都显示出很高的错误率,特别是对于高质量的人工智能生成的内容。我们的结论是,学术界对传统评估格式的重新考虑是必要的。
{"title":"Do humans identify AI-generated text better than machines? Evidence based on excerpts from German theses☆","authors":"Alexandra Fiedler ,&nbsp;Jörg Döpke","doi":"10.1016/j.iree.2025.100321","DOIUrl":"10.1016/j.iree.2025.100321","url":null,"abstract":"<div><div>We investigate whether human experts can identify AI-generated academic texts more accurately than current machine-based detectors. Conducted as a survey experiment at a German university of applied sciences, 63 lecturers in engineering, economics, and social sciences were asked to evaluate short excerpts (200–300 words) from both human-generated and AI-generated texts. These texts varied by discipline and writing level (student vs. professional) with the AI-generated content. The results show that both human evaluators and AI detectors correctly identified AI-generated texts only slightly better than chance, with humans achieving a recognition rate of 57 % for AI texts and 64 % for human-generated texts. There was no statistically significant difference between human and machine performance. Notably, professional-level AI texts were the most difficult to identify, with less than 20 % of respondents correctly classifying them. Regression analyses suggest that prior teaching experience slightly improves recognition accuracy, while subjective judgments of text quality were not influenced by actual or presumed authorship. These findings suggest that current written examination practices are increasingly vulnerable to undetected AI use. Both human judgment and existing AI detectors show high error rates, especially for high-quality AI-generated content. We conclude that a reconsideration of traditional assessment formats in academia is warranted.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"49 ","pages":"Article 100321"},"PeriodicalIF":1.3,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144177638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A purpose-driven approach to apply the universal design for learning: A focus on the “why” 目的驱动的学习通用设计应用方法:关注“为什么”
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2025-06-01 Epub Date: 2025-05-15 DOI: 10.1016/j.iree.2025.100319
Terry Eyland , Ambrose Leung
We aim to develop a teaching methodology that can strike the best balance between clear terminal goals and deep understanding informed by the Universal Design for Learning (UDL) pedagogy. UDL is a pedagogical framework that promotes academic curriculum design to develop students into expert learners who are purposeful and motivated, resourceful and knowledgeable, strategic and goal-directed. The pedagogical method discussed in this paper entails the application of backward design with a strong focus on the “why” of learning to maintain curiosity and interest of students throughout the semester. A key element of our strategy involves assigning students with tasks that are based on relevant examples of broad interest to a diverse student population. This approach can effectively motivate the learning of theoretical concepts before further advancing the curriculum in class. The goal is to provide students with guidance to achieve higher levels of learning in a progressive way through scaffolding so that at all steps students see the purpose, have the resources to get going, but also have a little research to do to complete the task.
我们的目标是开发一种教学方法,能够在明确的最终目标和基于通用学习设计(UDL)教学法的深刻理解之间取得最佳平衡。UDL是一种教学框架,旨在促进学术课程设计,将学生培养成有目的、有动力、足智多谋、知识渊博、有战略、目标明确的专家学习者。本文讨论的教学方法需要应用逆向设计,重点关注学习的“为什么”,以保持学生整个学期的好奇心和兴趣。我们策略的一个关键要素是给学生分配任务,这些任务是基于不同学生群体广泛感兴趣的相关例子。这种方法可以有效地激发理论概念的学习,然后在课堂上进一步推进课程。我们的目标是为学生提供指导,以循序渐进的方式实现更高层次的学习,以便学生在所有步骤中都能看到目的,有资源开始学习,但也有一些研究来完成任务。
{"title":"A purpose-driven approach to apply the universal design for learning: A focus on the “why”","authors":"Terry Eyland ,&nbsp;Ambrose Leung","doi":"10.1016/j.iree.2025.100319","DOIUrl":"10.1016/j.iree.2025.100319","url":null,"abstract":"<div><div>We aim to develop a teaching methodology that can strike the best balance between clear terminal goals and deep understanding informed by the Universal Design for Learning (UDL) pedagogy. UDL is a pedagogical framework that promotes academic curriculum design to develop students into expert learners who are purposeful and motivated, resourceful and knowledgeable, strategic and goal-directed. The pedagogical method discussed in this paper entails the application of backward design with a strong focus on the “why” of learning to maintain curiosity and interest of students throughout the semester. A key element of our strategy involves assigning students with tasks that are based on relevant examples of broad interest to a diverse student population. This approach can effectively motivate the learning of theoretical concepts before further advancing the curriculum in class. The goal is to provide students with guidance to achieve higher levels of learning in a progressive way through scaffolding so that at all steps students see the purpose, have the resources to get going, but also have a little research to do to complete the task.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"49 ","pages":"Article 100319"},"PeriodicalIF":1.3,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143946521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Online academic exams: Does multiplicity of exam versions mitigate cheating? 在线学术考试:考试版本的多样性是否减少了作弊?
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2025-03-01 Epub Date: 2024-11-29 DOI: 10.1016/j.iree.2024.100305
Flip Klijn , Mehdi Mdaghri Alaoui , Marc Vorsatz
We study academic integrity in a final exam of a game theory course with 463 undergraduate students at a major Spanish university. The exam is an unproctored online multiple-choice exam without backtracking. A key characteristic is that for each (type of) problem, groups of students receive different versions. Moreover, each problem version is assigned to one subgroup during one stage of the exam and to another subgroup during an immediately consecutive later stage. Thus, we can exploit grade points and timestamps to study students’ academic integrity. We observe a significant decrease in completion time at each later stage; however, surprisingly, there is no corresponding impact on average grade points. The precise number of different versions does not seem to have an effect on either variable. Our findings thus suggest that employing a limited number of distinct problem versions (as few as two) can diminish cheating effectiveness in online exams.
我们在西班牙一所主要大学的463名本科生的博弈论课程的期末考试中研究学术诚信。该考试是一个没有监考的在线选择题考试,没有回溯。一个关键的特点是,对于每种(类型)问题,不同的学生群体会收到不同的版本。此外,每个问题版本在考试的一个阶段分配给一个子组,在随后的阶段分配给另一个子组。因此,我们可以利用分数和时间戳来研究学生的学术诚信。我们观察到在每个后期阶段的完成时间显著减少;然而,令人惊讶的是,对平均成绩没有相应的影响。不同版本的确切数量似乎对这两个变量都没有影响。因此,我们的研究结果表明,使用有限数量的不同问题版本(少至两个)可以减少在线考试中的作弊效果。
{"title":"Online academic exams: Does multiplicity of exam versions mitigate cheating?","authors":"Flip Klijn ,&nbsp;Mehdi Mdaghri Alaoui ,&nbsp;Marc Vorsatz","doi":"10.1016/j.iree.2024.100305","DOIUrl":"10.1016/j.iree.2024.100305","url":null,"abstract":"<div><div>We study academic integrity in a final exam of a game theory course with 463 undergraduate students at a major Spanish university. The exam is an unproctored online multiple-choice exam without backtracking. A key characteristic is that for each (type of) problem, groups of students receive different versions. Moreover, each problem version is assigned to one subgroup during one stage of the exam and to another subgroup during an immediately consecutive later stage. Thus, we can exploit grade points and timestamps to study students’ academic integrity. We observe a significant decrease in completion time at each later stage; however, surprisingly, there is no corresponding impact on average grade points. The precise number of different versions does not seem to have an effect on either variable. Our findings thus suggest that employing a limited number of distinct problem versions (as few as two) can diminish cheating effectiveness in online exams.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"48 ","pages":"Article 100305"},"PeriodicalIF":1.3,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142747105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The belief that monetary exchanges are mutually beneficial: Are economics students different? Evidence from Guatemala 货币交换是互惠互利的信念:经济学专业的学生与众不同吗?来自危地马拉的证据
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2025-03-01 Epub Date: 2025-01-18 DOI: 10.1016/j.iree.2025.100309
María Jesús Valdemoros-Erro , José Luis Álvarez-Arce , Elena Sanjurjo-San-Martín
Research indicates that economics students are more supportive of the market allocation mechanism than their peers from other disciplines. This study investigates if these differences apply equally to their views on the mutual gains of voluntary and monetary transactions. Using survey data from university students in various majors in Guatemala, we found no significant differences across disciplines in the belief that voluntary exchanges are mutually beneficial. However, economics students showed significantly stronger agreement with the idea that monetary exchanges benefit all involved parties. This group also demonstrated a more consistent stance on voluntary and monetary exchanges, a pattern observable even among first-year students, indicating the presence of a self-selection effect. Our findings add novel insights to the discussion on the distinctive perspectives of economics students, while providing evidence from a developing country, a context barely studied before.
研究表明,经济学专业的学生比其他学科的学生更支持市场配置机制。这项研究调查了这些差异是否同样适用于他们对自愿交易和货币交易的共同收益的看法。通过对危地马拉各专业大学生的调查数据,我们发现,在自愿交换是互惠互利的信念方面,各学科之间没有显著差异。然而,经济学专业的学生对货币交换对所有相关方都有利的观点表现出明显更强的认同。这一群体在自愿和金钱交换方面也表现出更一致的立场,这种模式甚至在一年级学生中也可以观察到,表明自我选择效应的存在。我们的发现为关于经济学学生独特观点的讨论增添了新颖的见解,同时提供了来自发展中国家的证据,这是一个以前几乎没有研究过的背景。
{"title":"The belief that monetary exchanges are mutually beneficial: Are economics students different? Evidence from Guatemala","authors":"María Jesús Valdemoros-Erro ,&nbsp;José Luis Álvarez-Arce ,&nbsp;Elena Sanjurjo-San-Martín","doi":"10.1016/j.iree.2025.100309","DOIUrl":"10.1016/j.iree.2025.100309","url":null,"abstract":"<div><div>Research indicates that economics students are more supportive of the market allocation mechanism than their peers from other disciplines. This study investigates if these differences apply equally to their views on the mutual gains of voluntary and monetary transactions. Using survey data from university students in various majors in Guatemala, we found no significant differences across disciplines in the belief that voluntary exchanges are mutually beneficial. However, economics students showed significantly stronger agreement with the idea that monetary exchanges benefit all involved parties. This group also demonstrated a more consistent stance on voluntary and monetary exchanges, a pattern observable even among first-year students, indicating the presence of a self-selection effect. Our findings add novel insights to the discussion on the distinctive perspectives of economics students, while providing evidence from a developing country, a context barely studied before.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"48 ","pages":"Article 100309"},"PeriodicalIF":1.3,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143165983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A mixed methods evaluation of online discussion tools in higher education 对高等教育在线讨论工具进行混合方法评估
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-07-14 DOI: 10.1016/j.iree.2024.100298
Alex Squires, Dan Rigby

We present a mixed methods comparative assessment of three online discussion tools widely used in higher education. We combine different data types (quantitative, qualitative) and sources (usage data, survey responses) to assess Piazza, Padlet, and Blackboard discussion boards. We highlight and discuss the differences between, and relative merits of, the tools and report the preferences of students on a large introductory Economics unit for them. We summarise lessons learnt from using the tools and make recommendations to engender greater student engagement with online discussion spaces.

我们采用混合方法对高等教育中广泛使用的三种在线讨论工具进行了比较评估。我们结合了不同的数据类型(定量、定性)和来源(使用数据、调查反馈),对 Piazza、Padlet 和 Blackboard 讨论板进行了评估。我们强调并讨论了这些工具之间的差异和相对优点,并报告了学生在一个大型经济学入门单元中对这些工具的偏好。我们总结了使用这些工具的经验教训,并就如何提高学生对在线讨论空间的参与度提出了建议。
{"title":"A mixed methods evaluation of online discussion tools in higher education","authors":"Alex Squires,&nbsp;Dan Rigby","doi":"10.1016/j.iree.2024.100298","DOIUrl":"10.1016/j.iree.2024.100298","url":null,"abstract":"<div><p>We present a mixed methods comparative assessment of three online discussion tools widely used in higher education. We combine different data types (quantitative, qualitative) and sources (usage data, survey responses) to assess Piazza, Padlet, and Blackboard discussion boards. We highlight and discuss the differences between, and relative merits of, the tools and report the preferences of students on a large introductory Economics unit for them. We summarise lessons learnt from using the tools and make recommendations to engender greater student engagement with online discussion spaces.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100298"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1477388024000161/pdfft?md5=fa53615608b6dabbe802c17203cb738d&pid=1-s2.0-S1477388024000161-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141630084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving student comprehension through interactive model visualization 通过交互式模型可视化提高学生理解能力
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-06-30 DOI: 10.1016/j.iree.2024.100296
Simon D. Halliday , Christopher Makler , Douglas McKee , Anastasia Papadopoulou

A large literature has shown that novices and experts across the STEM disciplines differ markedly in how they approach and solve problems. Many STEM education scholars find that giving students scaffolded exercises in which they work with a visualization tool can be highly effective in teaching novices to think more like experts. Using model visualization software developed for EconGraphs, we have created three custom collections of interactive exercises for use in microeconomics courses at three institutions, two in the US and one in the UK. Based on surveys of the students (n=71, 167, and 57 respectively at the three institutions), students found the new exercises helpful. Additional analysis at two of the institutions suggests that the exercises were more likely to be valued by students with weaker math skills, students with weaker introductory microeconomics skills, and, in some cases, students who agreed that economics was interesting and applicable to their daily lives. The contributions of this paper are to illustrate how the free content from EconGraphs and the associated authoring tools may be used to create exercises that enhance the teaching and learning experience at a range of institutions; to provide the exercises themselves as a public good; and to invite further innovation and investigation in this area.

大量文献表明,STEM 学科的新手和专家在处理和解决问题的方式上存在明显差异。许多 STEM 教育学者发现,为学生提供支架式练习,让他们在练习中使用可视化工具,可以非常有效地教会新手像专家一样思考问题。利用为 EconGraphs 开发的模型可视化软件,我们为三所院校的微观经济学课程定制了三套互动练习,其中两所位于美国,一所位于英国。根据对学生(三所院校的学生人数分别为 71、167 和 57 人)的调查,学生认为新练习很有帮助。对其中两所院校的补充分析表明,数学技能较弱的学生、微观经济学入门技能较弱的学生,以及在某些情况下认为经济学有趣并适用于其日常生活的学生,更有可能重视这些练习。本文的贡献在于说明了如何利用 EconGraphs 的免费内容和相关创作工具来创建练习,以增强各种院校的教学体验;将练习本身作为一种公共产品来提供;并邀请各方在这一领域开展进一步的创新和研究。
{"title":"Improving student comprehension through interactive model visualization","authors":"Simon D. Halliday ,&nbsp;Christopher Makler ,&nbsp;Douglas McKee ,&nbsp;Anastasia Papadopoulou","doi":"10.1016/j.iree.2024.100296","DOIUrl":"https://doi.org/10.1016/j.iree.2024.100296","url":null,"abstract":"<div><p>A large literature has shown that novices and experts across the STEM disciplines differ markedly in how they approach and solve problems. Many STEM education scholars find that giving students scaffolded exercises in which they work with a visualization tool can be highly effective in teaching novices to think more like experts. Using model visualization software developed for EconGraphs, we have created three custom collections of interactive exercises for use in microeconomics courses at three institutions, two in the US and one in the UK. Based on surveys of the students (n=71, 167, and 57 respectively at the three institutions), students found the new exercises helpful. Additional analysis at two of the institutions suggests that the exercises were more likely to be valued by students with weaker math skills, students with weaker introductory microeconomics skills, and, in some cases, students who agreed that economics was interesting and applicable to their daily lives. The contributions of this paper are to illustrate how the free content from EconGraphs and the associated authoring tools may be used to create exercises that enhance the teaching and learning experience at a range of institutions; to provide the exercises themselves as a public good; and to invite further innovation and investigation in this area.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100296"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1477388024000148/pdfft?md5=0abd9668b41142b011e2d1a00251e8ee&pid=1-s2.0-S1477388024000148-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141582039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating the link between students’ learning intentions and their learning outcomes: A clustered randomised controlled trial 调查学生学习意愿与学习成果之间的联系:分组随机对照试验
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-07-15 DOI: 10.1016/j.iree.2024.100299
Erkal Ersoy, Rachel Forshaw, Suzanne Lampert

We investigate the impact of repeated contextual nudging on task com- pletion and performance within the setting of traditional face-to-face education, adding to a literature which has focused on non-contextual nudges, provided contextual nudges in online learning settings, or used one-time nudges. We undertake a clustered randomised controlled trial on first-year Business School students at Heriot-Watt University, employing weekly nudges during tutorials to encourage students to establish learning intentions for the upcoming week. We rule out significant treatment effects from the nudging intervention on tutorial attendance, the most important predictor of final marks of all intermediate outcomes that we consider. We are unable to make causal statements on the effects of the intervention on final marks. Nonetheless, this experiment yields valuable insights into the dynamics of repeated contextual nudging within traditional educational settings as well as shedding light on aspects of student behaviour.

我们研究了在传统的面对面教育环境中,重复情境激励对任务完成和学习成绩的影响,为关注非情境激励、在在线学习环境中提供情境激励或使用一次性激励的文献增添了新的内容。我们在赫瑞瓦特大学商学院一年级学生中开展了一项分组随机对照试验,每周在辅导课上进行暗示,鼓励学生确立下一周的学习意图。我们排除了辅导干预对辅导出勤率的重大治疗效果,而出勤率是我们考虑的所有中间结果中预测最终分数的最重要因素。我们无法就干预对最终分数的影响做出因果陈述。尽管如此,这项实验还是对传统教育环境下重复情境诱导的动态产生了有价值的启示,并揭示了学生行为的方方面面。
{"title":"Investigating the link between students’ learning intentions and their learning outcomes: A clustered randomised controlled trial","authors":"Erkal Ersoy,&nbsp;Rachel Forshaw,&nbsp;Suzanne Lampert","doi":"10.1016/j.iree.2024.100299","DOIUrl":"10.1016/j.iree.2024.100299","url":null,"abstract":"<div><p>We investigate the impact of repeated contextual nudging on task com- pletion and performance within the setting of traditional face-to-face education, adding to a literature which has focused on non-contextual nudges, provided contextual nudges in online learning settings, or used one-time nudges. We undertake a clustered randomised controlled trial on first-year Business School students at Heriot-Watt University, employing weekly nudges during tutorials to encourage students to establish learning intentions for the upcoming week. We rule out significant treatment effects from the nudging intervention on tutorial attendance, the most important predictor of final marks of all intermediate outcomes that we consider. We are unable to make causal statements on the effects of the intervention on final marks. Nonetheless, this experiment yields valuable insights into the dynamics of repeated contextual nudging within traditional educational settings as well as shedding light on aspects of student behaviour.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100299"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141688763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving student outcomes using automated feedback in a first-year economics class 在一年级经济学课堂上利用自动反馈提高学生成绩
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-09-26 DOI: 10.1016/j.iree.2024.100303
Sinead Huskisson , Tom O'Mahony , Seán Lacey
The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.
评估文献提倡利用形成性评估策略来支持和促进学生的学习。本研究在一年级微观经济学入门模块中使用了带有内置反馈的在线练习测试作为形成性反馈策略,学生可以反复使用。探讨的关键问题是,反复参与在线练习测试是否会对学生随后在终结性评估中的表现产生统计学意义上的显著影响。我们收集了一批一年级学生的参与和成绩数据(N = 223)。对这些数据的分析表明,多次参与在线练习测试对期末成绩有显著影响。在不考虑期中成绩的情况下,平均而言,每个 "寻求和行动 "周期都会使期末考试成绩提高 1.3%(p = 0.003)。因此,数据表明,包含反馈在内的多次在线模拟考试机会是该策略的一个重要特点。较小样本的定性调查数据(N = 131)显示,这些经济学学生对反馈持有传统观念,很少意识到自己在寻求反馈和根据反馈采取行动方面的作用。我们认为,形成性练习测试具有支持学生反馈素养发展的潜力。
{"title":"Improving student outcomes using automated feedback in a first-year economics class","authors":"Sinead Huskisson ,&nbsp;Tom O'Mahony ,&nbsp;Seán Lacey","doi":"10.1016/j.iree.2024.100303","DOIUrl":"10.1016/j.iree.2024.100303","url":null,"abstract":"<div><div>The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100303"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142416355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Turn the camera on to get better grade: Evidence from a field experiment 打开相机,获得更好的成绩:现场实验的证据
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-09-04 DOI: 10.1016/j.iree.2024.100301
Jan L. Anderson, Leonid A. Krasnozhon

The economics literature provides mixed results on the effect of online classroom technology on student outcomes. An emerging body of behavioral studies suggests that videoconferencing is a cognitively exhausting activity and that the camera that is a salient feature of virtual meetings is a leading cause of this fatigue, with a more pronounced effect on women. Thus, economists and behavioral scientists debate whether online education and its technology provide an effective method of instruction. We use a field experimental design to examine how camera use in online synchronous economics classes affects learning outcomes. We find that changing the method of student engagement from turning the camera off to turning it on increases quiz grades by 0.18 standard deviations while we control for students’ gender and aptitude.

关于在线课堂技术对学生成绩的影响,经济学文献提供了喜忧参半的结果。新出现的行为学研究表明,视频会议是一种让人疲惫不堪的认知活动,而虚拟会议的显著特征--摄像头--是造成这种疲劳的主要原因,对女性的影响更为明显。因此,经济学家和行为科学家争论在线教育及其技术是否是一种有效的教学方法。我们采用现场实验设计来研究在线同步经济学课堂中相机的使用如何影响学习效果。我们发现,在控制学生性别和能力的情况下,将学生参与的方式从关闭摄像头改为打开摄像头,会使测验成绩提高 0.18 个标准差。
{"title":"Turn the camera on to get better grade: Evidence from a field experiment","authors":"Jan L. Anderson,&nbsp;Leonid A. Krasnozhon","doi":"10.1016/j.iree.2024.100301","DOIUrl":"10.1016/j.iree.2024.100301","url":null,"abstract":"<div><p>The economics literature provides mixed results on the effect of online classroom technology on student outcomes. An emerging body of behavioral studies suggests that videoconferencing is a cognitively exhausting activity and that the camera that is a salient feature of virtual meetings is a leading cause of this fatigue, with a more pronounced effect on women. Thus, economists and behavioral scientists debate whether online education and its technology provide an effective method of instruction. We use a field experimental design to examine how camera use in online synchronous economics classes affects learning outcomes. We find that changing the method of student engagement from turning the camera off to turning it on increases quiz grades by 0.18 standard deviations while we control for students’ gender and aptitude.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100301"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A picture is worth a thousand words: The effectiveness of infographics in microeconomic principles courses 一图胜千言:信息图表在微观经济原理课程中的有效性
IF 1.3 4区 经济学 Q3 ECONOMICS Pub Date : 2024-12-01 Epub Date: 2024-07-11 DOI: 10.1016/j.iree.2024.100300
Lauren Calimeris , Edward Kosack

We investigate the impact of infographics on student learning in principles of economics classes. Infographics display facts, data, and information about a specific topic in a clear and easy to understand manner, using graphics and pictures to help summarize, explain, and display information. Creating an infographic can be a fun, engaging, and powerful educational tool for learning new topics in both introductory and advanced courses. We use a randomized classroom experiment to evaluate the effect of creating infographics on student learning in principles of microeconomics courses as measured by exam performance. The randomization across topics enables a student-fixed effects estimation of the effect of infographics. We find students were 2.1–2.2 percentage points more likely to answer a multiple-choice question correctly relating to the topics for which they completed an infographic relative to those they did not. We provide suggestive evidence that infographics may help higher ability students most, increasing their scores on both multiple choice and short answer questions.

我们调查了信息图表对学生在经济学原理课程中学习的影响。信息图表以清晰易懂的方式展示特定主题的事实、数据和信息,使用图形和图片帮助总结、解释和展示信息。在入门课程和高级课程中,制作信息图表可以成为学习新主题的有趣、吸引人和强大的教育工具。我们使用随机课堂实验来评估制作信息图表对学生学习微观经济学原理课程的影响,以考试成绩来衡量。通过对不同主题的随机化,可以对信息图表的效果进行学生固定效应估计。我们发现,与未完成信息图表的题目相比,学生正确回答与之相关的多选题的可能性要高出 2.1-2.2 个百分点。我们提供的提示性证据表明,信息图表可能对能力较高的学生帮助最大,能提高他们在多项选择题和简答题上的得分。
{"title":"A picture is worth a thousand words: The effectiveness of infographics in microeconomic principles courses","authors":"Lauren Calimeris ,&nbsp;Edward Kosack","doi":"10.1016/j.iree.2024.100300","DOIUrl":"https://doi.org/10.1016/j.iree.2024.100300","url":null,"abstract":"<div><p>We investigate the impact of infographics on student learning in principles of economics classes. Infographics display facts, data, and information about a specific topic in a clear and easy to understand manner, using graphics and pictures to help summarize, explain, and display information. Creating an infographic can be a fun, engaging, and powerful educational tool for learning new topics in both introductory and advanced courses. We use a randomized classroom experiment to evaluate the effect of creating infographics on student learning in principles of microeconomics courses as measured by exam performance. The randomization across topics enables a student-fixed effects estimation of the effect of infographics. We find students were 2.1–2.2 percentage points more likely to answer a multiple-choice question correctly relating to the topics for which they completed an infographic relative to those they did not. We provide suggestive evidence that infographics may help higher ability students most, increasing their scores on both multiple choice and short answer questions.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100300"},"PeriodicalIF":1.3,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141605521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Review of Economics Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1