Pub Date : 2024-11-29DOI: 10.1016/j.iree.2024.100305
Flip Klijn , Mehdi Mdaghri Alaoui , Marc Vorsatz
We study academic integrity in a final exam of a game theory course with 463 undergraduate students at a major Spanish university. The exam is an unproctored online multiple-choice exam without backtracking. A key characteristic is that for each (type of) problem, groups of students receive different versions. Moreover, each problem version is assigned to one subgroup during one stage of the exam and to another subgroup during an immediately consecutive later stage. Thus, we can exploit grade points and timestamps to study students’ academic integrity. We observe a significant decrease in completion time at each later stage; however, surprisingly, there is no corresponding impact on average grade points. The precise number of different versions does not seem to have an effect on either variable. Our findings thus suggest that employing a limited number of distinct problem versions (as few as two) can diminish cheating effectiveness in online exams.
{"title":"Online academic exams: Does multiplicity of exam versions mitigate cheating?","authors":"Flip Klijn , Mehdi Mdaghri Alaoui , Marc Vorsatz","doi":"10.1016/j.iree.2024.100305","DOIUrl":"10.1016/j.iree.2024.100305","url":null,"abstract":"<div><div>We study academic integrity in a final exam of a game theory course with 463 undergraduate students at a major Spanish university. The exam is an unproctored online multiple-choice exam without backtracking. A key characteristic is that for each (type of) problem, groups of students receive different versions. Moreover, each problem version is assigned to one subgroup during one stage of the exam and to another subgroup during an immediately consecutive later stage. Thus, we can exploit grade points and timestamps to study students’ academic integrity. We observe a significant decrease in completion time at each later stage; however, surprisingly, there is no corresponding impact on average grade points. The precise number of different versions does not seem to have an effect on either variable. Our findings thus suggest that employing a limited number of distinct problem versions (as few as two) can diminish cheating effectiveness in online exams.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"48 ","pages":"Article 100305"},"PeriodicalIF":1.3,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142747105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-08DOI: 10.1016/j.iree.2024.100304
Savannah Adkins
The Covid-19 pandemic created a sudden increased uptake of online teaching, and though the end of the pandemic signaled a shift back to more in-person learning, many schools have used the existing infrastructure to expand their offerings of online and hybrid courses. While previous studies have identified the impact of online teaching on student score, little work has been done on the heterogenous impact that online and hybrid teaching can have, particularly for underrepresented groups of students. I utilize a randomized control trial in an introductory microeconomics course to test whether there are any differences in quiz score with a lecture delivered online as compared to in-person, mimicking a hybrid class environment. I find that when students watch a lecture online, they score 5 percentage points lower on average than attending a lecture in-person. This estimate is based on an intent-to-treat study design and estimates within-individual effects. I also assess heterogeneous effects across various demographic variables, including gender, race, and First-Generation status, and find that this result is particularly salient for non-White and first-generation students, highlighting the equity implications of moving to online teaching.
{"title":"Equity in hybrid microeconomics classes: Effects on diverse student groups","authors":"Savannah Adkins","doi":"10.1016/j.iree.2024.100304","DOIUrl":"10.1016/j.iree.2024.100304","url":null,"abstract":"<div><div>The Covid-19 pandemic created a sudden increased uptake of online teaching, and though the end of the pandemic signaled a shift back to more in-person learning, many schools have used the existing infrastructure to expand their offerings of online and hybrid courses. While previous studies have identified the impact of online teaching on student score, little work has been done on the heterogenous impact that online and hybrid teaching can have, particularly for underrepresented groups of students. I utilize a randomized control trial in an introductory microeconomics course to test whether there are any differences in quiz score with a lecture delivered online as compared to in-person, mimicking a hybrid class environment. I find that when students watch a lecture online, they score 5 percentage points lower on average than attending a lecture in-person. This estimate is based on an intent-to-treat study design and estimates within-individual effects. I also assess heterogeneous effects across various demographic variables, including gender, race, and First-Generation status, and find that this result is particularly salient for non-White and first-generation students, highlighting the equity implications of moving to online teaching.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100304"},"PeriodicalIF":1.3,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142416356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-28DOI: 10.1016/j.iree.2024.100302
Malte Ring , Luis Oberrauch
The ability to work with graphs is at the core of the economic domain and is also one of the central challenges for novices in the field. To accurately assess the graph competence of higher education students, we developed and tested an 18-item graph competence instrument with different economics graphs. The sample consisted of 579 students from multiple higher education institutions in southwestern Germany. Our findings reveal that while students generally perform well on basic graph operations, they struggle with complex tasks such as comparing quantities and understanding economic implications, particularly with supply and demand models and indifference curves. The results highlight the need for instructional focus on integrating graph reading with economic concepts and provide a diagnostic tool for further research. The study underscores the challenges faced by learners, especially those with limited economic background and female students, and offers insights for improving economic graph education.
{"title":"Measuring economic graph competence","authors":"Malte Ring , Luis Oberrauch","doi":"10.1016/j.iree.2024.100302","DOIUrl":"10.1016/j.iree.2024.100302","url":null,"abstract":"<div><div>The ability to work with graphs is at the core of the economic domain and is also one of the central challenges for novices in the field. To accurately assess the graph competence of higher education students, we developed and tested an 18-item graph competence instrument with different economics graphs. The sample consisted of 579 students from multiple higher education institutions in southwestern Germany. Our findings reveal that while students generally perform well on basic graph operations, they struggle with complex tasks such as comparing quantities and understanding economic implications, particularly with supply and demand models and indifference curves. The results highlight the need for instructional focus on integrating graph reading with economic concepts and provide a diagnostic tool for further research. The study underscores the challenges faced by learners, especially those with limited economic background and female students, and offers insights for improving economic graph education.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100302"},"PeriodicalIF":1.3,"publicationDate":"2024-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142359184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-26DOI: 10.1016/j.iree.2024.100303
Sinead Huskisson , Tom O'Mahony , Seán Lacey
The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.
{"title":"Improving student outcomes using automated feedback in a first-year economics class","authors":"Sinead Huskisson , Tom O'Mahony , Seán Lacey","doi":"10.1016/j.iree.2024.100303","DOIUrl":"10.1016/j.iree.2024.100303","url":null,"abstract":"<div><div>The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.</div></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100303"},"PeriodicalIF":1.3,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142416355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-04DOI: 10.1016/j.iree.2024.100301
Jan L. Anderson, Leonid A. Krasnozhon
The economics literature provides mixed results on the effect of online classroom technology on student outcomes. An emerging body of behavioral studies suggests that videoconferencing is a cognitively exhausting activity and that the camera that is a salient feature of virtual meetings is a leading cause of this fatigue, with a more pronounced effect on women. Thus, economists and behavioral scientists debate whether online education and its technology provide an effective method of instruction. We use a field experimental design to examine how camera use in online synchronous economics classes affects learning outcomes. We find that changing the method of student engagement from turning the camera off to turning it on increases quiz grades by 0.18 standard deviations while we control for students’ gender and aptitude.
{"title":"Turn the camera on to get better grade: Evidence from a field experiment","authors":"Jan L. Anderson, Leonid A. Krasnozhon","doi":"10.1016/j.iree.2024.100301","DOIUrl":"10.1016/j.iree.2024.100301","url":null,"abstract":"<div><p>The economics literature provides mixed results on the effect of online classroom technology on student outcomes. An emerging body of behavioral studies suggests that videoconferencing is a cognitively exhausting activity and that the camera that is a salient feature of virtual meetings is a leading cause of this fatigue, with a more pronounced effect on women. Thus, economists and behavioral scientists debate whether online education and its technology provide an effective method of instruction. We use a field experimental design to examine how camera use in online synchronous economics classes affects learning outcomes. We find that changing the method of student engagement from turning the camera off to turning it on increases quiz grades by 0.18 standard deviations while we control for students’ gender and aptitude.</p></div>","PeriodicalId":45496,"journal":{"name":"International Review of Economics Education","volume":"47 ","pages":"Article 100301"},"PeriodicalIF":1.3,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
扫码关注我们
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号