Rachel Faerber-Ovaska, Tomi Ovaska, Joseph Palardy, Yogesh Uppal
{"title":"Has ChatGPT Made Economics Homework Questions Obsolete?","authors":"Rachel Faerber-Ovaska, Tomi Ovaska, Joseph Palardy, Yogesh Uppal","doi":"10.1111/boer.12481","DOIUrl":null,"url":null,"abstract":"<p>We investigate the accuracy of ChatGPT's answers to multiple-choice and short essay questions from a widely used OER economics textbook. The questions are classified by their difficulty and cognitive level. In our tests, the bot scored a high D in multiple-choice questions and a low A in essay questions. Most errors were found in questions of higher cognitive levels, and with calculations and graphs. While a student who has attended lectures would not gain much, if at all, from using the bot for multiple-choice questions, the gain for a higher grade in essays is considerably larger.</p>","PeriodicalId":46233,"journal":{"name":"Bulletin of Economic Research","volume":"77 2","pages":"219-223"},"PeriodicalIF":1.2000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/boer.12481","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bulletin of Economic Research","FirstCategoryId":"96","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/boer.12481","RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ECONOMICS","Score":null,"Total":0}
引用次数: 0
Abstract
We investigate the accuracy of ChatGPT's answers to multiple-choice and short essay questions from a widely used OER economics textbook. The questions are classified by their difficulty and cognitive level. In our tests, the bot scored a high D in multiple-choice questions and a low A in essay questions. Most errors were found in questions of higher cognitive levels, and with calculations and graphs. While a student who has attended lectures would not gain much, if at all, from using the bot for multiple-choice questions, the gain for a higher grade in essays is considerably larger.
期刊介绍：
The Bulletin of Economic Research is an international journal publishing articles across the entire field of economics, econometrics and economic history. The Bulletin contains original theoretical, applied and empirical work which makes a substantial contribution to the subject and is of broad interest to economists. We welcome submissions in all fields and, with the Bulletin expanding in new areas, we particularly encourage submissions in the fields of experimental economics, financial econometrics and health economics. In addition to full-length articles the Bulletin publishes refereed shorter articles, notes and comments; authoritative survey articles in all areas of economics and special themed issues.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
