Investigating ChatGPT-4’s performance in solving physics problems and its potential implications for education

IF 2.3 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Asia Pacific Education Review Pub Date : 2023-11-29 DOI:10.1007/s12564-023-09913-6
Dazhen Tong, Yang Tao, Kangkang Zhang, Xinxin Dong, Yangyang Hu, Sudong Pan, Qiaoyi Liu
{"title":"Investigating ChatGPT-4’s performance in solving physics problems and its potential implications for education","authors":"Dazhen Tong,&nbsp;Yang Tao,&nbsp;Kangkang Zhang,&nbsp;Xinxin Dong,&nbsp;Yangyang Hu,&nbsp;Sudong Pan,&nbsp;Qiaoyi Liu","doi":"10.1007/s12564-023-09913-6","DOIUrl":null,"url":null,"abstract":"<div><p>Artificial intelligence (AI) technologies have been consistently influencing the progress of education for an extended period, with its impact becoming more significant especially after the launch of ChatGPT-3.5 at the end of November 2022. In the field of physics education, recent research regarding the performance of ChatGPT-3.5 in solving physics problems discovered that its problem-solving abilities were only at the level of novice students, insufficient to cause outstanding alarm in the field of physics education. However, the release of ChatGPT-4 presented substantial improvements in reasoning and conciseness. How does this translate to performance in solving physics problems, and what kind of impact might it have on education? This study undertakes a comprehensive assessment of ChatGPT-4’s performance in solving physics problems from the perspective of physics conceptual understanding and reasoning, and compares its performance with that of students. It is concluded that ChatGPT-4’s performance in solving physics problems has significantly improved compared to ChatGPT-3.5, and was notably superior to the majority of middle school and high school students. This finding presents both a challenge and an opportunity for physics education and the broader educational field, and triggers immediate considerations for coping with this challenge in future teaching and assessment environments.</p></div>","PeriodicalId":47344,"journal":{"name":"Asia Pacific Education Review","volume":"25 5","pages":"1379 - 1389"},"PeriodicalIF":2.3000,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Asia Pacific Education Review","FirstCategoryId":"95","ListUrlMain":"https://link.springer.com/article/10.1007/s12564-023-09913-6","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Artificial intelligence (AI) technologies have been consistently influencing the progress of education for an extended period, with its impact becoming more significant especially after the launch of ChatGPT-3.5 at the end of November 2022. In the field of physics education, recent research regarding the performance of ChatGPT-3.5 in solving physics problems discovered that its problem-solving abilities were only at the level of novice students, insufficient to cause outstanding alarm in the field of physics education. However, the release of ChatGPT-4 presented substantial improvements in reasoning and conciseness. How does this translate to performance in solving physics problems, and what kind of impact might it have on education? This study undertakes a comprehensive assessment of ChatGPT-4’s performance in solving physics problems from the perspective of physics conceptual understanding and reasoning, and compares its performance with that of students. It is concluded that ChatGPT-4’s performance in solving physics problems has significantly improved compared to ChatGPT-3.5, and was notably superior to the majority of middle school and high school students. This finding presents both a challenge and an opportunity for physics education and the broader educational field, and triggers immediate considerations for coping with this challenge in future teaching and assessment environments.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
研究ChatGPT-4在解决物理问题方面的表现及其对教育的潜在影响
人工智能(AI)技术长期以来一直影响着教育的进步,尤其是在2022年11月底推出ChatGPT-3.5之后,其影响变得更加显著。在物理教育领域,最近对ChatGPT-3.5在解决物理问题方面的研究发现,其解决问题的能力仅处于初学者的水平,不足以在物理教育领域引起突出的警示。然而,ChatGPT-4的发布在推理和简洁性方面有了实质性的改进。这如何转化为解决物理问题的表现,它对教育可能产生什么样的影响?本研究从物理概念理解和推理的角度对ChatGPT-4在解决物理问题方面的表现进行了综合评估,并与学生的表现进行了比较。结果表明,ChatGPT-4在解决物理问题方面的能力较ChatGPT-3.5有了显著提高,明显优于大多数初高中学生。这一发现为物理教育和更广泛的教育领域提出了挑战和机遇,并引发了在未来的教学和评估环境中应对这一挑战的直接考虑。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Asia Pacific Education Review
Asia Pacific Education Review EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
5.20
自引率
4.30%
发文量
64
期刊介绍: The Asia Pacific Education Review (APER) aims to stimulate research, encourage academic exchange, and enhance the professional development of scholars and other researchers who are interested in educational and cultural issues in the Asia Pacific region. APER covers all areas of educational research, with a focus on cross-cultural, comparative and other studies with a broad Asia-Pacific context. APER is a peer reviewed journal produced by the Education Research Institute at Seoul National University. It was founded by the Institute of Asia Pacific Education Development, Seoul National University in 2000, which is owned and operated by Education Research Institute at Seoul National University since 2003. APER requires all submitted manuscripts to follow the seventh edition of the Publication Manual of the American Psychological Association (APA; http://www.apastyle.org/index.aspx).
期刊最新文献
Development of instructional design principles for using ICT in resource-limited learning environments: a case of Bangladesh Teacher’s views on professional learning and development in primary schools in Fiji Effects of the English language intervention as a foreign language for struggling elementary readers in South Korea: a meta-analysis Foreign higher education and corruption: is host country knowledge a blessing or a curse? Empirical evidence from MENA countries The trajectory of teachers’ multicultural transformation: an analysis of teachers’ beliefs about mathematics as a school subject
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1