Dazhen Tong, Yang Tao, Kangkang Zhang, Xinxin Dong, Yangyang Hu, Sudong Pan, Qiaoyi Liu
{"title":"Investigating ChatGPT-4’s performance in solving physics problems and its potential implications for education","authors":"Dazhen Tong, Yang Tao, Kangkang Zhang, Xinxin Dong, Yangyang Hu, Sudong Pan, Qiaoyi Liu","doi":"10.1007/s12564-023-09913-6","DOIUrl":null,"url":null,"abstract":"<div><p>Artificial intelligence (AI) technologies have been consistently influencing the progress of education for an extended period, with its impact becoming more significant especially after the launch of ChatGPT-3.5 at the end of November 2022. In the field of physics education, recent research regarding the performance of ChatGPT-3.5 in solving physics problems discovered that its problem-solving abilities were only at the level of novice students, insufficient to cause outstanding alarm in the field of physics education. However, the release of ChatGPT-4 presented substantial improvements in reasoning and conciseness. How does this translate to performance in solving physics problems, and what kind of impact might it have on education? This study undertakes a comprehensive assessment of ChatGPT-4’s performance in solving physics problems from the perspective of physics conceptual understanding and reasoning, and compares its performance with that of students. It is concluded that ChatGPT-4’s performance in solving physics problems has significantly improved compared to ChatGPT-3.5, and was notably superior to the majority of middle school and high school students. This finding presents both a challenge and an opportunity for physics education and the broader educational field, and triggers immediate considerations for coping with this challenge in future teaching and assessment environments.</p></div>","PeriodicalId":47344,"journal":{"name":"Asia Pacific Education Review","volume":"25 5","pages":"1379 - 1389"},"PeriodicalIF":2.3000,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Asia Pacific Education Review","FirstCategoryId":"95","ListUrlMain":"https://link.springer.com/article/10.1007/s12564-023-09913-6","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Artificial intelligence (AI) technologies have been consistently influencing the progress of education for an extended period, with its impact becoming more significant especially after the launch of ChatGPT-3.5 at the end of November 2022. In the field of physics education, recent research regarding the performance of ChatGPT-3.5 in solving physics problems discovered that its problem-solving abilities were only at the level of novice students, insufficient to cause outstanding alarm in the field of physics education. However, the release of ChatGPT-4 presented substantial improvements in reasoning and conciseness. How does this translate to performance in solving physics problems, and what kind of impact might it have on education? This study undertakes a comprehensive assessment of ChatGPT-4’s performance in solving physics problems from the perspective of physics conceptual understanding and reasoning, and compares its performance with that of students. It is concluded that ChatGPT-4’s performance in solving physics problems has significantly improved compared to ChatGPT-3.5, and was notably superior to the majority of middle school and high school students. This finding presents both a challenge and an opportunity for physics education and the broader educational field, and triggers immediate considerations for coping with this challenge in future teaching and assessment environments.
期刊介绍:
The Asia Pacific Education Review (APER) aims to stimulate research, encourage academic exchange, and enhance the professional development of scholars and other researchers who are interested in educational and cultural issues in the Asia Pacific region. APER covers all areas of educational research, with a focus on cross-cultural, comparative and other studies with a broad Asia-Pacific context.
APER is a peer reviewed journal produced by the Education Research Institute at Seoul National University. It was founded by the Institute of Asia Pacific Education Development, Seoul National University in 2000, which is owned and operated by Education Research Institute at Seoul National University since 2003.
APER requires all submitted manuscripts to follow the seventh edition of the Publication Manual of the American Psychological Association (APA; http://www.apastyle.org/index.aspx).