Implementation and Evaluation of a ChatGPT-Assisted Special Topics Writing Assignment in Biochemistry

IF 2.5 3区教育学 Q2 CHEMISTRY, MULTIDISCIPLINARY Journal of Chemical Education Pub Date : 2024-06-17 DOI:10.1021/acs.jchemed.4c00226

Manik R. Reddy, Nils G. Walter* and Yulia V. Sevryugina*,

{"title":"Implementation and Evaluation of a ChatGPT-Assisted Special Topics Writing Assignment in Biochemistry","authors":"Manik R. Reddy, Nils G. Walter* and Yulia V. Sevryugina*, ","doi":"10.1021/acs.jchemed.4c00226","DOIUrl":null,"url":null,"abstract":"<p >The effective and responsible educational application of ChatGPT and other generative artificial intelligence (GenAI) tools constitutes an active area of exploration. This study describes and assesses the implementation of a structured, GenAI-assisted scientific essay writing assignment in nucleic acid biochemistry. Briefly, students created, evaluated, and iteratively refined ChatGPT essays in response to feedback and independent literature research, identifying several strengths and shortcomings of large language model writing and citation practices. The scaffolded assignment structure aimed to prepare students for GenAI-assisted writing, and the majority of the class cohort ultimately indicated an improved understanding of GenAI functionality and prompt engineering, as well as interest in additional GenAI usage and applications. Moreover, students valued the instructional guidance on engagement with GenAI tools and the prompt engineering opportunities afforded by this exercise. However, discontentment with AI-produced citations was common, and 26% of supporting references were found to be nonexistent. The content evaluation and prompt generation strategies uncovered here may facilitate successful ChatGPT-guided writing assignments in other scientific contexts.</p>","PeriodicalId":43,"journal":{"name":"Journal of Chemical Education","volume":null,"pages":null},"PeriodicalIF":2.5000,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Chemical Education","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.jchemed.4c00226","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

The effective and responsible educational application of ChatGPT and other generative artificial intelligence (GenAI) tools constitutes an active area of exploration. This study describes and assesses the implementation of a structured, GenAI-assisted scientific essay writing assignment in nucleic acid biochemistry. Briefly, students created, evaluated, and iteratively refined ChatGPT essays in response to feedback and independent literature research, identifying several strengths and shortcomings of large language model writing and citation practices. The scaffolded assignment structure aimed to prepare students for GenAI-assisted writing, and the majority of the class cohort ultimately indicated an improved understanding of GenAI functionality and prompt engineering, as well as interest in additional GenAI usage and applications. Moreover, students valued the instructional guidance on engagement with GenAI tools and the prompt engineering opportunities afforded by this exercise. However, discontentment with AI-produced citations was common, and 26% of supporting references were found to be nonexistent. The content evaluation and prompt generation strategies uncovered here may facilitate successful ChatGPT-guided writing assignments in other scientific contexts.

Abstract Image

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

生物化学 ChatGPT 辅助专题写作作业的实施与评估

ChatGPT 和其他生成式人工智能（GenAI）工具的有效和负责任的教育应用是一个积极探索的领域。本研究描述并评估了结构化、GenAI 辅助的核酸生物化学科学论文写作作业的实施情况。简而言之，学生们根据反馈意见和独立的文献研究创建、评估和迭代改进了 ChatGPT 论文，确定了大语言模型写作和引用实践的若干优势和不足。支架式作业结构旨在让学生为 GenAI 辅助写作做好准备，班级中的大多数学生最终表示对 GenAI 功能和提示工程有了更好的理解，并对更多的 GenAI 使用和应用产生了兴趣。此外，学生们非常重视在使用 GenAI 工具方面的指导，以及这项练习所提供的提示工程机会。然而，学生对人工智能生成的引文普遍感到不满，26%的支持性参考文献不存在。本文所揭示的内容评估和提示生成策略可能有助于在其他科学环境中成功完成由 ChatGPT 指导的写作任务。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Journal of Chemical Education 化学-化学综合

CiteScore

5.60

自引率

50.00%

发文量

465

审稿时长

6.5 months

期刊介绍： The Journal of Chemical Education is the official journal of the Division of Chemical Education of the American Chemical Society, co-published with the American Chemical Society Publications Division. Launched in 1924, the Journal of Chemical Education is the world’s premier chemical education journal. The Journal publishes peer-reviewed articles and related information as a resource to those in the field of chemical education and to those institutions that serve them. JCE typically addresses chemical content, activities, laboratory experiments, instructional methods, and pedagogies. The Journal serves as a means of communication among people across the world who are interested in the teaching and learning of chemistry. This includes instructors of chemistry from middle school through graduate school, professional staff who support these teaching activities, as well as some scientists in commerce, industry, and government.