Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science

IF 15.6 1区管理学 Q1 BUSINESS Journal of Innovation & Knowledge Pub Date : 2024-09-13 DOI:10.1016/j.jik.2024.100563

{"title":"Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science","authors":"","doi":"10.1016/j.jik.2024.100563","DOIUrl":null,"url":null,"abstract":"<div><p>ChatGPT and Bard (now known as Gemini) are becoming indispensable resources for researchers, academicians and diverse stakeholders within the academic landscape. At the same time, traditional digital tools such as scholarly databases continue to be widely used. Web of Science and Scopus are the most extensive academic databases and are generally regarded as consistently reliable scholarly research resources. With the increasing acceptance of artificial intelligence (AI) in academic writing, this study focuses on understanding the reliability of the new AI models compared to Scopus and Web of Science. The study includes a bibliometric analysis of green, sustainable and ecological buying behaviour, covering the period from 1 January 2011 to 21 May 2023. These results are used to compare the results from the AI and the traditional scholarly databases on several parameters. Overall, the findings suggest that AI models like ChatGPT and Bard are not yet reliable for academic writing tasks. It appears to be too early to depend on AI for such tasks.</p></div>","PeriodicalId":46792,"journal":{"name":"Journal of Innovation & Knowledge","volume":null,"pages":null},"PeriodicalIF":15.6000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2444569X24001021/pdfft?md5=0753e2bda84c9d9251a73e6ae71dcb82&pid=1-s2.0-S2444569X24001021-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Innovation & Knowledge","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2444569X24001021","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BUSINESS","Score":null,"Total":0}

引用次数: 0

Abstract

ChatGPT and Bard (now known as Gemini) are becoming indispensable resources for researchers, academicians and diverse stakeholders within the academic landscape. At the same time, traditional digital tools such as scholarly databases continue to be widely used. Web of Science and Scopus are the most extensive academic databases and are generally regarded as consistently reliable scholarly research resources. With the increasing acceptance of artificial intelligence (AI) in academic writing, this study focuses on understanding the reliability of the new AI models compared to Scopus and Web of Science. The study includes a bibliometric analysis of green, sustainable and ecological buying behaviour, covering the period from 1 January 2011 to 21 May 2023. These results are used to compare the results from the AI and the traditional scholarly databases on several parameters. Overall, the findings suggest that AI models like ChatGPT and Bard are not yet reliable for academic writing tasks. It appears to be too early to depend on AI for such tasks.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

人工智能时代的学术写作：比较 ChatGPT 和 Bard 与 Scopus 和 Web of Science 的可靠性

ChatGPT 和 Bard（现更名为 Gemini）正在成为研究人员、学者和学术界不同利益相关者不可或缺的资源。与此同时，学术数据库等传统数字工具继续得到广泛使用。Web of Science 和 Scopus 是最广泛的学术数据库，被普遍认为是一贯可靠的学术研究资源。随着人工智能（AI）在学术写作中被越来越多地接受，本研究侧重于了解新的人工智能模型与 Scopus 和 Web of Science 相比的可靠性。研究包括对绿色、可持续和生态购买行为的文献计量分析，时间跨度为 2011 年 1 月 1 日至 2023 年 5 月 21 日。这些结果用于比较人工智能和传统学术数据库在几个参数上的结果。总体而言，研究结果表明，ChatGPT 和 Bard 等人工智能模型在学术写作任务方面尚不可靠。在此类任务中依赖人工智能似乎为时尚早。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Journal of Innovation & Knowledge Multiple-

CiteScore

16.10

自引率

12.70%

发文量

118

审稿时长

37 days

期刊介绍： The Journal of Innovation and Knowledge (JIK) explores how innovation drives knowledge creation and vice versa, emphasizing that not all innovation leads to knowledge, but enduring innovation across diverse fields fosters theory and knowledge. JIK invites papers on innovations enhancing or generating knowledge, covering innovation processes, structures, outcomes, and behaviors at various levels. Articles in JIK examine knowledge-related changes promoting innovation for societal best practices. JIK serves as a platform for high-quality studies undergoing double-blind peer review, ensuring global dissemination to scholars, practitioners, and policymakers who recognize innovation and knowledge as economic drivers. It publishes theoretical articles, empirical studies, case studies, reviews, and other content, addressing current trends and emerging topics in innovation and knowledge. The journal welcomes suggestions for special issues and encourages articles to showcase contextual differences and lessons for a broad audience. In essence, JIK is an interdisciplinary journal dedicated to advancing theoretical and practical innovations and knowledge across multiple fields, including Economics, Business and Management, Engineering, Science, and Education.