{"title":"Assessment of ChatGPT's potential as an innovative tool in searching for information on wild mammals","authors":"Jenner Rodas-Trejo , Paola Ocampo-González","doi":"10.1016/j.ecoinf.2024.102810","DOIUrl":null,"url":null,"abstract":"<div><p>In November 2022 OpenAI launched ChatGPT, an Artificial Intelligence model capable of processing, retrieving, and organizing large amounts of data and identifying patterns, thereby generating text on various topics and contexts. In recent months ChatGPT has gained wide attention and adoption in the academic and scientific fields, so its use is being widely evaluated and discussed. In this connection, an evaluation of the performance of ChatGPT was carried out on the accuracy of the answers on general knowledge about wild mammals and the specific knowledge of 30 species. A descriptive study was carried out using three chats where twenty-one questions on general knowledge and three questions on specific knowledge were asked. The questions considered information on the taxonomy, natural history, and conservation status of each species, as well as concepts and indices commonly used in the study of wild mammals. The answers were compared with scientific literature and a value was assigned to later obtain the percentage of precision. The results showed a high precision in the specific knowledge of the species, with an average of 88 % correct answers. Precision varied by species, with species scoring close to 100 % and others scoring as low as 65 %. The taxonomy question had 100 % correct answers, the natural history questions 90 %, and the conservation status question 56 %. In the precision of the general knowledge answers in the study of wild mammals, a moderate precision of 73.54 % was obtained. The study shows that ChatGPT has high precision, so it can be a helpful tool in the search for information in research on wild mammals. On the other hand, concerns are raised about its applicability in the academic field, due to the risk of producing unreliable or biased results and generating inaccurate or misleading content, so it is important to take into account the limitations and risks associated with its use. It is suggested that further research and insight into accuracy be done to explore the full potential of ChatGPT.</p></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":null,"pages":null},"PeriodicalIF":5.8000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1574954124003522/pdfft?md5=d5025382c641c9f60b6256f7ed5d09b2&pid=1-s2.0-S1574954124003522-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124003522","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
In November 2022 OpenAI launched ChatGPT, an Artificial Intelligence model capable of processing, retrieving, and organizing large amounts of data and identifying patterns, thereby generating text on various topics and contexts. In recent months ChatGPT has gained wide attention and adoption in the academic and scientific fields, so its use is being widely evaluated and discussed. In this connection, an evaluation of the performance of ChatGPT was carried out on the accuracy of the answers on general knowledge about wild mammals and the specific knowledge of 30 species. A descriptive study was carried out using three chats where twenty-one questions on general knowledge and three questions on specific knowledge were asked. The questions considered information on the taxonomy, natural history, and conservation status of each species, as well as concepts and indices commonly used in the study of wild mammals. The answers were compared with scientific literature and a value was assigned to later obtain the percentage of precision. The results showed a high precision in the specific knowledge of the species, with an average of 88 % correct answers. Precision varied by species, with species scoring close to 100 % and others scoring as low as 65 %. The taxonomy question had 100 % correct answers, the natural history questions 90 %, and the conservation status question 56 %. In the precision of the general knowledge answers in the study of wild mammals, a moderate precision of 73.54 % was obtained. The study shows that ChatGPT has high precision, so it can be a helpful tool in the search for information in research on wild mammals. On the other hand, concerns are raised about its applicability in the academic field, due to the risk of producing unreliable or biased results and generating inaccurate or misleading content, so it is important to take into account the limitations and risks associated with its use. It is suggested that further research and insight into accuracy be done to explore the full potential of ChatGPT.
期刊介绍：
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
