{"title":"Comparing advice on climate policy between academic experts and ChatGPT","authors":"","doi":"10.1016/j.ecolecon.2024.108352","DOIUrl":null,"url":null,"abstract":"<div><p>We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot <em>ChatGPT</em>. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.</p></div>","PeriodicalId":51021,"journal":{"name":"Ecological Economics","volume":null,"pages":null},"PeriodicalIF":6.6000,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921800924002490/pdfft?md5=f9c80a6ee193c2916742934fad040142&pid=1-s2.0-S0921800924002490-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Economics","FirstCategoryId":"96","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921800924002490","RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot ChatGPT. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.
期刊介绍:
Ecological Economics is concerned with extending and integrating the understanding of the interfaces and interplay between "nature''s household" (ecosystems) and "humanity''s household" (the economy). Ecological economics is an interdisciplinary field defined by a set of concrete problems or challenges related to governing economic activity in a way that promotes human well-being, sustainability, and justice. The journal thus emphasizes critical work that draws on and integrates elements of ecological science, economics, and the analysis of values, behaviors, cultural practices, institutional structures, and societal dynamics. The journal is transdisciplinary in spirit and methodologically open, drawing on the insights offered by a variety of intellectual traditions, and appealing to a diverse readership.
Specific research areas covered include: valuation of natural resources, sustainable agriculture and development, ecologically integrated technology, integrated ecologic-economic modelling at scales from local to regional to global, implications of thermodynamics for economics and ecology, renewable resource management and conservation, critical assessments of the basic assumptions underlying current economic and ecological paradigms and the implications of alternative assumptions, economic and ecological consequences of genetically engineered organisms, and gene pool inventory and management, alternative principles for valuing natural wealth, integrating natural resources and environmental services into national income and wealth accounts, methods of implementing efficient environmental policies, case studies of economic-ecologic conflict or harmony, etc. New issues in this area are rapidly emerging and will find a ready forum in Ecological Economics.