The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users

Proceedings of the 5th International Conference on Conversational User Interfaces Pub Date : 2023-07-19 DOI:10.1145/3571884.3597144

Marita Skjuve, Asbjørn Følstad, P. B. Brandtzaeg

{"title":"The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users","authors":"Marita Skjuve, Asbjørn Følstad, P. B. Brandtzaeg","doi":"10.1145/3571884.3597144","DOIUrl":null,"url":null,"abstract":"The launch of ChatGPT has attracted significant attention and showcased the potentially game-changing capabilities of conversational AI. These capabilities, and lack of user research, highlight the need to investigate how users experience interactions with conversational AIs like ChatGPT. Therefore, we conducted a questionnaire study with ChatGPT users (N=194), inquiring about their good and poor experiences with ChatGPT. The user reports were analyzed by a thematic analysis and systematized through a pragmatic-hedonic framework. Our results demonstrate how user experience is influenced by pragmatic attributes such as ChatGPT providing useful and detailed information and easing work- or school-related tasks. Additionally, user experience is impacted by hedonic attributes, such as entertainment and creative interactions, and interactions leaving the user impressed or surprised. Our study underscores that user experience concerning conversational AI like ChatGPT is assessed by useful and productive interactions even in early phase of uptake, suggesting the importance of pragmatic attributes.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"75 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 5th International Conference on Conversational User Interfaces","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3571884.3597144","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 5

Abstract

The launch of ChatGPT has attracted significant attention and showcased the potentially game-changing capabilities of conversational AI. These capabilities, and lack of user research, highlight the need to investigate how users experience interactions with conversational AIs like ChatGPT. Therefore, we conducted a questionnaire study with ChatGPT users (N=194), inquiring about their good and poor experiences with ChatGPT. The user reports were analyzed by a thematic analysis and systematized through a pragmatic-hedonic framework. Our results demonstrate how user experience is influenced by pragmatic attributes such as ChatGPT providing useful and detailed information and easing work- or school-related tasks. Additionally, user experience is impacted by hedonic attributes, such as entertainment and creative interactions, and interactions leaving the user impressed or surprised. Our study underscores that user experience concerning conversational AI like ChatGPT is assessed by useful and productive interactions even in early phase of uptake, suggesting the importance of pragmatic attributes.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

ChatGPT的用户体验:来自早期用户问卷调查的结果

ChatGPT的推出吸引了大量关注，并展示了会话人工智能潜在的改变游戏规则的能力。这些功能，以及缺乏用户研究，突出了研究用户如何体验与ChatGPT等会话人工智能交互的必要性。因此，我们对ChatGPT用户(N=194)进行了问卷调查，询问他们使用ChatGPT的好体验和差体验。用户报告采用主题分析的方法进行分析，并通过语用-享乐主义的框架进行系统化。我们的研究结果证明了用户体验是如何受到实用属性的影响的，比如ChatGPT提供有用和详细的信息，以及简化与工作或学校相关的任务。此外，用户体验受到享乐属性的影响，例如娱乐和创造性交互，以及让用户印象深刻或惊讶的交互。我们的研究强调，即使在使用的早期阶段，ChatGPT等会话式人工智能的用户体验也是通过有用和富有成效的交互来评估的，这表明实用主义属性的重要性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Proceedings of the 5th International Conference on Conversational User Interfaces

自引率

0.00%

发文量