人机协作:揭示智能决策支持系统中用户熟练程度和人工智能代理能力的影响

IF 2.5 2区 工程技术 Q2 ENGINEERING, INDUSTRIAL International Journal of Industrial Ergonomics Pub Date : 2024-08-12 DOI:10.1016/j.ergon.2024.103629
Lu Peng , Dailin Li , Zhaotong Zhang , Tingru Zhang , Anqi Huang , Shaohui Yang , Yu Hu
{"title":"人机协作:揭示智能决策支持系统中用户熟练程度和人工智能代理能力的影响","authors":"Lu Peng ,&nbsp;Dailin Li ,&nbsp;Zhaotong Zhang ,&nbsp;Tingru Zhang ,&nbsp;Anqi Huang ,&nbsp;Shaohui Yang ,&nbsp;Yu Hu","doi":"10.1016/j.ergon.2024.103629","DOIUrl":null,"url":null,"abstract":"<div><p>Artificial intelligence (AI) agents are integral components of modern intelligent decision support systems (IDSS), providing their capability to assist in decision-making processes. Understanding the influence of AI involvement on human responses within these systems is crucial for fostering appropriate reliance on AI advice and ensuring a comfortable user experience. This study delves into the impact of AI agents on decision change, correct rate change, confidence rate change and pleasure rating among users. It explores the main and interactive effects of user proficiency and AI agent capability on user responses. A block-factorial experiment involving 45 participants was conducted. The results indicated that high-capability AI agents were associated with substantial decision change, correct rate change and confidence rate change. Participants with higher proficiency, both subjectively and objectively, exhibited reduced reliance on AI agents for task execution. Notably, the involvement of AI agents led to a slight decline in correct rates for participants of high competence (i.e., participants' independent correct rate exceeds AI agent capability), while still enhancing their confidence levels. Additionally, agents lacking human-like embodiment tended to enhance participants’ pleasure ratings. Individual differences in gender, collaboration experience with AI agent, and stereotype on AI agent capability also shaped the decision changes and pleasure ratings of participants. These findings underscore the presence of complementary competence interaction between user and AI agent within IDSS, and can be applied in designing capability of advisory AI agents with consideration of user proficiency and individual characteristics.</p></div><div><h3>Relevance to industry</h3><p>The findings can be used as guidelines for designing AI agents and specifying their application strategies to integrate the assistance of AI agents effectively in intelligent decision support systems.</p></div>","PeriodicalId":50317,"journal":{"name":"International Journal of Industrial Ergonomics","volume":"103 ","pages":"Article 103629"},"PeriodicalIF":2.5000,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Human-AI collaboration: Unraveling the effects of user proficiency and AI agent capability in intelligent decision support systems\",\"authors\":\"Lu Peng ,&nbsp;Dailin Li ,&nbsp;Zhaotong Zhang ,&nbsp;Tingru Zhang ,&nbsp;Anqi Huang ,&nbsp;Shaohui Yang ,&nbsp;Yu Hu\",\"doi\":\"10.1016/j.ergon.2024.103629\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Artificial intelligence (AI) agents are integral components of modern intelligent decision support systems (IDSS), providing their capability to assist in decision-making processes. Understanding the influence of AI involvement on human responses within these systems is crucial for fostering appropriate reliance on AI advice and ensuring a comfortable user experience. This study delves into the impact of AI agents on decision change, correct rate change, confidence rate change and pleasure rating among users. It explores the main and interactive effects of user proficiency and AI agent capability on user responses. A block-factorial experiment involving 45 participants was conducted. The results indicated that high-capability AI agents were associated with substantial decision change, correct rate change and confidence rate change. Participants with higher proficiency, both subjectively and objectively, exhibited reduced reliance on AI agents for task execution. Notably, the involvement of AI agents led to a slight decline in correct rates for participants of high competence (i.e., participants' independent correct rate exceeds AI agent capability), while still enhancing their confidence levels. Additionally, agents lacking human-like embodiment tended to enhance participants’ pleasure ratings. Individual differences in gender, collaboration experience with AI agent, and stereotype on AI agent capability also shaped the decision changes and pleasure ratings of participants. These findings underscore the presence of complementary competence interaction between user and AI agent within IDSS, and can be applied in designing capability of advisory AI agents with consideration of user proficiency and individual characteristics.</p></div><div><h3>Relevance to industry</h3><p>The findings can be used as guidelines for designing AI agents and specifying their application strategies to integrate the assistance of AI agents effectively in intelligent decision support systems.</p></div>\",\"PeriodicalId\":50317,\"journal\":{\"name\":\"International Journal of Industrial Ergonomics\",\"volume\":\"103 \",\"pages\":\"Article 103629\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2024-08-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Industrial Ergonomics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0169814124000854\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Industrial Ergonomics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0169814124000854","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

摘要

人工智能(AI)代理是现代智能决策支持系统(IDSS)不可或缺的组成部分,能够为决策过程提供帮助。在这些系统中,了解人工智能参与对人类反应的影响对于促进适当依赖人工智能建议和确保舒适的用户体验至关重要。本研究深入探讨了人工智能代理对用户决策变化、正确率变化、信心率变化和愉悦度评级的影响。它探讨了用户熟练程度和人工智能代理能力对用户反应的主要影响和交互影响。研究人员进行了一项由 45 名参与者参与的分块因子实验。结果表明,高能力的人工智能代理与实质性的决策变化、正确率变化和信心率变化相关。在主观和客观方面,熟练度较高的参与者在执行任务时对人工智能代理的依赖程度都有所降低。值得注意的是,人工智能代理的参与导致高能力参与者的正确率略有下降(即参与者的独立正确率超过了人工智能代理的能力),同时仍然提高了他们的信心水平。此外,缺乏类人体现的代理往往会提高参与者的愉悦度。性别、与人工智能代理的合作经验以及对人工智能代理能力的刻板印象等个体差异也影响了参与者的决策变化和愉悦度评价。这些发现强调了用户和人工智能代理之间在智能决策支持系统中存在互补的能力互动,可用于设计人工智能代理的咨询能力,同时考虑用户的熟练程度和个体特征。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Human-AI collaboration: Unraveling the effects of user proficiency and AI agent capability in intelligent decision support systems

Artificial intelligence (AI) agents are integral components of modern intelligent decision support systems (IDSS), providing their capability to assist in decision-making processes. Understanding the influence of AI involvement on human responses within these systems is crucial for fostering appropriate reliance on AI advice and ensuring a comfortable user experience. This study delves into the impact of AI agents on decision change, correct rate change, confidence rate change and pleasure rating among users. It explores the main and interactive effects of user proficiency and AI agent capability on user responses. A block-factorial experiment involving 45 participants was conducted. The results indicated that high-capability AI agents were associated with substantial decision change, correct rate change and confidence rate change. Participants with higher proficiency, both subjectively and objectively, exhibited reduced reliance on AI agents for task execution. Notably, the involvement of AI agents led to a slight decline in correct rates for participants of high competence (i.e., participants' independent correct rate exceeds AI agent capability), while still enhancing their confidence levels. Additionally, agents lacking human-like embodiment tended to enhance participants’ pleasure ratings. Individual differences in gender, collaboration experience with AI agent, and stereotype on AI agent capability also shaped the decision changes and pleasure ratings of participants. These findings underscore the presence of complementary competence interaction between user and AI agent within IDSS, and can be applied in designing capability of advisory AI agents with consideration of user proficiency and individual characteristics.

Relevance to industry

The findings can be used as guidelines for designing AI agents and specifying their application strategies to integrate the assistance of AI agents effectively in intelligent decision support systems.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Industrial Ergonomics
International Journal of Industrial Ergonomics 工程技术-工程:工业
CiteScore
6.40
自引率
12.90%
发文量
110
审稿时长
56 days
期刊介绍: The journal publishes original contributions that add to our understanding of the role of humans in today systems and the interactions thereof with various system components. The journal typically covers the following areas: industrial and occupational ergonomics, design of systems, tools and equipment, human performance measurement and modeling, human productivity, humans in technologically complex systems, and safety. The focus of the articles includes basic theoretical advances, applications, case studies, new methodologies and procedures; and empirical studies.
期刊最新文献
Assessing the link between occupational risk factors, work-related musculoskeletal disorders and quality of work life: An analysis using PLS-SEM Ergonomic design of mastectomy bra based on emotion measurements Sedentary behavior and musculoskeletal symptoms among work from home employees Effects of control parameters of wearable robotics on muscle activity during assisted elbow flexion Discovering hidden strengths: How a passive lower extremity exoskeleton boosts the isometric pulling capacity to new heights
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1