首页 > 最新文献

arXiv - CS - Human-Computer Interaction最新文献

英文 中文
React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors 对此做出反应!人类如何利用非语言行为挑战交互式代理
Pub Date : 2024-09-17 DOI: arxiv-2409.11602
Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim, Lauren Yip, Ugo Cupcic, Stéphane Lallée, Angelica Lim
How do people use their faces and bodies to test the interactive abilities ofa robot? Making lively, believable agents is often seen as a goal for robotsand virtual agents but believability can easily break down. In thisWizard-of-Oz (WoZ) study, we observed 1169 nonverbal interactions between 20participants and 6 types of agents. We collected the nonverbal behaviorsparticipants used to challenge the characters physically, emotionally, andsocially. The participants interacted freely with humanoid and non-humanoidforms: a robot, a human, a penguin, a pufferfish, a banana, and a toilet. Wepresent a human behavior codebook of 188 unique nonverbal behaviors used byhumans to test the virtual characters. The insights and design strategies drawnfrom video observations aim to help build more interaction-aware and believablerobots, especially when humans push them to their limits.
人们如何用自己的脸和身体来测试机器人的交互能力?制作生动、可信的代理通常被视为机器人和虚拟代理的目标,但可信性很容易崩溃。在这项 WoZ(Wizard-of-Oz)研究中,我们观察了 20 名参与者与 6 种代理之间的 1169 次非语言互动。我们收集了参与者用来在身体、情感和社交方面挑战角色的非语言行为。参与者自由地与人形和非人形进行了互动:机器人、人类、企鹅、河豚、香蕉和马桶。我们展示了人类在测试虚拟角色时所使用的 188 种独特非语言行为的人类行为代码集。从视频观察中得出的见解和设计策略旨在帮助构建更具交互意识和可信度的机器人,尤其是当人类将它们推向极限时。
{"title":"React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors","authors":"Chuxuan Zhang, Bermet Burkanova, Lawrence H. Kim, Lauren Yip, Ugo Cupcic, Stéphane Lallée, Angelica Lim","doi":"arxiv-2409.11602","DOIUrl":"https://doi.org/arxiv-2409.11602","url":null,"abstract":"How do people use their faces and bodies to test the interactive abilities of\u0000a robot? Making lively, believable agents is often seen as a goal for robots\u0000and virtual agents but believability can easily break down. In this\u0000Wizard-of-Oz (WoZ) study, we observed 1169 nonverbal interactions between 20\u0000participants and 6 types of agents. We collected the nonverbal behaviors\u0000participants used to challenge the characters physically, emotionally, and\u0000socially. The participants interacted freely with humanoid and non-humanoid\u0000forms: a robot, a human, a penguin, a pufferfish, a banana, and a toilet. We\u0000present a human behavior codebook of 188 unique nonverbal behaviors used by\u0000humans to test the virtual characters. The insights and design strategies drawn\u0000from video observations aim to help build more interaction-aware and believable\u0000robots, especially when humans push them to their limits.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"4 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252160","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Exploration of Effects of Dark Mode on University Students: A Human Computer Interface Analysis 探索黑暗模式对大学生的影响:人机界面分析
Pub Date : 2024-09-17 DOI: arxiv-2409.10895
Awan Shrestha, Sabil Shrestha, Biplov Paneru, Bishwash Paneru, Sansrit Paudel, Ashish Adhikari, Sanjog Chhetri Sapkota
This research dives into exploring the dark mode effects on students of auniversity. Research is carried out implementing the dark mode in e-Learningsites and its impact on behavior of the users. Students are spending more timein front of the screen for their studies especially after the pandemic. Theblue light from the screen during late hours affects circadian rhythm of thebody which negatively impacts the health of humans including eye strain andheadache. The difficulty that students faced during the time of interactingwith various e-Learning sites especially during late hours was analyzed usingdifferent techniques of HCI like survey, interview, evaluation methods andprinciples of design. Dark mode is an option which creates a pseudo invertedadaptable interface by changing brighter elements of UI into a dim-lit friendlyenvironment. It is said that using dark mode will lessen the amount of bluelight emitted and benefit students who suffer from eye strain. Students'interactions with dark mode were investigated using a survey, and an e-learningsite with a dark mode theme was created. Based on the students' comments,researchers looked into the effects of dark mode on HCI in e-learning sites.The findings indicate that students have a clear preference for dark mode:79.7% of survey participants preferred dark mode on their phones, and 61.7%said they would be interested in seeing this feature added to e-learningwebsites.
本研究深入探讨了暗模式对大学生的影响。研究在电子学习网站中实施暗模式及其对用户行为的影响。学生花在屏幕前学习的时间越来越多,尤其是在大流行病之后。深夜屏幕发出的蓝光会影响人体的昼夜节律,从而对人体健康产生负面影响,包括眼睛疲劳和头痛。我们使用不同的人机交互技术,如调查、访谈、评估方法和设计原则,分析了学生在与各种电子学习网站交互时(尤其是在深夜)所面临的困难。暗光模式是一种通过将用户界面的亮光元素转换为暗光友好环境来创建伪倒置适应界面的选项。据说,使用黑暗模式可以减少蓝光的发射量,对眼睛疲劳的学生有好处。研究人员通过调查研究了学生与暗色模式的交互情况,并创建了一个以暗色模式为主题的电子学习网站。调查结果表明,学生对暗色模式有明显的偏好:79.7%的调查参与者喜欢手机上的暗色模式,61.7%的调查参与者表示他们有兴趣在电子学习网站中加入这一功能。
{"title":"An Exploration of Effects of Dark Mode on University Students: A Human Computer Interface Analysis","authors":"Awan Shrestha, Sabil Shrestha, Biplov Paneru, Bishwash Paneru, Sansrit Paudel, Ashish Adhikari, Sanjog Chhetri Sapkota","doi":"arxiv-2409.10895","DOIUrl":"https://doi.org/arxiv-2409.10895","url":null,"abstract":"This research dives into exploring the dark mode effects on students of a\u0000university. Research is carried out implementing the dark mode in e-Learning\u0000sites and its impact on behavior of the users. Students are spending more time\u0000in front of the screen for their studies especially after the pandemic. The\u0000blue light from the screen during late hours affects circadian rhythm of the\u0000body which negatively impacts the health of humans including eye strain and\u0000headache. The difficulty that students faced during the time of interacting\u0000with various e-Learning sites especially during late hours was analyzed using\u0000different techniques of HCI like survey, interview, evaluation methods and\u0000principles of design. Dark mode is an option which creates a pseudo inverted\u0000adaptable interface by changing brighter elements of UI into a dim-lit friendly\u0000environment. It is said that using dark mode will lessen the amount of blue\u0000light emitted and benefit students who suffer from eye strain. Students'\u0000interactions with dark mode were investigated using a survey, and an e-learning\u0000site with a dark mode theme was created. Based on the students' comments,\u0000researchers looked into the effects of dark mode on HCI in e-learning sites.\u0000The findings indicate that students have a clear preference for dark mode:\u000079.7% of survey participants preferred dark mode on their phones, and 61.7%\u0000said they would be interested in seeing this feature added to e-learning\u0000websites.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"208 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal Selves 利用人工智能生成的情感自我声音,引导人们实现理想自我
Pub Date : 2024-09-17 DOI: arxiv-2409.11531
Cathy Mengying Fang, Phoebe Chua, Samantha Chan, Joanne Leong, Andria Bao, Pattie Maes
Emotions, shaped by past experiences, significantly influence decision-makingand goal pursuit. Traditional cognitive-behavioral techniques for personaldevelopment rely on mental imagery to envision ideal selves, but may be lesseffective for individuals who struggle with visualization. This paperintroduces Emotional Self-Voice (ESV), a novel system combining emotionallyexpressive language models and voice cloning technologies to render customizedresponses in the user's own voice. We investigate the potential of ESV to nudgeindividuals towards their ideal selves in a study with 60 participants. Acrossall three conditions (ESV, text-only, and mental imagination), we observed anincrease in resilience, confidence, motivation, and goal commitment, but theESV condition was perceived as uniquely engaging and personalized. We discussthe implications of designing generated self-voice systems as a personalizedbehavioral intervention for different scenarios.
情绪受过去经历的影响,在很大程度上影响着决策和目标追求。传统的个人发展认知行为技术依赖于心理想象来憧憬理想中的自我,但对于那些在可视化方面有困难的人来说可能效果不佳。本文介绍的情感自言自语(ESV)是一种新型系统,它结合了情感表达语言模型和语音克隆技术,能以用户自己的声音提供定制的回应。在一项有 60 名参与者参加的研究中,我们调查了 ESV 在引导个人实现理想自我方面的潜力。在所有三种条件下(ESV、纯文本和心理想象),我们观察到复原力、自信心、积极性和目标承诺都有所提高,但 ESV 条件被认为具有独特的吸引力和个性化。我们讨论了将生成的自我语音系统设计为针对不同场景的个性化行为干预的意义。
{"title":"Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal Selves","authors":"Cathy Mengying Fang, Phoebe Chua, Samantha Chan, Joanne Leong, Andria Bao, Pattie Maes","doi":"arxiv-2409.11531","DOIUrl":"https://doi.org/arxiv-2409.11531","url":null,"abstract":"Emotions, shaped by past experiences, significantly influence decision-making\u0000and goal pursuit. Traditional cognitive-behavioral techniques for personal\u0000development rely on mental imagery to envision ideal selves, but may be less\u0000effective for individuals who struggle with visualization. This paper\u0000introduces Emotional Self-Voice (ESV), a novel system combining emotionally\u0000expressive language models and voice cloning technologies to render customized\u0000responses in the user's own voice. We investigate the potential of ESV to nudge\u0000individuals towards their ideal selves in a study with 60 participants. Across\u0000all three conditions (ESV, text-only, and mental imagination), we observed an\u0000increase in resilience, confidence, motivation, and goal commitment, but the\u0000ESV condition was perceived as uniquely engaging and personalized. We discuss\u0000the implications of designing generated self-voice systems as a personalized\u0000behavioral intervention for different scenarios.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"116 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252435","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Interface Design in Interactive Task Learning for Hierarchical Tasks based on a Qualitative Study 基于定性研究改进分层任务互动学习的界面设计
Pub Date : 2024-09-17 DOI: arxiv-2409.10826
Jieyu Zhou, Christopher MacLellan
Interactive Task Learning (ITL) systems acquire task knowledge from humaninstructions in natural language interaction. The interaction design of ITLagents for hierarchical tasks stays uncharted. This paper studied VerbalApprentice Learner(VAL) for gaming, as an ITL example, and qualitativelyanalyzed the user study data to provide design insights on dialogue languagetypes, task instruction strategies, and error handling. We then proposed aninterface design: Editable Hierarchy Knowledge (EHK), as a generic probe forITL systems for hierarchical tasks.
交互式任务学习(ITL)系统通过自然语言交互从人类指令中获取任务知识。针对分层任务的 ITL 代理的交互设计仍是未知数。本文以 VerbalApprentice Learner(VAL)游戏为例,对用户研究数据进行了定性分析,从而为对话语言类型、任务指令策略和错误处理提供了设计启示。然后,我们提出了一种界面设计:可编辑分层知识(EHK),作为用于分层任务的 ITL 系统的通用探针。
{"title":"Improving Interface Design in Interactive Task Learning for Hierarchical Tasks based on a Qualitative Study","authors":"Jieyu Zhou, Christopher MacLellan","doi":"arxiv-2409.10826","DOIUrl":"https://doi.org/arxiv-2409.10826","url":null,"abstract":"Interactive Task Learning (ITL) systems acquire task knowledge from human\u0000instructions in natural language interaction. The interaction design of ITL\u0000agents for hierarchical tasks stays uncharted. This paper studied Verbal\u0000Apprentice Learner(VAL) for gaming, as an ITL example, and qualitatively\u0000analyzed the user study data to provide design insights on dialogue language\u0000types, task instruction strategies, and error handling. We then proposed an\u0000interface design: Editable Hierarchy Knowledge (EHK), as a generic probe for\u0000ITL systems for hierarchical tasks.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"42 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins 虚拟现实技术在骨科手术中的沉浸式教育 数字双胞胎
Pub Date : 2024-09-17 DOI: arxiv-2409.11014
Jonas Hein, Jan Grunder, Lilian Calvet, Frédéric Giraud, Nicola Alessandro Cavalcanti, Fabio Carrillo, Philipp Fürnstahl
Virtual Reality technology, when integrated with Surgical Digital Twins(SDTs), offers significant potential in medical training and surgical planning.We present SurgTwinVR, a VR application that immerses users within an SDT andenables them to navigate a high-fidelity virtual replica of the surgicalenvironment. SurgTwinVR is the first VR application to utilize a dynamic 3Denvironment that is a clone of a real surgery, encompassing the entire surgicalscene, including the surgeon, anatomy, and instruments. Our system utilizes aSDT with important improvements for real-time rendering and features toshowcase the potential benefits of such an application in surgical education.
我们推出的 SurgTwinVR 是一款 VR 应用程序,它能让用户沉浸在 SDT 中,并在高保真的虚拟手术环境中进行操作。SurgTwinVR 是第一款利用动态 3D 环境的 VR 应用程序,该环境是真实手术的复制品,涵盖了整个手术场景,包括外科医生、解剖结构和器械。我们的系统利用了对实时渲染和功能进行了重要改进的 SDT,以展示这种应用在外科教育中的潜在优势。
{"title":"Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins","authors":"Jonas Hein, Jan Grunder, Lilian Calvet, Frédéric Giraud, Nicola Alessandro Cavalcanti, Fabio Carrillo, Philipp Fürnstahl","doi":"arxiv-2409.11014","DOIUrl":"https://doi.org/arxiv-2409.11014","url":null,"abstract":"Virtual Reality technology, when integrated with Surgical Digital Twins\u0000(SDTs), offers significant potential in medical training and surgical planning.\u0000We present SurgTwinVR, a VR application that immerses users within an SDT and\u0000enables them to navigate a high-fidelity virtual replica of the surgical\u0000environment. SurgTwinVR is the first VR application to utilize a dynamic 3D\u0000environment that is a clone of a real surgery, encompassing the entire surgical\u0000scene, including the surgeon, anatomy, and instruments. Our system utilizes a\u0000SDT with important improvements for real-time rendering and features to\u0000showcase the potential benefits of such an application in surgical education.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ASHABot: An LLM-Powered Chatbot to Support the Informational Needs of Community Health Workers ASHABot:由法学硕士驱动的聊天机器人,可满足社区卫生工作者的信息需求
Pub Date : 2024-09-17 DOI: arxiv-2409.10913
Pragnya Ramjee, Mehak Chhokar, Bhuvan Sachdeva, Mahendra Meena, Hamid Abdullah, Aditya Vashistha, Ruchit Nagar, Mohit Jain
Community health workers (CHWs) provide last-mile healthcare services butface challenges due to limited medical knowledge and training. This paperdescribes the design, deployment, and evaluation of ASHABot, an LLM-powered,experts-in-the-loop, WhatsApp-based chatbot to address the information needs ofCHWs in India. Through interviews with CHWs and their supervisors and loganalysis, we examine factors affecting their engagement with ASHABot, andASHABot's role in addressing CHWs' informational needs. We found that ASHABotprovided a private channel for CHWs to ask rudimentary and sensitive questionsthey hesitated to ask supervisors. CHWs trusted the information they receivedon ASHABot and treated it as an authoritative resource. CHWs' supervisorsexpanded their knowledge by contributing answers to questions ASHABot failed toanswer, but were concerned about demands on their workload and increasedaccountability. We emphasize positioning LLMs as supplemental fallibleresources within the community healthcare ecosystem, instead of as replacementsfor supervisor support.
社区保健工作者(CHWs)提供最后一英里的医疗保健服务,但由于医疗知识和培训有限而面临挑战。本文介绍了 ASHABot 的设计、部署和评估。ASHABot 是一个由 LLM 支持、专家在环路中、基于 WhatsApp 的聊天机器人,旨在满足印度社区卫生工作人员的信息需求。通过对卫生保健工作者及其主管的访谈和日志分析,我们研究了影响他们参与 ASHABot 的因素,以及 ASHABot 在满足卫生保健工作者信息需求方面的作用。我们发现,ASHABot 为卫生保健工作者提供了一个私人渠道,让他们可以向主管提出他们犹豫不决的基本敏感问题。卫生保健工作者信任他们在 ASHABot 上获得的信息,并将其视为权威资源。卫生保健工作者的主管通过回答 ASHABot 未能解答的问题来扩展自己的知识,但他们担心工作量的增加和责任的加重。我们强调要将 LLMs 定位为社区医疗生态系统中不可靠的补充资源,而不是主管支持的替代品。
{"title":"ASHABot: An LLM-Powered Chatbot to Support the Informational Needs of Community Health Workers","authors":"Pragnya Ramjee, Mehak Chhokar, Bhuvan Sachdeva, Mahendra Meena, Hamid Abdullah, Aditya Vashistha, Ruchit Nagar, Mohit Jain","doi":"arxiv-2409.10913","DOIUrl":"https://doi.org/arxiv-2409.10913","url":null,"abstract":"Community health workers (CHWs) provide last-mile healthcare services but\u0000face challenges due to limited medical knowledge and training. This paper\u0000describes the design, deployment, and evaluation of ASHABot, an LLM-powered,\u0000experts-in-the-loop, WhatsApp-based chatbot to address the information needs of\u0000CHWs in India. Through interviews with CHWs and their supervisors and log\u0000analysis, we examine factors affecting their engagement with ASHABot, and\u0000ASHABot's role in addressing CHWs' informational needs. We found that ASHABot\u0000provided a private channel for CHWs to ask rudimentary and sensitive questions\u0000they hesitated to ask supervisors. CHWs trusted the information they received\u0000on ASHABot and treated it as an authoritative resource. CHWs' supervisors\u0000expanded their knowledge by contributing answers to questions ASHABot failed to\u0000answer, but were concerned about demands on their workload and increased\u0000accountability. We emphasize positioning LLMs as supplemental fallible\u0000resources within the community healthcare ecosystem, instead of as replacements\u0000for supervisor support.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards Ethical Personal AI Applications: Practical Considerations for AI Assistants with Long-Term Memory 实现合乎道德的个人人工智能应用:具有长期记忆的人工智能助手的实际考虑因素
Pub Date : 2024-09-17 DOI: arxiv-2409.11192
Eunhae Lee
One application area of long-term memory (LTM) capabilities with increasingtraction is personal AI companions and assistants. With the ability to retainand contextualize past interactions and adapt to user preferences, personal AIcompanions and assistants promise a profound shift in how we interact with AIand are on track to become indispensable in personal and professional settings.However, this advancement introduces new challenges and vulnerabilities thatrequire careful consideration regarding the deployment and widespread use ofthese systems. The goal of this paper is to explore the broader implications ofbuilding and deploying personal AI applications with LTM capabilities using aholistic evaluation approach. This will be done in three ways: 1) reviewing thetechnological underpinnings of LTM in Large Language Models, 2) surveyingcurrent personal AI companions and assistants, and 3) analyzing criticalconsiderations and implications of deploying and using these applications.
个人人工智能伴侣和助手是长期记忆(LTM)能力的一个应用领域,其吸引力与日俱增。个人人工智能伴侣和助手能够保留过去的交互行为并将其与上下文联系起来,还能适应用户的偏好,因此有望在我们与人工智能的交互方式上实现深刻转变,并有望成为个人和职业环境中不可或缺的工具。然而,这一进步也带来了新的挑战和漏洞,在部署和广泛使用这些系统时需要仔细考虑。本文旨在采用整体评估方法,探讨构建和部署具有 LTM 功能的个人人工智能应用程序的广泛影响。本文将从三个方面进行探讨:1)回顾大型语言模型中 LTM 的技术基础;2)调查当前的个人人工智能伴侣和助手;3)分析部署和使用这些应用程序的关键考虑因素和影响。
{"title":"Towards Ethical Personal AI Applications: Practical Considerations for AI Assistants with Long-Term Memory","authors":"Eunhae Lee","doi":"arxiv-2409.11192","DOIUrl":"https://doi.org/arxiv-2409.11192","url":null,"abstract":"One application area of long-term memory (LTM) capabilities with increasing\u0000traction is personal AI companions and assistants. With the ability to retain\u0000and contextualize past interactions and adapt to user preferences, personal AI\u0000companions and assistants promise a profound shift in how we interact with AI\u0000and are on track to become indispensable in personal and professional settings.\u0000However, this advancement introduces new challenges and vulnerabilities that\u0000require careful consideration regarding the deployment and widespread use of\u0000these systems. The goal of this paper is to explore the broader implications of\u0000building and deploying personal AI applications with LTM capabilities using a\u0000holistic evaluation approach. This will be done in three ways: 1) reviewing the\u0000technological underpinnings of LTM in Large Language Models, 2) surveying\u0000current personal AI companions and assistants, and 3) analyzing critical\u0000considerations and implications of deploying and using these applications.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"25 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ping! Your Food is Ready: Comparing Different Notification Techniques in 3D AR Cooking Environment 平!您的食物准备好了比较 3D AR 烹饪环境中的不同通知技术
Pub Date : 2024-09-17 DOI: arxiv-2409.11357
Aditya Raikwar, Lucas Plabst, Anil Ufuk Batmaz, Florian Niebling, Francisco R. Ortega
Implementing visual and audio notifications on augmented reality devices is acrucial element of intuitive and easy-to-use interfaces. In this paper, weexplored creating intuitive interfaces through visual and audio notifications.The study evaluated user performance and preference across three conditions:visual notifications in fixed positions, visual notifications above objects,and no visual notifications with monaural sounds. The users were tasked withcooking and serving customers in an open-source Augmented-Reality sandboxenvironment called ARtisan Bistro. The results indicated that visualnotifications above objects combined with localized audio feedback were themost effective and preferred method by participants. The findings highlight theimportance of strategic placement of visual and audio notifications in AR,providing insights for engineers and developers to design intuitive 3D userinterfaces.
在增强现实设备上实现视觉和音频通知是直观易用界面的关键要素。本文探讨了通过视觉和音频通知创建直观界面的问题。研究评估了用户在三种情况下的表现和偏好:固定位置的视觉通知、物体上方的视觉通知以及无视觉通知的单声道声音。用户的任务是在名为 ARtisan Bistro 的开源增强现实沙盒环境中烹饪并为顾客提供服务。结果表明,物体上方的视觉通知与本地化音频反馈相结合是最有效且最受参与者青睐的方法。研究结果强调了在 AR 中战略性地放置视觉和音频通知的重要性,为工程师和开发人员设计直观的 3D 用户界面提供了启示。
{"title":"Ping! Your Food is Ready: Comparing Different Notification Techniques in 3D AR Cooking Environment","authors":"Aditya Raikwar, Lucas Plabst, Anil Ufuk Batmaz, Florian Niebling, Francisco R. Ortega","doi":"arxiv-2409.11357","DOIUrl":"https://doi.org/arxiv-2409.11357","url":null,"abstract":"Implementing visual and audio notifications on augmented reality devices is a\u0000crucial element of intuitive and easy-to-use interfaces. In this paper, we\u0000explored creating intuitive interfaces through visual and audio notifications.\u0000The study evaluated user performance and preference across three conditions:\u0000visual notifications in fixed positions, visual notifications above objects,\u0000and no visual notifications with monaural sounds. The users were tasked with\u0000cooking and serving customers in an open-source Augmented-Reality sandbox\u0000environment called ARtisan Bistro. The results indicated that visual\u0000notifications above objects combined with localized audio feedback were the\u0000most effective and preferred method by participants. The findings highlight the\u0000importance of strategic placement of visual and audio notifications in AR,\u0000providing insights for engineers and developers to design intuitive 3D user\u0000interfaces.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"65 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gestalt driven augmented collimator widget for precise 5 dof dental drill tool positioning in 3d space 格式塔驱动的增强型准直器小部件,用于在三维空间中精确定位 5 dof 牙科钻具
Pub Date : 2024-09-17 DOI: arxiv-2409.10960
Mine Dastan, Antonio E. Uva, Michele Fiorentino
Drill tool positioning in dental implantology is a challenging task requiring5DOF precision as the rotation around the tool axis is not influential. Thiswork improves the quasi-static visual elements of the state-of-the-art with anovel Augmented Collimation Widget (ACW), an interactive tool of position andangle error visualization based on the gestalt reification, the human abilityto group geometric elements. The user can seek in a quick, pre-attentive waythe collimation of five (three positional and two rotational) error componentwidgets (ECWs), taking advantage of three key aspects: component separation andreification, error visual amplification, and dynamic hiding of the collimatedcomponents. We compared the ACW with the golden standard in a within-subjects(N=30) user test using 32 implant targets, measuring the time, error, andusability. ACW performed significantly better in positional (+19%) and angular(+47%) precision accuracy and with less mental demand (-6%) and frustration(-13%), but with an expected increase in task time (+59%) and physical demand(+64%). The interview indicated the ACW as the main preference andaesthetically more pleasant than GSW, candidating it as the new golden standardfor implantology, but also for other applications where 5DOF positioning iskey.
牙科种植中的钻具定位是一项具有挑战性的任务,需要 5DOF 的精度,因为围绕钻具轴线的旋转并不具有影响力。这项工作通过一种新的增强准直小工具(ACW)改进了最先进的准静态视觉元素,这是一种基于格式塔重构(Gestalt reification)的位置和角度误差可视化互动工具,是人类将几何元素分组的能力。用户可以利用以下三个关键方面的优势,快速、专注地寻求五个(三个位置误差组件和两个旋转误差组件)误差组件(ECW)的准直:组件分离和重化、误差视觉放大以及准直组件的动态隐藏。我们在使用 32 个植入目标进行的主体内(N=30)用户测试中对 ACW 和黄金标准进行了比较,测量了时间、误差和可用性。ACW 在位置精确度(+19%)和角度精确度(+47%)方面的表现明显更好,心理需求(-6%)和挫败感(-13%)更低,但预期任务时间(+59%)和体力需求(+64%)会增加。访谈结果表明,ACW 是人们的主要偏好,而且在美学上比 GSW 更令人愉悦,因此它不仅是植入学的新黄金标准,也适用于其他需要 5DOF 定位的应用。
{"title":"Gestalt driven augmented collimator widget for precise 5 dof dental drill tool positioning in 3d space","authors":"Mine Dastan, Antonio E. Uva, Michele Fiorentino","doi":"arxiv-2409.10960","DOIUrl":"https://doi.org/arxiv-2409.10960","url":null,"abstract":"Drill tool positioning in dental implantology is a challenging task requiring\u00005DOF precision as the rotation around the tool axis is not influential. This\u0000work improves the quasi-static visual elements of the state-of-the-art with a\u0000novel Augmented Collimation Widget (ACW), an interactive tool of position and\u0000angle error visualization based on the gestalt reification, the human ability\u0000to group geometric elements. The user can seek in a quick, pre-attentive way\u0000the collimation of five (three positional and two rotational) error component\u0000widgets (ECWs), taking advantage of three key aspects: component separation and\u0000reification, error visual amplification, and dynamic hiding of the collimated\u0000components. We compared the ACW with the golden standard in a within-subjects\u0000(N=30) user test using 32 implant targets, measuring the time, error, and\u0000usability. ACW performed significantly better in positional (+19%) and angular\u0000(+47%) precision accuracy and with less mental demand (-6%) and frustration\u0000(-13%), but with an expected increase in task time (+59%) and physical demand\u0000(+64%). The interview indicated the ACW as the main preference and\u0000aesthetically more pleasant than GSW, candidating it as the new golden standard\u0000for implantology, but also for other applications where 5DOF positioning is\u0000key.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"25 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances 人工智能建议使写作趋同于西方风格,削弱了文化的细微差别
Pub Date : 2024-09-17 DOI: arxiv-2409.11360
Dhruv Agarwal, Mor Naaman, Aditya Vashistha
Large language models (LLMs) are being increasingly integrated into everydayproducts and services, such as coding tools and writing assistants. As theseembedded AI applications are deployed globally, there is a growing concern thatthe AI models underlying these applications prioritize Western values. Thispaper investigates what happens when a Western-centric AI model provideswriting suggestions to users from a different cultural background. We conducteda cross-cultural controlled experiment with 118 participants from India and theUnited States who completed culturally grounded writing tasks with and withoutAI suggestions. Our analysis reveals that AI provided greater efficiency gainsfor Americans compared to Indians. Moreover, AI suggestions led Indianparticipants to adopt Western writing styles, altering not just what is writtenbut also how it is written. These findings show that Western-centric AI modelshomogenize writing toward Western norms, diminishing nuances that differentiatecultural expression.
大型语言模型(LLM)正被越来越多地集成到日常产品和服务中,如编码工具和写作助手。随着这些嵌入式人工智能应用在全球范围内的部署,人们越来越担心这些应用背后的人工智能模型会优先考虑西方价值观。本文研究了当以西方为中心的人工智能模型向来自不同文化背景的用户提供写作建议时会发生什么。我们对来自印度和美国的 118 名参与者进行了跨文化对照实验,他们在有人工智能建议和没有人工智能建议的情况下完成了具有文化基础的写作任务。我们的分析表明,与印度人相比,人工智能为美国人带来了更高的效率。此外,人工智能建议导致印度参与者采用西方写作风格,不仅改变了写作内容,还改变了写作方式。这些研究结果表明,以西方为中心的人工智能模式将写作同质化,使其趋向于西方规范,减少了文化表达的细微差别。
{"title":"AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances","authors":"Dhruv Agarwal, Mor Naaman, Aditya Vashistha","doi":"arxiv-2409.11360","DOIUrl":"https://doi.org/arxiv-2409.11360","url":null,"abstract":"Large language models (LLMs) are being increasingly integrated into everyday\u0000products and services, such as coding tools and writing assistants. As these\u0000embedded AI applications are deployed globally, there is a growing concern that\u0000the AI models underlying these applications prioritize Western values. This\u0000paper investigates what happens when a Western-centric AI model provides\u0000writing suggestions to users from a different cultural background. We conducted\u0000a cross-cultural controlled experiment with 118 participants from India and the\u0000United States who completed culturally grounded writing tasks with and without\u0000AI suggestions. Our analysis reveals that AI provided greater efficiency gains\u0000for Americans compared to Indians. Moreover, AI suggestions led Indian\u0000participants to adopt Western writing styles, altering not just what is written\u0000but also how it is written. These findings show that Western-centric AI models\u0000homogenize writing toward Western norms, diminishing nuances that differentiate\u0000cultural expression.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"15 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - CS - Human-Computer Interaction
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1