首页 > 最新文献

ACM Transactions on Human-Robot Interaction最新文献

英文 中文
Open-source Natural Language Processing on the PAL Robotics ARI Social Robot 开源自然语言处理的PAL机器人ARI社交机器人
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580041
S. Lemaignan, S. Cooper, Raquel Ros, L. Ferrini, Antonio Andriella, Aina Irisarri
We demonstrate how state-of-art open-source tools for automatic speech recognition (vosk) and dialogue management (rasa) can be integrated on a social robotic platform (PAL Robotics' ARI robot) to provide rich verbal interactions. Our open-source, ROS-based pipeline implements the ROS4HRI standard, and the demonstration specifically presents the details of the integration, in a way that will enable attendees to replicate it on their robots. The demonstration takes place in the context of assistive robotics and robots for elderly care, two application domains with unique interaction challenges, for which, the ARI robot has been designed and extensively tested in real-world settings.
我们展示了如何将最先进的自动语音识别(vosk)和对话管理(rasa)的开源工具集成到社交机器人平台(PAL Robotics的ARI机器人)上,以提供丰富的语言交互。我们的开源、基于ros的管道实现了ROS4HRI标准,演示特别展示了集成的细节,使与会者能够在他们的机器人上复制它。该演示是在辅助机器人和老年护理机器人的背景下进行的,这两个应用领域具有独特的交互挑战,ARI机器人已经被设计并在现实环境中进行了广泛的测试。
{"title":"Open-source Natural Language Processing on the PAL Robotics ARI Social Robot","authors":"S. Lemaignan, S. Cooper, Raquel Ros, L. Ferrini, Antonio Andriella, Aina Irisarri","doi":"10.1145/3568294.3580041","DOIUrl":"https://doi.org/10.1145/3568294.3580041","url":null,"abstract":"We demonstrate how state-of-art open-source tools for automatic speech recognition (vosk) and dialogue management (rasa) can be integrated on a social robotic platform (PAL Robotics' ARI robot) to provide rich verbal interactions. Our open-source, ROS-based pipeline implements the ROS4HRI standard, and the demonstration specifically presents the details of the integration, in a way that will enable attendees to replicate it on their robots. The demonstration takes place in the context of assistive robotics and robots for elderly care, two application domains with unique interaction challenges, for which, the ARI robot has been designed and extensively tested in real-world settings.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"89 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82352478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Utilizing Prior Knowledge to Improve Automatic Speech Recognition in Human-Robot Interactive Scenarios 利用先验知识改进人机交互场景下的自动语音识别
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580129
Pradip Pramanick, Chayan Sarkar
The prolificacy of human-robot interaction not only depends on a robot's ability to understand the intent and content of the human utterance but also gets impacted by the automatic speech recognition (ASR) system. Modern ASR can provide highly accurate (grammatically and syntactically) translation. Yet, the general purpose ASR often misses out on the semantics of the translation by incorrect word prediction due to open-vocabulary modeling. ASR inaccuracy can have significant repercussions as this can lead to a completely different action by the robot in the real world. Can any prior knowledge be helpful in such a scenario? In this work, we explore how prior knowledge can be utilized in ASR decoding. Using our experiments, we demonstrate how our system can significantly improve ASR translation for robotic task instruction.
人机交互的多产性不仅取决于机器人理解人类话语意图和内容的能力,而且还受到自动语音识别系统的影响。现代ASR可以提供高度准确的(语法和句法)翻译。然而,由于开放词汇建模,通用ASR往往会由于单词预测错误而错过翻译的语义。ASR不准确会产生重大影响,因为这可能导致机器人在现实世界中采取完全不同的行动。在这种情况下,任何先验知识都有帮助吗?在这项工作中,我们探讨了如何将先验知识用于ASR解码。通过我们的实验,我们证明了我们的系统如何显著提高机器人任务指令的ASR翻译。
{"title":"Utilizing Prior Knowledge to Improve Automatic Speech Recognition in Human-Robot Interactive Scenarios","authors":"Pradip Pramanick, Chayan Sarkar","doi":"10.1145/3568294.3580129","DOIUrl":"https://doi.org/10.1145/3568294.3580129","url":null,"abstract":"The prolificacy of human-robot interaction not only depends on a robot's ability to understand the intent and content of the human utterance but also gets impacted by the automatic speech recognition (ASR) system. Modern ASR can provide highly accurate (grammatically and syntactically) translation. Yet, the general purpose ASR often misses out on the semantics of the translation by incorrect word prediction due to open-vocabulary modeling. ASR inaccuracy can have significant repercussions as this can lead to a completely different action by the robot in the real world. Can any prior knowledge be helpful in such a scenario? In this work, we explore how prior knowledge can be utilized in ASR decoding. Using our experiments, we demonstrate how our system can significantly improve ASR translation for robotic task instruction.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"58 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84891050","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collaborative Planning and Negotiation in Human-Robot Teams 人机团队中的协同规划与协商
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3579978
Christine T. Chang, Mitchell Hebert, Bradley Hayes
Our work aims to apply iterative communication techniques to improve functionality of human-robot teams working in space and other high-risk environments. Forms of iterative communication include progressive incorporation of human preference and otherwise latent task specifications. Our prior work found that humans would choose not to comply with robot-provided instructions and then proceed to self-justify their choices despite the risks of physical harm and blatant disregard for rules. Results clearly showed that humans working near robots are willing to sacrifice safety for efficiency. Current work aims to improve communication by iteratively incorporating human preference into optimized path planning for human-robot teams operating over large areas. Future work will explore the extent to which negotiation can be used as a mechanism for improving task planning and joint task execution for humans and robots.
我们的工作旨在应用迭代通信技术来提高在太空和其他高风险环境中工作的人机团队的功能。迭代沟通的形式包括人类偏好和潜在任务规范的逐步结合。我们之前的研究发现,人类会选择不遵守机器人提供的指令,然后继续为自己的选择辩护,尽管有身体伤害的风险和公然无视规则。结果清楚地表明,在机器人附近工作的人类愿意为了效率而牺牲安全。目前的工作旨在通过迭代地将人类偏好纳入在大面积操作的人机团队的优化路径规划中来改善沟通。未来的工作将探索谈判在多大程度上可以作为一种机制,用于改进人类和机器人的任务规划和联合任务执行。
{"title":"Collaborative Planning and Negotiation in Human-Robot Teams","authors":"Christine T. Chang, Mitchell Hebert, Bradley Hayes","doi":"10.1145/3568294.3579978","DOIUrl":"https://doi.org/10.1145/3568294.3579978","url":null,"abstract":"Our work aims to apply iterative communication techniques to improve functionality of human-robot teams working in space and other high-risk environments. Forms of iterative communication include progressive incorporation of human preference and otherwise latent task specifications. Our prior work found that humans would choose not to comply with robot-provided instructions and then proceed to self-justify their choices despite the risks of physical harm and blatant disregard for rules. Results clearly showed that humans working near robots are willing to sacrifice safety for efficiency. Current work aims to improve communication by iteratively incorporating human preference into optimized path planning for human-robot teams operating over large areas. Future work will explore the extent to which negotiation can be used as a mechanism for improving task planning and joint task execution for humans and robots.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"49 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84917363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interactive Policy Shaping for Human-Robot Collaboration with Transparent Matrix Overlays 基于透明矩阵叠加的人机协作交互式策略制定
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568162.3576983
Jake Brawer, Debasmita Ghose, Kate Candon, Meiying Qin, A. Roncone, Marynel Vázquez, B. Scassellati
One important aspect of effective human--robot collaborations is the ability for robots to adapt quickly to the needs of humans. While techniques like deep reinforcement learning have demonstrated success as sophisticated tools for learning robot policies, the fluency of human-robot collaborations is often limited by these policies' inability to integrate changes to a user's preferences for the task. To address these shortcomings, we propose a novel approach that can modify learned policies at execution time via symbolic if-this-then-that rules corresponding to a modular and superimposable set of low-level constraints on the robot's policy. These rules, which we call Transparent Matrix Overlays, function not only as succinct and explainable descriptions of the robot's current strategy but also as an interface by which a human collaborator can easily alter a robot's policy via verbal commands. We demonstrate the efficacy of this approach on a series of proof-of-concept cooking tasks performed in simulation and on a physical robot.
有效的人机协作的一个重要方面是机器人快速适应人类需求的能力。虽然像深度强化学习这样的技术已经证明了作为学习机器人策略的复杂工具的成功,但人机协作的流畅性往往受到这些策略无法整合用户对任务偏好变化的限制。为了解决这些缺点,我们提出了一种新的方法,可以在执行时通过象征性的if-this-then-that规则来修改学习到的策略,这些规则对应于机器人策略上的一组模块化和可叠加的低级约束。这些规则,我们称之为透明矩阵叠加,不仅作为机器人当前策略的简洁和可解释的描述,而且作为一个接口,人类合作者可以通过口头命令轻松改变机器人的策略。我们在模拟和物理机器人上执行的一系列概念验证烹饪任务中证明了这种方法的有效性。
{"title":"Interactive Policy Shaping for Human-Robot Collaboration with Transparent Matrix Overlays","authors":"Jake Brawer, Debasmita Ghose, Kate Candon, Meiying Qin, A. Roncone, Marynel Vázquez, B. Scassellati","doi":"10.1145/3568162.3576983","DOIUrl":"https://doi.org/10.1145/3568162.3576983","url":null,"abstract":"One important aspect of effective human--robot collaborations is the ability for robots to adapt quickly to the needs of humans. While techniques like deep reinforcement learning have demonstrated success as sophisticated tools for learning robot policies, the fluency of human-robot collaborations is often limited by these policies' inability to integrate changes to a user's preferences for the task. To address these shortcomings, we propose a novel approach that can modify learned policies at execution time via symbolic if-this-then-that rules corresponding to a modular and superimposable set of low-level constraints on the robot's policy. These rules, which we call Transparent Matrix Overlays, function not only as succinct and explainable descriptions of the robot's current strategy but also as an interface by which a human collaborator can easily alter a robot's policy via verbal commands. We demonstrate the efficacy of this approach on a series of proof-of-concept cooking tasks performed in simulation and on a physical robot.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"30 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78928547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Robots for Learning 7 (R4L): A Look from Stakeholders' Perspective 学习机器人7 (R4L):从利益相关者的角度看
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3579958
D. Tozadore, Jauwairia Nasir, Sarah Gillet, Rianne van den Berghe, Arzu Guneysu, W. Johal
This year's conference theme "HRI for all" not just raises the importance of reflecting on how to promote inclusion for every type of user but also calls for careful consideration of the different layers of people potentially impacted by such systems. In educational setups, for instance, the users to be considered first and foremost are the learners. However, teachers, school directors, therapists and parents also form a more secondary layer of users in this ecosystem. The 7th edition of R4L focuses on the issues that HRI experiments in educational environments may cause to stakeholders and how we could improve on bringing the stakeholders' point of view into the loop. This goal is expected to be achieved in a very practical and dynamic way by the means of: (i) lightening talks from the participants; (ii) two discussion panels with special guests: One with active researchers from academia and industry about their experience and point of view regarding the inclusion of stakeholders; another panel with teacher, school directors, and parents that are/were involved in HRI experiments and will share their viewpoint; (iii) semi-structured group discussions and hands-on activities with participants and panellists to evaluate and propose guidelines for good practices regarding how to promote the inclusion of stakeholders, especially teachers, in educational HRI activities. By acquiring the viewpoint from the experimenters and stakeholders and analysing them in the same workshop, we expect to identify current gaps, propose practical solutions to bridge these gaps, and capitalise on existing synergies with the collective intelligence of the two communities.
今年的会议主题“人人享有人力资源研究所”不仅提出了思考如何促进各类用户的包容性的重要性,而且还呼吁仔细考虑可能受到此类系统影响的不同阶层的人。例如,在教育设置中,首先要考虑的用户是学习者。然而,教师、学校主管、治疗师和家长也在这个生态系统中形成了更二级的用户层。第7版R4L重点关注教育环境中HRI实验可能给利益相关者带来的问题,以及我们如何将利益相关者的观点纳入循环中进行改进。这一目标预计将通过以下方式以非常实际和充满活力的方式实现:(i)减轻与会者的谈话;(ii)两个由特别嘉宾组成的讨论小组:一个是由学术界和工业界的活跃研究人员讨论他们在纳入持份者方面的经验和观点;另一个小组,由教师、学校负责人和参与人力资源研究所实验的家长组成,分享他们的观点;(iii)与参与者和小组成员进行半结构化的小组讨论和实践活动,以评估和提出有关如何促进利益相关者(特别是教师)参与教育人力资源研究所活动的良好做法指南。通过获取实验者和利益相关者的观点,并在同一研讨会上对其进行分析,我们希望能够确定当前的差距,提出切实可行的解决方案来弥合这些差距,并利用两个社区的集体智慧利用现有的协同效应。
{"title":"Robots for Learning 7 (R4L): A Look from Stakeholders' Perspective","authors":"D. Tozadore, Jauwairia Nasir, Sarah Gillet, Rianne van den Berghe, Arzu Guneysu, W. Johal","doi":"10.1145/3568294.3579958","DOIUrl":"https://doi.org/10.1145/3568294.3579958","url":null,"abstract":"This year's conference theme \"HRI for all\" not just raises the importance of reflecting on how to promote inclusion for every type of user but also calls for careful consideration of the different layers of people potentially impacted by such systems. In educational setups, for instance, the users to be considered first and foremost are the learners. However, teachers, school directors, therapists and parents also form a more secondary layer of users in this ecosystem. The 7th edition of R4L focuses on the issues that HRI experiments in educational environments may cause to stakeholders and how we could improve on bringing the stakeholders' point of view into the loop. This goal is expected to be achieved in a very practical and dynamic way by the means of: (i) lightening talks from the participants; (ii) two discussion panels with special guests: One with active researchers from academia and industry about their experience and point of view regarding the inclusion of stakeholders; another panel with teacher, school directors, and parents that are/were involved in HRI experiments and will share their viewpoint; (iii) semi-structured group discussions and hands-on activities with participants and panellists to evaluate and propose guidelines for good practices regarding how to promote the inclusion of stakeholders, especially teachers, in educational HRI activities. By acquiring the viewpoint from the experimenters and stakeholders and analysing them in the same workshop, we expect to identify current gaps, propose practical solutions to bridge these gaps, and capitalise on existing synergies with the collective intelligence of the two communities.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"43 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79979988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Language Models for Human-Robot Interaction 人机交互的语言模型
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580040
E. Billing, Julia Rosén, M. Lamb
Recent advances in large scale language models have significantly changed the landscape of automatic dialogue systems and chatbots. We believe that these models also have a great potential for changing the way we interact with robots. Here, we present the first integration of the OpenAI GPT-3 language model for the Aldebaran Pepper and Nao robots. The present work transforms the text-based API of GPT-3 into an open verbal dialogue with the robots. The system will be presented live during the HRI2023 conference and the source code of this integration is shared with the hope that it will serve the community in designing and evaluating new dialogue systems for robots.
大规模语言模型的最新进展极大地改变了自动对话系统和聊天机器人的面貌。我们相信,这些模型也有很大的潜力来改变我们与机器人互动的方式。在这里,我们将首次为Aldebaran Pepper和Nao机器人集成OpenAI GPT-3语言模型。目前的工作将GPT-3的基于文本的API转换为与机器人的开放式口头对话。该系统将在HRI2023会议期间现场展示,并分享此集成的源代码,希望它将在设计和评估机器人的新对话系统方面为社区服务。
{"title":"Language Models for Human-Robot Interaction","authors":"E. Billing, Julia Rosén, M. Lamb","doi":"10.1145/3568294.3580040","DOIUrl":"https://doi.org/10.1145/3568294.3580040","url":null,"abstract":"Recent advances in large scale language models have significantly changed the landscape of automatic dialogue systems and chatbots. We believe that these models also have a great potential for changing the way we interact with robots. Here, we present the first integration of the OpenAI GPT-3 language model for the Aldebaran Pepper and Nao robots. The present work transforms the text-based API of GPT-3 into an open verbal dialogue with the robots. The system will be presented live during the HRI2023 conference and the source code of this integration is shared with the hope that it will serve the community in designing and evaluating new dialogue systems for robots.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"25 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78011440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Robot Theory of Mind with Reverse Psychology 机器人心理理论与逆向心理学
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580144
Chuang Yu, Baris Serhan, M. Romeo, A. Cangelosi
Theory of mind (ToM) corresponds to the human ability to infer other people's desires, beliefs, and intentions. Acquisition of ToM skills is crucial to obtain a natural interaction between robots and humans. A core component of ToM is the ability to attribute false beliefs. In this paper, a collaborative robot tries to assist a human partner who plays a trust-based card game against another human. The robot infers its partner's trust in the robot's decision system via reinforcement learning. Robot ToM refers to the ability to implicitly anticipate the human collaborator's strategy and inject the prediction into its optimal decision model for a better team performance. In our experiments, the robot learns when its human partner does not trust the robot and consequently gives recommendations in its optimal policy to ensure the effectiveness of team performance. The interesting finding is that the optimal robotic policy attempts to use reverse psychology on its human collaborator when trust is low. This finding will provide guidance for the study of a trustworthy robot decision model with a human partner in the loop.
心理理论(ToM)对应于人类推断他人欲望、信仰和意图的能力。习得ToM技能对于实现机器人与人之间的自然互动至关重要。ToM的一个核心组件是对错误信念进行归因的能力。在本文中,一个协作机器人试图帮助一个人类伙伴与另一个人进行基于信任的纸牌游戏。机器人通过强化学习来推断其伙伴对机器人决策系统的信任。机器人ToM指的是能够隐式地预测人类合作者的策略,并将预测注入其最优决策模型中,以获得更好的团队绩效。在我们的实验中,机器人在人类伙伴不信任它的时候进行学习,并给出最优策略建议,以确保团队绩效的有效性。有趣的发现是,当信任度较低时,最佳机器人策略试图对人类合作者使用逆向心理。这一发现将为具有人类伙伴的可信赖机器人决策模型的研究提供指导。
{"title":"Robot Theory of Mind with Reverse Psychology","authors":"Chuang Yu, Baris Serhan, M. Romeo, A. Cangelosi","doi":"10.1145/3568294.3580144","DOIUrl":"https://doi.org/10.1145/3568294.3580144","url":null,"abstract":"Theory of mind (ToM) corresponds to the human ability to infer other people's desires, beliefs, and intentions. Acquisition of ToM skills is crucial to obtain a natural interaction between robots and humans. A core component of ToM is the ability to attribute false beliefs. In this paper, a collaborative robot tries to assist a human partner who plays a trust-based card game against another human. The robot infers its partner's trust in the robot's decision system via reinforcement learning. Robot ToM refers to the ability to implicitly anticipate the human collaborator's strategy and inject the prediction into its optimal decision model for a better team performance. In our experiments, the robot learns when its human partner does not trust the robot and consequently gives recommendations in its optimal policy to ensure the effectiveness of team performance. The interesting finding is that the optimal robotic policy attempts to use reverse psychology on its human collaborator when trust is low. This finding will provide guidance for the study of a trustworthy robot decision model with a human partner in the loop.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"32 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85125818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Human Gesture Recognition with a Flow-based Model for Human Robot Interaction 基于流模型的人机交互人机手势识别
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580145
Lanmiao Liu, Chuang Yu, Siyang Song, Zhidong Su, A. Tapus
Human skeleton-based gesture classification plays a dominant role in social robotics. Learning the variety of human skeleton-based gestures can help the robot to continuously interact in an appropriate manner in a natural human-robot interaction (HRI). In this paper, we proposed a Flow-based model to classify human gesture actions with skeletal data. Instead of inferring new human skeleton actions from noisy data using a retrained model, our end-to-end model can expand the diversity of labels for gesture recognition from noisy data without retraining the model. At first, our model focuses on detecting five human gesture actions (i.e., come on, right up, left up, hug, and noise-random action). The accuracy of our online human gesture recognition system is as well as the offline one. Meanwhile, both attain 100% accuracy among the first four actions. Our proposed method is more efficient for inference of new human gesture action without retraining, which acquires about 90% accuracy for noise-random action. The gesture recognition system has been applied to the robot's reaction toward the human gesture, which is promising to facilitate a natural human-robot interaction.
基于人体骨骼的手势分类在社交机器人中占有主导地位。学习各种基于人体骨骼的手势可以帮助机器人在自然的人机交互(HRI)中以适当的方式持续交互。在本文中,我们提出了一种基于flow的模型来对骨骼数据进行人体手势动作分类。我们的端到端模型可以在不重新训练模型的情况下从噪声数据中扩展手势识别标签的多样性,而不是使用重新训练的模型从噪声数据中推断新的人体骨骼动作。首先,我们的模型专注于检测五种人类手势动作(即,加油,右上,左上,拥抱和噪声随机动作)。我们的在线人体手势识别系统的准确率与离线系统一样高。同时,在前四个动作中,两者都达到了100%的准确率。我们提出的方法在不需要再训练的情况下对新的人体手势动作进行更有效的推断,对噪声随机动作的推断准确率达到90%左右。手势识别系统已被应用于机器人对人类手势的反应,有望促进自然的人机交互。
{"title":"Human Gesture Recognition with a Flow-based Model for Human Robot Interaction","authors":"Lanmiao Liu, Chuang Yu, Siyang Song, Zhidong Su, A. Tapus","doi":"10.1145/3568294.3580145","DOIUrl":"https://doi.org/10.1145/3568294.3580145","url":null,"abstract":"Human skeleton-based gesture classification plays a dominant role in social robotics. Learning the variety of human skeleton-based gestures can help the robot to continuously interact in an appropriate manner in a natural human-robot interaction (HRI). In this paper, we proposed a Flow-based model to classify human gesture actions with skeletal data. Instead of inferring new human skeleton actions from noisy data using a retrained model, our end-to-end model can expand the diversity of labels for gesture recognition from noisy data without retraining the model. At first, our model focuses on detecting five human gesture actions (i.e., come on, right up, left up, hug, and noise-random action). The accuracy of our online human gesture recognition system is as well as the offline one. Meanwhile, both attain 100% accuracy among the first four actions. Our proposed method is more efficient for inference of new human gesture action without retraining, which acquires about 90% accuracy for noise-random action. The gesture recognition system has been applied to the robot's reaction toward the human gesture, which is promising to facilitate a natural human-robot interaction.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"28 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87611736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Save Baby Whale! A Pet Robot as a Medication Reminder for Children with Asthma 救救小鲸鱼!宠物机器人作为哮喘儿童用药提醒器
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580108
Dian Lv, Jirui Liu, Jiancheng Zhong, Zhiyao Ma, Yijie Guo
Asthma is one of the most common chronic diseases in children, but adherence to asthma medications is very low, which can lead to poor or even dangerous outcomes. To solve this problem, we came up with a baby whale pet robot that needs to be taken care of by children. In this paper, we present the design of our first prototype to explore whether a pet robot could help improve medication adherence in children with asthma.
哮喘是儿童中最常见的慢性疾病之一,但对哮喘药物的依从性非常低,这可能导致不良甚至危险的结果。为了解决这个问题,我们想出了一个需要孩子照顾的小鲸鱼宠物机器人。在本文中,我们展示了我们的第一个原型的设计,以探索宠物机器人是否可以帮助改善哮喘儿童的药物依从性。
{"title":"Save Baby Whale! A Pet Robot as a Medication Reminder for Children with Asthma","authors":"Dian Lv, Jirui Liu, Jiancheng Zhong, Zhiyao Ma, Yijie Guo","doi":"10.1145/3568294.3580108","DOIUrl":"https://doi.org/10.1145/3568294.3580108","url":null,"abstract":"Asthma is one of the most common chronic diseases in children, but adherence to asthma medications is very low, which can lead to poor or even dangerous outcomes. To solve this problem, we came up with a baby whale pet robot that needs to be taken care of by children. In this paper, we present the design of our first prototype to explore whether a pet robot could help improve medication adherence in children with asthma.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"46 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73494713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Answer lies in User Experience: Qualitative Comparison of US and South Korean Perceptions of In-home Robotic Pet Interactions 答案在于用户体验:美国和韩国对家庭机器人宠物互动的看法的定性比较
IF 5.1 Q2 ROBOTICS Pub Date : 2023-03-13 DOI: 10.1145/3568294.3580094
Jihye Oh, Casey C. Bennett
This paper describes a user experience comparison study to explore whether a user's 'cultural background' affects their interaction with in-home pet robots designed for health purposes, e.g. socially-assistive robots (SARs). 11 Koreans and 10 Americans were interviewed after interacting in their own homes with a SAR. Statistical analyses and TF-IDF keyword analyses were conducted to detect significant differences between groups in terms of code co-occurrences. Results showed that American participants were more likely to focus on the interactive experience itself, whereas Korean participants focused more on critiquing technical aspects of the technology. Such differences suggest that Koreans tend to treat robotic pets as "tools", while Americans view the robotic pet through the lens of their past experience raising real-life pets. We discuss implications of this for human-robot interaction (HRI) regarding SARs may be dependent on users' cultural characteristics, e.g. necessitating customized content that takes into account culturally-specific modes of use.
本文描述了一项用户体验比较研究,以探索用户的“文化背景”是否会影响他们与为健康目的设计的家庭宠物机器人的互动,例如社交辅助机器人(SARs)。11名韩国人和10名美国人在自己家中与SAR互动后接受了采访。进行了统计分析和TF-IDF关键字分析,以发现两组之间在代码共现方面的显著差异。结果显示,美国参与者更关注互动体验本身,而韩国参与者更关注技术方面的批评。这种差异表明,韩国人倾向于将机器人宠物视为“工具”,而美国人则是通过他们过去饲养真实宠物的经验来看待机器人宠物。我们讨论了这对人机交互(HRI)的影响,因为sar可能依赖于用户的文化特征,例如,需要考虑到文化特定使用模式的定制内容。
{"title":"The Answer lies in User Experience: Qualitative Comparison of US and South Korean Perceptions of In-home Robotic Pet Interactions","authors":"Jihye Oh, Casey C. Bennett","doi":"10.1145/3568294.3580094","DOIUrl":"https://doi.org/10.1145/3568294.3580094","url":null,"abstract":"This paper describes a user experience comparison study to explore whether a user's 'cultural background' affects their interaction with in-home pet robots designed for health purposes, e.g. socially-assistive robots (SARs). 11 Koreans and 10 Americans were interviewed after interacting in their own homes with a SAR. Statistical analyses and TF-IDF keyword analyses were conducted to detect significant differences between groups in terms of code co-occurrences. Results showed that American participants were more likely to focus on the interactive experience itself, whereas Korean participants focused more on critiquing technical aspects of the technology. Such differences suggest that Koreans tend to treat robotic pets as \"tools\", while Americans view the robotic pet through the lens of their past experience raising real-life pets. We discuss implications of this for human-robot interaction (HRI) regarding SARs may be dependent on users' cultural characteristics, e.g. necessitating customized content that takes into account culturally-specific modes of use.","PeriodicalId":36515,"journal":{"name":"ACM Transactions on Human-Robot Interaction","volume":"40 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73425333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
ACM Transactions on Human-Robot Interaction
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1