首页 > 最新文献

2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)最新文献

英文 中文
Trustworthiness assessment in multimodal human-robot interaction based on cognitive load 基于认知负荷的多模态人机交互可信度评估
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900730
M. Kirtay, Erhan Öztop, A. Kuhlen, M. Asada, V. Hafner
In this study, we extend our robot trust model into a multimodal setting in which the Nao robot leverages audio-visual data to perform a sequential multimodal pattern recalling task while interacting with a human partner who has different guiding strategies: reliable, unreliable, and random. Here, the humanoid robot is equipped with a multimodal auto-associative memory module to process audio-visual patterns to extract cognitive load (i.e., computational cost) and an internal reward module to perform cost-guided reinforcement learning. After interactive experiments, the robot associates a low cognitive load (i.e., high cumulative reward) yielded during the interaction with high trustworthiness of the guiding strategy of the partner. At the end of the experiment, we provide a free choice to the robot to select a trustworthy instructor. We show that the robot forms trust in a reliable partner. In the second setting of the same experiment, we endow the robot with an additional simple theory of mind module to assess the efficacy of the instructor in helping the robot perform the task. Our results show that the performance of the robot is improved when the robot bases its action decisions on factoring in the instructor assessment.
在本研究中,我们将机器人信任模型扩展到一个多模态环境,其中Nao机器人在与具有不同指导策略(可靠、不可靠和随机)的人类伙伴交互时,利用视听数据执行顺序的多模态模式回忆任务。在这里,人形机器人配备了一个多模态自动联想记忆模块来处理视听模式以提取认知负荷(即计算成本),并配备了一个内部奖励模块来执行成本导向的强化学习。通过交互实验,机器人将交互过程中产生的低认知负荷(即高累积奖励)与同伴指导策略的高可信度相关联。在实验的最后,我们给机器人一个自由的选择,选择一个值得信赖的指导员。我们展示了机器人对一个可靠的伙伴形成信任。在同一实验的第二个设置中,我们赋予机器人一个额外的简单的心智理论模块来评估指导者在帮助机器人执行任务方面的功效。我们的研究结果表明,当机器人的动作决策基于教练的评估因素时,机器人的性能得到了提高。
{"title":"Trustworthiness assessment in multimodal human-robot interaction based on cognitive load","authors":"M. Kirtay, Erhan Öztop, A. Kuhlen, M. Asada, V. Hafner","doi":"10.1109/RO-MAN53752.2022.9900730","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900730","url":null,"abstract":"In this study, we extend our robot trust model into a multimodal setting in which the Nao robot leverages audio-visual data to perform a sequential multimodal pattern recalling task while interacting with a human partner who has different guiding strategies: reliable, unreliable, and random. Here, the humanoid robot is equipped with a multimodal auto-associative memory module to process audio-visual patterns to extract cognitive load (i.e., computational cost) and an internal reward module to perform cost-guided reinforcement learning. After interactive experiments, the robot associates a low cognitive load (i.e., high cumulative reward) yielded during the interaction with high trustworthiness of the guiding strategy of the partner. At the end of the experiment, we provide a free choice to the robot to select a trustworthy instructor. We show that the robot forms trust in a reliable partner. In the second setting of the same experiment, we endow the robot with an additional simple theory of mind module to assess the efficacy of the instructor in helping the robot perform the task. Our results show that the performance of the robot is improved when the robot bases its action decisions on factoring in the instructor assessment.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128811349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Transparent Learning from Demonstration for Robot-Mediated Therapy 机器人介导治疗示范的透明学习
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900854
Alexander Tyshka, W. Louie
Robot-mediated therapy is an emerging field of research seeking to improve therapy for children with Autism Spectrum Disorder (ASD). Current approaches to autonomous robot-mediated therapy often focus on having a robot teach a single skill to children with ASD and lack a personalized approach to each individual. More recently, Learning from Demonstration (LfD) approaches are being explored to teach socially assistive robots to deliver personalized interventions after they have been deployed but these approaches require large amounts of demonstrations and utilize learning models that cannot be easily interpreted. In this work, we present a LfD system capable of learning the delivery of autism therapies in a data-efficient manner utilizing learning models that are inherently interpretable. The LfD system learns a behavioral model of the task with minimal supervision via hierarchical clustering and then learns an interpretable policy to determine when to execute the learned behaviors. The system is able to learn from less than an hour of demonstrations and for each of its predictions can identify demonstrated instances that contributed to its decision. The system performs well under unsupervised conditions and achieves even better performance with a low-effort human correction process that is enabled by the interpretable model.
机器人介导疗法是一个新兴的研究领域,旨在改善自闭症谱系障碍(ASD)儿童的治疗。目前自主机器人介导的治疗方法通常侧重于让机器人教授自闭症儿童一项技能,而缺乏针对每个个体的个性化方法。最近,人们正在探索从演示中学习(LfD)的方法,教社交辅助机器人在部署后提供个性化干预,但这些方法需要大量的演示,并利用不易解释的学习模型。在这项工作中,我们提出了一个LfD系统,该系统能够利用固有可解释的学习模型,以数据高效的方式学习自闭症治疗的交付。LfD系统通过分层聚类学习任务的行为模型,然后学习一个可解释的策略来确定何时执行学习到的行为。该系统能够从不到一个小时的演示中学习,并且它的每个预测都可以识别有助于其决策的演示实例。该系统在无监督条件下表现良好,并且通过可解释模型实现的低成本人工校正过程实现更好的性能。
{"title":"Transparent Learning from Demonstration for Robot-Mediated Therapy","authors":"Alexander Tyshka, W. Louie","doi":"10.1109/RO-MAN53752.2022.9900854","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900854","url":null,"abstract":"Robot-mediated therapy is an emerging field of research seeking to improve therapy for children with Autism Spectrum Disorder (ASD). Current approaches to autonomous robot-mediated therapy often focus on having a robot teach a single skill to children with ASD and lack a personalized approach to each individual. More recently, Learning from Demonstration (LfD) approaches are being explored to teach socially assistive robots to deliver personalized interventions after they have been deployed but these approaches require large amounts of demonstrations and utilize learning models that cannot be easily interpreted. In this work, we present a LfD system capable of learning the delivery of autism therapies in a data-efficient manner utilizing learning models that are inherently interpretable. The LfD system learns a behavioral model of the task with minimal supervision via hierarchical clustering and then learns an interpretable policy to determine when to execute the learned behaviors. The system is able to learn from less than an hour of demonstrations and for each of its predictions can identify demonstrated instances that contributed to its decision. The system performs well under unsupervised conditions and achieves even better performance with a low-effort human correction process that is enabled by the interpretable model.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115943517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SM-EXO: Shape Memory alloy-based Hand EXOskeleton for Cobotic Application SM-EXO:用于机器人应用的基于形状记忆合金的手外骨骼
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900776
Rupal Srivastava, Maulshree Singh, Guilherme Daniel Gomes, Niall Murray, D. Devine
The conventional smart gloves present a challenge regarding their portability as most work on gesture recognition techniques based on vision sensing and image processing. The multiple algorithms and signal filtering further make the overall process cumbersome. This work proposes a Shape Memory Alloy (SMA) integrated sensing mechanism in a smart glove for autonomous control. A novel hand gesture recognition technology is developed using kinaesthetic feedback from the finger joint movements. The paper presents a smart glove with an external SMA embedded tubing attachment for the thumb, index, and middle fingers. The motion of the SMA wires is constrained between a fixed end on the tip of the fingers, and the other end is connected to a linear position sensor with spring feedback. The SMA wires in this design exist in their Austenite phase at room temperature, thus exhibiting superelastic or pseudoelastic behavior. The tension in the SMA wire is observed and measured upon bending the fingers, corresponding to the mechanical travel in the linear position sensor. The individual and a combination of position sensor readings are then used as commands for actuating interactive toys. Using a three-finger approach, one can extract seven commands depending upon single or multiple finger movements. This data is further used to actuate the toys, and a use-case for cobotic application is proposed to help better understand interactive play, hand-eye coordination, and thus early cognitive development in children with Autism Spectrum Disorder (ASD). The discrete data output with binary data is independent of other devices or heavy data processing requirements, thus making the proposed novel SM-EXO a better alternative for non-portable and complex smart gloves.
传统的智能手套在便携性方面面临挑战,因为大多数工作都是基于视觉感知和图像处理的手势识别技术。多种算法和信号滤波进一步使整个过程变得繁琐。这项工作提出了一种形状记忆合金(SMA)集成传感机制,用于智能手套的自主控制。利用手指关节运动的动觉反馈,开发了一种新的手势识别技术。本文提出了一个智能手套与外部SMA嵌入管附件拇指,食指和中指。SMA导线的运动被限制在手指尖端的固定端之间,另一端连接到具有弹簧反馈的线性位置传感器。本设计的SMA丝在室温下以奥氏体相存在,因此表现出超弹性或伪弹性行为。在弯曲手指时观察和测量SMA线的张力,对应于线性位置传感器的机械行程。个人和位置传感器读数的组合然后被用作驱动交互式玩具的命令。使用三指方法,用户可以根据单个或多个手指的运动提取七个命令。这些数据被进一步用于驱动玩具,并提出了一个机器人应用的用例,以帮助更好地理解自闭症谱系障碍(ASD)儿童的互动游戏、手眼协调和早期认知发展。具有二进制数据的离散数据输出独立于其他设备或繁重的数据处理要求,从而使所提出的新型SM-EXO成为非便携式和复杂智能手套的更好选择。
{"title":"SM-EXO: Shape Memory alloy-based Hand EXOskeleton for Cobotic Application","authors":"Rupal Srivastava, Maulshree Singh, Guilherme Daniel Gomes, Niall Murray, D. Devine","doi":"10.1109/RO-MAN53752.2022.9900776","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900776","url":null,"abstract":"The conventional smart gloves present a challenge regarding their portability as most work on gesture recognition techniques based on vision sensing and image processing. The multiple algorithms and signal filtering further make the overall process cumbersome. This work proposes a Shape Memory Alloy (SMA) integrated sensing mechanism in a smart glove for autonomous control. A novel hand gesture recognition technology is developed using kinaesthetic feedback from the finger joint movements. The paper presents a smart glove with an external SMA embedded tubing attachment for the thumb, index, and middle fingers. The motion of the SMA wires is constrained between a fixed end on the tip of the fingers, and the other end is connected to a linear position sensor with spring feedback. The SMA wires in this design exist in their Austenite phase at room temperature, thus exhibiting superelastic or pseudoelastic behavior. The tension in the SMA wire is observed and measured upon bending the fingers, corresponding to the mechanical travel in the linear position sensor. The individual and a combination of position sensor readings are then used as commands for actuating interactive toys. Using a three-finger approach, one can extract seven commands depending upon single or multiple finger movements. This data is further used to actuate the toys, and a use-case for cobotic application is proposed to help better understand interactive play, hand-eye coordination, and thus early cognitive development in children with Autism Spectrum Disorder (ASD). The discrete data output with binary data is independent of other devices or heavy data processing requirements, thus making the proposed novel SM-EXO a better alternative for non-portable and complex smart gloves.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117126007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Structural optimization of variable stiffness mechanism with particle jamming and core-frame 具有颗粒干扰和芯架的变刚度机构结构优化
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900565
E. Song, Yeo-Il Yun, S. Lee, J. Koo
As a collaboration between humans and robots becomes critical, stiffness control of the robot is essential for stability and efficiency of work. Therefore, research on the variable stiffness mechanism is being actively conducted in service robots, soft robots, and exoskeletons. The main types of variable stiffness mechanisms are jamming effect (particle jamming and layer jamming), shape memory polymer (SMP), and low melting point alloy (LMPA). The case of the jamming effect uses negative pneumatic pressure to change the stiffness. Because of that, it is possible to change the stiffness quickly, and it is easy to manufacture. However, both SMP and LMPA use thermal energy to increase the material’s stiffness. There is a risk of damage to humans or robots, and it takes much time to change the stiffness. Therefore, this study introduces a variable stiffness mechanism that combines particle jamming and core-frame. In addition, optimization studies are being conducted to use the jamming effect in industries. However, due to the randomness of particle jamming, the existing studies assumed that the variable stiffness mechanism was a simple beam or modeled it using hook’s law, so the accuracy was low. Therefore, in this study, five design variables are selected for particle and core-frame, the main elements constituting the variable stiffness mechanism. In addition, design variables are optimized through various FEM simulations. Furthermore, the simulation is proved by establishing a theoretical model for variable stiffness structure when the jamming effect occurs. Finally, the optimization of five design variables is proved through experiments.
由于人与机器人之间的协作变得至关重要,机器人的刚度控制对工作的稳定性和效率至关重要。因此,变刚度机构在服务机器人、软体机器人和外骨骼中得到了积极的研究。变刚度机制的主要类型是干扰效应(颗粒干扰和层干扰)、形状记忆聚合物(SMP)和低熔点合金(LMPA)。在出现卡壳效应的情况下,采用负压气动来改变刚度。因此,可以快速改变刚度,并且易于制造。然而,SMP和LMPA都使用热能来增加材料的刚度。有对人或机器人造成伤害的风险,而且改变刚度需要很长时间。因此,本研究引入了一种粒子干扰与核心框架相结合的变刚度机构。此外,正在进行优化研究,以在工业中使用干扰效应。然而,由于粒子干扰的随机性,现有研究将变刚度机构假设为简支梁或采用hook定律建模,精度较低。因此,在本研究中,对于构成变刚度机构的主要元素颗粒和核心框架,选择了5个设计变量。此外,通过各种有限元模拟对设计变量进行了优化。在此基础上,建立了变刚度结构发生干扰时的理论模型,验证了仿真结果。最后,通过实验验证了五个设计变量的优化。
{"title":"Structural optimization of variable stiffness mechanism with particle jamming and core-frame","authors":"E. Song, Yeo-Il Yun, S. Lee, J. Koo","doi":"10.1109/RO-MAN53752.2022.9900565","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900565","url":null,"abstract":"As a collaboration between humans and robots becomes critical, stiffness control of the robot is essential for stability and efficiency of work. Therefore, research on the variable stiffness mechanism is being actively conducted in service robots, soft robots, and exoskeletons. The main types of variable stiffness mechanisms are jamming effect (particle jamming and layer jamming), shape memory polymer (SMP), and low melting point alloy (LMPA). The case of the jamming effect uses negative pneumatic pressure to change the stiffness. Because of that, it is possible to change the stiffness quickly, and it is easy to manufacture. However, both SMP and LMPA use thermal energy to increase the material’s stiffness. There is a risk of damage to humans or robots, and it takes much time to change the stiffness. Therefore, this study introduces a variable stiffness mechanism that combines particle jamming and core-frame. In addition, optimization studies are being conducted to use the jamming effect in industries. However, due to the randomness of particle jamming, the existing studies assumed that the variable stiffness mechanism was a simple beam or modeled it using hook’s law, so the accuracy was low. Therefore, in this study, five design variables are selected for particle and core-frame, the main elements constituting the variable stiffness mechanism. In addition, design variables are optimized through various FEM simulations. Furthermore, the simulation is proved by establishing a theoretical model for variable stiffness structure when the jamming effect occurs. Finally, the optimization of five design variables is proved through experiments.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116194090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An affordable system for the teleoperation of dexterous robotic hands using Leap Motion hand tracking and vibrotactile feedback 一个经济实惠的系统,用于远程操作灵巧的机械手使用Leap Motion手部跟踪和振动触觉反馈
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900583
Claudio Coppola, Gokhan Solak, L. Jamone
Using robot manipulators in contexts where it is undesirable or impractical for humans to physically intervene is crucial for several applications, from manufacturing to extreme environments. However, robots require a high degree of intelligence to operate in those environments, especially if they are not fully structured. Teleoperation compensates for this limitation by connecting the human operator to the robot using human-robot interfaces. The remotely operated sessions can also be used as demonstrations to program more powerful autonomous agents. In this article, we report a thorough user study to characterise the effect of simple vibrotactile feedback on the performance and cognitive load of the human user in performing teleoperated grasping and manipulation tasks. The experiments are performed using a portable and affordable bilateral teleoperation system that we designed, composed of a Leap Motion sensor and a custom-designed vibrotactile haptic glove to operate a 4-fingered robot hand equipped with 3-axis force sensors on the fingertips; the software packages we developed are open-source and publicly available. Our results show that vibrotactile feedback improves teleoperation and reduces cognitive load, especially for complex in-hand manipulation tasks.
从制造到极端环境,在人类不希望或不现实的情况下使用机器人操纵器对几个应用至关重要。然而,机器人需要高度的智能才能在这些环境中运行,尤其是在它们没有完全结构化的情况下。远程操作通过使用人机界面将人类操作员连接到机器人来弥补这一限制。远程操作的会话还可以用作演示,以编写更强大的自主代理。在本文中,我们报告了一项全面的用户研究,以表征简单的振动触觉反馈对人类用户在执行远程操作抓取和操作任务时的表现和认知负荷的影响。实验使用我们设计的便携且经济实惠的双边远程操作系统进行,该系统由Leap Motion传感器和定制的振动触觉触觉手套组成,用于操作指尖上装有3轴力传感器的4指机器人手;我们开发的软件包是开源的,是公开的。我们的研究结果表明,振动触觉反馈改善了远端操作,减少了认知负荷,特别是在复杂的手操作任务中。
{"title":"An affordable system for the teleoperation of dexterous robotic hands using Leap Motion hand tracking and vibrotactile feedback","authors":"Claudio Coppola, Gokhan Solak, L. Jamone","doi":"10.1109/RO-MAN53752.2022.9900583","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900583","url":null,"abstract":"Using robot manipulators in contexts where it is undesirable or impractical for humans to physically intervene is crucial for several applications, from manufacturing to extreme environments. However, robots require a high degree of intelligence to operate in those environments, especially if they are not fully structured. Teleoperation compensates for this limitation by connecting the human operator to the robot using human-robot interfaces. The remotely operated sessions can also be used as demonstrations to program more powerful autonomous agents. In this article, we report a thorough user study to characterise the effect of simple vibrotactile feedback on the performance and cognitive load of the human user in performing teleoperated grasping and manipulation tasks. The experiments are performed using a portable and affordable bilateral teleoperation system that we designed, composed of a Leap Motion sensor and a custom-designed vibrotactile haptic glove to operate a 4-fingered robot hand equipped with 3-axis force sensors on the fingertips; the software packages we developed are open-source and publicly available. Our results show that vibrotactile feedback improves teleoperation and reduces cognitive load, especially for complex in-hand manipulation tasks.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"104 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125264730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Multi-perspective human robot interaction through an augmented video interface supported by deep learning 通过深度学习支持的增强视频界面进行多视角人机交互
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900671
Grimaldo Silva, K. Rekik, A. Kanso, L. Schnitman
As the world surpasses a billion cameras [1] and their coverage of the public and private spaces increases, the possibility of using their visual feed to not just observe, but to command robots through their video becomes an ever more interesting prospect. Our work deals with multi-perspective interaction, where a robot autonomously maps image pixels from reachable cameras to positions on its global coordinate space. This enables an operator to send the robot to specific positions in a camera with no manual calibration. Furthermore, robot information, such as planned paths, can be used to augment all affected camera images with an overlayed projection of their visual information. The robustness of this approach has been validated in both simulated and real world experiments.
随着世界上的摄像机数量超过10亿个[1],它们对公共和私人空间的覆盖范围也在增加,利用它们的视觉反馈不仅可以观察,还可以通过它们的视频来指挥机器人的可能性变得越来越有趣。我们的工作涉及多视角交互,其中机器人自主地将可达摄像机的图像像素映射到其全局坐标空间上的位置。这使得操作员可以将机器人发送到相机中的特定位置,而无需手动校准。此外,机器人的信息,如规划的路径,可以用来增强所有受影响的相机图像与他们的视觉信息的叠加投影。该方法的鲁棒性已在模拟和现实世界的实验中得到验证。
{"title":"Multi-perspective human robot interaction through an augmented video interface supported by deep learning","authors":"Grimaldo Silva, K. Rekik, A. Kanso, L. Schnitman","doi":"10.1109/RO-MAN53752.2022.9900671","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900671","url":null,"abstract":"As the world surpasses a billion cameras [1] and their coverage of the public and private spaces increases, the possibility of using their visual feed to not just observe, but to command robots through their video becomes an ever more interesting prospect. Our work deals with multi-perspective interaction, where a robot autonomously maps image pixels from reachable cameras to positions on its global coordinate space. This enables an operator to send the robot to specific positions in a camera with no manual calibration. Furthermore, robot information, such as planned paths, can be used to augment all affected camera images with an overlayed projection of their visual information. The robustness of this approach has been validated in both simulated and real world experiments.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126959504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Ankle Intention Detection Algorithm with HD-EMG Sensor 基于HD-EMG传感器的踝关节意图检测算法
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900750
Inwoo Kim, H. Jung, Jongkyu Kim, Sihwan Kim, Jong-Myung Park, Soo-Hong Lee
The ankle plays a very large role as an end effector in gait and leg erection. As the number of people with reduced mobility in the ankle joint due to aging and nerve damage increases, rehabilitation and related research are steadily increasing. However, most studies overlook the eversion action that plays an important role in stability. In this study, an intention detection algorithm including the eversion motion was developed, and a multi-channel EMG sensor module was developed and utilized. By moving the ankle in a specific direction, 36 channels of EMG signals were measured to determine the correlation between ankle motion and EMG signals. CNN and ADAM were used for algorithm production, and ankle motion was estimated with high accuracy.
踝关节作为末端执行器在步态和腿部勃起中起着非常重要的作用。随着因衰老和神经损伤导致踝关节活动能力降低的人群越来越多,康复及相关研究也在不断增加。然而,大多数研究忽略了在稳定性中起重要作用的外翻作用。在本研究中,开发了一种包含外倾运动的意图检测算法,并开发和利用了多通道肌电传感器模块。通过特定方向运动踝关节,测量36个通道的肌电信号,确定踝关节运动与肌电信号的相关性。算法制作采用CNN和ADAM,踝关节运动估计精度较高。
{"title":"Ankle Intention Detection Algorithm with HD-EMG Sensor","authors":"Inwoo Kim, H. Jung, Jongkyu Kim, Sihwan Kim, Jong-Myung Park, Soo-Hong Lee","doi":"10.1109/RO-MAN53752.2022.9900750","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900750","url":null,"abstract":"The ankle plays a very large role as an end effector in gait and leg erection. As the number of people with reduced mobility in the ankle joint due to aging and nerve damage increases, rehabilitation and related research are steadily increasing. However, most studies overlook the eversion action that plays an important role in stability. In this study, an intention detection algorithm including the eversion motion was developed, and a multi-channel EMG sensor module was developed and utilized. By moving the ankle in a specific direction, 36 channels of EMG signals were measured to determine the correlation between ankle motion and EMG signals. CNN and ADAM were used for algorithm production, and ankle motion was estimated with high accuracy.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121903700","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Seeing is not Feeling the Touch from a Robot * 看不是感觉机器人的触摸
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900788
Laura Kunold
A pre-registered conceptual video-based replication of a laboratory experiment was conducted to test whether the impact of a robot’s non-functional touch to a human can be studied from observation (online). Therefore, n=92 participants watched either a video recording of the same human–robot interaction with or without touch. The interpretation, evaluation, and emotional as well as behavioral responses were collected by means of an online-survey. The results show that the observation of touch affects observers’ emotional state: Contrary to what was hypothesized, observers felt significantly better when no touch was visible and they evaluated the robot’s touch as inappropriate. The findings are compared to results from a laboratory experiment to raise awareness for the different perspectives involved in observing and experiencing touch.
为了测试机器人的非功能性触摸对人类的影响是否可以通过观察(在线)来研究,我们进行了一个基于预先注册的概念视频的实验室实验复制。因此,n=92名参与者观看了同一人机交互的视频记录,有或没有触摸。通过在线调查收集学生的解读、评价、情绪和行为反应。结果表明,观察触摸会影响观察者的情绪状态:与假设相反,当看不到触摸时,观察者感觉好得多,他们认为机器人的触摸是不恰当的。这些发现与实验室实验的结果进行了比较,以提高人们对观察和体验触摸所涉及的不同视角的认识。
{"title":"Seeing is not Feeling the Touch from a Robot *","authors":"Laura Kunold","doi":"10.1109/RO-MAN53752.2022.9900788","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900788","url":null,"abstract":"A pre-registered conceptual video-based replication of a laboratory experiment was conducted to test whether the impact of a robot’s non-functional touch to a human can be studied from observation (online). Therefore, n=92 participants watched either a video recording of the same human–robot interaction with or without touch. The interpretation, evaluation, and emotional as well as behavioral responses were collected by means of an online-survey. The results show that the observation of touch affects observers’ emotional state: Contrary to what was hypothesized, observers felt significantly better when no touch was visible and they evaluated the robot’s touch as inappropriate. The findings are compared to results from a laboratory experiment to raise awareness for the different perspectives involved in observing and experiencing touch.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121797475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Tolerating Untrustworthy Robots: Studying Human Vulnerability Experience within a Privacy Scenario for Trust in Robots 容忍不值得信任的机器人:在机器人信任的隐私场景下研究人类的脆弱性经验
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900830
Glenda Hannibal, Anna Dobrosovestnova, A. Weiss
Focusing on human experience of vulnerability in everyday life interaction scenarios is still a novel approach. So far, only a proof-of-concept online study has been conducted, and to extend this work, we present a follow-up online study. We consider in more detail how human experience of vulnerability caused by a trust violation through a privacy breach affects trust ratings in an interaction scenario with the PEPPER robot assisting with clothes shopping. We report the results from 32 survey responses and 11 semi-structured interviews. Our findings reveal the existence of the privacy paradox also for studying trust in HRI, which is a common observation describing a discrepancy between the stated privacy concerns by people and their behavior to safeguard it. Moreover, we reflect that participants considered only the added value of utility and entertainment when deciding whether or not to interact with the robot again, but not the privacy breach. We conclude that people might tolerate an untrustworthy robot even when they are feeling vulnerable in the everyday life situation of clothes shopping.
关注人类在日常生活互动场景中的脆弱性体验仍然是一种新颖的方法。到目前为止,只进行了概念验证的在线研究,为了扩展这项工作,我们提出了一个后续的在线研究。我们更详细地考虑了在与PEPPER机器人协助购买衣服的交互场景中,通过隐私泄露导致的信任侵犯所导致的人类脆弱性体验如何影响信任评级。我们报告了32个调查回应和11个半结构化访谈的结果。我们的研究结果揭示了隐私悖论的存在,这也适用于研究HRI中的信任,这是一种常见的观察结果,描述了人们所陈述的隐私问题与他们保护隐私的行为之间的差异。此外,我们反映出参与者在决定是否再次与机器人互动时只考虑了实用性和娱乐性的附加价值,而没有考虑隐私泄露。我们的结论是,即使人们在日常生活中购物时感到脆弱,他们也可能会容忍一个不值得信任的机器人。
{"title":"Tolerating Untrustworthy Robots: Studying Human Vulnerability Experience within a Privacy Scenario for Trust in Robots","authors":"Glenda Hannibal, Anna Dobrosovestnova, A. Weiss","doi":"10.1109/RO-MAN53752.2022.9900830","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900830","url":null,"abstract":"Focusing on human experience of vulnerability in everyday life interaction scenarios is still a novel approach. So far, only a proof-of-concept online study has been conducted, and to extend this work, we present a follow-up online study. We consider in more detail how human experience of vulnerability caused by a trust violation through a privacy breach affects trust ratings in an interaction scenario with the PEPPER robot assisting with clothes shopping. We report the results from 32 survey responses and 11 semi-structured interviews. Our findings reveal the existence of the privacy paradox also for studying trust in HRI, which is a common observation describing a discrepancy between the stated privacy concerns by people and their behavior to safeguard it. Moreover, we reflect that participants considered only the added value of utility and entertainment when deciding whether or not to interact with the robot again, but not the privacy breach. We conclude that people might tolerate an untrustworthy robot even when they are feeling vulnerable in the everyday life situation of clothes shopping.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122150672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Extending Quantitative Proxemics and Trust to HRI 将定量近邻学与信任扩展到人力资源调查
Pub Date : 2022-08-29 DOI: 10.1109/RO-MAN53752.2022.9900821
F. Camara, Charles W. Fox
Human-robot interaction (HRI) requires quantitative models of proxemics and trust for robots to use in negotiating with people for space. Hall’s theory of proxemics has been used for decades to describe social interaction distances but has lacked detailed quantitative models and generative explanations to apply to these cases. In the limited case of autonomous vehicle interactions with pedestrians crossing a road, a recent model has explained the quantitative sizes of Hall’s distances to 4% error and their links to the concept of trust in human interactions. The present study extends this model by generalising several of its assumptions to cover further cases including human-human and human-robot interactions. It tightens the explanations of Hall zones from 4% to 1% error and fits several more recent empirical HRI results. This may help to further unify these disparate fields and quantify them to a level which enables real-world operational HRI applications.
人机交互(HRI)需要机器人在与人协商空间时使用的邻近学和信任的定量模型。霍尔的近距学理论几十年来一直被用来描述社会互动距离,但缺乏详细的定量模型和生成性解释来适用于这些案例。在自动驾驶汽车与过马路的行人互动的有限情况下,最近的一个模型解释了霍尔距离的定量大小,误差为4%,以及它们与人类互动中信任概念的联系。目前的研究扩展了这个模型,通过推广它的几个假设,以涵盖更多的情况,包括人类和人类机器人的相互作用。它将霍尔区域的解释误差从4%缩小到1%,并符合最近的几个实证HRI结果。这可能有助于进一步统一这些不同的领域,并将它们量化到能够实现实际操作HRI应用程序的水平。
{"title":"Extending Quantitative Proxemics and Trust to HRI","authors":"F. Camara, Charles W. Fox","doi":"10.1109/RO-MAN53752.2022.9900821","DOIUrl":"https://doi.org/10.1109/RO-MAN53752.2022.9900821","url":null,"abstract":"Human-robot interaction (HRI) requires quantitative models of proxemics and trust for robots to use in negotiating with people for space. Hall’s theory of proxemics has been used for decades to describe social interaction distances but has lacked detailed quantitative models and generative explanations to apply to these cases. In the limited case of autonomous vehicle interactions with pedestrians crossing a road, a recent model has explained the quantitative sizes of Hall’s distances to 4% error and their links to the concept of trust in human interactions. The present study extends this model by generalising several of its assumptions to cover further cases including human-human and human-robot interactions. It tightens the explanations of Hall zones from 4% to 1% error and fits several more recent empirical HRI results. This may help to further unify these disparate fields and quantify them to a level which enables real-world operational HRI applications.","PeriodicalId":250997,"journal":{"name":"2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131334064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1