首页 > 最新文献

Robotics最新文献

英文 中文
Learning to Walk with Adaptive Feet 学会用自适应足行走
Pub Date : 2024-07-24 DOI: 10.3390/robotics13080113
Antonello Scaldaferri, Franco Angelini, M. Garabini
In recent years, tasks regarding autonomous mobility favoredthe use of legged robots rather than wheeled ones thanks to their higher mobility on rough and uneven terrains. This comes at the cost of more complex motion planners and controllers to ensure robot stability and balance. However, in the case of quadrupedal robots, balancing is simpler than it is for bipeds thanks to their larger support polygons. Until a few years ago, most scientists and engineers addressed the quadrupedal locomotion problem with model-based approaches, which require a great deal of modeling expertise. A new trend is the use of data-driven methods, which seem to be quite promising and have shown great results. These methods do not require any modeling effort, but they suffer from computational limitations dictated by the hardware resources used. However, only the design phase of these algorithms requires large computing resources (controller training); their execution in the operational phase (deployment), takes place in real time on common processors. Moreover, adaptive feet capable of sensing terrain profile information have been designed and have shown great performance. Still, no dynamic locomotion control method has been specifically designed to leverage the advantages and supplementary information provided by this type of adaptive feet. In this work, we investigate the use and evaluate the performance of different end-to-end control policies trained via reinforcement learning algorithms specifically designed and trained to work on quadrupedal robots equipped with passive adaptive feet for their dynamic locomotion control over a diverse set of terrains. We examine how the addition of the haptic perception of the terrain affects the locomotion performance.
近年来,与自主移动有关的任务更倾向于使用腿式机器人,而不是轮式机器人,这是因为腿式机器人在崎岖不平的地形上具有更高的机动性。但这样做的代价是需要更复杂的运动规划和控制器来确保机器人的稳定性和平衡性。不过,四足机器人的支撑多边形更大,因此平衡比两足机器人更简单。直到几年前,大多数科学家和工程师还在使用基于模型的方法来解决四足运动问题,这需要大量的建模专业知识。一个新的趋势是使用数据驱动方法,这种方法似乎很有前途,并已显示出很好的效果。这些方法不需要任何建模工作,但受到所使用硬件资源的计算限制。不过,这些算法只有在设计阶段(控制器训练)才需要大量计算资源;而在运行阶段(部署),则需要在普通处理器上实时执行。此外,还设计出了能够感知地形轮廓信息的自适应脚,并显示出很好的性能。不过,目前还没有专门设计出一种动态运动控制方法来利用这类自适应脚的优势和提供的补充信息。在这项工作中,我们研究了通过强化学习算法训练的不同端到端控制策略的使用和性能评估,这些算法是专门为配备被动自适应脚的四足机器人设计和训练的,用于在各种地形上进行动态运动控制。我们研究了增加地形触觉感知对运动性能的影响。
{"title":"Learning to Walk with Adaptive Feet","authors":"Antonello Scaldaferri, Franco Angelini, M. Garabini","doi":"10.3390/robotics13080113","DOIUrl":"https://doi.org/10.3390/robotics13080113","url":null,"abstract":"In recent years, tasks regarding autonomous mobility favoredthe use of legged robots rather than wheeled ones thanks to their higher mobility on rough and uneven terrains. This comes at the cost of more complex motion planners and controllers to ensure robot stability and balance. However, in the case of quadrupedal robots, balancing is simpler than it is for bipeds thanks to their larger support polygons. Until a few years ago, most scientists and engineers addressed the quadrupedal locomotion problem with model-based approaches, which require a great deal of modeling expertise. A new trend is the use of data-driven methods, which seem to be quite promising and have shown great results. These methods do not require any modeling effort, but they suffer from computational limitations dictated by the hardware resources used. However, only the design phase of these algorithms requires large computing resources (controller training); their execution in the operational phase (deployment), takes place in real time on common processors. Moreover, adaptive feet capable of sensing terrain profile information have been designed and have shown great performance. Still, no dynamic locomotion control method has been specifically designed to leverage the advantages and supplementary information provided by this type of adaptive feet. In this work, we investigate the use and evaluate the performance of different end-to-end control policies trained via reinforcement learning algorithms specifically designed and trained to work on quadrupedal robots equipped with passive adaptive feet for their dynamic locomotion control over a diverse set of terrains. We examine how the addition of the haptic perception of the terrain affects the locomotion performance.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141809478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare 智能医疗的未来:利用大语言模型系统分析和讨论机器人在医疗保健领域的整合及其影响
Pub Date : 2024-07-23 DOI: 10.3390/robotics13080112
Souren Pashangpour, G. Nejat
The potential use of large language models (LLMs) in healthcare robotics can help address the significant demand put on healthcare systems around the world with respect to an aging demographic and a shortage of healthcare professionals. Even though LLMs have already been integrated into medicine to assist both clinicians and patients, the integration of LLMs within healthcare robots has not yet been explored for clinical settings. In this perspective paper, we investigate the groundbreaking developments in robotics and LLMs to uniquely identify the needed system requirements for designing health-specific LLM-based robots in terms of multi-modal communication through human–robot interactions (HRIs), semantic reasoning, and task planning. Furthermore, we discuss the ethical issues, open challenges, and potential future research directions for this emerging innovative field.
随着人口老龄化和医疗保健专业人员的短缺,世界各地的医疗保健系统面临着巨大的需求,在医疗保健机器人中使用大型语言模型(LLMs)的可能性有助于解决这一问题。尽管 LLM 已被整合到医学中,为临床医生和患者提供帮助,但在临床环境中将 LLM 整合到医疗保健机器人中的问题尚未得到探讨。在这篇视角论文中,我们研究了机器人学和 LLM 的突破性发展,从而独特地确定了设计基于 LLM 的医疗专用机器人所需的系统要求,包括通过人机交互(HRI)进行多模式交流、语义推理和任务规划。此外,我们还讨论了这一新兴创新领域的伦理问题、公开挑战和潜在的未来研究方向。
{"title":"The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare","authors":"Souren Pashangpour, G. Nejat","doi":"10.3390/robotics13080112","DOIUrl":"https://doi.org/10.3390/robotics13080112","url":null,"abstract":"The potential use of large language models (LLMs) in healthcare robotics can help address the significant demand put on healthcare systems around the world with respect to an aging demographic and a shortage of healthcare professionals. Even though LLMs have already been integrated into medicine to assist both clinicians and patients, the integration of LLMs within healthcare robots has not yet been explored for clinical settings. In this perspective paper, we investigate the groundbreaking developments in robotics and LLMs to uniquely identify the needed system requirements for designing health-specific LLM-based robots in terms of multi-modal communication through human–robot interactions (HRIs), semantic reasoning, and task planning. Furthermore, we discuss the ethical issues, open challenges, and potential future research directions for this emerging innovative field.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141811912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Nonbinary Voices for Digital Assistants—An Investigation of User Perceptions and Gender Stereotypes 数字助理的非二元声音--用户认知和性别成见调查
Pub Date : 2024-07-23 DOI: 10.3390/robotics13080111
Sonja Theresa Längle, Stephan Schlögl, Annina Ecker, Willemijn S. M. T. van Kooten, Teresa Spiess
Due to the wide adoption of digital voice assistants (DVAs), interactions with technology have also changed our perceptions, highlighting and reinforcing (mostly) negative gender stereotypes. Regarding the ongoing advancements in the field of human–machine interaction, a developed and improved understanding of and awareness of the reciprocity of gender and DVA technology use is thus crucial. Our work in this field expands prior research by including a nonbinary voice option as a means to eschew gender stereotypes. We used a between-subject quasi-experimental questionnaire study (female voice vs. male voice vs. nonbinary voice), in which n=318 participants provided feedback on gender stereotypes connected to voice perceptions and personality traits. Our findings show that the overall gender perception of our nonbinary voice leaned towards male on the gender spectrum, whereas the female-gendered and male-gendered voices were clearly identified as such. Furthermore, we found that feminine attributes were clearly tied to our female-gendered voice, whereas the connection of masculine attributes to the male voice was less pronounced. Most notably, however, we did not find gender-stereotypical trait attributions with our nonbinary voice. Results also show that the likability of our female-gendered and nonbinary voices was lower than it was with our male-gendered voice, and that, particularly with the nonbinary voice, this likability was affected by people’s personality traits. Thus, overall, our findings contribute (1) additional theoretical grounding for gender-studies in human–machine interaction, and (2) insights concerning peoples’ perceptions of nonbinary voices, providing additional guidance for researchers, technology designers, and DVA providers.
由于数字语音助手(DVA)的广泛应用,与技术的互动也改变了我们的观念,凸显并强化了(大部分)负面的性别刻板印象。随着人机交互领域的不断进步,对性别和数字语音助理技术使用的互惠性的理解和认识的发展和提高至关重要。我们在这一领域的工作扩展了之前的研究,加入了非二元语音选项,以此来摒弃性别刻板印象。我们使用了一项主体间准实验问卷研究(女声 vs. 男声 vs. 非二元语音),共有 318 名参与者提供了与语音感知和个性特征相关的性别刻板印象反馈。我们的研究结果表明,非二元声音的整体性别认知偏向于性别光谱中的男性,而女性性别和男性性别的声音则被明确识别为男性声音。此外,我们还发现,女性特质与我们的女性性别声音有着明显的联系,而男性特质与男性声音的联系则不那么明显。然而,最值得注意的是,我们没有发现我们的非二元声音具有性别陈规定型特征。研究结果还显示,女性性别声音和非二元声音的好感度低于男性性别声音,尤其是非二元声音,这种好感度受到人们人格特质的影响。因此,总的来说,我们的研究结果有助于:(1)为人机交互中的性别研究提供更多理论依据;(2)深入了解人们对非二元声音的看法,为研究人员、技术设计人员和 DVA 提供者提供更多指导。
{"title":"Nonbinary Voices for Digital Assistants—An Investigation of User Perceptions and Gender Stereotypes","authors":"Sonja Theresa Längle, Stephan Schlögl, Annina Ecker, Willemijn S. M. T. van Kooten, Teresa Spiess","doi":"10.3390/robotics13080111","DOIUrl":"https://doi.org/10.3390/robotics13080111","url":null,"abstract":"Due to the wide adoption of digital voice assistants (DVAs), interactions with technology have also changed our perceptions, highlighting and reinforcing (mostly) negative gender stereotypes. Regarding the ongoing advancements in the field of human–machine interaction, a developed and improved understanding of and awareness of the reciprocity of gender and DVA technology use is thus crucial. Our work in this field expands prior research by including a nonbinary voice option as a means to eschew gender stereotypes. We used a between-subject quasi-experimental questionnaire study (female voice vs. male voice vs. nonbinary voice), in which n=318 participants provided feedback on gender stereotypes connected to voice perceptions and personality traits. Our findings show that the overall gender perception of our nonbinary voice leaned towards male on the gender spectrum, whereas the female-gendered and male-gendered voices were clearly identified as such. Furthermore, we found that feminine attributes were clearly tied to our female-gendered voice, whereas the connection of masculine attributes to the male voice was less pronounced. Most notably, however, we did not find gender-stereotypical trait attributions with our nonbinary voice. Results also show that the likability of our female-gendered and nonbinary voices was lower than it was with our male-gendered voice, and that, particularly with the nonbinary voice, this likability was affected by people’s personality traits. Thus, overall, our findings contribute (1) additional theoretical grounding for gender-studies in human–machine interaction, and (2) insights concerning peoples’ perceptions of nonbinary voices, providing additional guidance for researchers, technology designers, and DVA providers.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141810809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Reconfigurable UGV for Modular and Flexible Inspection Tasks in Nuclear Sites 用于核基地模块化灵活检查任务的可重构 UGV
Pub Date : 2024-07-22 DOI: 10.3390/robotics13070110
Ivan Villaverde, Arkaitz Urquiza, Jose Luis Outón
Current operations involving Dismantling and Decommissioning (D&D) in nuclear and other harsh environments rely on manual inspection and assessment of the sites, exposing human operators to potentially dangerous situations. This work presents a reconfigurable Autonomous Mobile Robot (AMR) able to mount a wide range of nuclear sensors for flexible and modular inspection tasks in these operations. This AMR is part of the CLEANDEM solution, which uses Unmanned Ground Vehicles (UGVs), nuclear sensors, and a Digital Twin to facilitate a tool for improving D&D operations in nuclear sites. Both the AMR used as a UGV and the system have been successfully tested in real nuclear sites, showing that these tools can greatly aid in operations management and hazard reduction.
目前在核设施和其他恶劣环境中进行的拆卸和退役(D&D)作业主要依靠人工对现场进行检查和评估,这使人类操作员面临潜在的危险。这项工作展示了一种可重新配置的自主移动机器人(AMR),它能够安装各种核传感器,在这些作业中执行灵活的模块化检查任务。AMR 是 CLEANDEM 解决方案的一部分,该解决方案使用无人地面车辆 (UGV)、核传感器和数字孪生系统来促进改善核现场 D&D 操作的工具。作为 UGV 使用的 AMR 和该系统都已在实际核设施中进行了成功测试,表明这些工具可以极大地帮助运营管理和降低危害。
{"title":"A Reconfigurable UGV for Modular and Flexible Inspection Tasks in Nuclear Sites","authors":"Ivan Villaverde, Arkaitz Urquiza, Jose Luis Outón","doi":"10.3390/robotics13070110","DOIUrl":"https://doi.org/10.3390/robotics13070110","url":null,"abstract":"Current operations involving Dismantling and Decommissioning (D&D) in nuclear and other harsh environments rely on manual inspection and assessment of the sites, exposing human operators to potentially dangerous situations. This work presents a reconfigurable Autonomous Mobile Robot (AMR) able to mount a wide range of nuclear sensors for flexible and modular inspection tasks in these operations. This AMR is part of the CLEANDEM solution, which uses Unmanned Ground Vehicles (UGVs), nuclear sensors, and a Digital Twin to facilitate a tool for improving D&D operations in nuclear sites. Both the AMR used as a UGV and the system have been successfully tested in real nuclear sites, showing that these tools can greatly aid in operations management and hazard reduction.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141816544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large-Scale Urban Traffic Management Using Zero-Shot Knowledge Transfer in Multi-Agent Reinforcement Learning for Intersection Patterns 在交叉路口模式的多代理强化学习中利用零点知识转移进行大规模城市交通管理
Pub Date : 2024-07-19 DOI: 10.3390/robotics13070109
Theodore Tranos, Christos Spatharis, Konstantinos Blekas, Andreas-Giorgios Stafylopatis
The automatic control of vehicle traffic in large urban networks constitutes one of the most serious challenges to modern societies, with an impact on improving the quality of human life and saving energy and time. Intersections are a special traffic structure of pivotal importance as they accumulate a large number of vehicles that should be served in an optimal manner. Constructing intelligent models that manage to automatically coordinate and steer vehicles through intersections is a key point in the fragmentation of traffic control, offering active solutions through the flexibility of automatically adapting to a variety of traffic conditions. Responding to this call, this work aims to propose an integrated active solution of automatic traffic management. We introduce a multi-agent reinforcement learning framework that effectively models traffic flow at individual unsignalized intersections. It relies on a compact agent definition, a rich information state space, and a learning process characterized not only by depth and quality, but also by substantial degrees of freedom and variability. The resulting driving profiles are further transferred to larger road networks to integrate their individual elements and compose an effective automatic traffic control platform. Experiments are conducted on simulated road networks of variable complexity, demonstrating the potential of the proposed method.
大型城市交通网络中的车辆交通自动控制是现代社会面临的最严峻挑战之一,对提高人类生活质量、节约能源和时间具有重要影响。交叉路口是一种特殊的交通结构,其重要性不言而喻,因为交叉路口聚集了大量车辆,必须以最佳方式为这些车辆提供服务。构建能够自动协调和引导车辆通过交叉路口的智能模型是交通控制碎片化的关键点,通过自动适应各种交通状况的灵活性提供积极的解决方案。为响应这一号召,本研究旨在提出一种自动交通管理的综合主动解决方案。我们引入了一个多代理强化学习框架,该框架能有效模拟单个无信号交叉路口的交通流量。它依赖于紧凑的代理定义、丰富的信息状态空间,以及不仅具有深度和质量,而且具有大量自由度和可变性的学习过程。由此产生的驾驶剖面图被进一步转移到更大的道路网络中,以整合其中的各个元素并组成一个有效的自动交通控制平台。在复杂程度不同的模拟道路网络上进行了实验,证明了拟议方法的潜力。
{"title":"Large-Scale Urban Traffic Management Using Zero-Shot Knowledge Transfer in Multi-Agent Reinforcement Learning for Intersection Patterns","authors":"Theodore Tranos, Christos Spatharis, Konstantinos Blekas, Andreas-Giorgios Stafylopatis","doi":"10.3390/robotics13070109","DOIUrl":"https://doi.org/10.3390/robotics13070109","url":null,"abstract":"The automatic control of vehicle traffic in large urban networks constitutes one of the most serious challenges to modern societies, with an impact on improving the quality of human life and saving energy and time. Intersections are a special traffic structure of pivotal importance as they accumulate a large number of vehicles that should be served in an optimal manner. Constructing intelligent models that manage to automatically coordinate and steer vehicles through intersections is a key point in the fragmentation of traffic control, offering active solutions through the flexibility of automatically adapting to a variety of traffic conditions. Responding to this call, this work aims to propose an integrated active solution of automatic traffic management. We introduce a multi-agent reinforcement learning framework that effectively models traffic flow at individual unsignalized intersections. It relies on a compact agent definition, a rich information state space, and a learning process characterized not only by depth and quality, but also by substantial degrees of freedom and variability. The resulting driving profiles are further transferred to larger road networks to integrate their individual elements and compose an effective automatic traffic control platform. Experiments are conducted on simulated road networks of variable complexity, demonstrating the potential of the proposed method.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141822538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Continuous Online Semantic Implicit Representation for Autonomous Ground Robot Navigation in Unstructured Environments 用于非结构化环境中自主地面机器人导航的连续在线语义隐含表征
Pub Date : 2024-07-18 DOI: 10.3390/robotics13070108
Quentin Serdel, J. Marzat, Julien Moras
While mobile ground robots have now the physical capacity of travelling in unstructured challenging environments such as extraterrestrial surfaces or devastated terrains, their safe and efficient autonomous navigation has yet to be improved before entrusting them with complex unsupervised missions in such conditions. Recent advances in machine learning applied to semantic scene understanding and environment representations, coupled with modern embedded computational means and sensors hold promising potential in this matter. This paper therefore introduces the combination of semantic understanding, continuous implicit environment representation and smooth informed path-planning in a new method named COSMAu-Nav. It is specifically dedicated to autonomous ground robot navigation in unstructured environments and adaptable for embedded, real-time usage without requiring any form of telecommunication. Data clustering and Gaussian processes are employed to perform online regression of the environment topography, occupancy and terrain traversability from 3D semantic point clouds while providing an uncertainty modeling. The continuous and differentiable properties of Gaussian processes allow gradient based optimisation to be used for smooth local path-planning with respect to the terrain properties. The proposed pipeline has been evaluated and compared with two reference 3D semantic mapping methods in terms of quality of representation under localisation and semantic segmentation uncertainty using a Gazebo simulation, derived from the 3DRMS dataset. Its computational requirements have been evaluated using the Rellis-3D real world dataset. It has been implemented on a real ground robot and successfully employed for its autonomous navigation in a previously unknown outdoor environment.
虽然地面移动机器人现在已经具备了在非结构化挑战环境(如地外表面或破坏严重的地形)中行进的物理能力,但要让它们在这种条件下执行复杂的无监督任务,其安全高效的自主导航能力还有待提高。将机器学习应用于语义场景理解和环境表征方面的最新进展,再加上现代嵌入式计算手段和传感器,在这一问题上大有可为。因此,本文在一种名为 COSMAu-Nav 的新方法中介绍了语义理解、连续隐式环境表示和平滑知情路径规划的结合。该方法专门用于非结构化环境中地面机器人的自主导航,可用于嵌入式实时使用,无需任何形式的远程通信。该方法采用数据聚类和高斯过程,通过三维语义点云对环境地形、占用率和地形可穿越性进行在线回归,同时提供不确定性建模。高斯过程的连续性和可微分性允许使用基于梯度的优化方法,根据地形特性进行平滑的局部路径规划。通过使用源自 3DRMS 数据集的 Gazebo 仿真,就定位和语义分割不确定性条件下的表示质量而言,对所提出的管道进行了评估,并与两种参考 3D 语义映射方法进行了比较。利用 Rellis-3D 真实世界数据集对其计算要求进行了评估。它已在一个真实的地面机器人上实现,并成功地用于在先前未知的室外环境中进行自主导航。
{"title":"Continuous Online Semantic Implicit Representation for Autonomous Ground Robot Navigation in Unstructured Environments","authors":"Quentin Serdel, J. Marzat, Julien Moras","doi":"10.3390/robotics13070108","DOIUrl":"https://doi.org/10.3390/robotics13070108","url":null,"abstract":"While mobile ground robots have now the physical capacity of travelling in unstructured challenging environments such as extraterrestrial surfaces or devastated terrains, their safe and efficient autonomous navigation has yet to be improved before entrusting them with complex unsupervised missions in such conditions. Recent advances in machine learning applied to semantic scene understanding and environment representations, coupled with modern embedded computational means and sensors hold promising potential in this matter. This paper therefore introduces the combination of semantic understanding, continuous implicit environment representation and smooth informed path-planning in a new method named COSMAu-Nav. It is specifically dedicated to autonomous ground robot navigation in unstructured environments and adaptable for embedded, real-time usage without requiring any form of telecommunication. Data clustering and Gaussian processes are employed to perform online regression of the environment topography, occupancy and terrain traversability from 3D semantic point clouds while providing an uncertainty modeling. The continuous and differentiable properties of Gaussian processes allow gradient based optimisation to be used for smooth local path-planning with respect to the terrain properties. The proposed pipeline has been evaluated and compared with two reference 3D semantic mapping methods in terms of quality of representation under localisation and semantic segmentation uncertainty using a Gazebo simulation, derived from the 3DRMS dataset. Its computational requirements have been evaluated using the Rellis-3D real world dataset. It has been implemented on a real ground robot and successfully employed for its autonomous navigation in a previously unknown outdoor environment.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141824996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Human–Robot Collaborative Manufacturing Cell with Learning-Based Interaction Abilities 具有基于学习的交互能力的人机协作制造单元
Pub Date : 2024-07-17 DOI: 10.3390/robotics13070107
Joel Baptista, Afonso Castro, Manuel Gomes, Pedro Amaral, Vítor M. F. Santos, Filipe Silva, Miguel Oliveira
This paper presents a collaborative manufacturing cell implemented in a laboratory setting, focusing on developing learning-based interaction abilities to enhance versatility and ease of use. The key components of the system include 3D real-time volumetric monitoring for safety, visual recognition of hand gestures for human-to-robot communication, classification of physical-contact-based interaction primitives during handover operations, and detection of hand–object interactions to anticipate human intentions. Due to the nature and complexity of perception, deep-learning-based techniques were used to enhance robustness and adaptability. The main components are integrated in a system containing multiple functionalities, coordinated through a dedicated state machine. This ensures appropriate actions and reactions based on events, enabling the execution of specific modules to complete a given multi-step task. An ROS-based architecture supports the software infrastructure among sensor interfacing, data processing, and robot and gripper controllers nodes. The result is demonstrated by a functional use case that involves multiple tasks and behaviors, paving the way for the deployment of more advanced collaborative cells in manufacturing contexts.
本文介绍了在实验室环境中实施的协作制造单元,重点是开发基于学习的交互能力,以提高通用性和易用性。该系统的关键组成部分包括用于安全的三维实时体积监测、用于人与机器人交流的手势视觉识别、交接操作过程中基于物理接触的交互基元分类,以及用于预测人类意图的手与物体交互检测。由于感知的性质和复杂性,使用了基于深度学习的技术来增强鲁棒性和适应性。主要组件集成在一个包含多种功能的系统中,通过专用状态机进行协调。这确保了根据事件采取适当的行动和反应,使特定模块的执行能够完成给定的多步骤任务。基于 ROS 的架构支持传感器接口、数据处理以及机器人和抓手控制器节点之间的软件基础设施。结果通过一个涉及多个任务和行为的功能用例进行了演示,为在制造环境中部署更先进的协作单元铺平了道路。
{"title":"Human–Robot Collaborative Manufacturing Cell with Learning-Based Interaction Abilities","authors":"Joel Baptista, Afonso Castro, Manuel Gomes, Pedro Amaral, Vítor M. F. Santos, Filipe Silva, Miguel Oliveira","doi":"10.3390/robotics13070107","DOIUrl":"https://doi.org/10.3390/robotics13070107","url":null,"abstract":"This paper presents a collaborative manufacturing cell implemented in a laboratory setting, focusing on developing learning-based interaction abilities to enhance versatility and ease of use. The key components of the system include 3D real-time volumetric monitoring for safety, visual recognition of hand gestures for human-to-robot communication, classification of physical-contact-based interaction primitives during handover operations, and detection of hand–object interactions to anticipate human intentions. Due to the nature and complexity of perception, deep-learning-based techniques were used to enhance robustness and adaptability. The main components are integrated in a system containing multiple functionalities, coordinated through a dedicated state machine. This ensures appropriate actions and reactions based on events, enabling the execution of specific modules to complete a given multi-step task. An ROS-based architecture supports the software infrastructure among sensor interfacing, data processing, and robot and gripper controllers nodes. The result is demonstrated by a functional use case that involves multiple tasks and behaviors, paving the way for the deployment of more advanced collaborative cells in manufacturing contexts.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141829717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ANN Enhanced Hybrid Force/Position Controller of Robot Manipulators for Fiber Placement 用于光纤置放的机器人机械手的 ANN 增强型力/位置混合控制器
Pub Date : 2024-07-13 DOI: 10.3390/robotics13070105
José Francisco Villa-Tiburcio, José Antonio Estrada-Torres, R. Hernández-Alvarado, Josue-Rafael Montes-Martínez, Darío Bringas-Posadas, E. Franco-Urquiza
In practice, most industrial robot manipulators use PID (Proportional + Integral + Derivative) controllers, thanks to their simplicity and adequate performance under certain conditions. Normally, this type of controller has a good performance in tasks where the robot moves freely, performing movements without contact with its environment. However, complications arise in applications such as the AFP (Automated Fiber Placement) process, where a high degree of precision and repeatability is required in the control of parameters such as position and compression force for the production of composite parts. The control of these parameters is a major challenge in terms of quality and productivity of the final product, mainly due to the complex geometry of the part and the type of tooling with which the AFP system is equipped. In the last decades, several control system approaches have been proposed in the literature, such as classical, adaptive or sliding mode control theory based methodologies. Nevertheless, such strategies present difficulties to change their dynamics since their design consider only some set of disturbances. This article presents a novel intelligent type control algorithm based on back-propagation neural networks (BP-NNs) combined with classical PID/PI control schemes for force/position control in manipulator robots. The PID/PI controllers are responsible for the main control action, while the BP-NNs contributes with its ability to estimate and compensate online the dynamic variations of the AFP process. It is proven that the proposed control achieves both, stability in the Lyapunov sense for the desired interaction force between the end-effector and the environment, and position trajectory tracking for the robot tip in Cartesian space. The performance and efficiency of the proposed control is evaluated by numerical simulations in MATLAB-Simulink environment, obtaining as results that the errors for the desired force and the tracking of complex trajectories are reduced to a range below 5% in root mean square error (RMSE).
在实践中,大多数工业机器人机械手都使用 PID(比例+积分+微分)控制器,因为这种控制器简单易用,而且在特定条件下性能良好。通常情况下,这种控制器在机器人自由移动、不与环境接触的情况下性能良好。然而,在诸如 AFP(自动纤维铺放)工艺等应用中,由于生产复合材料部件时对位置和压缩力等参数的控制精度和可重复性要求很高,因此出现了一些复杂问题。这些参数的控制是对最终产品的质量和生产率的一大挑战,这主要是由于部件的几何形状和 AFP 系统所配备的工具类型十分复杂。过去几十年中,文献中提出了多种控制系统方法,如基于经典、自适应或滑模控制理论的方法。然而,由于这些方法在设计时只考虑了部分干扰因素,因此很难改变其动态特性。本文介绍了一种基于反向传播神经网络(BP-NN)的新型智能型控制算法,该算法结合了用于机械手机器人力/位置控制的经典 PID/PI 控制方案。PID/PI 控制器负责主要的控制动作,而 BP-NNs 则能对 AFP 过程的动态变化进行在线估计和补偿。事实证明,所提出的控制既能实现末端执行器与环境之间所需的相互作用力的 Lyapunov 意义上的稳定性,又能实现机器人顶端在笛卡尔空间中的位置轨迹跟踪。通过在 MATLAB-Simulink 环境中进行数值模拟,对所提控制的性能和效率进行了评估,结果表明所需力的误差和复杂轨迹的跟踪误差均减小到均方根误差(RMSE)5% 以下。
{"title":"ANN Enhanced Hybrid Force/Position Controller of Robot Manipulators for Fiber Placement","authors":"José Francisco Villa-Tiburcio, José Antonio Estrada-Torres, R. Hernández-Alvarado, Josue-Rafael Montes-Martínez, Darío Bringas-Posadas, E. Franco-Urquiza","doi":"10.3390/robotics13070105","DOIUrl":"https://doi.org/10.3390/robotics13070105","url":null,"abstract":"In practice, most industrial robot manipulators use PID (Proportional + Integral + Derivative) controllers, thanks to their simplicity and adequate performance under certain conditions. Normally, this type of controller has a good performance in tasks where the robot moves freely, performing movements without contact with its environment. However, complications arise in applications such as the AFP (Automated Fiber Placement) process, where a high degree of precision and repeatability is required in the control of parameters such as position and compression force for the production of composite parts. The control of these parameters is a major challenge in terms of quality and productivity of the final product, mainly due to the complex geometry of the part and the type of tooling with which the AFP system is equipped. In the last decades, several control system approaches have been proposed in the literature, such as classical, adaptive or sliding mode control theory based methodologies. Nevertheless, such strategies present difficulties to change their dynamics since their design consider only some set of disturbances. This article presents a novel intelligent type control algorithm based on back-propagation neural networks (BP-NNs) combined with classical PID/PI control schemes for force/position control in manipulator robots. The PID/PI controllers are responsible for the main control action, while the BP-NNs contributes with its ability to estimate and compensate online the dynamic variations of the AFP process. It is proven that the proposed control achieves both, stability in the Lyapunov sense for the desired interaction force between the end-effector and the environment, and position trajectory tracking for the robot tip in Cartesian space. The performance and efficiency of the proposed control is evaluated by numerical simulations in MATLAB-Simulink environment, obtaining as results that the errors for the desired force and the tracking of complex trajectories are reduced to a range below 5% in root mean square error (RMSE).","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141651472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Framework for Enhanced Human–Robot Collaboration during Disassembly Using Digital Twin and Virtual Reality 利用数字双胞胎和虚拟现实技术加强拆卸过程中人机协作的框架
Pub Date : 2024-07-12 DOI: 10.3390/robotics13070104
Timon Hoebert, Stephan Seibel, Manuel Amersdorfer, Markus Vincze, Wilfried Lepuschitz, M. Merdan
This paper presents a framework that integrates digital twin and virtual reality (VR) technologies to improve the efficiency and safety of human–robot collaborative systems in the disassembly domain. With the increasing complexity of the handling of end-of-life electronic products and as the related disassembly tasks are characterized by variabilities such as rust, deformation, and diverse part geometries, traditional industrial robots face significant challenges in this domain. These challenges require adaptable and flexible automation solutions that can work safely alongside human workers. We developed an architecture to address these challenges and support system configuration, training, and operational monitoring. Our framework incorporates a digital twin to provide a real-time virtual representation of the physical disassembly process, allowing for immediate feedback and dynamic adjustment of operations. In addition, VR is used to simulate and optimize the workspace layout, improve human–robot interaction, and facilitate safe and effective training scenarios without the need for physical prototypes. A unique case study is presented, where the collaborative system is specifically applied to the disassembly of antenna amplifiers, illustrating the potential of our comprehensive approach to facilitate engineering processes and enhance collaborative safety.
本文介绍了一个整合数字孪生和虚拟现实(VR)技术的框架,以提高拆卸领域人机协作系统的效率和安全性。随着处理报废电子产品的复杂性不断增加,以及相关拆卸任务具有生锈、变形和不同部件几何形状等多变性的特点,传统工业机器人在这一领域面临着重大挑战。这些挑战需要适应性强且灵活的自动化解决方案,以便与人类工人一起安全地工作。我们开发了一种架构来应对这些挑战,并为系统配置、培训和运行监控提供支持。我们的框架采用了数字孪生技术,提供物理拆卸过程的实时虚拟表示,允许即时反馈和动态调整操作。此外,VR 还可用于模拟和优化工作空间布局,改善人与机器人的交互,并促进安全有效的培训场景,而无需物理原型。本报告介绍了一个独特的案例研究,该案例研究将协作系统具体应用于天线放大器的拆卸,说明了我们的综合方法在促进工程流程和提高协作安全性方面的潜力。
{"title":"A Framework for Enhanced Human–Robot Collaboration during Disassembly Using Digital Twin and Virtual Reality","authors":"Timon Hoebert, Stephan Seibel, Manuel Amersdorfer, Markus Vincze, Wilfried Lepuschitz, M. Merdan","doi":"10.3390/robotics13070104","DOIUrl":"https://doi.org/10.3390/robotics13070104","url":null,"abstract":"This paper presents a framework that integrates digital twin and virtual reality (VR) technologies to improve the efficiency and safety of human–robot collaborative systems in the disassembly domain. With the increasing complexity of the handling of end-of-life electronic products and as the related disassembly tasks are characterized by variabilities such as rust, deformation, and diverse part geometries, traditional industrial robots face significant challenges in this domain. These challenges require adaptable and flexible automation solutions that can work safely alongside human workers. We developed an architecture to address these challenges and support system configuration, training, and operational monitoring. Our framework incorporates a digital twin to provide a real-time virtual representation of the physical disassembly process, allowing for immediate feedback and dynamic adjustment of operations. In addition, VR is used to simulate and optimize the workspace layout, improve human–robot interaction, and facilitate safe and effective training scenarios without the need for physical prototypes. A unique case study is presented, where the collaborative system is specifically applied to the disassembly of antenna amplifiers, illustrating the potential of our comprehensive approach to facilitate engineering processes and enhance collaborative safety.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141653497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development, Experimental, and Numerical Characterisation of Novel Flexible Strain Sensors for Soft Robotics Applications 用于软机器人应用的新型柔性应变传感器的开发、实验和数值特性分析
Pub Date : 2024-07-11 DOI: 10.3390/robotics13070103
Sylvester Ndidiamaka Nnadi, Ivor Ajadalu, Amir Rahmani, A. Aliyu, Khaled Elgeneidy, Allahyar Montazeri, B. Sohani
Medical and agricultural robots that interact with living tissue or pick fruit require tactile and flexible sensors to minimise or eliminate damage. Until recently, research has focused on the development of robots made of rigid materials, such as metal or plastic. Due to their complex configuration, poor spatial adaptability and low flexibility, rigid robots are not fully applicable in some special environments such as limb rehabilitation, fragile objects gripping, human–machine interaction, and locomotion. All these should be done in an accurate and safe manner for them to be useful. However, the design and manufacture of soft robot parts that interact with living tissue or fragile objects is not as straightforward. Given that hyper-elasticity and conductivity are involved, conventional (subtractive) manufacturing can result in wasted materials (which are expensive), incompatible parts due to different physical properties, and high costs. In this work, additive manufacturing (3D printing) is used to produce a conductive, composite flexible sensor. Its electrical response was tested based on various physical conditions. Finite element analysis (FEA) was used to characterise its deformation and stress behaviour for optimisation to achieve functionality and durability. Also, a nonlinear regression model was developed for the sensor’s performance.
与活体组织互动或采摘水果的医疗和农业机器人需要触觉灵活的传感器,以尽量减少或消除损害。直到最近,研究一直集中在开发由金属或塑料等刚性材料制成的机器人。由于刚性机器人结构复杂、空间适应性差、灵活性低,因此并不完全适用于一些特殊环境,如肢体康复、易碎物体抓取、人机交互和运动等。所有这些都必须以精确和安全的方式完成,才能发挥它们的作用。然而,设计和制造与活体组织或易碎物体相互作用的软体机器人部件并不那么简单。由于涉及到超弹性和导电性,传统(减法)制造可能会导致材料浪费(成本高昂)、因不同物理性质而不兼容的部件以及高昂的成本。在这项工作中,采用了增材制造(3D 打印)技术来生产导电复合柔性传感器。根据各种物理条件对其电气响应进行了测试。有限元分析(FEA)用于描述其变形和应力行为,以便进行优化,实现功能性和耐用性。此外,还为传感器的性能开发了一个非线性回归模型。
{"title":"Development, Experimental, and Numerical Characterisation of Novel Flexible Strain Sensors for Soft Robotics Applications","authors":"Sylvester Ndidiamaka Nnadi, Ivor Ajadalu, Amir Rahmani, A. Aliyu, Khaled Elgeneidy, Allahyar Montazeri, B. Sohani","doi":"10.3390/robotics13070103","DOIUrl":"https://doi.org/10.3390/robotics13070103","url":null,"abstract":"Medical and agricultural robots that interact with living tissue or pick fruit require tactile and flexible sensors to minimise or eliminate damage. Until recently, research has focused on the development of robots made of rigid materials, such as metal or plastic. Due to their complex configuration, poor spatial adaptability and low flexibility, rigid robots are not fully applicable in some special environments such as limb rehabilitation, fragile objects gripping, human–machine interaction, and locomotion. All these should be done in an accurate and safe manner for them to be useful. However, the design and manufacture of soft robot parts that interact with living tissue or fragile objects is not as straightforward. Given that hyper-elasticity and conductivity are involved, conventional (subtractive) manufacturing can result in wasted materials (which are expensive), incompatible parts due to different physical properties, and high costs. In this work, additive manufacturing (3D printing) is used to produce a conductive, composite flexible sensor. Its electrical response was tested based on various physical conditions. Finite element analysis (FEA) was used to characterise its deformation and stress behaviour for optimisation to achieve functionality and durability. Also, a nonlinear regression model was developed for the sensor’s performance.","PeriodicalId":506759,"journal":{"name":"Robotics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141656283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1