首页 > 最新文献

Artificial Life and Robotics最新文献

英文 中文
Poisoning attack on VIMT and its adverse effect 对 VIMT 的中毒攻击及其不利影响
IF 0.8 Q4 ROBOTICS Pub Date : 2023-11-13 DOI: 10.1007/s10015-023-00914-7
Taichi Ikezaki, Osamu Kaneko, Kenji Sawada, Junya Fujita

In recent years, various approaches have been proposed to design control systems that directly utilize data without mathematical plant models. Data-driven control involves updating or redesigning a controller using actual operating data, enabling fine-tuning control systems and achieving desired characteristics. However, the increasing prevalence of cyber-attacks targeting control systems presents significant societal challenges. A study by Russo and Proutiere (in Proceeding of American Control Conference (ACC), 2021) showed a poisoning approach targeting virtual reference feedback tuning, a data-driven control method. The study suggests that compromising the data used in the data-driven method may result in the closed-loop performance failing to achieve desired specifications and, in the worst case, destabilizing the control system. Hence, investigating the adverse effects of cyber-attacks on data employed in data-driven methods becomes crucial. This study explores the impact of a poisoning attack on the data used in the data-driven control method, specifically emphasizing virtual internal model tuning as a representative data-driven control approach.

近年来,人们提出了各种方法来设计控制系统,直接利用数据而无需数学工厂模型。数据驱动控制涉及利用实际运行数据更新或重新设计控制器,从而对控制系统进行微调并实现所需的特性。然而,针对控制系统的网络攻击日益猖獗,给社会带来了巨大挑战。Russo 和 Proutiere 的一项研究(载于 2021 年美国控制会议(ACC)论文集)展示了一种针对虚拟参考反馈调整(一种数据驱动的控制方法)的中毒方法。研究表明,破坏数据驱动方法中使用的数据可能会导致闭环性能无法达到预期规格,在最坏的情况下还会破坏控制系统的稳定性。因此,研究网络攻击对数据驱动方法中使用的数据的不利影响至关重要。本研究探讨了中毒攻击对数据驱动控制方法所用数据的影响,特别强调了虚拟内部模型调整作为一种代表性的数据驱动控制方法。
{"title":"Poisoning attack on VIMT and its adverse effect","authors":"Taichi Ikezaki,&nbsp;Osamu Kaneko,&nbsp;Kenji Sawada,&nbsp;Junya Fujita","doi":"10.1007/s10015-023-00914-7","DOIUrl":"10.1007/s10015-023-00914-7","url":null,"abstract":"<div><p>In recent years, various approaches have been proposed to design control systems that directly utilize data without mathematical plant models. Data-driven control involves updating or redesigning a controller using actual operating data, enabling fine-tuning control systems and achieving desired characteristics. However, the increasing prevalence of cyber-attacks targeting control systems presents significant societal challenges. A study by Russo and Proutiere (in Proceeding of American Control Conference (ACC), 2021) showed a poisoning approach targeting virtual reference feedback tuning, a data-driven control method. The study suggests that compromising the data used in the data-driven method may result in the closed-loop performance failing to achieve desired specifications and, in the worst case, destabilizing the control system. Hence, investigating the adverse effects of cyber-attacks on data employed in data-driven methods becomes crucial. This study explores the impact of a poisoning attack on the data used in the data-driven control method, specifically emphasizing virtual internal model tuning as a representative data-driven control approach.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"168 - 176"},"PeriodicalIF":0.8,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136346557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neural-network-driven method for optimal path planning via high-accuracy region prediction 通过高精度区域预测实现最优路径规划的神经网络驱动方法
IF 0.8 Q4 ROBOTICS Pub Date : 2023-11-08 DOI: 10.1007/s10015-023-00915-6
Yuan Huang, Cheng-Tien Tsao, Tianyu Shen, Hee-Hyol Lee

Sampling-based path planning algorithms suffer from heavy reliance on uniform sampling, which accounts for unreliable and time-consuming performance, especially in complex environments. Recently, neural-network-driven methods predict regions as sampling domains to realize a non-uniform sampling and reduce calculation time. However, the accuracy of region prediction hinders further improvement. We propose a sampling-based algorithm, abbreviated to Region Prediction Neural Network RRT* (RPNN-RRT*), to rapidly obtain the optimal path based on a high-accuracy region prediction. First, we implement a region prediction neural network (RPNN), to predict accurate regions for the RPNN-RRT*. A full-layer channel-wise attention module is employed to enhance the feature fusion in the concatenation between the encoder and decoder. Moreover, a three-level hierarchy loss is designed to learn the pixel-wise, map-wise, and patch-wise features. A dataset, named Complex Environment Motion Planning, is established to test the performance in complex environments. Ablation studies and test results show that a high accuracy of 89.13% is achieved by the RPNN for region prediction, compared with other region prediction models. In addition, the RPNN-RRT* performs in different complex scenarios, demonstrating significant and reliable superiority in terms of the calculation time, sampling efficiency, and success rate for optimal path planning.

基于采样的路径规划算法严重依赖均匀采样,因此性能不可靠且耗时,尤其是在复杂环境中。最近,神经网络驱动的方法预测区域作为采样域,以实现非均匀采样并减少计算时间。然而,区域预测的准确性阻碍了进一步的改进。我们提出了一种基于采样的算法,简称为区域预测神经网络 RRT* (RPNN-RRT*),在高精度区域预测的基础上快速获得最佳路径。首先,我们实现了一个区域预测神经网络(RPNN),为 RPNN-RRT* 预测准确的区域。在编码器和解码器之间的串联过程中,我们采用了全层信道关注模块来增强特征融合。此外,还设计了三级层次损失来学习像素、地图和斑块特征。建立了一个名为 "复杂环境运动规划 "的数据集,以测试其在复杂环境中的性能。消融研究和测试结果表明,与其他区域预测模型相比,RPNN 的区域预测准确率高达 89.13%。此外,RPNN-RRT*在不同的复杂场景中的表现,在最优路径规划的计算时间、采样效率和成功率方面都表现出了显著而可靠的优势。
{"title":"Neural-network-driven method for optimal path planning via high-accuracy region prediction","authors":"Yuan Huang,&nbsp;Cheng-Tien Tsao,&nbsp;Tianyu Shen,&nbsp;Hee-Hyol Lee","doi":"10.1007/s10015-023-00915-6","DOIUrl":"10.1007/s10015-023-00915-6","url":null,"abstract":"<div><p>Sampling-based path planning algorithms suffer from heavy reliance on uniform sampling, which accounts for unreliable and time-consuming performance, especially in complex environments. Recently, neural-network-driven methods predict regions as sampling domains to realize a non-uniform sampling and reduce calculation time. However, the accuracy of region prediction hinders further improvement. We propose a sampling-based algorithm, abbreviated to Region Prediction Neural Network RRT* (RPNN-RRT*), to rapidly obtain the optimal path based on a high-accuracy region prediction. First, we implement a region prediction neural network (RPNN), to predict accurate regions for the RPNN-RRT*. A full-layer channel-wise attention module is employed to enhance the feature fusion in the concatenation between the encoder and decoder. Moreover, a three-level hierarchy loss is designed to learn the pixel-wise, map-wise, and patch-wise features. A dataset, named Complex Environment Motion Planning, is established to test the performance in complex environments. Ablation studies and test results show that a high accuracy of 89.13% is achieved by the RPNN for region prediction, compared with other region prediction models. In addition, the RPNN-RRT* performs in different complex scenarios, demonstrating significant and reliable superiority in terms of the calculation time, sampling efficiency, and success rate for optimal path planning.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"12 - 21"},"PeriodicalIF":0.8,"publicationDate":"2023-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135341998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation 利用 Grad-CAM 和随机屏蔽数据增强技术加强工业产品缺陷区域可视化
IF 0.8 Q4 ROBOTICS Pub Date : 2023-11-08 DOI: 10.1007/s10015-023-00913-8
Tatsuki Shimizu, Fusaomi Nagata, Koki Arima, Kohei Miki, Hirohisa Kato, Akimasa Otsuka, Keigo Watanabe, Maki K. Habib

Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.

各种工业产品中的缺陷检测可确保产品质量和安全。本文介绍了一种创新的设计、训练和评估应用,采用 CNN、CAE、YOLO、FCN 和 SVM 模型,无需丰富的 IT 专业知识即可促进缺陷检测。然而,传统使用 Grad-CAM 对缺陷区域进行可视化有时会包含与目标缺陷无关的区域。为了增强缺陷区域的可视化,我们提出了一种名为随机屏蔽的新型数据增强技术,从而更准确、更集中地检测各种工业产品中的缺陷。该技术在训练过程中使用,用随机生成的掩码模式替换每张图像中的非目标区域。通过使用 Grad-CAM 对缺陷区域进行可视化测试,证明了所提技术的功效。此外,我们还进行了一项消融研究,以评估数据增强技术的有效性,并比较了 Grad-CAM 在使用和不使用随机掩膜增强技术时的性能。我们进一步深入了解了所使用的数据集,并介绍了评估中值得注意的发现,展示了我们的工作在推进缺陷检测方法方面所做的贡献。
{"title":"Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation","authors":"Tatsuki Shimizu,&nbsp;Fusaomi Nagata,&nbsp;Koki Arima,&nbsp;Kohei Miki,&nbsp;Hirohisa Kato,&nbsp;Akimasa Otsuka,&nbsp;Keigo Watanabe,&nbsp;Maki K. Habib","doi":"10.1007/s10015-023-00913-8","DOIUrl":"10.1007/s10015-023-00913-8","url":null,"abstract":"<div><p>Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"62 - 69"},"PeriodicalIF":0.8,"publicationDate":"2023-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135390619","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of neuromorphic circuits with receptor cell model for animal-like gait generation using foot pressure 开发带有受体细胞模型的神经形态电路,利用脚压产生类似动物的步态
IF 0.8 Q4 ROBOTICS Pub Date : 2023-11-07 DOI: 10.1007/s10015-023-00911-w
Katsuyuki Morishita, Akihisa Ishida, Isuke Okuma, Ken Saito

The authors are studying to mimic the mechanism of gait generation in animals and implement the mechanism in robots. Previously, the authors developed a quadruped robot system that spontaneously generates gait through feedback on foot pressure. The neuromorphic circuits that mimic the animal's nervous systems control the legs of the quadruped robot. Neuromorphic circuits are analog electronic circuits that output electrical spikes the same as biological neurons. However, quadruped robots system require digital processing by a microcontroller to transmit signals from pressure sensors to the neuromorphic circuit. In addition, a microcontroller drives the servo motors using a pulsewidth modulation waveform. This paper describes a newly developed neuromorphic circuit that does not require the processing of a microcontroller to convert pressure sensor signals. The authors add the receptor cell model and the integral circuit to the conventional neuromorphic circuit. By converting pressure sensor signals with the receptor cell model and the integral circuit, the neuromorphic circuit can be processed similar to a microcontroller. As a simulation and a measurement result, we confirmed that the proposed neuromorphic circuit could implement in a quadruped robot system.

作者正在研究模仿动物的步态产生机制,并在机器人中实现这一机制。在此之前,作者开发了一种四足机器人系统,它能通过对脚部压力的反馈自发产生步态。模仿动物神经系统的神经形态电路控制着四足机器人的双腿。神经形态电路是一种模拟电子电路,可输出与生物神经元相同的电子尖峰。不过,四足机器人系统需要微控制器进行数字处理,将压力传感器的信号传输到神经形态电路。此外,微控制器还利用脉宽调制波形驱动伺服电机。本文介绍了一种新开发的神经形态电路,它不需要微控制器来处理压力传感器信号的转换。作者在传统的神经形态电路中加入了受体细胞模型和积分电路。通过受体细胞模型和积分电路转换压力传感器信号,神经形态电路的处理过程与微控制器类似。通过模拟和测量结果,我们证实所提出的神经形态电路可以在四足机器人系统中实现。
{"title":"Development of neuromorphic circuits with receptor cell model for animal-like gait generation using foot pressure","authors":"Katsuyuki Morishita,&nbsp;Akihisa Ishida,&nbsp;Isuke Okuma,&nbsp;Ken Saito","doi":"10.1007/s10015-023-00911-w","DOIUrl":"10.1007/s10015-023-00911-w","url":null,"abstract":"<div><p>The authors are studying to mimic the mechanism of gait generation in animals and implement the mechanism in robots. Previously, the authors developed a quadruped robot system that spontaneously generates gait through feedback on foot pressure. The neuromorphic circuits that mimic the animal's nervous systems control the legs of the quadruped robot. Neuromorphic circuits are analog electronic circuits that output electrical spikes the same as biological neurons. However, quadruped robots system require digital processing by a microcontroller to transmit signals from pressure sensors to the neuromorphic circuit. In addition, a microcontroller drives the servo motors using a pulsewidth modulation waveform. This paper describes a newly developed neuromorphic circuit that does not require the processing of a microcontroller to convert pressure sensor signals. The authors add the receptor cell model and the integral circuit to the conventional neuromorphic circuit. By converting pressure sensor signals with the receptor cell model and the integral circuit, the neuromorphic circuit can be processed similar to a microcontroller. As a simulation and a measurement result, we confirmed that the proposed neuromorphic circuit could implement in a quadruped robot system.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"161 - 167"},"PeriodicalIF":0.8,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135475886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards robotic deep spatiotemporal language understanding based on mental-image-directed semantic theory 基于心理图像导向语义理论的机器人深度时空语言理解
IF 0.8 Q4 ROBOTICS Pub Date : 2023-11-02 DOI: 10.1007/s10015-023-00905-8
Rojanee Khummongkol, Masao Yokota

Among subsets of natural language, spatial language, more exactly spatiotemporal language here, has been considered most essential for human-like interaction between people and robots expected in near future. Quite distinctively from conventional learning-based approaches to natural language understanding (NLU), mental-image-directed theory (MIDST) proposes a robotic deep NLU methodology based on a mental image model as a formal system for knowledge representation and reasoning. The application system named CoMaS is designed to understand User’s utterances in text and respond in text or animation through human-like spatiotemporal reasoning based on the mental image model. In this work, CoMaS was compared with human subjects through a psychological experiment on spatiotemporal language understanding and showed globally good agreement with them and locally some interesting and reasonable disagreement. This kind of disagreement was found among the human participants as well and explainable as difference in personal conceptualization or reasoning based on mental image. The experimental results and theoretical discussion based on them showed well the effectiveness and uniqueness of our study.

在自然语言的子集中,空间语言,更确切地说是时空语言,被认为是在不久的将来实现人与机器人之间类似人类互动的最基本语言。与传统的基于学习的自然语言理解(NLU)方法截然不同,心智图像导向理论(MIDST)提出了一种基于心智图像模型的机器人深度 NLU 方法,作为知识表示和推理的正式系统。名为 CoMaS 的应用系统旨在理解用户在文本中的话语,并通过基于心像模型的类人时空推理,以文本或动画的形式做出回应。在这项工作中,CoMaS 通过时空语言理解心理实验与人类受试者进行了比较,结果显示,CoMaS 与人类受试者在总体上具有良好的一致性,在局部上存在一些有趣而合理的分歧。这种分歧在人类受试者中也有发现,可以解释为基于心理图像的个人概念化或推理的差异。实验结果和基于这些结果的理论讨论充分显示了我们研究的有效性和独特性。
{"title":"Towards robotic deep spatiotemporal language understanding based on mental-image-directed semantic theory","authors":"Rojanee Khummongkol,&nbsp;Masao Yokota","doi":"10.1007/s10015-023-00905-8","DOIUrl":"10.1007/s10015-023-00905-8","url":null,"abstract":"<div><p>Among subsets of natural language, spatial language, more exactly spatiotemporal language here, has been considered most essential for human-like interaction between people and robots expected in near future. Quite distinctively from conventional learning-based approaches to natural language understanding (NLU), mental-image-directed theory (MIDST) proposes a robotic deep NLU methodology based on a mental image model as a formal system for knowledge representation and reasoning. The application system named CoMaS is designed to understand User’s utterances in text and respond in text or animation through human-like spatiotemporal reasoning based on the mental image model. In this work, CoMaS was compared with human subjects through a psychological experiment on spatiotemporal language understanding and showed globally good agreement with them and locally some interesting and reasonable disagreement. This kind of disagreement was found among the human participants as well and explainable as difference in personal conceptualization or reasoning based on mental image. The experimental results and theoretical discussion based on them showed well the effectiveness and uniqueness of our study.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"70 - 80"},"PeriodicalIF":0.8,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135876439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep-reinforcement learning-based route planning with obstacle avoidance for autonomous vessels 基于深度强化学习的自动驾驶船舶避障路线规划
IF 0.8 Q4 ROBOTICS Pub Date : 2023-10-26 DOI: 10.1007/s10015-023-00909-4
Ryosuke Saga, Rinto Kozono, Yutaro Tsurumi, Yasunori Nihei

This paper proposes a method to enables the generation of short-length routes with consideration of obstacle avoidance and significantly reduces the computation time compared to existing research for ocean route optimization. The reduced computation time allows recalculation of routes for autonomous vessel underway. By simulating the recalculation of four cases of the vessel underway that may require recalculation, this paper demonstrates that the proposed method can generate new and superior routes for the vessel that needs to change their routes due to certain factors.

与现有的海洋航线优化研究相比,本文提出的方法能够在考虑避障的情况下生成短程航线,并显著缩短计算时间。计算时间缩短后,可以重新计算自主航行船只的航线。通过模拟四种可能需要重新计算的航行中船只的情况,本文证明了所提出的方法可以为因某些因素而需要改变航线的船只生成新的和更优的航线。
{"title":"Deep-reinforcement learning-based route planning with obstacle avoidance for autonomous vessels","authors":"Ryosuke Saga,&nbsp;Rinto Kozono,&nbsp;Yutaro Tsurumi,&nbsp;Yasunori Nihei","doi":"10.1007/s10015-023-00909-4","DOIUrl":"10.1007/s10015-023-00909-4","url":null,"abstract":"<div><p>This paper proposes a method to enables the generation of short-length routes with consideration of obstacle avoidance and significantly reduces the computation time compared to existing research for ocean route optimization. The reduced computation time allows recalculation of routes for autonomous vessel underway. By simulating the recalculation of four cases of the vessel underway that may require recalculation, this paper demonstrates that the proposed method can generate new and superior routes for the vessel that needs to change their routes due to certain factors.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"136 - 144"},"PeriodicalIF":0.8,"publicationDate":"2023-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134907552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A data grid strategy for non-prehensile object transport by a multi-robot system 多机器人系统中不可抓握物体运输的数据网格策略
IF 0.9 Q4 ROBOTICS Pub Date : 2023-10-24 DOI: 10.1007/s10015-023-00908-5
Priyank Narvekar, Andrew Vardy

In this paper, we propose a control strategy for non-prehensile object transport using a multi-robot system. While an object can be unmanageable for a single robot to push and transport, we demonstrate via simulations that a team of cooperative robots can be used to transport such an object. The proposed control strategy is divided into two phases: caging and cooperative transport. In the first phase, the robots start from arbitrary positions and then approach the object to be transported, forming a cage around it. The second phase consists of cooperatively transporting the object ensuring it remains caged during transport. In the proposed strategy, the robots take a decentralized approach where robots behave autonomously while being in indirect communication by leveraging distributed data structures to share their state. Our use of distributed data structures like distributed locks, sets, and maps offered by the data grid concept provides a mechanism for inter-robot communication without development of a new application-specific protocol. To our knowledge, the use of in-memory data grid (IMDG) is new to the field of multi-robot systems. We believe it could provide a promising solution to simplify inter-robot communication. In this paper, we present our design for a coordinated motion control strategy for object transport leveraging IMDG. Finally, we demonstrate our results using a realistic simulator that shows the feasibility of our approach in various environments.

在本文中,我们提出了一种使用多机器人系统的不可抓握物体运输的控制策略。虽然一个物体可能无法由单个机器人推动和运输,但我们通过模拟证明,一组协作机器人可以用来运输这样的物体。所提出的控制策略分为两个阶段:锁定和协同运输。在第一阶段,机器人从任意位置开始,然后接近要运输的物体,在物体周围形成一个笼子。第二阶段包括协同运输物体,确保物体在运输过程中保持笼子状态。在所提出的策略中,机器人采取了一种去中心化的方法,通过利用分布式数据结构来共享状态,机器人在间接通信时自主行为。我们使用数据网格概念提供的分布式数据结构,如分布式锁、集合和地图,为机器人之间的通信提供了一种机制,而无需开发新的特定于应用程序的协议。据我们所知,内存数据网格(IMDG)的使用在多机器人系统领域是新的。我们相信它可以为简化机器人之间的通信提供一个有前景的解决方案。在本文中,我们提出了一种利用IMDG的物体运输协调运动控制策略的设计。最后,我们使用真实的模拟器演示了我们的结果,该模拟器显示了我们的方法在各种环境中的可行性。
{"title":"A data grid strategy for non-prehensile object transport by a multi-robot system","authors":"Priyank Narvekar,&nbsp;Andrew Vardy","doi":"10.1007/s10015-023-00908-5","DOIUrl":"10.1007/s10015-023-00908-5","url":null,"abstract":"<div><p>In this paper, we propose a control strategy for non-prehensile object transport using a multi-robot system. While an object can be unmanageable for a single robot to push and transport, we demonstrate via simulations that a team of cooperative robots can be used to transport such an object. The proposed control strategy is divided into two phases: caging and cooperative transport. In the first phase, the robots start from arbitrary positions and then approach the object to be transported, forming a cage around it. The second phase consists of cooperatively transporting the object ensuring it remains caged during transport. In the proposed strategy, the robots take a decentralized approach where robots behave autonomously while being in indirect communication by leveraging distributed data structures to share their state. Our use of distributed data structures like distributed locks, sets, and maps offered by the data grid concept provides a mechanism for inter-robot communication without development of a new application-specific protocol. To our knowledge, the use of in-memory data grid (IMDG) is new to the field of multi-robot systems. We believe it could provide a promising solution to simplify inter-robot communication. In this paper, we present our design for a coordinated motion control strategy for object transport leveraging IMDG. Finally, we demonstrate our results using a realistic simulator that shows the feasibility of our approach in various environments.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"28 4","pages":"680 - 689"},"PeriodicalIF":0.9,"publicationDate":"2023-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71910335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An evolutionary robotics approach to a multi-legged robotic swarm in a rough terrain environment 粗糙地形环境中多足机器人群的进化机器人方法
IF 0.9 Q4 ROBOTICS Pub Date : 2023-10-21 DOI: 10.1007/s10015-023-00906-7
Daichi Morimoto, Haruhi Tsukamoto, Motoaki Hiraga, Kazuhiro Ohkura, Masaharu Munetomo

This paper demonstrates a controller design of a multi-legged robotic swarm in a rough terrain environment. Many studies in swarm robotics are conducted with mobile robots that work in relatively flat fields. This paper focuses on a multi-legged robotic swarm, which is expected to operate not only in a flat field but also in rough terrain environments. However, designing a robot controller becomes a challenging problem because a designer has to consider how to coordinate a large number of joints in a robot, besides the complexity of a swarm problem. This paper employed an evolutionary robotics approach for the automatic design of a robot controller. The experiments were conducted by computer simulations with the path formation task. The results showed that the proposed approach succeeds in generating collective behavior in flat and rough terrain environments.

本文演示了在崎岖地形环境中多足机器人群的控制器设计。群体机器人的许多研究都是用在相对平坦的领域工作的移动机器人进行的。本文重点研究了一种多足机器人群,它不仅可以在平坦的场地上工作,还可以在崎岖的地形环境中工作。然而,设计机器人控制器成为一个具有挑战性的问题,因为除了群体问题的复杂性外,设计师还必须考虑如何协调机器人中的大量关节。本文采用进化机器人方法进行机器人控制器的自动设计。实验是通过路径形成任务的计算机模拟进行的。结果表明,该方法能够成功地在平坦和粗糙的地形环境中生成集体行为。
{"title":"An evolutionary robotics approach to a multi-legged robotic swarm in a rough terrain environment","authors":"Daichi Morimoto,&nbsp;Haruhi Tsukamoto,&nbsp;Motoaki Hiraga,&nbsp;Kazuhiro Ohkura,&nbsp;Masaharu Munetomo","doi":"10.1007/s10015-023-00906-7","DOIUrl":"10.1007/s10015-023-00906-7","url":null,"abstract":"<div><p>This paper demonstrates a controller design of a multi-legged robotic swarm in a rough terrain environment. Many studies in swarm robotics are conducted with mobile robots that work in relatively flat fields. This paper focuses on a multi-legged robotic swarm, which is expected to operate not only in a flat field but also in rough terrain environments. However, designing a robot controller becomes a challenging problem because a designer has to consider how to coordinate a large number of joints in a robot, besides the complexity of a swarm problem. This paper employed an evolutionary robotics approach for the automatic design of a robot controller. The experiments were conducted by computer simulations with the path formation task. The results showed that the proposed approach succeeds in generating collective behavior in flat and rough terrain environments.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"28 4","pages":"661 - 668"},"PeriodicalIF":0.9,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71910212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing multi-agent adversarial environment using reinforcement learning and imitation learning 利用强化学习和模仿学习开发多智能体对抗环境
IF 0.9 Q4 ROBOTICS Pub Date : 2023-10-17 DOI: 10.1007/s10015-023-00912-9
Ziyao Han, Yupeng Liang, Kazuhiro Ohkura

A multi-agent system is a collection of autonomous, interacting agents that share a common environment. These entities observe their environment using sensors and interact with the environment. A multi-agent system that develops cooperative strategies by reinforcement learning does not perform well, mostly because of the sparse reward problem. This study conducts a 3D environment in which robots play the beach volleyball game. This study combines imitation learning (IL) with reinforcement learning (RL) to solve the sparse reward problem. The results show that the proposed approach gets a higher score in the Elo rating system and robots perform better than the conventional RL approach.

多智能体系统是共享公共环境的自主、交互的智能体的集合。这些实体使用传感器来观察它们的环境,并与环境进行交互。通过强化学习开发合作策略的多智能体系统表现不佳,主要是因为稀疏奖励问题。这项研究进行了一个3D环境,机器人在其中玩沙滩排球游戏。本研究将模仿学习(IL)与强化学习(RL)相结合来解决稀疏奖励问题。结果表明,该方法在Elo评级系统中获得了更高的分数,机器人的性能也优于传统的RL方法。
{"title":"Developing multi-agent adversarial environment using reinforcement learning and imitation learning","authors":"Ziyao Han,&nbsp;Yupeng Liang,&nbsp;Kazuhiro Ohkura","doi":"10.1007/s10015-023-00912-9","DOIUrl":"10.1007/s10015-023-00912-9","url":null,"abstract":"<div><p>A multi-agent system is a collection of autonomous, interacting agents that share a common environment. These entities observe their environment using sensors and interact with the environment. A multi-agent system that develops cooperative strategies by reinforcement learning does not perform well, mostly because of the sparse reward problem. This study conducts a 3D environment in which robots play the beach volleyball game. This study combines imitation learning (IL) with reinforcement learning (RL) to solve the sparse reward problem. The results show that the proposed approach gets a higher score in the Elo rating system and robots perform better than the conventional RL approach.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"28 4","pages":"703 - 709"},"PeriodicalIF":0.9,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71910281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of methods for estimating autonomic nervous activity using a web camera 使用网络摄像机评估自主神经活动的方法
IF 0.9 Q4 ROBOTICS Pub Date : 2023-10-17 DOI: 10.1007/s10015-023-00897-5
Miku Shimizu, Yu Matsumoto, Naoaki Itakura, Kuzuyuki Mito, Tota Mizuno

There is an increasing need for methods to estimate autonomic nerve activity, such as using autonomic nerve activity as an indicator of stress and to improve the activity environment, such that people can live more comfortably. In a previous study, a method for estimating autonomic nervous activity using facial thermal images was established. Such activity was evaluated by obtaining the differential temperature of the nasal region, which is a sympathetic index of autonomic nervous activity, and the less-affected forehead region. However, this method requires the use of an expensive far-infrared camera, which is difficult to obtain and is cited as a problem. Another study suggested acquiring pulse waves and heartbeats by obtaining changes in blood flow from the heart using real facial images. This was obtained using independent component analysis for each Red–Green–Blue (RGB [color model]) component value of the real image. However, the problem with this method is that it cannot evaluate autonomic nerve activity, such as thermal images, because it cannot examine changes in the blood flow in peripheral blood vessels. Therefore, in this study, a method for estimating autonomic nerve activity is proposed, with the same accuracy as thermal images, by obtaining changes in peripheral blood flow from real images taken with an easily usable web camera. To obtain the changes in peripheral blood flow from real images, we used the property that the incident depth of light entering the skin differs depending on the color component. By considering the difference between the R component (which enters the skin at the deepest depth) and the B component (which is almost reflected by the epidermis), we assumed that we could capture the blood flow in the widest range and measure the change in blood flow in the peripheral vasculature. To cause unpleasant irritation, an experiment was conducted in which participants performed a randomly assigned memorization task for 10 min. A rest period of 1 min was provided before and after the mental calculation task, and a subjective evaluation questionnaire was administered during the rest period and before the mental calculation task. The results showed that some subjects exhibited a significant decrease in the R-B component values when they noticed calculation errors, whereas others exhibited an increase in the R-B component values after completing the memorization task. Also, some subjects showed a correspondence between the variation of R-B component values and the results of the questionnaire. Additionally, compared to the conventional method, it was clear that we could obtain real-time and even fine variations in response to event switching. These results suggest that it is possible to evaluate autonomic nervous system activity from real image data to the same extent as from thermal images.

人们越来越需要估计自主神经活动的方法,例如使用自主神经活动作为压力的指标,并改善活动环境,使人们能够生活得更舒适。在之前的一项研究中,建立了一种使用面部热图像估计自主神经活动的方法。通过获得鼻腔区域和受影响较小的前额区域的温差来评估这种活动,鼻腔区域是自主神经活动的交感指数。然而,这种方法需要使用昂贵的远红外相机,这很难获得,并且被认为是一个问题。另一项研究建议,通过使用真实的面部图像获取心脏血流的变化来获取脉搏波和心跳。这是使用真实图像的每个红-绿-蓝(RGB[颜色模型])分量值的独立分量分析获得的。然而,这种方法的问题是,它无法评估自主神经活动,如热图像,因为它无法检查外周血管中血流的变化。因此,在这项研究中,提出了一种估计自主神经活动的方法,其精度与热图像相同,方法是从使用易于使用的网络相机拍摄的真实图像中获得外周血流量的变化。为了从真实图像中获得外周血流量的变化,我们使用了进入皮肤的光的入射深度根据颜色成分而不同的特性。通过考虑R成分(在最深的深度进入皮肤)和B成分(几乎被表皮反射)之间的差异,我们假设我们可以在最宽的范围内捕捉血流,并测量外周血管系统中血流的变化。为了引起不愉快的刺激,进行了一项实验,参与者执行随机分配的记忆任务10分钟。在心理计算任务前后提供1分钟的休息时间,并在休息时间和心理计算任务之前进行主观评估问卷。结果表明,当一些受试者注意到计算错误时,他们的R-B分量值显著降低,而另一些受试在完成记忆任务后,他们的R-B分量值增加。此外,一些受试者表现出R-B成分值的变化与问卷结果之间的对应关系。此外,与传统方法相比,很明显,我们可以获得响应事件切换的实时甚至精细变化。这些结果表明,从真实图像数据中评估自主神经系统活动的程度与从热图像中评估的程度相同是可能的。
{"title":"Evaluation of methods for estimating autonomic nervous activity using a web camera","authors":"Miku Shimizu,&nbsp;Yu Matsumoto,&nbsp;Naoaki Itakura,&nbsp;Kuzuyuki Mito,&nbsp;Tota Mizuno","doi":"10.1007/s10015-023-00897-5","DOIUrl":"10.1007/s10015-023-00897-5","url":null,"abstract":"<div><p>There is an increasing need for methods to estimate autonomic nerve activity, such as using autonomic nerve activity as an indicator of stress and to improve the activity environment, such that people can live more comfortably. In a previous study, a method for estimating autonomic nervous activity using facial thermal images was established. Such activity was evaluated by obtaining the differential temperature of the nasal region, which is a sympathetic index of autonomic nervous activity, and the less-affected forehead region. However, this method requires the use of an expensive far-infrared camera, which is difficult to obtain and is cited as a problem. Another study suggested acquiring pulse waves and heartbeats by obtaining changes in blood flow from the heart using real facial images. This was obtained using independent component analysis for each Red–Green–Blue (RGB [color model]) component value of the real image. However, the problem with this method is that it cannot evaluate autonomic nerve activity, such as thermal images, because it cannot examine changes in the blood flow in peripheral blood vessels. Therefore, in this study, a method for estimating autonomic nerve activity is proposed, with the same accuracy as thermal images, by obtaining changes in peripheral blood flow from real images taken with an easily usable web camera. To obtain the changes in peripheral blood flow from real images, we used the property that the incident depth of light entering the skin differs depending on the color component. By considering the difference between the R component (which enters the skin at the deepest depth) and the B component (which is almost reflected by the epidermis), we assumed that we could capture the blood flow in the widest range and measure the change in blood flow in the peripheral vasculature. To cause unpleasant irritation, an experiment was conducted in which participants performed a randomly assigned memorization task for 10 min. A rest period of 1 min was provided before and after the mental calculation task, and a subjective evaluation questionnaire was administered during the rest period and before the mental calculation task. The results showed that some subjects exhibited a significant decrease in the R-B component values when they noticed calculation errors, whereas others exhibited an increase in the R-B component values after completing the memorization task. Also, some subjects showed a correspondence between the variation of R-B component values and the results of the questionnaire. Additionally, compared to the conventional method, it was clear that we could obtain real-time and even fine variations in response to event switching. These results suggest that it is possible to evaluate autonomic nervous system activity from real image data to the same extent as from thermal images.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"28 4","pages":"718 - 725"},"PeriodicalIF":0.9,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71910282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Artificial Life and Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1