首页 > 最新文献

Robotics and Autonomous Systems最新文献

英文 中文
Learning latent causal factors from the intricate sensor feedback of contact-rich robotic assembly tasks 从接触丰富的机器人装配任务的复杂传感器反馈中学习潜在因果因素
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-11-09 DOI: 10.1016/j.robot.2024.104832
Yurou Chen , Jiyang Yu , Zhenyang Lin , Liancheng Shen , Zhiyong Liu
Achieving precise robotic assembly is paramount for safety and performance in industrial settings. Conventional assembly methods require tedious manual adjustment of many parameters, and it is challenging to meet the assembly requirements with tight clearance. Robot learning has been at the forefront of research, showing potential for automation and intelligence in robotic operations. However, intricate information such as force feedback is indispensable for high-precision robot assembly tasks, and current learning methods grapple with processing this complex observation data due to discontinuous force changes during operation and the inherent noise from the force sensor. To enhance learning efficiency amidst challenging observations, this paper proposes introducing the concept of latent causal factors that drive sensor observations and hold paramount significance in assembly tasks. This paper analyses the impact of discontinuous and noisy observations and offers two ways to infer causal factors. Based on the implied latent factors, we propose a method that learns high-precision assembly policies from interacting with the environment. The algorithm’s performance is evaluated in simulated and real-world nut insertion environments, demonstrating significant improvements over the previous methods. This research also underscores the promise of causal inference in addressing industrial challenges.
在工业环境中,实现精确的机器人装配对安全和性能至关重要。传统的装配方法需要对许多参数进行繁琐的手动调整,而且要在间隙很小的情况下满足装配要求具有挑战性。机器人学习一直处于研究前沿,显示出机器人操作自动化和智能化的潜力。然而,力反馈等复杂信息是高精度机器人装配任务中不可或缺的,由于操作过程中力的不连续变化以及力传感器固有的噪声,目前的学习方法在处理这些复杂的观察数据时困难重重。为了在具有挑战性的观测中提高学习效率,本文提出引入潜在因果因素的概念,这些因果因素驱动着传感器的观测,在装配任务中具有极其重要的意义。本文分析了不连续和噪声观测的影响,并提供了两种推断因果因素的方法。基于隐含的潜在因素,我们提出了一种从与环境的交互中学习高精度装配策略的方法。我们在模拟和真实的螺母插入环境中对该算法的性能进行了评估,结果表明它比以前的方法有了显著的改进。这项研究还强调了因果推理在应对工业挑战方面的前景。
{"title":"Learning latent causal factors from the intricate sensor feedback of contact-rich robotic assembly tasks","authors":"Yurou Chen ,&nbsp;Jiyang Yu ,&nbsp;Zhenyang Lin ,&nbsp;Liancheng Shen ,&nbsp;Zhiyong Liu","doi":"10.1016/j.robot.2024.104832","DOIUrl":"10.1016/j.robot.2024.104832","url":null,"abstract":"<div><div>Achieving precise robotic assembly is paramount for safety and performance in industrial settings. Conventional assembly methods require tedious manual adjustment of many parameters, and it is challenging to meet the assembly requirements with tight clearance. Robot learning has been at the forefront of research, showing potential for automation and intelligence in robotic operations. However, intricate information such as force feedback is indispensable for high-precision robot assembly tasks, and current learning methods grapple with processing this complex observation data due to discontinuous force changes during operation and the inherent noise from the force sensor. To enhance learning efficiency amidst challenging observations, this paper proposes introducing the concept of latent causal factors that drive sensor observations and hold paramount significance in assembly tasks. This paper analyses the impact of discontinuous and noisy observations and offers two ways to infer causal factors. Based on the implied latent factors, we propose a method that learns high-precision assembly policies from interacting with the environment. The algorithm’s performance is evaluated in simulated and real-world nut insertion environments, demonstrating significant improvements over the previous methods. This research also underscores the promise of causal inference in addressing industrial challenges.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104832"},"PeriodicalIF":4.3,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142658821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A sensorless approach for cable failure detection and identification in cable-driven parallel robots 用于电缆驱动并联机器人电缆故障检测和识别的无传感器方法
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-11-09 DOI: 10.1016/j.robot.2024.104855
Giovanni Boschetti , Riccardo Minto
Cable-driven parallel robots (CDPRs) are a particular class of parallel robots that provide several advantages that may well be received in the industrial field. However, the risk of damage due to cable failure is not negligible, thus procedures that move the end-effector to a safe pose after failure are required. This work aims to provide a sensorless failure detection and identification strategy to properly recognize the cable failure event without adding additional devices. This approach is paired with an end-effector recovery strategy to move the end-effector towards a safe position, thus providing for a complete cable failure recovery strategy, which detects the failure event and controls the end-effector accordingly. The proposed strategy is tested on a cable-driven suspended parallel robot prototype composed of industrial-grade components. The experimental results show the feasibility of the proposed approach.
电缆驱动并联机器人(CDPRs)是一类特殊的并联机器人,具有多种优势,在工业领域很受欢迎。然而,电缆故障造成损坏的风险不容忽视,因此需要在故障发生后将末端执行器移动到安全位置。这项工作旨在提供一种无传感器故障检测和识别策略,在不增加额外设备的情况下正确识别电缆故障事件。该方法与末端执行器恢复策略相配合,可将末端执行器移至安全位置,从而提供完整的电缆故障恢复策略,该策略可检测故障事件并相应地控制末端执行器。我们在一个由工业级组件组成的缆索驱动悬挂并联机器人原型上测试了所提出的策略。实验结果表明了所提方法的可行性。
{"title":"A sensorless approach for cable failure detection and identification in cable-driven parallel robots","authors":"Giovanni Boschetti ,&nbsp;Riccardo Minto","doi":"10.1016/j.robot.2024.104855","DOIUrl":"10.1016/j.robot.2024.104855","url":null,"abstract":"<div><div>Cable-driven parallel robots (CDPRs) are a particular class of parallel robots that provide several advantages that may well be received in the industrial field. However, the risk of damage due to cable failure is not negligible, thus procedures that move the end-effector to a safe pose after failure are required. This work aims to provide a sensorless failure detection and identification strategy to properly recognize the cable failure event without adding additional devices. This approach is paired with an end-effector recovery strategy to move the end-effector towards a safe position, thus providing for a complete cable failure recovery strategy, which detects the failure event and controls the end-effector accordingly. The proposed strategy is tested on a cable-driven suspended parallel robot prototype composed of industrial-grade components. The experimental results show the feasibility of the proposed approach.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104855"},"PeriodicalIF":4.3,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142658820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GPS-free autonomous navigation in cluttered tree rows with deep semantic segmentation 利用深度语义分割技术在杂乱树行中实现无 GPS 自主导航
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-11-08 DOI: 10.1016/j.robot.2024.104854
Alessandro Navone, Mauro Martini, Marco Ambrosio, Andrea Ostuni, Simone Angarano, Marcello Chiaberge
Segmentation-based autonomous navigation has recently been presented as an appealing approach to guiding robotic platforms through crop rows without requiring perfect GPS localization. Nevertheless, current techniques are restricted to situations where the distinct separation between the plants and the sky allows for the identification of the row’s center. However, tall, dense vegetation, such as high tree rows and orchards, is the primary cause of GPS signal blockage. In this study, we increase the overall robustness and adaptability of the control algorithm by extending the segmentation-based robotic guiding to those cases where canopies and branches occlude the sky and prevent the utilization of GPS and earlier approaches. An efficient Deep Neural Network architecture has been used to address semantic segmentation, performing the training with synthetic data only. Numerous vineyards and tree fields have undergone extensive testing in both simulation and real world to show the solution’s competitive benefits. The system achieved unseen results in orchards, with a Mean Average Error smaller than 9% of the maximum width of each row, improving state-of-the-art algorithms by disclosing new scenarios such as close canopy crops. The official code can be found at: https://github.com/PIC4SeR/SegMinNavigation.git.
最近,基于分段的自主导航技术被认为是一种极具吸引力的方法,它可以引导机器人平台穿过作物行,而无需完美的 GPS 定位。不过,目前的技术仅限于植物与天空之间的明显分隔可以识别作物行中心的情况。然而,高大茂密的植被,如高树行和果园,是 GPS 信号受阻的主要原因。在本研究中,我们通过将基于分割的机器人引导扩展到树冠和树枝遮挡天空并妨碍利用 GPS 和早期方法的情况,提高了控制算法的整体鲁棒性和适应性。我们采用了高效的深度神经网络架构来解决语义分割问题,只使用合成数据进行训练。在模拟和现实世界中,对大量葡萄园和树田进行了广泛测试,以显示该解决方案的竞争优势。该系统在果园中取得了前所未有的成果,平均误差小于每行最大宽度的 9%,通过揭示新的应用场景(如近树冠作物)改进了最先进的算法。正式代码见:https://github.com/PIC4SeR/SegMinNavigation.git。
{"title":"GPS-free autonomous navigation in cluttered tree rows with deep semantic segmentation","authors":"Alessandro Navone,&nbsp;Mauro Martini,&nbsp;Marco Ambrosio,&nbsp;Andrea Ostuni,&nbsp;Simone Angarano,&nbsp;Marcello Chiaberge","doi":"10.1016/j.robot.2024.104854","DOIUrl":"10.1016/j.robot.2024.104854","url":null,"abstract":"<div><div>Segmentation-based autonomous navigation has recently been presented as an appealing approach to guiding robotic platforms through crop rows without requiring perfect GPS localization. Nevertheless, current techniques are restricted to situations where the distinct separation between the plants and the sky allows for the identification of the row’s center. However, tall, dense vegetation, such as high tree rows and orchards, is the primary cause of GPS signal blockage. In this study, we increase the overall robustness and adaptability of the control algorithm by extending the segmentation-based robotic guiding to those cases where canopies and branches occlude the sky and prevent the utilization of GPS and earlier approaches. An efficient Deep Neural Network architecture has been used to address semantic segmentation, performing the training with synthetic data only. Numerous vineyards and tree fields have undergone extensive testing in both simulation and real world to show the solution’s competitive benefits. The system achieved unseen results in orchards, with a Mean Average Error smaller than 9% of the maximum width of each row, improving state-of-the-art algorithms by disclosing new scenarios such as close canopy crops. The official code can be found at: <span><span>https://github.com/PIC4SeR/SegMinNavigation.git</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104854"},"PeriodicalIF":4.3,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142658818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust trajectory tracking for omnidirectional robots by means of anti-peaking linear active disturbance rejection 利用反发音线性主动干扰抑制技术实现全向机器人的鲁棒轨迹跟踪
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-31 DOI: 10.1016/j.robot.2024.104842
Mario Ramírez-Neria , Rafal Madonski , Eduardo Gamaliel Hernández-Martínez , Norma Lozada-Castillo , Guillermo Fernández-Anaya , Alberto Luviano-Juárez
This article presents a Linear Active Disturbance Rejection scheme for the robust trajectory tracking control of an Omnidirectional robot, including an additional saturation element in the control design to improve the transient closed-loop response by including a saturation-input strategy in the Extended State Observer design, mitigating the possible arising peaking phenomenon. In addition, the controller is implemented in the kinematic model of the robotic system, assuming as the available information the position and orientation measurement and concerning the system structure, it is just known the order of the system and the control gain matrix as well. A wide set of laboratory experiments, including a comparison with a standard ADRC (i.e. without the proposed anti-peaking mechanism) and a PI-based control including an anti-peaking proposal, in the presence of different disturbance elements in the terrain of smooth and abrupt nature is carried out to formulate a comprehensive assessment of the proposal which validate the practical advantages of the proposal in robust trajectory tracking of the kind of robots.
本文提出了一种线性主动干扰抑制方案,用于全向机器人的鲁棒轨迹跟踪控制,在控制设计中加入了额外的饱和元素,通过在扩展状态观测器设计中加入饱和输入策略来改善瞬态闭环响应,缓解可能出现的峰值现象。此外,控制器是在机器人系统的运动学模型中实现的,假定位置和方向测量为可用信息,关于系统结构,只知道系统的阶次和控制增益矩阵。通过大量的实验室实验,包括与标准 ADRC(即不含提议的防抖动机制)和基于 PI 的控制(包括防抖动提议)的比较,在平滑和突变地形中存在不同干扰因素的情况下,对该提议进行了全面评估,验证了该提议在机器人稳健轨迹跟踪方面的实际优势。
{"title":"Robust trajectory tracking for omnidirectional robots by means of anti-peaking linear active disturbance rejection","authors":"Mario Ramírez-Neria ,&nbsp;Rafal Madonski ,&nbsp;Eduardo Gamaliel Hernández-Martínez ,&nbsp;Norma Lozada-Castillo ,&nbsp;Guillermo Fernández-Anaya ,&nbsp;Alberto Luviano-Juárez","doi":"10.1016/j.robot.2024.104842","DOIUrl":"10.1016/j.robot.2024.104842","url":null,"abstract":"<div><div>This article presents a Linear Active Disturbance Rejection scheme for the robust trajectory tracking control of an Omnidirectional robot, including an additional saturation element in the control design to improve the transient closed-loop response by including a saturation-input strategy in the Extended State Observer design, mitigating the possible arising peaking phenomenon. In addition, the controller is implemented in the kinematic model of the robotic system, assuming as the available information the position and orientation measurement and concerning the system structure, it is just known the order of the system and the control gain matrix as well. A wide set of laboratory experiments, including a comparison with a standard ADRC (<em>i.e</em>. without the proposed anti-peaking mechanism) and a PI-based control including an anti-peaking proposal, in the presence of different disturbance elements in the terrain of smooth and abrupt nature is carried out to formulate a comprehensive assessment of the proposal which validate the practical advantages of the proposal in robust trajectory tracking of the kind of robots.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104842"},"PeriodicalIF":4.3,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142586364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
YOLO with feature enhancement and its application in intelligent assembly 增强功能的 YOLO 及其在智能装配中的应用
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-30 DOI: 10.1016/j.robot.2024.104844
Fenglei Zheng , Aijun Yin , Chuande Zhou
Object detection is the most important part in intelligent assembly tasks, accurate and fast detection for different targets can complete positioning and assembly tasks more automatically and efficiently. In this paper, a feature enhancement object detection model based on YOLO is proposed. Firstly, the expression ability of feature layer is enhanced through RFP (Recursive Feature Pyramid) structure. The ARSPP (Atrous Residual Spatial Pyramid Pooling) is proposed to have a further enhancement for the feature layers output by the backbone network, it improves the recognition performance for multi-scale targets of model by using different size of dilated convolution and residual connection. Finally, the contiguous pyramid features are fused and enhanced through the attention mechanism, the results are used for the input of next recursive or predictive output. The model proposed in this paper effectively improves the detection accuracy of YOLO, it has 3% MAP improvement in PASCAL VOC dataset. The validity and accuracy of the model are verified in the robot intelligent assembly recognition task.
物体检测是智能装配任务中最重要的一环,准确、快速地检测不同目标可以更自动、更高效地完成定位和装配任务。本文提出了一种基于 YOLO 的特征增强物体检测模型。首先,通过 RFP(递归特征金字塔)结构增强特征层的表达能力。为了进一步增强骨干网络输出的特征层,本文提出了 ARSPP(Atrous Residual Spatial Pyramid Pooling),通过使用不同大小的扩张卷积和残差连接,提高了模型对多尺度目标的识别性能。最后,通过注意力机制对连续的金字塔特征进行融合和增强,并将结果用于下一次递归或预测输出的输入。本文提出的模型有效地提高了 YOLO 的检测精度,在 PASCAL VOC 数据集中的 MAP 提高了 3%。该模型的有效性和准确性在机器人智能装配识别任务中得到了验证。
{"title":"YOLO with feature enhancement and its application in intelligent assembly","authors":"Fenglei Zheng ,&nbsp;Aijun Yin ,&nbsp;Chuande Zhou","doi":"10.1016/j.robot.2024.104844","DOIUrl":"10.1016/j.robot.2024.104844","url":null,"abstract":"<div><div>Object detection is the most important part in intelligent assembly tasks, accurate and fast detection for different targets can complete positioning and assembly tasks more automatically and efficiently. In this paper, a feature enhancement object detection model based on YOLO is proposed. Firstly, the expression ability of feature layer is enhanced through RFP (Recursive Feature Pyramid) structure. The ARSPP (Atrous Residual Spatial Pyramid Pooling) is proposed to have a further enhancement for the feature layers output by the backbone network, it improves the recognition performance for multi-scale targets of model by using different size of dilated convolution and residual connection. Finally, the contiguous pyramid features are fused and enhanced through the attention mechanism, the results are used for the input of next recursive or predictive output. The model proposed in this paper effectively improves the detection accuracy of YOLO, it has 3% MAP improvement in PASCAL VOC dataset. The validity and accuracy of the model are verified in the robot intelligent assembly recognition task.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104844"},"PeriodicalIF":4.3,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142578893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Local obstacle avoidance control for multi-axle and multi-steering-mode wheeled robot based on window-zone division strategy 基于窗区划分策略的多轴和多转向模式轮式机器人局部避障控制
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-28 DOI: 10.1016/j.robot.2024.104843
Yongqiang Zhu , Junru Zhu , Pingxia Zhang
Due to the length of the body, multiple number of wheels and the complexity of controlling, it is difficult for a multi-axle wheeled robot to avoid obstacles autonomously in narrow space. To solve this problem, this article presents window-zone division and gap-seeking strategies for local obstacle avoidance of a multi-axle multi-steering-mode all-wheel-steering wheeled robot. Firstly, according to the influence degree of lidar points on the robot, combining with the human driving characteristics of avoiding obstacles, a window-zone division strategy is proposed. The lidar points are selected and divided according to the degree of emergency. By eliminating irrelevant points, the work of obstacle avoidance calculation is reduced. Thus, this increases the response speed of obstacle avoidance. Based on this, the robot uses a multi-steering-mode to avoid emergency obstacle. Secondly, the gap-seeking theory of normal obstacle avoidance is proposed. It can seek the passable gap among the surrounding lidar points according to the prediction of the robot's driving trajectory corresponding to different steering angles. Thirdly, the on-board control system and the upper computer program of the robot were designed. Thereafter a multi-steering-mode algorithm was designed based on the front and rear wheel steering angles and speed, as well as the travel trajectory forecast-drawing module. Finally, the proposed methods have been implemented on a five-axle all-wheel steering wheeled robot. Some obstacle avoidance experiments are carried out with S-shaped, Z-Shaped, U-Shaped, and Random obstacle distribution. The results show that the proposed strategy can finish all obstacle avoidance successfully.
由于车身长、轮子多、控制复杂,多轴轮式机器人很难在狭窄空间内自主避障。为解决这一问题,本文提出了多轴多转向模式全轮转向轮式机器人局部避障的窗区划分和间隙寻找策略。首先,根据激光雷达点对机器人的影响程度,结合人类驾驶避障的特点,提出了窗口区域划分策略。根据紧急程度对激光雷达点进行选择和划分。通过剔除无关点,减少了避障计算的工作量。因此,这提高了避障响应速度。在此基础上,机器人采用多转向模式避开紧急障碍物。其次,提出了正常避障的间隙寻找理论。它可以根据不同转向角度对应的机器人行驶轨迹预测,在周围激光雷达点中寻找可通过的间隙。第三,设计了机器人的车载控制系统和上位机程序。之后,设计了基于前后轮转向角和速度的多转向模式算法,以及行驶轨迹预测绘制模块。最后,在一个五轴全轮转向轮式机器人上实现了所提出的方法。在 S 形、Z 形、U 形和随机障碍物分布情况下,进行了一些避障实验。结果表明,所提出的策略可以成功完成所有障碍物的避让。
{"title":"Local obstacle avoidance control for multi-axle and multi-steering-mode wheeled robot based on window-zone division strategy","authors":"Yongqiang Zhu ,&nbsp;Junru Zhu ,&nbsp;Pingxia Zhang","doi":"10.1016/j.robot.2024.104843","DOIUrl":"10.1016/j.robot.2024.104843","url":null,"abstract":"<div><div>Due to the length of the body, multiple number of wheels and the complexity of controlling, it is difficult for a multi-axle wheeled robot to avoid obstacles autonomously in narrow space. To solve this problem, this article presents window-zone division and gap-seeking strategies for local obstacle avoidance of a multi-axle multi-steering-mode all-wheel-steering wheeled robot. Firstly, according to the influence degree of lidar points on the robot, combining with the human driving characteristics of avoiding obstacles, a window-zone division strategy is proposed. The lidar points are selected and divided according to the degree of emergency. By eliminating irrelevant points, the work of obstacle avoidance calculation is reduced. Thus, this increases the response speed of obstacle avoidance. Based on this, the robot uses a multi-steering-mode to avoid emergency obstacle. Secondly, the gap-seeking theory of normal obstacle avoidance is proposed. It can seek the passable gap among the surrounding lidar points according to the prediction of the robot's driving trajectory corresponding to different steering angles. Thirdly, the on-board control system and the upper computer program of the robot were designed. Thereafter a multi-steering-mode algorithm was designed based on the front and rear wheel steering angles and speed, as well as the travel trajectory forecast-drawing module. Finally, the proposed methods have been implemented on a five-axle all-wheel steering wheeled robot. Some obstacle avoidance experiments are carried out with S-shaped, Z-Shaped, U-Shaped, and Random obstacle distribution. The results show that the proposed strategy can finish all obstacle avoidance successfully.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104843"},"PeriodicalIF":4.3,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142572217","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fractional-order sliding mode control of manipulator combined with disturbance and state observer 与干扰和状态观测器相结合的机械手分数阶滑动模式控制
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-28 DOI: 10.1016/j.robot.2024.104840
Jinghui Pan
A fractional-order sliding mode control (FSMC) method for a manipulator based on disturbance and state observers is proposed. First, a state estimator is designed that can estimate the velocity and acceleration, and only joint position feedback and the mathematical model of the manipulator are needed. The state estimator converges in finite time. Then, the disturbance observer is designed. By designing the nominal system model of the manipulator, a disturbance observation error is introduced into the closed-loop control so that the performance of the manipulator can track the nominal system. Finally, a sliding mode controller (SMC) based on the fractional differential operator theory is also designed. The value of the sliding mode variable in the derivation of the controller is composed of the fractional derivative of the trajectory tracking error of the manipulator, whereas the fractional differentiation operation uses integration in its realization, and the integration is a low-pass filter, thus, high-frequency noise is suppressed. In the experimental section, the method designed is compared with the conventional sliding mode, which further reveals the rapidity and control accuracy of FSMC.
本文提出了一种基于扰动和状态观测器的机械手分数阶滑动模态控制(FSMC)方法。首先,设计了一个能估计速度和加速度的状态估计器,只需要关节位置反馈和机械手的数学模型。状态估计器在有限时间内收敛。然后,设计干扰观测器。通过设计机械手的标称系统模型,在闭环控制中引入干扰观测误差,使机械手的性能能够跟踪标称系统。最后,还设计了基于分数微分算子理论的滑动模式控制器(SMC)。控制器推导过程中的滑模变量值由机械手轨迹跟踪误差的分数导数组成,而分数微分运算在实现过程中使用积分,积分是低通滤波器,因此可以抑制高频噪声。在实验部分,将所设计的方法与传统的滑动模式进行了比较,进一步揭示了 FSMC 的快速性和控制精度。
{"title":"Fractional-order sliding mode control of manipulator combined with disturbance and state observer","authors":"Jinghui Pan","doi":"10.1016/j.robot.2024.104840","DOIUrl":"10.1016/j.robot.2024.104840","url":null,"abstract":"<div><div>A fractional-order sliding mode control (FSMC) method for a manipulator based on disturbance and state observers is proposed. First, a state estimator is designed that can estimate the velocity and acceleration, and only joint position feedback and the mathematical model of the manipulator are needed. The state estimator converges in finite time. Then, the disturbance observer is designed. By designing the nominal system model of the manipulator, a disturbance observation error is introduced into the closed-loop control so that the performance of the manipulator can track the nominal system. Finally, a sliding mode controller (SMC) based on the fractional differential operator theory is also designed. The value of the sliding mode variable in the derivation of the controller is composed of the fractional derivative of the trajectory tracking error of the manipulator, whereas the fractional differentiation operation uses integration in its realization, and the integration is a low-pass filter, thus, high-frequency noise is suppressed. In the experimental section, the method designed is compared with the conventional sliding mode, which further reveals the rapidity and control accuracy of FSMC.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104840"},"PeriodicalIF":4.3,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142572216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An explainable deep learning model for automated classification and localization of microrobots by functionality using ultrasound images 利用超声波图像对微型机器人进行功能性自动分类和定位的可解释深度学习模型
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-25 DOI: 10.1016/j.robot.2024.104841
Ferhat Sadak
The rapid advancements of untethered microrobots offer exciting opportunities in fields such as targeted drug delivery and minimally invasive surgical procedures. However, several challenges remain, especially in achieving precise localization and classification of microrobots within living organisms using ultrasound (US) imaging. Current US-based detection algorithms often suffer from inaccurate visual feedback, causing positioning errors. This paper presents a novel explainable deep learning model for the localization and classification of eight different types of microrobots using US images. We introduce the Attention-Fused Bottleneck Module (AFBM), which enhances feature extraction and improves the performance of microrobot classification and localization tasks. Our model consistently outperforms baseline models such as YOLOR, YOLOv5-C3HB, YOLOv5-TBH, YOLOv5 m, and YOLOv7. The proposed model achieved mean Average Precision (mAP) of 0.861 and 0.909 at an IoU threshold of 0.95 which is 2% and 1.5% higher than the YOLOv5 m model in training and testing, respectively. Multi-thresh IoU analysis was performed at IoU thresholds of 0.6, 0.75, and 0.95, and demonstrated that the microrobot localization accuracy of our model is superior. A robustness analysis was performed based on high and low frequencies, gain, and speckle in our test data set, and our model demonstrated higher overall accuracy. UsingScore-CAM in our framework enhances interpretability, allowing for transparent insights into the model’s decision-making process. Our work signifies a notable advancement in microrobot classification and detection, with potential applications in real-world scenarios using the newly available USMicroMagset dataset for benchmarking.
无系微型机器人的快速发展为靶向药物输送和微创外科手术等领域提供了令人兴奋的机遇。然而,目前仍存在一些挑战,特别是如何利用超声波(US)成像技术实现微机器人在生物体内的精确定位和分类。目前基于 US 的检测算法往往存在视觉反馈不准确的问题,从而导致定位错误。本文提出了一种新颖的可解释深度学习模型,用于利用 US 图像对八种不同类型的微型机器人进行定位和分类。我们引入了注意力融合瓶颈模块(AFBM),该模块增强了特征提取,提高了微型机器人分类和定位任务的性能。我们的模型始终优于 YOLOR、YOLOv5-C3HB、YOLOv5-TBH、YOLOv5 m 和 YOLOv7 等基线模型。在 IoU 阈值为 0.95 时,拟议模型的平均精度 (mAP) 分别为 0.861 和 0.909,在训练和测试中分别比 YOLOv5 m 模型高出 2% 和 1.5%。在 0.6、0.75 和 0.95 的 IoU 阈值下进行了多阈值 IoU 分析,结果表明我们的模型的微机器人定位精度更高。根据测试数据集中的高频、低频、增益和斑点进行了鲁棒性分析,结果表明我们的模型总体精度更高。在我们的框架中使用 Score-CAM 增强了可解释性,使人们能够透明地了解模型的决策过程。我们的工作标志着在微型机器人分类和检测方面取得了显著进步,并有可能在现实世界的应用场景中使用最新可用的 USMicroMagset 数据集作为基准。
{"title":"An explainable deep learning model for automated classification and localization of microrobots by functionality using ultrasound images","authors":"Ferhat Sadak","doi":"10.1016/j.robot.2024.104841","DOIUrl":"10.1016/j.robot.2024.104841","url":null,"abstract":"<div><div>The rapid advancements of untethered microrobots offer exciting opportunities in fields such as targeted drug delivery and minimally invasive surgical procedures. However, several challenges remain, especially in achieving precise localization and classification of microrobots within living organisms using ultrasound (US) imaging. Current US-based detection algorithms often suffer from inaccurate visual feedback, causing positioning errors. This paper presents a novel explainable deep learning model for the localization and classification of eight different types of microrobots using US images. We introduce the Attention-Fused Bottleneck Module (AFBM), which enhances feature extraction and improves the performance of microrobot classification and localization tasks. Our model consistently outperforms baseline models such as YOLOR, YOLOv5-C3HB, YOLOv5-TBH, YOLOv5 m, and YOLOv7. The proposed model achieved mean Average Precision (mAP) of 0.861 and 0.909 at an IoU threshold of 0.95 which is 2% and 1.5% higher than the YOLOv5 m model in training and testing, respectively. Multi-thresh IoU analysis was performed at IoU thresholds of 0.6, 0.75, and 0.95, and demonstrated that the microrobot localization accuracy of our model is superior. A robustness analysis was performed based on high and low frequencies, gain, and speckle in our test data set, and our model demonstrated higher overall accuracy. UsingScore-CAM in our framework enhances interpretability, allowing for transparent insights into the model’s decision-making process. Our work signifies a notable advancement in microrobot classification and detection, with potential applications in real-world scenarios using the newly available USMicroMagset dataset for benchmarking.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104841"},"PeriodicalIF":4.3,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142572215","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visual place recognition for aerial imagery: A survey 航空图像的视觉地点识别:一项调查
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-23 DOI: 10.1016/j.robot.2024.104837
Ivan Moskalenko , Anastasiia Kornilova , Gonzalo Ferrer
Aerial imagery and its direct application to visual localization is an essential problem for many Robotics and Computer Vision tasks. While Global Navigation Satellite Systems (GNSS) are the standard default solution for solving the aerial localization problem, it is subject to a number of limitations, such as, signal instability or solution unreliability that make this option not so desirable. Consequently, visual geolocalization is emerging as a viable alternative. However, adapting Visual Place Recognition (VPR) task to aerial imagery presents significant challenges, including weather variations and repetitive patterns. Current VPR reviews largely neglect the specific context of aerial data. This paper introduces a methodology tailored for evaluating VPR techniques specifically in the domain of aerial imagery, providing a comprehensive assessment of various methods and their performance. However, we not only compare various VPR methods, but also demonstrate the importance of selecting appropriate zoom and overlap levels when constructing map tiles to achieve maximum efficiency of VPR algorithms in the case of aerial imagery. The code is available on our GitHub repository — https://github.com/prime-slam/aero-vloc.
航空图像及其在视觉定位中的直接应用是许多机器人和计算机视觉任务的基本问题。虽然全球导航卫星系统(GNSS)是解决空中定位问题的标准默认解决方案,但它受到许多限制,例如信号不稳定或解决方案不可靠,使得这一方案不那么理想。因此,视觉地理定位正在成为一种可行的替代方案。然而,将视觉地点识别(VPR)任务应用于航空图像面临着巨大的挑战,包括天气变化和重复模式。目前的视觉地点识别(VPR)评测在很大程度上忽视了航空数据的特定环境。本文介绍了一种专门针对航空图像领域的 VPR 技术进行评估的方法,对各种方法及其性能进行了全面评估。不过,我们不仅比较了各种 VPR 方法,还证明了在构建地图瓦片时选择适当缩放和重叠级别的重要性,以便在航空图像中实现 VPR 算法的最高效率。代码可从我们的 GitHub 代码库中获取 - https://github.com/prime-slam/aero-vloc。
{"title":"Visual place recognition for aerial imagery: A survey","authors":"Ivan Moskalenko ,&nbsp;Anastasiia Kornilova ,&nbsp;Gonzalo Ferrer","doi":"10.1016/j.robot.2024.104837","DOIUrl":"10.1016/j.robot.2024.104837","url":null,"abstract":"<div><div>Aerial imagery and its direct application to visual localization is an essential problem for many Robotics and Computer Vision tasks. While Global Navigation Satellite Systems (GNSS) are the standard default solution for solving the aerial localization problem, it is subject to a number of limitations, such as, signal instability or solution unreliability that make this option not so desirable. Consequently, visual geolocalization is emerging as a viable alternative. However, adapting <em>Visual Place Recognition</em> (VPR) task to aerial imagery presents significant challenges, including weather variations and repetitive patterns. Current VPR reviews largely neglect the specific context of aerial data. This paper introduces a methodology tailored for evaluating VPR techniques specifically in the domain of aerial imagery, providing a comprehensive assessment of various methods and their performance. However, we not only compare various VPR methods, but also demonstrate the importance of selecting appropriate zoom and overlap levels when constructing map tiles to achieve maximum efficiency of VPR algorithms in the case of aerial imagery. The code is available on our GitHub repository — <span><span>https://github.com/prime-slam/aero-vloc</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104837"},"PeriodicalIF":4.3,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142553696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advancements in amphibious robot navigation through wheeled odometer uncertainty extension and distributed information fusion 通过轮式里程表不确定性扩展和分布式信息融合推进两栖机器人导航
IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-10-22 DOI: 10.1016/j.robot.2024.104839
Mingxuan Ding , Qinyun Tang , Kaixin Liu , Xi Chen , Dake Lu , Changda Tian , Liquan Wang , Yingxuan Li , Gang Wang
The advancement and safeguarding of the water-land interface region is of paramount importance, and amphibious robots with the capacity for autonomous operation can play a pivotal role in this domain. However, the inability of the majority of reliable navigation sensors to adapt to the water-land interface environment presents a significant challenge for amphibious robots, as obtaining positional information is crucial for autonomous operation. To address this issue, we have proposed a positioning and navigation framework, designated as NAWR (Navigation Algorithm for Amphibious Wheeled Robots), with the objective of enhancing the navigation capabilities of amphibious robots. Firstly, a method for representing the odometer's confidence based on a simplified wheel-terrain interaction model has been developed. This method quantitatively assesses the reliability of each odometer by estimating the slip rate. Secondly, we have introduced an improved split covariance intersection filter (I-SCIF), which maximizes the utilization of navigation information sources to enhance the accuracy of positional estimation. Finally, we will integrate these two methods to form the NAWR framework and validate the effectiveness of the proposed methods through multiple robot field trials. The results from both field trials and ablation tests collectively demonstrate that the modules and overall approach within the NAWR framework effectively enhance the navigation capabilities of amphibious robots.
水陆交界地区的进步和保护至关重要,而具有自主操作能力的两栖机器人可以在这一领域发挥关键作用。然而,大多数可靠的导航传感器都无法适应水陆交界环境,这给两栖机器人带来了巨大挑战,因为获取定位信息对于自主操作至关重要。为了解决这个问题,我们提出了一个定位和导航框架,命名为 NAWR(两栖轮式机器人导航算法),目的是提高两栖机器人的导航能力。首先,基于简化的车轮与地形相互作用模型,开发了一种表示里程表可信度的方法。这种方法通过估算滑移率来定量评估每个里程表的可靠性。其次,我们引入了改进的分裂协方差交叉滤波器(I-SCIF),最大限度地利用导航信息源来提高位置估计的准确性。最后,我们将整合这两种方法,形成 NAWR 框架,并通过多个机器人现场试验验证所提方法的有效性。实地试验和烧蚀测试的结果共同证明,NAWR 框架内的模块和整体方法可有效提高两栖机器人的导航能力。
{"title":"Advancements in amphibious robot navigation through wheeled odometer uncertainty extension and distributed information fusion","authors":"Mingxuan Ding ,&nbsp;Qinyun Tang ,&nbsp;Kaixin Liu ,&nbsp;Xi Chen ,&nbsp;Dake Lu ,&nbsp;Changda Tian ,&nbsp;Liquan Wang ,&nbsp;Yingxuan Li ,&nbsp;Gang Wang","doi":"10.1016/j.robot.2024.104839","DOIUrl":"10.1016/j.robot.2024.104839","url":null,"abstract":"<div><div>The advancement and safeguarding of the water-land interface region is of paramount importance, and amphibious robots with the capacity for autonomous operation can play a pivotal role in this domain. However, the inability of the majority of reliable navigation sensors to adapt to the water-land interface environment presents a significant challenge for amphibious robots, as obtaining positional information is crucial for autonomous operation. To address this issue, we have proposed a positioning and navigation framework, designated as NAWR (Navigation Algorithm for Amphibious Wheeled Robots), with the objective of enhancing the navigation capabilities of amphibious robots. Firstly, a method for representing the odometer's confidence based on a simplified wheel-terrain interaction model has been developed. This method quantitatively assesses the reliability of each odometer by estimating the slip rate. Secondly, we have introduced an improved split covariance intersection filter (I-SCIF), which maximizes the utilization of navigation information sources to enhance the accuracy of positional estimation. Finally, we will integrate these two methods to form the NAWR framework and validate the effectiveness of the proposed methods through multiple robot field trials. The results from both field trials and ablation tests collectively demonstrate that the modules and overall approach within the NAWR framework effectively enhance the navigation capabilities of amphibious robots.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"183 ","pages":"Article 104839"},"PeriodicalIF":4.3,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142586363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Robotics and Autonomous Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1