首页 > 最新文献

IEEE Robotics and Automation Letters最新文献

英文 中文
Learning Based Exteroception of Soft Underwater Manipulator With Soft Actuator Network 基于学习的软执行器网络水下软机械手外感知技术
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487512
Kailuan Tang;Shaowu Tang;Chenghua Lu;Shijian Wu;Sicong Liu;Juan Yi;Jian S. Dai;Zheng Wang
Interactions with environmental objects can induce substantial alterations in both exteroceptive and proprioceptive signals. However, the deployment of exteroceptive sensors within underwater soft manipulators encounters numerous challenges and constraints, thereby imposing limitations on their perception capabilities. In this article, we present a novel learning-based exteroceptive approach that utilizes internal proprioceptive signals and harnesses the principles of soft actuator network (SAN). Deformation and vibration resulting from external collisions tend to propagate through the SANs in underwater soft manipulators and can be detected by proprioceptive sensors. We extract features from the sensor signals and develop a fully-connected neural network (FCNN)-based classifier to determine collision positions. We have constructed a training dataset and an independent validation dataset for the purpose of training and validating the classifier. The experimental results affirm that the proposed method can identify collision locations with an accuracy level of 97.11% using the independent validation dataset, which exhibits potential applications within the domain of underwater soft robotics perception and control.
与环境物体的相互作用会引起外部感觉和本体感觉信号的巨大变化。然而,在水下软机械手中部署外感知传感器会遇到许多挑战和限制,从而对其感知能力造成限制。在这篇文章中,我们提出了一种基于学习的新型外感知方法,它利用内部本体感觉信号和软致动器网络(SAN)原理。外部碰撞产生的变形和振动往往会通过水下软体机械手的 SAN 传播,并可被本体感觉传感器检测到。我们从传感器信号中提取特征,并开发了基于全连接神经网络(FCNN)的分类器来确定碰撞位置。我们构建了一个训练数据集和一个独立的验证数据集,用于训练和验证分类器。实验结果表明,利用独立验证数据集,所提出的方法能够以 97.11% 的准确率识别碰撞位置,在水下软机器人感知和控制领域具有潜在的应用前景。
{"title":"Learning Based Exteroception of Soft Underwater Manipulator With Soft Actuator Network","authors":"Kailuan Tang;Shaowu Tang;Chenghua Lu;Shijian Wu;Sicong Liu;Juan Yi;Jian S. Dai;Zheng Wang","doi":"10.1109/LRA.2024.3487512","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487512","url":null,"abstract":"Interactions with environmental objects can induce substantial alterations in both exteroceptive and proprioceptive signals. However, the deployment of exteroceptive sensors within underwater soft manipulators encounters numerous challenges and constraints, thereby imposing limitations on their perception capabilities. In this article, we present a novel learning-based exteroceptive approach that utilizes internal proprioceptive signals and harnesses the principles of soft actuator network (SAN). Deformation and vibration resulting from external collisions tend to propagate through the SANs in underwater soft manipulators and can be detected by proprioceptive sensors. We extract features from the sensor signals and develop a fully-connected neural network (FCNN)-based classifier to determine collision positions. We have constructed a training dataset and an independent validation dataset for the purpose of training and validating the classifier. The experimental results affirm that the proposed method can identify collision locations with an accuracy level of 97.11% using the independent validation dataset, which exhibits potential applications within the domain of underwater soft robotics perception and control.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11082-11089"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142600249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Open-Structure: Structural Benchmark Dataset for SLAM Algorithms 开放式结构:用于 SLAM 算法的结构基准数据集
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487071
Yanyan Li;Zhao Guo;Ze Yang;Yanbiao Sun;Liang Zhao;Federico Tombari
This letter presents Open-Structure, a novel benchmark dataset for evaluating visual odometry and SLAM methods. Compared to existing public datasets that primarily offer raw images, Open-Structure provides direct access to point and line measurements, correspondences, structural associations, and co-visibility factor graphs, which can be fed to various stages of SLAM pipelines to mitigate the impact of data preprocessing modules in ablation experiments. The dataset comprises two distinct types of sequences from the perspective of scenarios. The first type maintains reasonable observation and occlusion relationships, as these critical elements are extracted from public image-based sequences using our dataset generator. In contrast, the second type consists of carefully designed simulation sequences that enhance dataset diversity by introducing a wide range of trajectories and observations. Furthermore, a baseline is proposed using our dataset to evaluate widely used modules, including camera pose tracking, parametrization, and factor graph optimization, within SLAM systems. By evaluating these state-of-the-art algorithms across different scenarios, we discern each module's strengths and weaknesses in the context of camera tracking and optimization processes.
本文介绍了用于评估视觉里程测量和 SLAM 方法的新型基准数据集 Open-Structure。与主要提供原始图像的现有公共数据集相比,Open-Structure 数据集可直接获取点和线的测量结果、对应关系、结构关联和共视因子图,这些数据可输入 SLAM 管道的各个阶段,以减轻消融实验中数据预处理模块的影响。从场景的角度来看,该数据集包括两种不同类型的序列。第一种类型保持了合理的观察和遮挡关系,因为这些关键要素是利用我们的数据集生成器从基于图像的公共序列中提取的。相比之下,第二种类型由精心设计的模拟序列组成,通过引入各种轨迹和观测数据来增强数据集的多样性。此外,我们还提出了一个基线,利用我们的数据集来评估 SLAM 系统中广泛使用的模块,包括相机姿态跟踪、参数化和因子图优化。通过在不同场景下对这些先进算法进行评估,我们发现了每个模块在摄像机跟踪和优化过程中的优缺点。
{"title":"Open-Structure: Structural Benchmark Dataset for SLAM Algorithms","authors":"Yanyan Li;Zhao Guo;Ze Yang;Yanbiao Sun;Liang Zhao;Federico Tombari","doi":"10.1109/LRA.2024.3487071","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487071","url":null,"abstract":"This letter presents Open-Structure, a novel benchmark dataset for evaluating visual odometry and SLAM methods. Compared to existing public datasets that primarily offer raw images, Open-Structure provides direct access to point and line measurements, correspondences, structural associations, and co-visibility factor graphs, which can be fed to various stages of SLAM pipelines to mitigate the impact of data preprocessing modules in ablation experiments. The dataset comprises two distinct types of sequences from the perspective of scenarios. The first type maintains reasonable observation and occlusion relationships, as these critical elements are extracted from public image-based sequences using our dataset generator. In contrast, the second type consists of carefully designed simulation sequences that enhance dataset diversity by introducing a wide range of trajectories and observations. Furthermore, a baseline is proposed using our dataset to evaluate widely used modules, including camera pose tracking, parametrization, and factor graph optimization, within SLAM systems. By evaluating these state-of-the-art algorithms across different scenarios, we discern each module's strengths and weaknesses in the context of camera tracking and optimization processes.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11457-11464"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mitigating Catastrophic Forgetting in Robot Continual Learning: A Guided Policy Search Approach Enhanced With Memory-Aware Synapses 减轻机器人持续学习中的灾难性遗忘:利用记忆感知突触增强的引导式策略搜索方法
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487484
Qingwei Dong;Peng Zeng;Yunpeng He;Guangxi Wan;Xiaoting Dong
Complex operational scenarios increasingly demand that industrial robots sequentially resolve multiple interrelated problems to accomplish complex operational tasks, necessitating robots to have the capacity for not only learning through interaction with the environment but also for continual learning. Current deep reinforcement learning methods have demonstrated substantial prowess in enabling robots to learn individual simple operational skills. However, catastrophic forgetting regarding the continual learning of various distinct tasks under a unified control policy remains a challenge. The lengthy sequential decision-making trajectory in reinforcement learning scenarios results in a massive state-action search space for the agent. Moreover, low-value state-action samples exacerbate the difficulty of continuous learning in reinforcement learning problems. In this letter, we propose a Continual Reinforcement Learning (CRL) method that accommodates the incremental multiskill learning demands of robots. We transform the tightly coupled structure in Guided Policy Search (GPS) algorithms, which closely intertwine local and global policies, into a loosely coupled structure. This revised structure updates the global policy only after the local policy for a specific task has converged, enabling online learning. In incrementally learning new tasks, the global policy is updated using hard parameter sharing and Memory Aware Synapses (MAS), creating task-specific layers while penalizing significant parameter changes in shared layers linked to prior tasks. This method reduces overfitting and mitigates catastrophic forgetting in robotic CRL. We validate our method on PR2, UR5 and Sawyer robots in simulators as well as on a real UR5 robot.
复杂的操作场景越来越多地要求工业机器人按顺序解决多个相互关联的问题,以完成复杂的操作任务,这就要求机器人不仅要具备通过与环境互动来学习的能力,还要具备持续学习的能力。目前的深度强化学习方法在帮助机器人学习单个简单操作技能方面已显示出巨大的优势。然而,在统一控制策略下持续学习各种不同任务的灾难性遗忘仍然是一个挑战。在强化学习场景中,冗长的顺序决策轨迹会给机器人带来一个巨大的状态动作搜索空间。此外,低价值的状态-动作样本加剧了强化学习问题中持续学习的难度。在这封信中,我们提出了一种持续强化学习(CRL)方法,以适应机器人的增量多技能学习需求。我们将引导策略搜索(GPS)算法中紧密结合局部策略和全局策略的紧密耦合结构转变为松散耦合结构。这种修改后的结构只有在特定任务的局部策略收敛后才会更新全局策略,从而实现在线学习。在增量学习新任务时,全局策略通过硬参数共享和记忆感知突触(MAS)进行更新,创建特定任务层,同时对与先前任务相关的共享层中的重大参数变化进行惩罚。这种方法减少了过拟合,减轻了机器人 CRL 中的灾难性遗忘。我们在模拟器中的 PR2、UR5 和 Sawyer 机器人以及真实的 UR5 机器人上验证了我们的方法。
{"title":"Mitigating Catastrophic Forgetting in Robot Continual Learning: A Guided Policy Search Approach Enhanced With Memory-Aware Synapses","authors":"Qingwei Dong;Peng Zeng;Yunpeng He;Guangxi Wan;Xiaoting Dong","doi":"10.1109/LRA.2024.3487484","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487484","url":null,"abstract":"Complex operational scenarios increasingly demand that industrial robots sequentially resolve multiple interrelated problems to accomplish complex operational tasks, necessitating robots to have the capacity for not only learning through interaction with the environment but also for continual learning. Current deep reinforcement learning methods have demonstrated substantial prowess in enabling robots to learn individual simple operational skills. However, catastrophic forgetting regarding the continual learning of various distinct tasks under a unified control policy remains a challenge. The lengthy sequential decision-making trajectory in reinforcement learning scenarios results in a massive state-action search space for the agent. Moreover, low-value state-action samples exacerbate the difficulty of continuous learning in reinforcement learning problems. In this letter, we propose a Continual Reinforcement Learning (CRL) method that accommodates the incremental multiskill learning demands of robots. We transform the tightly coupled structure in Guided Policy Search (GPS) algorithms, which closely intertwine local and global policies, into a loosely coupled structure. This revised structure updates the global policy only after the local policy for a specific task has converged, enabling online learning. In incrementally learning new tasks, the global policy is updated using hard parameter sharing and Memory Aware Synapses (MAS), creating task-specific layers while penalizing significant parameter changes in shared layers linked to prior tasks. This method reduces overfitting and mitigates catastrophic forgetting in robotic CRL. We validate our method on PR2, UR5 and Sawyer robots in simulators as well as on a real UR5 robot.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11242-11249"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Depth-Visual-Inertial (DVI) Mapping System for Robust Indoor 3D Reconstruction 用于稳健室内三维重建的深度-视觉-惯性(DVI)映射系统
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487496
Charles Hamesse;Michiel Vlaminck;Hiep Luong;Rob Haelterman
We propose the Depth-Visual-Inertial (DVI) mapping system: a robust multi-sensor fusion framework for dense 3D mapping using time-of-flight cameras equipped with RGB and IMU sensors. Inspired by recent developments in real-time LiDAR-based odometry and mapping, our system uses an error-state iterative Kalman filter for state estimation: it processes the inertial sensor's data for state propagation, followed by a state update first using visual-inertial odometry, then depth-based odometry. This sensor fusion scheme makes our system robust to degenerate scenarios (e.g. lack of visual or geometrical features, fast rotations) and to noisy sensor data, like those that can be obtained with off-the-shelf time-of-flight DVI sensors. For evaluation, we propose the new Bunker DVI Dataset, featuring data from multiple DVI sensors recorded in challenging conditions reflecting search-and-rescue operations. We show the superior robustness and precision of our method against previous work. Following the open science principle, we make both our source code and dataset publicly available.
我们提出了深度-视觉-惯性(DVI)测绘系统:这是一种稳健的多传感器融合框架,用于使用配备了 RGB 和 IMU 传感器的飞行时间照相机进行密集 3D 测绘。受基于激光雷达的实时里程测量和制图的最新发展的启发,我们的系统使用误差状态迭代卡尔曼滤波器进行状态估计:它处理惯性传感器的数据进行状态传播,然后首先使用视觉惯性里程测量进行状态更新,接着使用基于深度的里程测量进行状态更新。这种传感器融合方案使我们的系统对退化场景(如缺乏视觉或几何特征、快速旋转)和嘈杂的传感器数据(如使用现成的飞行时间 DVI 传感器获得的数据)具有鲁棒性。为了进行评估,我们提出了新的掩体 DVI 数据集,该数据集由多个 DVI 传感器在具有挑战性的条件下记录的数据组成,反映了搜救行动的情况。与之前的研究相比,我们的方法具有更高的鲁棒性和精确性。遵循开放科学原则,我们公开了源代码和数据集。
{"title":"Depth-Visual-Inertial (DVI) Mapping System for Robust Indoor 3D Reconstruction","authors":"Charles Hamesse;Michiel Vlaminck;Hiep Luong;Rob Haelterman","doi":"10.1109/LRA.2024.3487496","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487496","url":null,"abstract":"We propose the \u0000<underline>D</u>\u0000epth-\u0000<underline>V</u>\u0000isual-\u0000<underline>I</u>\u0000nertial (DVI) mapping system: a robust multi-sensor fusion framework for dense 3D mapping using time-of-flight cameras equipped with RGB and IMU sensors. Inspired by recent developments in real-time LiDAR-based odometry and mapping, our system uses an error-state iterative Kalman filter for state estimation: it processes the inertial sensor's data for state propagation, followed by a state update first using visual-inertial odometry, then depth-based odometry. This sensor fusion scheme makes our system robust to degenerate scenarios (e.g. lack of visual or geometrical features, fast rotations) and to noisy sensor data, like those that can be obtained with off-the-shelf time-of-flight DVI sensors. For evaluation, we propose the new Bunker DVI Dataset, featuring data from multiple DVI sensors recorded in challenging conditions reflecting search-and-rescue operations. We show the superior robustness and precision of our method against previous work. Following the open science principle, we make both our source code and dataset publicly available.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11313-11320"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142600124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive Bearing-Only Target Localization and Circumnavigation Under Unknown Wind Disturbance: Theory and Experiments 未知风扰动下的自适应仅轴承目标定位和环绕航行:理论与实验
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487483
Donglin Sui;Mohammad Deghat;Zhiyong Sun;Mohsen Eskandari
This letter addresses the problem of controlling an autonomous agent to localize and circumnavigate a stationary or slowly moving target in the presence of an unknown wind disturbance. First, we introduce a novel wind estimator that utilizes bearing-only measurements to adaptively estimate the wind velocity. Then, we develop an estimator-coupled circumnavigation controller to mitigate wind effects, enabling the agent to move in a circular orbit centered at the target with a predefined radius. We analytically prove that the estimation and control errors are locally exponentially convergent when the wind is constant and the target is stationary. Then, the robustness of the method is evaluated for a slowly moving target and time-varying wind. It is shown that the circumnavigation errors converge to small neighborhoods of the origin whose sizes depend on the velocities of the wind and that of the target. Comprehensive simulation and experiments using unmanned aerial vehicles (UAVs) illustrate the efficacy of the proposed estimator and controller.
这封信探讨了在未知风力干扰的情况下,如何控制自主代理定位并环绕静止或缓慢移动的目标的问题。首先,我们介绍了一种新颖的风力估算器,它利用方位测量来自适应地估算风速。然后,我们开发了一种与估算器耦合的环绕飞行控制器,以减轻风的影响,使飞行器以预定半径在以目标为中心的圆形轨道上移动。我们通过分析证明,当风力恒定且目标静止时,估计误差和控制误差是局部指数收敛的。然后,针对缓慢移动的目标和随时间变化的风,对该方法的鲁棒性进行了评估。结果表明,环绕误差收敛于原点的小邻域,其大小取决于风速和目标的速度。利用无人驾驶飞行器(UAV)进行的综合模拟和实验说明了所提出的估计器和控制器的功效。
{"title":"Adaptive Bearing-Only Target Localization and Circumnavigation Under Unknown Wind Disturbance: Theory and Experiments","authors":"Donglin Sui;Mohammad Deghat;Zhiyong Sun;Mohsen Eskandari","doi":"10.1109/LRA.2024.3487483","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487483","url":null,"abstract":"This letter addresses the problem of controlling an autonomous agent to localize and circumnavigate a stationary or slowly moving target in the presence of an unknown wind disturbance. First, we introduce a novel wind estimator that utilizes bearing-only measurements to adaptively estimate the wind velocity. Then, we develop an estimator-coupled circumnavigation controller to mitigate wind effects, enabling the agent to move in a circular orbit centered at the target with a predefined radius. We analytically prove that the estimation and control errors are locally exponentially convergent when the wind is constant and the target is stationary. Then, the robustness of the method is evaluated for a slowly moving target and time-varying wind. It is shown that the circumnavigation errors converge to small neighborhoods of the origin whose sizes depend on the velocities of the wind and that of the target. Comprehensive simulation and experiments using unmanned aerial vehicles (UAVs) illustrate the efficacy of the proposed estimator and controller.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11321-11328"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142600250","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UADA3D: Unsupervised Adversarial Domain Adaptation for 3D Object Detection With Sparse LiDAR and Large Domain Gaps UADA3D:利用稀疏激光雷达和大域间隙进行 3D 物体检测的无监督对抗域自适应技术
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-29 DOI: 10.1109/LRA.2024.3487489
Maciej K. Wozniak;Mattias Hansson;Marko Thiel;Patric Jensfelt
In this study, we address a gap in existing unsupervised domain adaptation approaches on LiDAR-based 3D object detection, which have predominantly concentrated on adapting between established, high-density autonomous driving datasets. We focus on sparser point clouds, capturing scenarios from different perspectives: not just from vehicles on the road but also from mobile robots on sidewalks, which encounter significantly different environmental conditions and sensor configurations. We introduce Unsupervised Adversarial Domain Adaptation for 3D Object Detection (UADA3D). UADA3D does not depend on pre-trained source models or teacher-student architectures. Instead, it uses an adversarial approach to directly learn domain-invariant features. We demonstrate its efficacy in various adaptation scenarios, showing significant improvements in both self-driving car and mobile robot domains.
在本研究中,我们解决了现有基于激光雷达的三维物体检测无监督领域适应方法的不足,这些方法主要集中在既有的高密度自动驾驶数据集之间的适应上。我们将重点放在更稀疏的点云上,从不同的角度捕捉场景:不仅从道路上的车辆,而且从人行道上的移动机器人,它们会遇到明显不同的环境条件和传感器配置。我们引入了用于三维物体检测的无监督对抗域自适应(UADA3D)。UADA3D 不依赖于预先训练的源模型或师生架构。相反,它使用对抗方法直接学习领域不变特征。我们展示了它在各种适应场景中的功效,显示了它在自动驾驶汽车和移动机器人领域的显著改进。
{"title":"UADA3D: Unsupervised Adversarial Domain Adaptation for 3D Object Detection With Sparse LiDAR and Large Domain Gaps","authors":"Maciej K. Wozniak;Mattias Hansson;Marko Thiel;Patric Jensfelt","doi":"10.1109/LRA.2024.3487489","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487489","url":null,"abstract":"In this study, we address a gap in existing unsupervised domain adaptation approaches on LiDAR-based 3D object detection, which have predominantly concentrated on adapting between established, high-density autonomous driving datasets. We focus on sparser point clouds, capturing scenarios from different perspectives: not just from vehicles on the road but also from mobile robots on sidewalks, which encounter significantly different environmental conditions and sensor configurations. We introduce Unsupervised Adversarial Domain Adaptation for 3D Object Detection (\u0000<bold>UADA3D</b>\u0000). UADA3D does not depend on pre-trained source models or teacher-student architectures. Instead, it uses an adversarial approach to directly learn domain-invariant features. We demonstrate its efficacy in various adaptation scenarios, showing significant improvements in both self-driving car and mobile robot domains.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11210-11217"},"PeriodicalIF":4.6,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10737391","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598629","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Robotics and Automation Society Information 电气和电子工程师学会机器人与自动化协会信息
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-28 DOI: 10.1109/LRA.2024.3484113
{"title":"IEEE Robotics and Automation Society Information","authors":"","doi":"10.1109/LRA.2024.3484113","DOIUrl":"https://doi.org/10.1109/LRA.2024.3484113","url":null,"abstract":"","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 11","pages":"C3-C3"},"PeriodicalIF":4.6,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10737235","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142555133","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Robotics and Automation Letters Information for Authors IEEE 《机器人与自动化通讯》作者须知
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-28 DOI: 10.1109/LRA.2024.3484115
{"title":"IEEE Robotics and Automation Letters Information for Authors","authors":"","doi":"10.1109/LRA.2024.3484115","DOIUrl":"https://doi.org/10.1109/LRA.2024.3484115","url":null,"abstract":"","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 11","pages":"C4-C4"},"PeriodicalIF":4.6,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10737236","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142536323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
State Estimation by Joint Approach With Dynamic Modeling and Observer for Soft Actuator 采用动态建模和观测器联合方法对软致动器进行状态估计
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-28 DOI: 10.1109/LRA.2024.3487499
Huichen Ma;Junjie Zhou;Chen-Hua Yeow;Lijun Meng
In order to achieve a significant reduction in state estimation error and improved convergence speed, ensuring real-time responsiveness and computational efficiency, this article proposes a joint approach that combines dynamic modeling and observers to achieve accurate nonlinear state estimation of the functional soft actuator. First, inspired by the viscoelastic model, a general framework for modeling the 2D dynamics of the pneumatic network soft actuator under external conditions was studied. The dimensionless dynamic model of the soft actuator's bending deformation is derived through the dimensional analysis method. Then, an adaptive extended Kalman particle filter (aEKPF) is used for state estimation. It can restrain noise from pressure sensors and reduce drift error from rate gyroscopes. The closed-loop performance of the nonlinear pose estimation combined with the conventional control method was experimentally assessed using soft actuators and soft crawling. Results show that the aEKPF can accurately estimate the state from noise sensor measurements. Compared with conventional EKF, aEKPF improves the performance by more than 50% in terms of state estimation error and convergence speed. At the same time, in the rectilinear crawling test, the mean centroid offset in different environments is less than 3% of the soft crawling module width, verifying the effectiveness and robustness of this strategy in accurate state estimation and stability control.
为了大幅降低状态估计误差并提高收敛速度,确保实时响应性和计算效率,本文提出了一种结合动态建模和观测器的联合方法,以实现对功能软执行器的精确非线性状态估计。首先,受粘弹性模型的启发,研究了外部条件下气动网络软执行器二维动态建模的一般框架。通过尺寸分析方法推导出了软执行器弯曲变形的无量纲动态模型。然后,使用自适应扩展卡尔曼粒子滤波器(aEKPF)进行状态估计。它可以抑制来自压力传感器的噪声,减少来自速率陀螺仪的漂移误差。利用软致动器和软爬行实验评估了非线性姿态估计与传统控制方法相结合的闭环性能。结果表明,aEKPF 可以从噪声传感器测量结果中准确估计状态。与传统的 EKF 相比,aEKPF 在状态估计误差和收敛速度方面提高了 50% 以上。同时,在直线爬行测试中,不同环境下的平均中心点偏移小于软爬行模块宽度的 3%,验证了该策略在精确状态估计和稳定性控制方面的有效性和鲁棒性。
{"title":"State Estimation by Joint Approach With Dynamic Modeling and Observer for Soft Actuator","authors":"Huichen Ma;Junjie Zhou;Chen-Hua Yeow;Lijun Meng","doi":"10.1109/LRA.2024.3487499","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487499","url":null,"abstract":"In order to achieve a significant reduction in state estimation error and improved convergence speed, ensuring real-time responsiveness and computational efficiency, this article proposes a joint approach that combines dynamic modeling and observers to achieve accurate nonlinear state estimation of the functional soft actuator. First, inspired by the viscoelastic model, a general framework for modeling the 2D dynamics of the pneumatic network soft actuator under external conditions was studied. The dimensionless dynamic model of the soft actuator's bending deformation is derived through the dimensional analysis method. Then, an adaptive extended Kalman particle filter (aEKPF) is used for state estimation. It can restrain noise from pressure sensors and reduce drift error from rate gyroscopes. The closed-loop performance of the nonlinear pose estimation combined with the conventional control method was experimentally assessed using soft actuators and soft crawling. Results show that the aEKPF can accurately estimate the state from noise sensor measurements. Compared with conventional EKF, aEKPF improves the performance by more than 50% in terms of state estimation error and convergence speed. At the same time, in the rectilinear crawling test, the mean centroid offset in different environments is less than 3% of the soft crawling module width, verifying the effectiveness and robustness of this strategy in accurate state estimation and stability control.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11706-11713"},"PeriodicalIF":4.6,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142679286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Distributed Algorithms via Saddle-Point Dynamics for Multi-Robot Task Assignment 多机器人任务分配的鞍点动力学分布式算法
IF 4.6 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-10-28 DOI: 10.1109/LRA.2024.3487077
Yi Huang;Jiacheng Kuai;Shisheng Cui;Ziyang Meng;Jian Sun
This letter develops two distributed algorithms to solve multi-robot task assignment problems (MTAP). We first describe MTAP as an integer linear programming (ILP) problem and then reformulate it as a relaxed convex optimization problem. Based on the saddle-point dynamics, we propose two distributed optimization algorithms using optimistic gradient decent ascent (OGDA) and extra-gradient (EG) methods, which achieve exact convergence to an optimal solution of the relaxed problem. In most cases, such an solution reflects the optimality of the original ILP problems. For some special ILP problems, we provide a perturbation-based distributed method to avoid the inconsistency phenomenon, such that an optimal solution to any ILP problem is obtained. Compared with some decentralized algorithms requiring a central robot that communicates with the other robots, our developed algorithms are fully distributed, in which each robot only communicates with the nearest neighbors for an arbitrary connected graph. We evaluate the developed algorithms in terms of computation, communication, and data storage complexities, and compare them with some typical algorithms. It is shown that the developed algorithms have low computational and communication complexities. We also verify the effectiveness of our algorithms via numerical examples.
本文开发了两种分布式算法来解决多机器人任务分配问题(MTAP)。我们首先将 MTAP 描述为一个整数线性规划(ILP)问题,然后将其重新表述为一个松弛凸优化问题。基于鞍点动力学,我们提出了两种分布式优化算法,分别采用乐观梯度下降法(OGDA)和额外梯度法(EG),这两种算法都能精确收敛到松弛问题的最优解。在大多数情况下,这种解反映了原始 ILP 问题的最优性。对于一些特殊的 ILP 问题,我们提供了一种基于扰动的分布式方法,以避免不一致现象,从而获得任何 ILP 问题的最优解。与一些需要一个中心机器人与其他机器人通信的分散式算法相比,我们开发的算法是完全分布式的,其中每个机器人只与任意连通图的近邻通信。我们从计算、通信和数据存储复杂性方面对所开发的算法进行了评估,并与一些典型算法进行了比较。结果表明,所开发的算法具有较低的计算和通信复杂度。我们还通过实例验证了算法的有效性。
{"title":"Distributed Algorithms via Saddle-Point Dynamics for Multi-Robot Task Assignment","authors":"Yi Huang;Jiacheng Kuai;Shisheng Cui;Ziyang Meng;Jian Sun","doi":"10.1109/LRA.2024.3487077","DOIUrl":"https://doi.org/10.1109/LRA.2024.3487077","url":null,"abstract":"This letter develops two distributed algorithms to solve multi-robot task assignment problems (MTAP). We first describe MTAP as an integer linear programming (ILP) problem and then reformulate it as a relaxed convex optimization problem. Based on the saddle-point dynamics, we propose two distributed optimization algorithms using optimistic gradient decent ascent (OGDA) and extra-gradient (EG) methods, which achieve exact convergence to an optimal solution of the relaxed problem. In most cases, such an solution reflects the optimality of the original ILP problems. For some special ILP problems, we provide a perturbation-based distributed method to avoid the inconsistency phenomenon, such that an optimal solution to any ILP problem is obtained. Compared with some decentralized algorithms requiring a central robot that communicates with the other robots, our developed algorithms are fully distributed, in which each robot only communicates with the nearest neighbors for an arbitrary connected graph. We evaluate the developed algorithms in terms of computation, communication, and data storage complexities, and compare them with some typical algorithms. It is shown that the developed algorithms have low computational and communication complexities. We also verify the effectiveness of our algorithms via numerical examples.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"9 12","pages":"11178-11185"},"PeriodicalIF":4.6,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Robotics and Automation Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1