首页 > 最新文献

2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)最新文献

英文 中文
Active Pedestrian Detection for Excavator Robots based on Multi-Sensor Fusion 基于多传感器融合的挖掘机机器人主动行人检测
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872286
Meiyuan Zou, Jiajie Yu, Bo Lu, Wenzheng Chi, Lining Sun
As a common multi-functional engineering equipment, excavators are widely used in civil construction, coal mining, power engineering, etc. The excellent performance of the excavator not only greatly improves the work efficiency during the construction process, but also effectively saves labor costs. However, due to the complexity of the working environment of the excavator and the blind area of the excavator itself, the driver cannot make timely judgments on the surrounding environment, which may cause potential threats to pedestrians. In response to such problems, this paper proposes a multi-sensor fusion detection method applied to excavators to provide vision assistance for excavator drivers, thereby reducing the risk of pedestrian casualties. Based on the results of the joint calibration, the transformation relationship between the camera and lidar coordinate systems is determined. Combining the detection results of the pedestrian detection algorithm YOLO-v5 and the segmented image information, the position of the pedestrian in the image can be inversely mapped to the 3D point clouds via the matrix transformation, which can accurately display the position of the pedestrian in the point clouds, consequently making up for the lack of depth information in the image. The experimental results show that our method can effectively extract the location information of pedestrians from the complex background environment and realize timely pedestrian alarm.
挖掘机作为一种常见的多功能工程设备,广泛应用于民用建筑、煤矿、电力工程等领域。挖掘机的优异性能不仅大大提高了施工过程中的工作效率,而且有效地节省了人工成本。但是,由于挖掘机工作环境的复杂性和挖掘机本身的盲区,驾驶员不能及时对周围环境做出判断,这可能会对行人造成潜在的威胁。针对这些问题,本文提出了一种应用于挖掘机的多传感器融合检测方法,为挖掘机驾驶员提供视觉辅助,从而降低行人伤亡的风险。根据联合标定的结果,确定了相机与激光雷达坐标系之间的转换关系。结合行人检测算法YOLO-v5的检测结果和分割后的图像信息,通过矩阵变换将图像中行人的位置逆映射到三维点云中,可以准确显示行人在点云中的位置,从而弥补图像中深度信息的不足。实验结果表明,该方法能够有效地从复杂的背景环境中提取行人的位置信息,实现行人的及时报警。
{"title":"Active Pedestrian Detection for Excavator Robots based on Multi-Sensor Fusion","authors":"Meiyuan Zou, Jiajie Yu, Bo Lu, Wenzheng Chi, Lining Sun","doi":"10.1109/RCAR54675.2022.9872286","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872286","url":null,"abstract":"As a common multi-functional engineering equipment, excavators are widely used in civil construction, coal mining, power engineering, etc. The excellent performance of the excavator not only greatly improves the work efficiency during the construction process, but also effectively saves labor costs. However, due to the complexity of the working environment of the excavator and the blind area of the excavator itself, the driver cannot make timely judgments on the surrounding environment, which may cause potential threats to pedestrians. In response to such problems, this paper proposes a multi-sensor fusion detection method applied to excavators to provide vision assistance for excavator drivers, thereby reducing the risk of pedestrian casualties. Based on the results of the joint calibration, the transformation relationship between the camera and lidar coordinate systems is determined. Combining the detection results of the pedestrian detection algorithm YOLO-v5 and the segmented image information, the position of the pedestrian in the image can be inversely mapped to the 3D point clouds via the matrix transformation, which can accurately display the position of the pedestrian in the point clouds, consequently making up for the lack of depth information in the image. The experimental results show that our method can effectively extract the location information of pedestrians from the complex background environment and realize timely pedestrian alarm.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131462165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Improved RRT*-A*-based Three-Dimensional Path Planning Algorithm for the Robotic Dolphin 基于改进RRT*-A*的机器海豚三维路径规划算法
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872185
Chi Zhang, Zhenna Liu, Yaoguang Wei, Dong An, Jincun Liu
The dolphins are fairly well endowed with high turn maneuverability in vertical and horizontal planes. This paper proposes a modified path planning algorithm fusions of rapidly-exploring random tree (RRT) and graph-based methods for a developed robotic dolphin. Considering simultaneously the both minimum yaw radius and minimum pitch radius constraints, a method of calculating a three-dimensional (3D) Dubins curve from two 2D Dubins curves by interpolation is proposed. The 3D Dubins curves and the length of the curves are utilized as the paths and costs of path planning to satisfy the motion constraints of the robotic dolphin. Furthermore, in order to meet the speed and optimization of planned path, a variant RRT algorithm combined with A* algorithm is employed to generate feasible path for the robotic dolphin. The path cost and calculation time of this method is lower. Finally, a tendon-driven continuum robotic dolphin is presented to provide the simulation platform for verifying the effectiveness of the proposed methods.
海豚在垂直和水平平面上具有很高的转弯机动性。针对已开发的机器海豚,提出了一种融合快速探索随机树和基于图的路径规划改进算法。同时考虑最小偏航半径和最小俯仰半径约束,提出了一种由两条二维Dubins曲线插值计算三维Dubins曲线的方法。利用三维Dubins曲线和曲线长度作为路径规划的路径和代价来满足机器人海豚的运动约束。为满足规划路径的快速性和最优性,采用变型RRT算法结合a *算法生成机器人海豚的可行路径。该方法的路径代价和计算时间较低。最后,提出了一种肌腱驱动连续体机器人海豚,为验证所提方法的有效性提供了仿真平台。
{"title":"Improved RRT*-A*-based Three-Dimensional Path Planning Algorithm for the Robotic Dolphin","authors":"Chi Zhang, Zhenna Liu, Yaoguang Wei, Dong An, Jincun Liu","doi":"10.1109/RCAR54675.2022.9872185","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872185","url":null,"abstract":"The dolphins are fairly well endowed with high turn maneuverability in vertical and horizontal planes. This paper proposes a modified path planning algorithm fusions of rapidly-exploring random tree (RRT) and graph-based methods for a developed robotic dolphin. Considering simultaneously the both minimum yaw radius and minimum pitch radius constraints, a method of calculating a three-dimensional (3D) Dubins curve from two 2D Dubins curves by interpolation is proposed. The 3D Dubins curves and the length of the curves are utilized as the paths and costs of path planning to satisfy the motion constraints of the robotic dolphin. Furthermore, in order to meet the speed and optimization of planned path, a variant RRT algorithm combined with A* algorithm is employed to generate feasible path for the robotic dolphin. The path cost and calculation time of this method is lower. Finally, a tendon-driven continuum robotic dolphin is presented to provide the simulation platform for verifying the effectiveness of the proposed methods.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123770707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Two-stage Self-supervised MVS Network using Adaptive Depth Sampling 基于自适应深度采样的两阶段自监督MVS网络
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872231
Yangyan Deng, Ding Yuan, Hong Zhang
With the development of deep learning, multi-view stereo has achieved significant progress recently. Due to the expensive three-dimension supervision, self-supervised methods have more potential. In this work, a novel two-stage self-supervised learning framework for multi-view stereo is proposed to overcome photometric dependency and the effect of foreshortening. On considering that accurate depth hypothesis always plays an important role in estimating depth information. Therefore, this work concentrates on designing an adaptive depth sampling module based on neighboring spatial patches propagation, which is determined by the normal maps. From this point of view, a two-stage process is carried out in this work. In detail, the coarse initial depth maps and normal maps are obtained in the first stage, and then the network in the second stage refines the depth sampling module by taking the influence of foreshortening into account. Furthermore, the loss functions are developed including feature-metric consistency to overcome the photometric inconsistency caused by lighting variation. Moreover, the consistency between depth maps and normal maps is also employed in the loss functions. To evaluate the effectiveness of our proposed two-stage framework, the experiments are carried out on the DTU datasets. The experimental results demonstrate that our self-supervised learning framework has excellent performance compared to the baseline methods.
随着深度学习技术的发展,多视点立体视觉技术近年来取得了重大进展。由于三维监控成本高昂,自监督方法具有更大的潜力。在这项工作中,提出了一种新的两阶段自监督学习框架,以克服光度依赖和视野缩短的影响。考虑到准确的深度假设在深度信息估计中一直起着重要的作用。因此,本文的工作重点是设计一个基于相邻空间斑块传播的自适应深度采样模块,该模块由法线贴图决定。从这个角度来看,在这项工作中进行了两个阶段的过程。其中,在第一阶段获得粗初始深度图和法线图,然后在第二阶段的网络中考虑到预缩的影响,对深度采样模块进行细化。在此基础上,建立了包含特征度量一致性的损失函数,克服了光照变化引起的光度不一致。此外,在损失函数中还采用了深度图与法线图的一致性。为了评估我们提出的两阶段框架的有效性,在DTU数据集上进行了实验。实验结果表明,与基线方法相比,我们的自监督学习框架具有优异的性能。
{"title":"Two-stage Self-supervised MVS Network using Adaptive Depth Sampling","authors":"Yangyan Deng, Ding Yuan, Hong Zhang","doi":"10.1109/RCAR54675.2022.9872231","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872231","url":null,"abstract":"With the development of deep learning, multi-view stereo has achieved significant progress recently. Due to the expensive three-dimension supervision, self-supervised methods have more potential. In this work, a novel two-stage self-supervised learning framework for multi-view stereo is proposed to overcome photometric dependency and the effect of foreshortening. On considering that accurate depth hypothesis always plays an important role in estimating depth information. Therefore, this work concentrates on designing an adaptive depth sampling module based on neighboring spatial patches propagation, which is determined by the normal maps. From this point of view, a two-stage process is carried out in this work. In detail, the coarse initial depth maps and normal maps are obtained in the first stage, and then the network in the second stage refines the depth sampling module by taking the influence of foreshortening into account. Furthermore, the loss functions are developed including feature-metric consistency to overcome the photometric inconsistency caused by lighting variation. Moreover, the consistency between depth maps and normal maps is also employed in the loss functions. To evaluate the effectiveness of our proposed two-stage framework, the experiments are carried out on the DTU datasets. The experimental results demonstrate that our self-supervised learning framework has excellent performance compared to the baseline methods.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116602419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning* 基于多模态变压器和深度强化学习的自动驾驶决策*
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872180
Wen Fu, Yanjie Li, Zhaohui Ye, Qi Liu
On the basis of environmental information processed by the sensing module, the decision module in automatic driving integrates environmental and vehicle information to make the autonomous vehicle produce safe and reasonable driving behavior. Considering the complexity and variability of the driving environment of autonomous vehicles, researchers have begun to apply deep reinforcement learning (DRL) in the study of autonomous driving control strategies in recent years. In this paper, we apply an algorithm framework combining multimodal transformer and DRL to solve the autonomous driving decision problem in complex scenarios. We use ResNet and transformer to extract the features of LiDAR point cloud and image. We use Deep Deterministic Policy Gradient (DDPG) algorithm to complete the subsequent autonomous driving decision-making task. And we use information bottleneck to improve the sampling efficiency of RL. We use CARLA simulator to evaluate our approach. The results show that our approach allows the agent to learn better driving strategies.
自动驾驶中的决策模块在感知模块处理环境信息的基础上,将环境信息与车辆信息进行整合,使自动驾驶汽车产生安全合理的驾驶行为。考虑到自动驾驶汽车行驶环境的复杂性和可变性,近年来研究人员开始将深度强化学习(DRL)应用于自动驾驶控制策略的研究。本文采用多模态变压器和DRL相结合的算法框架来解决复杂场景下的自动驾驶决策问题。利用ResNet和transformer对激光雷达点云和图像进行特征提取。我们使用深度确定性策略梯度(Deep Deterministic Policy Gradient, DDPG)算法来完成后续的自动驾驶决策任务。并利用信息瓶颈来提高强化学习的采样效率。我们使用CARLA模拟器来评估我们的方法。结果表明,我们的方法允许智能体学习更好的驾驶策略。
{"title":"Decision Making for Autonomous Driving Via Multimodal Transformer and Deep Reinforcement Learning*","authors":"Wen Fu, Yanjie Li, Zhaohui Ye, Qi Liu","doi":"10.1109/RCAR54675.2022.9872180","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872180","url":null,"abstract":"On the basis of environmental information processed by the sensing module, the decision module in automatic driving integrates environmental and vehicle information to make the autonomous vehicle produce safe and reasonable driving behavior. Considering the complexity and variability of the driving environment of autonomous vehicles, researchers have begun to apply deep reinforcement learning (DRL) in the study of autonomous driving control strategies in recent years. In this paper, we apply an algorithm framework combining multimodal transformer and DRL to solve the autonomous driving decision problem in complex scenarios. We use ResNet and transformer to extract the features of LiDAR point cloud and image. We use Deep Deterministic Policy Gradient (DDPG) algorithm to complete the subsequent autonomous driving decision-making task. And we use information bottleneck to improve the sampling efficiency of RL. We use CARLA simulator to evaluate our approach. The results show that our approach allows the agent to learn better driving strategies.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131687619","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A semi-supervised support vector machines approach for condition monitoring of construction equipment 建筑设备状态监测的半监督支持向量机方法
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872264
Shubo Cao, Shitao Liu, Yunfei Shi, Yubo Pan, Lifang Han, Yiwei Yang
In this paper, a semi-supervised learning-based method for condition monitoring of construction equipment is developed. The method is suitable for vibration datasets collected from mechanical equipment on the construction site, for which class definitions are difficult to obtain. The collected vibration signals are analyzed in the time and frequency domain, respectively. Combining the statistical features of the vibration data and some expert information to obtain the category labels of extremely few data, the Fast Fourier transform (FFT) of the vibration signal is used for feature extraction to increase the ability of the classifier. Finally, the limited labeled samples and a large number of unlabeled samples are used as training sets to establish a condition monitoring model based on semi-supervised support vector machines. The performance of the proposed method is evaluated on the real datasets which collected on three different mechanical devices. The result shows that the correct classification rates of the method is 98.87%, 97.37% and 95.33% respectively, which proves that the proposed method is suitable for the condition monitoring of multiple mechanical equipment.
本文提出了一种基于半监督学习的施工设备状态监测方法。该方法适用于难以获得分类定义的施工现场机械设备的振动数据集。对采集到的振动信号分别进行时域和频域分析。结合振动数据的统计特征和一些专家信息获得极少数据的类别标签,利用振动信号的快速傅里叶变换(FFT)进行特征提取,提高分类器的分类能力。最后,将有限的标记样本和大量未标记样本作为训练集,建立基于半监督支持向量机的状态监测模型。在三种不同机械设备的实际数据集上对该方法的性能进行了评价。结果表明,该方法的正确分类率分别为98.87%、97.37%和95.33%,证明该方法适用于多台机械设备的状态监测。
{"title":"A semi-supervised support vector machines approach for condition monitoring of construction equipment","authors":"Shubo Cao, Shitao Liu, Yunfei Shi, Yubo Pan, Lifang Han, Yiwei Yang","doi":"10.1109/RCAR54675.2022.9872264","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872264","url":null,"abstract":"In this paper, a semi-supervised learning-based method for condition monitoring of construction equipment is developed. The method is suitable for vibration datasets collected from mechanical equipment on the construction site, for which class definitions are difficult to obtain. The collected vibration signals are analyzed in the time and frequency domain, respectively. Combining the statistical features of the vibration data and some expert information to obtain the category labels of extremely few data, the Fast Fourier transform (FFT) of the vibration signal is used for feature extraction to increase the ability of the classifier. Finally, the limited labeled samples and a large number of unlabeled samples are used as training sets to establish a condition monitoring model based on semi-supervised support vector machines. The performance of the proposed method is evaluated on the real datasets which collected on three different mechanical devices. The result shows that the correct classification rates of the method is 98.87%, 97.37% and 95.33% respectively, which proves that the proposed method is suitable for the condition monitoring of multiple mechanical equipment.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122346750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Design of A Continuum Robot System with Object Detection for the Diagnosis of Vocal Fold Lesions 具有目标检测的连续机器人系统用于声带病变诊断的设计
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872301
Fan Feng, Zefeng Liu, Yongfeng Cao, Le Xie
Currently, on the one hand, continuum robots have been widely used for robot-assisted minimally invasive surgery. On the other hand, deep learning is also widely used in medical image detection and recognition. However, there is no robotic system that integrates those two technologies for vocal fold tissue lesion detection. Therefore, in this paper, we designed a continuum robot for diagnosing vocal fold lesions based on the helical flexible joint and the master-slave kinematic mapping method is derived. In addition, we conducted experiments on object detection vocal fold lesions using a laryngeal model based on YOLOv5 by using the Pytorch framework.
目前,一方面,连续体机器人已广泛应用于机器人辅助微创手术。另一方面,深度学习也广泛应用于医学图像检测和识别。然而,目前还没有机器人系统将这两种技术集成到声带组织病变检测中。因此,本文设计了一种基于螺旋柔性关节的连续诊断声带病变机器人,并推导了主从运动映射方法。此外,我们利用Pytorch框架,利用基于YOLOv5的喉部模型进行了目标检测声带病变的实验。
{"title":"Design of A Continuum Robot System with Object Detection for the Diagnosis of Vocal Fold Lesions","authors":"Fan Feng, Zefeng Liu, Yongfeng Cao, Le Xie","doi":"10.1109/RCAR54675.2022.9872301","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872301","url":null,"abstract":"Currently, on the one hand, continuum robots have been widely used for robot-assisted minimally invasive surgery. On the other hand, deep learning is also widely used in medical image detection and recognition. However, there is no robotic system that integrates those two technologies for vocal fold tissue lesion detection. Therefore, in this paper, we designed a continuum robot for diagnosing vocal fold lesions based on the helical flexible joint and the master-slave kinematic mapping method is derived. In addition, we conducted experiments on object detection vocal fold lesions using a laryngeal model based on YOLOv5 by using the Pytorch framework.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121427653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Teleoperation of Dexterous Micro-Nano Hand with Haptic Devices 基于触觉装置的微纳灵巧手遥操作
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872241
Yue Zhao, Xiaoming Liu, Junnan Chen, M. Kojima, Qiang Huang, T. Arai
Micro-nano operation refers to the high-precision operation of the target on the micro-nano scale. It is widely used in the assembly of small devices, single-cell manipulation and analysis, and cell assembly in tissue engineering. At present, many micro-operations mainly rely on traditional manual operations, which have poor accuracy, low efficiency and low controllability. In this paper, a teleoperation system composed of a three-degree-of-freedom parallel micro-nano manipulator driven by piezoelectric ceramics and the 3D Systems’ Touch haptic device is designed. The system has the characteristics of small size, high precision, fast speed, and convenient operation. It can greatly reduce the technical threshold of the operator and make it more intuitive and efficient to complete the micro-nano operation task, which has a great market prospect.
微纳操作是指在微纳尺度上对目标进行高精度的操作。它广泛应用于小型装置的组装、单细胞操作和分析以及组织工程中的细胞组装。目前,许多微操作主要依靠传统的人工操作,精度差、效率低、可控性低。本文设计了一种由压电陶瓷驱动的三自由度并联微纳机械手和3D Systems的Touch触觉装置组成的遥操作系统。该系统具有体积小、精度高、速度快、操作方便等特点。它可以大大降低操作人员的技术门槛,使其更直观、高效地完成微纳操作任务,具有很大的市场前景。
{"title":"Teleoperation of Dexterous Micro-Nano Hand with Haptic Devices","authors":"Yue Zhao, Xiaoming Liu, Junnan Chen, M. Kojima, Qiang Huang, T. Arai","doi":"10.1109/RCAR54675.2022.9872241","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872241","url":null,"abstract":"Micro-nano operation refers to the high-precision operation of the target on the micro-nano scale. It is widely used in the assembly of small devices, single-cell manipulation and analysis, and cell assembly in tissue engineering. At present, many micro-operations mainly rely on traditional manual operations, which have poor accuracy, low efficiency and low controllability. In this paper, a teleoperation system composed of a three-degree-of-freedom parallel micro-nano manipulator driven by piezoelectric ceramics and the 3D Systems’ Touch haptic device is designed. The system has the characteristics of small size, high precision, fast speed, and convenient operation. It can greatly reduce the technical threshold of the operator and make it more intuitive and efficient to complete the micro-nano operation task, which has a great market prospect.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116873536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design of a Movable Rotating Magnetic Field Actuation System for Target Delivery in 3-D Vascular Model 三维血管模型中可移动旋转磁场致动系统的设计
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872287
Yuanhe Chen, Qingsong Xu
This paper presents a new movable rotating magnetic field actuation system by integrating a rotating permanent magnet as the end-effector of a robot arm. The permanent magnet is rotated by a stepper motor, which creates a rotating magnetic field for driving a millimeter-scale magnet robot in 3D space. The trajectory tracking control of the miniature robot in 3D vascular model filled with different liquids has been realized by programming the movement of the robot arm. Experimental study has been carried out to test the performance of the magnetic millirobot for catheter-based target delivery. The results demonstrate the effectiveness of the millirobot for tracking predefined 2-D planar and 3-D spatial trajectories in vascular model under wireless control by the created movable rotating magnetic field. The reported magnetic actuation system provides a promising solution for target delivery in vascular navigation.
本文提出了一种将旋转永磁体作为机械臂末端执行器的可移动旋转磁场驱动系统。永磁体由步进电机旋转,产生旋转磁场,用于驱动三维空间中的毫米级磁铁机器人。通过对机器人手臂的运动进行编程,实现了微型机器人在不同液体填充的三维血管模型中的轨迹跟踪控制。为了测试磁性微机器人在导管式靶投递中的性能,进行了实验研究。实验结果表明,该微机器人可以在无线控制下,通过所创建的可移动旋转磁场跟踪血管模型中预定义的二维平面和三维空间轨迹。磁致动系统为血管导航中的靶标递送提供了一种很有前途的解决方案。
{"title":"Design of a Movable Rotating Magnetic Field Actuation System for Target Delivery in 3-D Vascular Model","authors":"Yuanhe Chen, Qingsong Xu","doi":"10.1109/RCAR54675.2022.9872287","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872287","url":null,"abstract":"This paper presents a new movable rotating magnetic field actuation system by integrating a rotating permanent magnet as the end-effector of a robot arm. The permanent magnet is rotated by a stepper motor, which creates a rotating magnetic field for driving a millimeter-scale magnet robot in 3D space. The trajectory tracking control of the miniature robot in 3D vascular model filled with different liquids has been realized by programming the movement of the robot arm. Experimental study has been carried out to test the performance of the magnetic millirobot for catheter-based target delivery. The results demonstrate the effectiveness of the millirobot for tracking predefined 2-D planar and 3-D spatial trajectories in vascular model under wireless control by the created movable rotating magnetic field. The reported magnetic actuation system provides a promising solution for target delivery in vascular navigation.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115148064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Pipeline Robot Positioning System Based on Machine Learning 基于机器学习的管道机器人定位系统
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872302
Binglin Li, Qiang Lei, Pai Li, Y. Lian
With the continuous development of artificial intelligence, sewage pipeline robot is also gradually intelligent. This intelligent system is inseparable from machine perception systems and machine learning. Therefore, for the problem that the robot in the sewage pipeline can not locate accurately, a pipeline robot positioning system based on machine learning is designed. From the perspective of computer vision, the full convolution neural network is used to locate the robot. The robot can realize its positioning function by acquiring a single RGB (Red Green Blue) image from the current perspective. The positioning results are combined with the robot mobile platform system to complete the robot navigation task. Through the test in the simulated sewage pipeline scene, the practical value of the system method is verified. The experimental data show that the positioning and navigation system has high positioning accuracy, strong stability and certain practical value.
随着人工智能的不断发展,污水管道机器人也逐渐智能化。这个智能系统离不开机器感知系统和机器学习。因此,针对机器人在污水管道中无法准确定位的问题,设计了一种基于机器学习的管道机器人定位系统。从计算机视觉的角度出发,利用全卷积神经网络对机器人进行定位。机器人通过获取当前视角的单个RGB(红绿蓝)图像来实现定位功能。将定位结果与机器人移动平台系统相结合,完成机器人导航任务。通过在模拟污水管道场景中的测试,验证了系统方法的实用价值。实验数据表明,该定位导航系统定位精度高,稳定性强,具有一定的实用价值。
{"title":"Pipeline Robot Positioning System Based on Machine Learning","authors":"Binglin Li, Qiang Lei, Pai Li, Y. Lian","doi":"10.1109/RCAR54675.2022.9872302","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872302","url":null,"abstract":"With the continuous development of artificial intelligence, sewage pipeline robot is also gradually intelligent. This intelligent system is inseparable from machine perception systems and machine learning. Therefore, for the problem that the robot in the sewage pipeline can not locate accurately, a pipeline robot positioning system based on machine learning is designed. From the perspective of computer vision, the full convolution neural network is used to locate the robot. The robot can realize its positioning function by acquiring a single RGB (Red Green Blue) image from the current perspective. The positioning results are combined with the robot mobile platform system to complete the robot navigation task. Through the test in the simulated sewage pipeline scene, the practical value of the system method is verified. The experimental data show that the positioning and navigation system has high positioning accuracy, strong stability and certain practical value.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127001195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Wireless Ionic sensor on microrobots for Medical Application 医用微型机器人的无线离子传感器
Pub Date : 2022-07-17 DOI: 10.1109/RCAR54675.2022.9872232
Jing Zhao, Zhongyi Li, Chunyang Li, Fanqing Zhang
Health detection and early diagnosis of disease have become one of the most concerned topics. However, the existing medical detection equipment were limited by huge size or sensitivity, which were unable to satisfy growing demand. Therefore, the microrobot combined with sensors can be a new route to realize the in-situ detection with more sensitivity and precision in real time due to the tiny scale and flexible movement. Here we introduced a micro wireless ionic sensor based on LC resonant circuit, which required no on-board power and can be easily fabricated on the microrobot to realize the real-time wireless sensing signal transmission. Further, the sensor fabricated on microrobot can realize remote sensing based on changes of the local imaging signal during navigation in magnetic field-based medical imaging equipment such as MRI or MPI. In addition, the non-invasive implantation of sensors on microrobots will provide more possible applications for future in vivo monitoring technology.
健康检测和疾病早期诊断已成为人们最为关注的话题之一。然而,现有的医疗检测设备受限于巨大的尺寸或灵敏度,无法满足日益增长的需求。因此,结合传感器的微型机器人由于其微小的尺度和灵活的运动,可以成为实现实时原位检测的新途径,具有更高的灵敏度和精度。本文介绍了一种基于LC谐振电路的微型无线离子传感器,该传感器不需要板载电源,可以很容易地在微型机器人上制作,实现无线传感信号的实时传输。此外,在MRI或MPI等基于磁场的医学成像设备中,基于导航过程中局部成像信号的变化,制作在微型机器人上的传感器可以实现遥感。此外,传感器在微型机器人上的无创植入将为未来的体内监测技术提供更多可能的应用。
{"title":"Wireless Ionic sensor on microrobots for Medical Application","authors":"Jing Zhao, Zhongyi Li, Chunyang Li, Fanqing Zhang","doi":"10.1109/RCAR54675.2022.9872232","DOIUrl":"https://doi.org/10.1109/RCAR54675.2022.9872232","url":null,"abstract":"Health detection and early diagnosis of disease have become one of the most concerned topics. However, the existing medical detection equipment were limited by huge size or sensitivity, which were unable to satisfy growing demand. Therefore, the microrobot combined with sensors can be a new route to realize the in-situ detection with more sensitivity and precision in real time due to the tiny scale and flexible movement. Here we introduced a micro wireless ionic sensor based on LC resonant circuit, which required no on-board power and can be easily fabricated on the microrobot to realize the real-time wireless sensing signal transmission. Further, the sensor fabricated on microrobot can realize remote sensing based on changes of the local imaging signal during navigation in magnetic field-based medical imaging equipment such as MRI or MPI. In addition, the non-invasive implantation of sensors on microrobots will provide more possible applications for future in vivo monitoring technology.","PeriodicalId":304963,"journal":{"name":"2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126406131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 IEEE International Conference on Real-time Computing and Robotics (RCAR)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1