首页 > 最新文献

IET Cybersystems and Robotics最新文献

英文 中文
An Effective Training Strategy for Upper-limb Rehabilitation Robots Based on Visual-haptic Feedback Using Potential Field 基于势场视觉-触觉反馈的上肢康复机器人有效训练策略
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907062
Guang Feng, Jiaji Zhang, G. Chai, Maoqin Li, Guokun Zuo, Lei Yang
Visual and haptic feedback are crucial to enhance the effectiveness of robot-assisted rehabilitation. To improve the performance of clinical rehabilitation training for patients with motor dysfunction, we propose an effective training strategy based on visual and haptic feedback. Haptic feedback is generated by a designed artificial potential field, which allows patients to perceive the correct training direction. The effectiveness of the proposed training strategy is initially verified, by recruiting three healthy subjects to perform circle drawing tasks on an upper limb rehabilitation robot. Experimental results showed that higher training accuracies were obtained using visual-haptic feedback compared to those with unimodal feedback. The proposed strategy can enhance the users' perception of the training process and corrects the incorrect movements in real-time, simultaneously. The current training strategy can be applied to commercial rehabilitation robots and meet the rehabilitation training needs of the users with impaired vision or the vision is unavailable.
视觉和触觉反馈是提高机器人辅助康复效果的关键。为了提高运动功能障碍患者的临床康复训练效果,我们提出了一种基于视觉和触觉反馈的有效训练策略。触觉反馈由设计的人工电位场产生,使患者感知到正确的训练方向。通过招募三名健康受试者在上肢康复机器人上完成画圆任务,初步验证了所提训练策略的有效性。实验结果表明,视觉-触觉反馈比单模态反馈具有更高的训练精度。所提出的策略可以增强用户对训练过程的感知,同时实时纠正不正确的动作。目前的训练策略可以应用于商用康复机器人,满足视力受损或视力缺失用户的康复训练需求。
{"title":"An Effective Training Strategy for Upper-limb Rehabilitation Robots Based on Visual-haptic Feedback Using Potential Field","authors":"Guang Feng, Jiaji Zhang, G. Chai, Maoqin Li, Guokun Zuo, Lei Yang","doi":"10.1109/CYBER55403.2022.9907062","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907062","url":null,"abstract":"Visual and haptic feedback are crucial to enhance the effectiveness of robot-assisted rehabilitation. To improve the performance of clinical rehabilitation training for patients with motor dysfunction, we propose an effective training strategy based on visual and haptic feedback. Haptic feedback is generated by a designed artificial potential field, which allows patients to perceive the correct training direction. The effectiveness of the proposed training strategy is initially verified, by recruiting three healthy subjects to perform circle drawing tasks on an upper limb rehabilitation robot. Experimental results showed that higher training accuracies were obtained using visual-haptic feedback compared to those with unimodal feedback. The proposed strategy can enhance the users' perception of the training process and corrects the incorrect movements in real-time, simultaneously. The current training strategy can be applied to commercial rehabilitation robots and meet the rehabilitation training needs of the users with impaired vision or the vision is unavailable.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"31 1","pages":"678-681"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81078178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Image-Based Visual Servoing under Field of View Constraints for Robot Manipulators* 机器人操纵臂视场约束下基于图像的视觉伺服*
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907340
Guoyu Zuo, Yan Liu, Gao Huang, Daoxiong Gong
The challenge in image-based visual servoing is to deal with the visibility constraints, which require the image features to always remain in the field of view (FOV) of the camera. In this paper, a novel constraint function is proposed to address this problem. The FOV constraint function represented by the coordinates of the features and the region boundaries defined in the image is added to the classical proportional controller, which leads the image features from the margin to the center of the image. Simulation results verify the efficiency of the modified controller by controlling a robot manipulator with eye-in-hand configuration.
基于图像的视觉伺服面临的挑战是如何处理可见性约束,这要求图像特征始终保持在相机的视场中。本文提出了一种新的约束函数来解决这一问题。在经典比例控制器中加入由特征坐标和图像中定义的区域边界表示的视场约束函数,将图像特征从边缘引导到图像中心。仿真结果验证了改进后的控制器对具有眼手结构的机械手的控制效率。
{"title":"Image-Based Visual Servoing under Field of View Constraints for Robot Manipulators*","authors":"Guoyu Zuo, Yan Liu, Gao Huang, Daoxiong Gong","doi":"10.1109/CYBER55403.2022.9907340","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907340","url":null,"abstract":"The challenge in image-based visual servoing is to deal with the visibility constraints, which require the image features to always remain in the field of view (FOV) of the camera. In this paper, a novel constraint function is proposed to address this problem. The FOV constraint function represented by the coordinates of the features and the region boundaries defined in the image is added to the classical proportional controller, which leads the image features from the margin to the center of the image. Simulation results verify the efficiency of the modified controller by controlling a robot manipulator with eye-in-hand configuration.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"62 1","pages":"77-82"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73899073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Comparison of Modality-Matched and Modality-Missed-Matched Sensory Feedback by Brain Mapping and Practical Trials 模态匹配与模态不匹配感觉反馈的脑图与实验比较
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907057
Saeed Bahrami Moqadam, Ahmad Saleh Asheghabadi, Farzaneh Norouzi, Nikki Akraminejad, Behruz Shiee Zadeh Yazdi, Jing Xu
This paper compares two methods of sensory feedback (SF) in prosthetic hands noninvasively by investigating practical experiments, a questionnaire form, and brain activity mapping. The modality-missed-matched sensory feedback (MMM-SF) is per-formed on remnant muscles of the amputated limb using transcutaneous electrical Stimulation (TES). In addition, an armband with multi-modal sensory stimulators is being used for the modality-matched sensory feedback (MM-SF) on the superficial layer of the skin. Both sensory stimulators have been synced with a designed myoelectric bionic hand, equipped with differ-ent sensors to assess surrounding stimuli. The results indicate that the MMM-SF imposes higher cognitive loads on amputee participants than the MM-SF strat-egy. Furthermore, the effects of sensory stimulation by proposed methods have been investigated by brain mapping through quantitative electroencephalography (QEEG) and low-resolution brain electromagnetic to-mography (LORETA), which shows that perceived SF in both approaches could assist in recovering the Alpha/Delta-band rhythm balance.
本文通过实际实验、问卷调查和脑活动测绘,比较了两种义肢无创感觉反馈方法。采用经皮电刺激(TES)对残肢残肌进行模态缺失匹配感觉反馈(MMM-SF)。此外,一个带有多模态感觉刺激器的臂章正在被用于皮肤浅层的模态匹配感觉反馈(MM-SF)。这两种感觉刺激器都与设计的肌电仿生手同步,配备不同的传感器来评估周围的刺激。结果表明,MM-SF策略对截肢者的认知负荷高于MM-SF策略。此外,通过定量脑电图(QEEG)和低分辨率脑电磁成像(LORETA)研究了上述方法的感觉刺激效果,结果表明,两种方法感知的SF都有助于恢复α / δ带节奏平衡。
{"title":"A Comparison of Modality-Matched and Modality-Missed-Matched Sensory Feedback by Brain Mapping and Practical Trials","authors":"Saeed Bahrami Moqadam, Ahmad Saleh Asheghabadi, Farzaneh Norouzi, Nikki Akraminejad, Behruz Shiee Zadeh Yazdi, Jing Xu","doi":"10.1109/CYBER55403.2022.9907057","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907057","url":null,"abstract":"This paper compares two methods of sensory feedback (SF) in prosthetic hands noninvasively by investigating practical experiments, a questionnaire form, and brain activity mapping. The modality-missed-matched sensory feedback (MMM-SF) is per-formed on remnant muscles of the amputated limb using transcutaneous electrical Stimulation (TES). In addition, an armband with multi-modal sensory stimulators is being used for the modality-matched sensory feedback (MM-SF) on the superficial layer of the skin. Both sensory stimulators have been synced with a designed myoelectric bionic hand, equipped with differ-ent sensors to assess surrounding stimuli. The results indicate that the MMM-SF imposes higher cognitive loads on amputee participants than the MM-SF strat-egy. Furthermore, the effects of sensory stimulation by proposed methods have been investigated by brain mapping through quantitative electroencephalography (QEEG) and low-resolution brain electromagnetic to-mography (LORETA), which shows that perceived SF in both approaches could assist in recovering the Alpha/Delta-band rhythm balance.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"47 5 1","pages":"498-503"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73013450","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Development of Unmanned Combat Game Platform 无人作战游戏平台的设计与开发
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907246
Lina Hao, Zhe Li, Shuai Wang, Chenling Hao
The unmanned combat game platform is the technical carrier to research unmanned combat issues. Although most current unmanned combat simulation platforms can effectively simulate the unmanned combat process, their scenes are fixed and single. They cannot carry out the secondary design of the scene. At the same time, they also lack an effective description of the scene information. Therefore, this paper takes air-ground unmanned combat as a specific task scenario and independently develops an unmanned combat deduction platform based on the Hybrid Stochastic Time Delay Petri Net (HSTPN) modelling theory and PyQt development tool. The platform supports scene modelling and model changes, deep reinforcement learning algorithm battles, animation deductions, file storage, etc. At the same time, a battle decision algorithm is designed based on Proximal Policy Optimization (PPO). The experimental results show that the unmanned combat game platform can fully realize the combat process simulation. Its scene modelling function can show all the hybrid characteristics of the combat process and support the modification of the scene model and its secondary development. The battle function can complete the confrontation game of the decision-making algorithm.
无人作战游戏平台是研究无人作战问题的技术载体。目前大多数无人作战仿真平台虽然能够有效模拟无人作战过程,但其场景固定且单一。他们不能进行场景的二次设计。同时,它们也缺乏对场景信息的有效描述。因此,本文以空地无人作战为具体任务场景,自主开发了基于混合随机时滞Petri网(HSTPN)建模理论和PyQt开发工具的无人作战演绎平台。平台支持场景建模和模型变更、深度强化学习算法对战、动画演绎、文件存储等。同时,设计了一种基于最近邻策略优化(PPO)的战斗决策算法。实验结果表明,该无人作战游戏平台能够充分实现作战过程仿真。其场景建模功能可以显示战斗过程的所有混合特性,并支持场景模型的修改和二次开发。战斗函数可以完成决策算法的对抗博弈。
{"title":"Design and Development of Unmanned Combat Game Platform","authors":"Lina Hao, Zhe Li, Shuai Wang, Chenling Hao","doi":"10.1109/CYBER55403.2022.9907246","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907246","url":null,"abstract":"The unmanned combat game platform is the technical carrier to research unmanned combat issues. Although most current unmanned combat simulation platforms can effectively simulate the unmanned combat process, their scenes are fixed and single. They cannot carry out the secondary design of the scene. At the same time, they also lack an effective description of the scene information. Therefore, this paper takes air-ground unmanned combat as a specific task scenario and independently develops an unmanned combat deduction platform based on the Hybrid Stochastic Time Delay Petri Net (HSTPN) modelling theory and PyQt development tool. The platform supports scene modelling and model changes, deep reinforcement learning algorithm battles, animation deductions, file storage, etc. At the same time, a battle decision algorithm is designed based on Proximal Policy Optimization (PPO). The experimental results show that the unmanned combat game platform can fully realize the combat process simulation. Its scene modelling function can show all the hybrid characteristics of the combat process and support the modification of the scene model and its secondary development. The battle function can complete the confrontation game of the decision-making algorithm.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"11 1","pages":"1032-1037"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74847213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Robust Seabed Terrain Contour Aid Navigation Method Facing the Smooth Terrain 面向平滑地形的鲁棒海底地形等高线辅助导航方法
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907123
Wenjun Zhang, Dong Ma, Jingxuan Gao, Teng Ma, Yueyang Ben
The underwater terrain-aid navigation (TAN) method using a single-beam sonar has demonstrated its potential for autonomous underwater vehicles (AUVs) long-range accurate navigation without the aid of acoustics arrays and satellites. This paper proposed a robust terrain contour aid navigation(TCAN) method using a single-beam sonar in the smooth terrain areas, which considered the error characteristics of an inertial navigation system(INS), can realize long-range underwater navigation. As for the measurement error of a single-beam sonar and the influence of the smooth terrain areas, this paper proposed a measurement confidence interval calculation method, which can reduce the influence of the measurement error on the navigational result, improving the accuracy and robustness of the TCAN method. The influence of algorithm parameters on the result of the navigation method are researched by simulation experiments. The results show that the navigation method can realize long-range underwater navigation in the smooth terrain areas on making full use of an INS error characteristics, and has a good application prospect.
使用单波束声纳的水下地形辅助导航(TAN)方法已经证明了其在没有声学阵列和卫星辅助的情况下自主水下航行器(auv)远程精确导航的潜力。本文提出了一种利用单波束声呐在平坦地形区域进行鲁棒地形轮廓辅助导航的方法,该方法考虑了惯性导航系统的误差特性,可实现水下远程导航。针对单波束声呐的测量误差和平坦地形区域的影响,本文提出了一种测量置信区间计算方法,该方法可以减小测量误差对导航结果的影响,提高TCAN方法的精度和鲁棒性。通过仿真实验研究了算法参数对导航结果的影响。结果表明,该导航方法充分利用惯导系统的误差特性,可在平坦地形区域实现远程水下导航,具有良好的应用前景。
{"title":"A Robust Seabed Terrain Contour Aid Navigation Method Facing the Smooth Terrain","authors":"Wenjun Zhang, Dong Ma, Jingxuan Gao, Teng Ma, Yueyang Ben","doi":"10.1109/CYBER55403.2022.9907123","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907123","url":null,"abstract":"The underwater terrain-aid navigation (TAN) method using a single-beam sonar has demonstrated its potential for autonomous underwater vehicles (AUVs) long-range accurate navigation without the aid of acoustics arrays and satellites. This paper proposed a robust terrain contour aid navigation(TCAN) method using a single-beam sonar in the smooth terrain areas, which considered the error characteristics of an inertial navigation system(INS), can realize long-range underwater navigation. As for the measurement error of a single-beam sonar and the influence of the smooth terrain areas, this paper proposed a measurement confidence interval calculation method, which can reduce the influence of the measurement error on the navigational result, improving the accuracy and robustness of the TCAN method. The influence of algorithm parameters on the result of the navigation method are researched by simulation experiments. The results show that the navigation method can realize long-range underwater navigation in the smooth terrain areas on making full use of an INS error characteristics, and has a good application prospect.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"29 1","pages":"1166-1170"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75058972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive PID Trajectory Tracking Algorithm Using Q-Learning for Mobile Robots 基于q -学习的移动机器人自适应PID轨迹跟踪算法
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907573
Xiaoliang Fan, Jin Sui, Naifeng He, Bi Zhang, Chunguang Bu, Junbo Yang, Lele Cui
Classical PID controllers usually rely on some prior knowledge to manually adjust the gains of the controller and determine them. However, when the mobile robot works in a complex and changeable environment, the fixed PID gains may be difficult to meet the needs of the robot trajectory tracking accuracy. Therefore, this paper proposes a Q-learning-based adaptive PID trajectory tracking algorithm. Firstly, we construct a trajectory tracking Q-PID controller based on the error model of mobile robot. Then, the Q-learning algorithm is used to adaptively adjust the gains of the PID controller online. Meanwhile, the incremental active learning exploration method is used to improve learning efficiency and adaptability of agent. Finally, we use simulation experiments to verify the high performance of our algorithm.
传统的PID控制器通常依靠一些先验知识来手动调整控制器的增益并确定它们。然而,当移动机器人工作在复杂多变的环境中时,固定的PID增益可能难以满足机器人轨迹跟踪精度的需要。因此,本文提出了一种基于q学习的自适应PID轨迹跟踪算法。首先,基于移动机器人的误差模型,构造了轨迹跟踪Q-PID控制器。然后,利用q -学习算法对PID控制器的增益进行在线自适应调整。同时,采用渐进式主动学习探索方法,提高智能体的学习效率和适应性。最后,通过仿真实验验证了算法的高性能。
{"title":"Adaptive PID Trajectory Tracking Algorithm Using Q-Learning for Mobile Robots","authors":"Xiaoliang Fan, Jin Sui, Naifeng He, Bi Zhang, Chunguang Bu, Junbo Yang, Lele Cui","doi":"10.1109/CYBER55403.2022.9907573","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907573","url":null,"abstract":"Classical PID controllers usually rely on some prior knowledge to manually adjust the gains of the controller and determine them. However, when the mobile robot works in a complex and changeable environment, the fixed PID gains may be difficult to meet the needs of the robot trajectory tracking accuracy. Therefore, this paper proposes a Q-learning-based adaptive PID trajectory tracking algorithm. Firstly, we construct a trajectory tracking Q-PID controller based on the error model of mobile robot. Then, the Q-learning algorithm is used to adaptively adjust the gains of the PID controller online. Meanwhile, the incremental active learning exploration method is used to improve learning efficiency and adaptability of agent. Finally, we use simulation experiments to verify the high performance of our algorithm.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"21 1","pages":"1112-1117"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82814100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A 3D Reconstruction Technology of Indoor Scene based on Image Sequence 基于图像序列的室内场景三维重建技术
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907578
Songna Zhang, Tong Jia, Wenhao Li, Xiaojun Sun
The 3D reconstruction technology of indoor scenes based on image sequences has always been the focus of research in computer vision. It can be widely used in medical diagnosis, unmanned driving, AR/VR, cultural relics restoration, and other fields. However, due to the complex information and cluttered features of indoor scenes, the existing feature matching algorithms and point cloud registration algorithms still have certain limitations in terms of computational efficiency and matching accuracy. Therefore, this paper firstly adopts a uniform extraction of ORB features method based on octree and a feature matching method based on colour and descriptor distance information and uses the RANSAC algorithm to eliminate mismatched points to obtain matching results with high accuracy. Secondly, this paper adopts a point cloud fine-registration method based on a double threshold constraint. Based on the point cloud normal vector angle threshold constraint, the search of the nearest neighbour point pair in the ICP algorithm is realized through the adaptive distance threshold constraint. Finally, experimental analysis is carried out in a real indoor scene to verify the effectiveness of the proposed algorithm in reconstruction efficiency and accuracy.
基于图像序列的室内场景三维重建技术一直是计算机视觉领域的研究热点。可广泛应用于医疗诊断、无人驾驶、AR/VR、文物修复等领域。然而,由于室内场景信息复杂、特征杂乱,现有的特征匹配算法和点云配准算法在计算效率和匹配精度上仍然存在一定的局限性。因此,本文首先采用基于八叉树的ORB特征均匀提取方法和基于颜色和描述子距离信息的特征匹配方法,并使用RANSAC算法消除不匹配点,获得精度较高的匹配结果。其次,采用基于双阈值约束的点云精细配准方法。在点云法向量角度阈值约束的基础上,通过自适应距离阈值约束实现ICP算法中最近邻点对的搜索。最后,在一个真实的室内场景中进行了实验分析,验证了所提算法在重建效率和精度上的有效性。
{"title":"A 3D Reconstruction Technology of Indoor Scene based on Image Sequence","authors":"Songna Zhang, Tong Jia, Wenhao Li, Xiaojun Sun","doi":"10.1109/CYBER55403.2022.9907578","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907578","url":null,"abstract":"The 3D reconstruction technology of indoor scenes based on image sequences has always been the focus of research in computer vision. It can be widely used in medical diagnosis, unmanned driving, AR/VR, cultural relics restoration, and other fields. However, due to the complex information and cluttered features of indoor scenes, the existing feature matching algorithms and point cloud registration algorithms still have certain limitations in terms of computational efficiency and matching accuracy. Therefore, this paper firstly adopts a uniform extraction of ORB features method based on octree and a feature matching method based on colour and descriptor distance information and uses the RANSAC algorithm to eliminate mismatched points to obtain matching results with high accuracy. Secondly, this paper adopts a point cloud fine-registration method based on a double threshold constraint. Based on the point cloud normal vector angle threshold constraint, the search of the nearest neighbour point pair in the ICP algorithm is realized through the adaptive distance threshold constraint. Finally, experimental analysis is carried out in a real indoor scene to verify the effectiveness of the proposed algorithm in reconstruction efficiency and accuracy.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"15 1","pages":"906-911"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88273516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Efficient Color and Geometric Feature Fusion Module for 6D Object Pose Estiamtion 一种有效的6D物体姿态估计颜色和几何特征融合模块
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907032
Jiangeng Li, Hong Liu, Gao Huang, Guoyu Zuo
6D pose estimation is widely used in robot tasks such as sorting and grasping. RGB-D-based methods have recently attained brilliant success, but they are still susceptible to heavy occlusion. Our critical insight is that color and geometry information in RGBD images are two complementary data, and the crux of the pose estimation problem under occlusion is fully leveraging them. Towards this end, we propose a new color and geometry feature fusion module that can efficiently leverage two complementary data sources from RGB-D images. Unlike prior fusion methods, we conduct a two-stage fusion strategy to do color-depth fusion and local-global fusion successively. Specifically, we fuse the color features extracted from RGB images into the point cloud in the first stage. In the second stage, we extract local and global features from the fused point cloud using an ASSANet-like network and splice them together to obtain the final fusion features. We conducted experiments on the widely used LineMod and YCB-Video datasets, which shows that our method improves the prediction accuracy while reducing the training time.
6D姿态估计广泛应用于机器人的分类、抓取等任务中。基于rgb - d的方法最近取得了辉煌的成功,但它们仍然容易受到严重遮挡的影响。我们的关键见解是RGBD图像中的颜色和几何信息是两个互补的数据,遮挡下姿态估计问题的关键是充分利用它们。为此,我们提出了一种新的颜色和几何特征融合模块,可以有效地利用来自RGB-D图像的两个互补数据源。与以往的融合方法不同,我们采用了两阶段融合策略,分别进行颜色深度融合和局部-全局融合。具体来说,我们在第一阶段将从RGB图像中提取的颜色特征融合到点云中。在第二阶段,我们使用类似assanet的网络从融合点云中提取局部和全局特征,并将它们拼接在一起,得到最终的融合特征。我们在广泛使用的LineMod和YCB-Video数据集上进行了实验,结果表明我们的方法在减少训练时间的同时提高了预测精度。
{"title":"An Efficient Color and Geometric Feature Fusion Module for 6D Object Pose Estiamtion","authors":"Jiangeng Li, Hong Liu, Gao Huang, Guoyu Zuo","doi":"10.1109/CYBER55403.2022.9907032","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907032","url":null,"abstract":"6D pose estimation is widely used in robot tasks such as sorting and grasping. RGB-D-based methods have recently attained brilliant success, but they are still susceptible to heavy occlusion. Our critical insight is that color and geometry information in RGBD images are two complementary data, and the crux of the pose estimation problem under occlusion is fully leveraging them. Towards this end, we propose a new color and geometry feature fusion module that can efficiently leverage two complementary data sources from RGB-D images. Unlike prior fusion methods, we conduct a two-stage fusion strategy to do color-depth fusion and local-global fusion successively. Specifically, we fuse the color features extracted from RGB images into the point cloud in the first stage. In the second stage, we extract local and global features from the fused point cloud using an ASSANet-like network and splice them together to obtain the final fusion features. We conducted experiments on the widely used LineMod and YCB-Video datasets, which shows that our method improves the prediction accuracy while reducing the training time.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"23 1","pages":"83-88"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74599402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design of Programmable Droplet Manipulation Platform Based on Magnetic Control 基于磁控的可编程液滴操作平台设计
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907625
Xianmiao Zhang, Jie Liu, Jiying Liu, Yu-zhou Wang, Mian Zhang, Hongbiao Xiang
Droplet actuation simplifies the handling of various reagents or samples and can be applied to a wide range of fields, including chemistry, biology, biomedical, and others. This paper presents a programmable droplet control system based on a magnetoelastic membrane and electromagnetic pillar array. Different magnetic blocks with different magnetization directions were designed on the silicone rubber membrane, and the magnetoelastic membrane deformed under the magnetic field generated by the array of electromagnetic pillars. By combining the gravitational forces of the droplet and the deformation of the magnetic membranes, the motion of the droplet can be controlled. Furthermore, the surface of membranes was ablated with a laser machine to impart superhydrophobic properties. The simulation results show that with the different magnetic fields, the droplet can move lengthwise, widthwise, and diagonally in the horizontal plane, and multiple droplets can be merged and mixed. In contrast to the traditional droplet control method, the droplet programmable movement control system utilizing superhydrophobic magnetoelastic membranes and an electromagnetic pillar array has better stationarity, flexibility and does not affect the basic properties of the droplets.
液滴驱动简化了各种试剂或样品的处理,可应用于广泛的领域,包括化学,生物学,生物医学等。提出了一种基于磁弹性膜和电磁柱阵列的可编程液滴控制系统。在硅橡胶膜上设计不同磁化方向的磁块,使磁弹性膜在电磁柱阵列产生的磁场下发生变形。通过结合液滴的重力和磁膜的变形,可以控制液滴的运动。此外,用激光机器烧蚀膜的表面以赋予其超疏水性。仿真结果表明,在不同的磁场作用下,液滴可以在水平面上进行纵向、横向和对角线运动,并且可以实现多个液滴的合并和混合。与传统的液滴控制方法相比,利用超疏水磁弹性膜和电磁柱阵列的液滴可编程运动控制系统具有更好的平稳性和灵活性,并且不影响液滴的基本性质。
{"title":"Design of Programmable Droplet Manipulation Platform Based on Magnetic Control","authors":"Xianmiao Zhang, Jie Liu, Jiying Liu, Yu-zhou Wang, Mian Zhang, Hongbiao Xiang","doi":"10.1109/CYBER55403.2022.9907625","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907625","url":null,"abstract":"Droplet actuation simplifies the handling of various reagents or samples and can be applied to a wide range of fields, including chemistry, biology, biomedical, and others. This paper presents a programmable droplet control system based on a magnetoelastic membrane and electromagnetic pillar array. Different magnetic blocks with different magnetization directions were designed on the silicone rubber membrane, and the magnetoelastic membrane deformed under the magnetic field generated by the array of electromagnetic pillars. By combining the gravitational forces of the droplet and the deformation of the magnetic membranes, the motion of the droplet can be controlled. Furthermore, the surface of membranes was ablated with a laser machine to impart superhydrophobic properties. The simulation results show that with the different magnetic fields, the droplet can move lengthwise, widthwise, and diagonally in the horizontal plane, and multiple droplets can be merged and mixed. In contrast to the traditional droplet control method, the droplet programmable movement control system utilizing superhydrophobic magnetoelastic membranes and an electromagnetic pillar array has better stationarity, flexibility and does not affect the basic properties of the droplets.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"21 1","pages":"1224-1229"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74911572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robot Manipulation Skill Learning Based on Dynamic Movement Primitive* 基于动态运动原语的机器人操作技能学习
Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-27 DOI: 10.1109/CYBER55403.2022.9907262
Yunfeng Bai, Fengming Li, Man Zhao, Wei Wang, Yibin Li, R. Song
This paper proposes a robot automatic valve turning control strategy based on teaching learning, which consists of teaching, model learning and task repetition. The first stage is the teaching and learning stage. The robot learns motor skills by observing the human performing tasks. In order to accurately learn motor skills from demonstrations, data alignment is performed on the teaching data through Dynamic Time Warping (DTW). The second stage is the model construction and learning stage. The high-level learning strategy aims to learn motor skills from demonstrations through Dynamic Movement Primitives (DMP), using the statistical approach Gaussian Mixture Model and Gaussian Mixture Regression (GMM-GMR) to analyze the data from demonstrations. And the valve turning is repetition. To verify the effectiveness of the proposed control strategy, the experiment of the butterfly valve closing is performed. The results show that the robot is able to learn and reproduce the valve reaching and turning tasks. It completes the valve closing action by turning the valve for 7 turns.
本文提出了一种基于教与学的机器人自动转阀控制策略,该策略由教学、模型学习和任务重复组成。第一阶段是教与学阶段。机器人通过观察人类执行任务来学习运动技能。为了从演示中准确地学习运动技能,通过动态时间翘曲(Dynamic Time Warping, DTW)对教学数据进行数据对齐。第二阶段是模式建构和学习阶段。高阶学习策略旨在通过动态运动原语(Dynamic Movement Primitives, DMP)从演示中学习运动技能,使用统计方法高斯混合模型和高斯混合回归(Gaussian Mixture Model, GMM-GMR)对演示数据进行分析。阀门转动是重复的。为了验证所提控制策略的有效性,进行了蝶阀关闭实验。结果表明,该机器人能够学习和再现阀门到达和转向任务。通过转动阀门7圈完成阀门关闭动作。
{"title":"Robot Manipulation Skill Learning Based on Dynamic Movement Primitive*","authors":"Yunfeng Bai, Fengming Li, Man Zhao, Wei Wang, Yibin Li, R. Song","doi":"10.1109/CYBER55403.2022.9907262","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907262","url":null,"abstract":"This paper proposes a robot automatic valve turning control strategy based on teaching learning, which consists of teaching, model learning and task repetition. The first stage is the teaching and learning stage. The robot learns motor skills by observing the human performing tasks. In order to accurately learn motor skills from demonstrations, data alignment is performed on the teaching data through Dynamic Time Warping (DTW). The second stage is the model construction and learning stage. The high-level learning strategy aims to learn motor skills from demonstrations through Dynamic Movement Primitives (DMP), using the statistical approach Gaussian Mixture Model and Gaussian Mixture Regression (GMM-GMR) to analyze the data from demonstrations. And the valve turning is repetition. To verify the effectiveness of the proposed control strategy, the experiment of the butterfly valve closing is performed. The results show that the robot is able to learn and reproduce the valve reaching and turning tasks. It completes the valve closing action by turning the valve for 7 turns.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"67 1","pages":"579-584"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76529737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IET Cybersystems and Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1