首页 > 最新文献

2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)最新文献

英文 中文
Full Utilization of a Single Image by Characterizing Multiple Regions of Interest for Line Tracing 充分利用单幅图像特征的多个感兴趣的区域线跟踪
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011795
Jinsung Ahn, Y. Yamakawa
This paper presents a new method of image processing for the line tracing task, which is one of the simple and fundamental tasks that has been applied to an unmanned system, utilizing multiple regions of interest to draw information from the entire image which was discarded in traditional image processing method for more accurate and flexible line trace. This new method divides the acquired image by machine vision into 3 regions: feedback region, prediction region, and inspection region. And different process was applied to each region to acquire parameters depending on the characteristics of each region that can enhance line tracing performance. In this paper, parameters of the new method are applied to the proportional control method and implemented to the robot arm and the camera and evaluated with the basic proportional control by comparing adaptability to a sharp curve. Consequently, the new method provided more adaptability in line tracing compared to the traditional single region of interest method.
本文提出了一种新的图像处理方法,利用多个感兴趣区域从整个图像中提取信息,以获得更精确和灵活的线条跟踪,这是无人系统中应用的简单而基本的任务之一。该方法将机器视觉获取的图像划分为3个区域:反馈区、预测区和检测区。根据每个区域的特点,对每个区域采用不同的处理方法获取参数,以提高直线跟踪性能。本文将新方法的参数应用到比例控制方法中,并将其应用到机器人手臂和相机上,并通过比较对锐曲线的适应性来与基本比例控制进行评价。因此,与传统的单一感兴趣区域方法相比,该方法在直线跟踪方面具有更强的适应性。
{"title":"Full Utilization of a Single Image by Characterizing Multiple Regions of Interest for Line Tracing","authors":"Jinsung Ahn, Y. Yamakawa","doi":"10.1109/ROBIO55434.2022.10011795","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011795","url":null,"abstract":"This paper presents a new method of image processing for the line tracing task, which is one of the simple and fundamental tasks that has been applied to an unmanned system, utilizing multiple regions of interest to draw information from the entire image which was discarded in traditional image processing method for more accurate and flexible line trace. This new method divides the acquired image by machine vision into 3 regions: feedback region, prediction region, and inspection region. And different process was applied to each region to acquire parameters depending on the characteristics of each region that can enhance line tracing performance. In this paper, parameters of the new method are applied to the proportional control method and implemented to the robot arm and the camera and evaluated with the basic proportional control by comparing adaptability to a sharp curve. Consequently, the new method provided more adaptability in line tracing compared to the traditional single region of interest method.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115232115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Stair-Climbing Robot with Star-wheel Configuration 星轮结构的爬楼梯机器人
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011928
Tongxin Cui, Wenhui Wang, Zheng Zhu, Jing Wu, Zhenzhong Jia
This paper proposes a four-wheel mobile robot that uses passive star-wheel configuration to climb stairs. Without adding any control complexity, the robot can climb a standard indoor staircase of 15 x 28cm at a speed of 0.7 $s$ / step. For stairs of other sizes, it also has a certain adaptability, avoiding the problem of slipping when using active star-wheel to climb stairs. This paper analyzes the obstacle-surmounting conditions of the four-star-wheel robot during stair climbing, and uses statics to calculate the driving torque. We use simulation to validate the torque consumption study, and prove the stability of the robot's central trajectory during stair climbing. These results provide a basis to quantify the robot's stair-climbing capability under certain load. We build an robot prototype platform and conduct physical experimentation to validate the robot performance.
提出了一种采用被动星轮结构的四轮移动爬楼梯机器人。在不增加任何控制复杂性的情况下,机器人可以以每步0.7美元的速度爬上15 x 28厘米的标准室内楼梯。对于其他尺寸的楼梯,也具有一定的适应性,避免了使用有源星轮爬楼梯时打滑的问题。本文分析了四星级轮式机器人在爬楼梯过程中的越障条件,并利用静力学方法计算了驱动力矩。通过仿真验证了扭矩消耗的研究结果,并证明了机器人在爬楼梯过程中中心轨迹的稳定性。这些结果为机器人在一定载荷下的爬楼梯能力的量化提供了依据。我们搭建了机器人原型平台,并进行了物理实验来验证机器人的性能。
{"title":"A Stair-Climbing Robot with Star-wheel Configuration","authors":"Tongxin Cui, Wenhui Wang, Zheng Zhu, Jing Wu, Zhenzhong Jia","doi":"10.1109/ROBIO55434.2022.10011928","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011928","url":null,"abstract":"This paper proposes a four-wheel mobile robot that uses passive star-wheel configuration to climb stairs. Without adding any control complexity, the robot can climb a standard indoor staircase of 15 x 28cm at a speed of 0.7 $s$ / step. For stairs of other sizes, it also has a certain adaptability, avoiding the problem of slipping when using active star-wheel to climb stairs. This paper analyzes the obstacle-surmounting conditions of the four-star-wheel robot during stair climbing, and uses statics to calculate the driving torque. We use simulation to validate the torque consumption study, and prove the stability of the robot's central trajectory during stair climbing. These results provide a basis to quantify the robot's stair-climbing capability under certain load. We build an robot prototype platform and conduct physical experimentation to validate the robot performance.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"975 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123077849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Experiments of a Robotic Arm with a Rigid-Soft Coupling Structure* 一种具有刚软耦合结构的机械臂设计与实验*
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011683
W. He, Tao Wang
Aiming at the insufficient load capacity of a soft robot, a robotic arm based on rigid-soft coupling structure was proposed. It is composed of fluidic soft actuators external installed and a rigid skeleton in central. The stiffness variation of the skeleton is realized by using jamming principle. The rigid skeleton is a Y-shaped linkage mechanism, which can realize bending and elongation simultaneously. This coupling structure has the same degrees of freedom in comparison with the original three-chamber soft robotic arm without the rigid skeleton. A prototype of the robotic arm as well as an experimental setup were developed. Load capacity experiments and dynamic response experiments of the robotic arm were implemented respectively. The results verify that the proposed rigid-soft coupling robotic arm is superior to the skeletonless soft robotic arm in terms of load-carrying capacity and dynamic response performance.
针对软体机器人承载能力不足的问题,提出了一种基于刚软耦合结构的机械臂。它由外部安装的流体软执行器和中央安装的刚性骨架组成。利用干扰原理实现了骨架的刚度变化。刚性骨架为y形连杆机构,可同时实现弯曲和伸长。这种耦合结构与原有的无刚性骨架的三腔软机械臂相比,具有相同的自由度。开发了机械臂的原型和实验装置。分别进行了机械臂承载能力实验和动态响应实验。结果表明,所提出的刚软耦合机械臂在承载能力和动态响应性能方面优于无骨柔性机械臂。
{"title":"Design and Experiments of a Robotic Arm with a Rigid-Soft Coupling Structure*","authors":"W. He, Tao Wang","doi":"10.1109/ROBIO55434.2022.10011683","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011683","url":null,"abstract":"Aiming at the insufficient load capacity of a soft robot, a robotic arm based on rigid-soft coupling structure was proposed. It is composed of fluidic soft actuators external installed and a rigid skeleton in central. The stiffness variation of the skeleton is realized by using jamming principle. The rigid skeleton is a Y-shaped linkage mechanism, which can realize bending and elongation simultaneously. This coupling structure has the same degrees of freedom in comparison with the original three-chamber soft robotic arm without the rigid skeleton. A prototype of the robotic arm as well as an experimental setup were developed. Load capacity experiments and dynamic response experiments of the robotic arm were implemented respectively. The results verify that the proposed rigid-soft coupling robotic arm is superior to the skeletonless soft robotic arm in terms of load-carrying capacity and dynamic response performance.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"273 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127333126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
RBT-HCI: A Reliable Behavior Tree Planning Method with Human-Computer Interaction RBT-HCI:一种可靠的人机交互行为树规划方法
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011651
Yunlong Wu, Jinghua Li, Haoxiang Jin, Jiexin Zhang, Yanzhen Wang
In this paper, we propose RBT-HCI, a reliable behavior tree (BT) planning method with human-computer interaction, aiming at generating an interpretable and human-acceptable BT. Compared with other BT generation methods, RBT-HCI can reliably plan a BT based on the knowledge base. When an available BT cannot be planned automatically, instead of terminating or relaxing the rules, RBT-HCI provides a new idea, which is to make decisions through human-computer interaction, thereby enhancing the reliability and robustness of the method. The effectiveness of RBT-HCI is verified by an example of robot grasping objects, showing that a reliable and robust planning result can be obtained through knowledge-based automatic planning and human-computer interaction.
本文提出了基于人机交互的可靠行为树规划方法RBT-HCI,旨在生成可解释且人类可接受的行为树,与其他行为树生成方法相比,RBT-HCI可以基于知识库可靠地规划行为树。当可用BT无法自动规划时,RBT-HCI提供了一种新的思路,即通过人机交互进行决策,从而增强了方法的可靠性和鲁棒性,而不是终止或放松规则。通过机器人抓取物体的实例验证了RBT-HCI的有效性,表明通过基于知识的自动规划和人机交互可以获得可靠的鲁棒规划结果。
{"title":"RBT-HCI: A Reliable Behavior Tree Planning Method with Human-Computer Interaction","authors":"Yunlong Wu, Jinghua Li, Haoxiang Jin, Jiexin Zhang, Yanzhen Wang","doi":"10.1109/ROBIO55434.2022.10011651","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011651","url":null,"abstract":"In this paper, we propose RBT-HCI, a reliable behavior tree (BT) planning method with human-computer interaction, aiming at generating an interpretable and human-acceptable BT. Compared with other BT generation methods, RBT-HCI can reliably plan a BT based on the knowledge base. When an available BT cannot be planned automatically, instead of terminating or relaxing the rules, RBT-HCI provides a new idea, which is to make decisions through human-computer interaction, thereby enhancing the reliability and robustness of the method. The effectiveness of RBT-HCI is verified by an example of robot grasping objects, showing that a reliable and robust planning result can be obtained through knowledge-based automatic planning and human-computer interaction.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125123443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Visuotactile Feedback Parallel Gripper for Robotic Adaptive Grasping 机器人自适应抓取的视触觉反馈平行夹持器
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011873
Boyue Zhang, Shaowei Cui, C. Zhang, Jingyi Hu, Shuo Wang
In robot grasp and dexterous manipulation tasks, tactile sensing is important for the control adjustment of the manipulator. In this paper, we present a novel low-cost parallel gripper with high-resolution tactile sensing, named the GelStereo Gripper. Furthermore, an adaptive grasp strategy is proposed to endow the gripper with tactile-feedback grasp stability-maintaining ability. We install the gripper on our robot platform and conduct various grasp experiments by utilizing proposed control methods. Experimental results verify the reliability of the GelStereo gripper and also prove the effectiveness of the proposed strategy for experimental objects with different features.
在机器人抓取和灵巧操作任务中,触觉感知对机械手的控制调节具有重要意义。在本文中,我们提出了一种新型的低成本的具有高分辨率触觉传感的平行夹持器,称为GelStereo夹持器。在此基础上,提出了一种自适应抓取策略,使机械手具有触觉反馈的抓取稳定性保持能力。我们将抓取器安装在我们的机器人平台上,并利用提出的控制方法进行各种抓取实验。实验结果验证了GelStereo夹持器的可靠性,也证明了该策略对不同特征的实验对象的有效性。
{"title":"Visuotactile Feedback Parallel Gripper for Robotic Adaptive Grasping","authors":"Boyue Zhang, Shaowei Cui, C. Zhang, Jingyi Hu, Shuo Wang","doi":"10.1109/ROBIO55434.2022.10011873","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011873","url":null,"abstract":"In robot grasp and dexterous manipulation tasks, tactile sensing is important for the control adjustment of the manipulator. In this paper, we present a novel low-cost parallel gripper with high-resolution tactile sensing, named the GelStereo Gripper. Furthermore, an adaptive grasp strategy is proposed to endow the gripper with tactile-feedback grasp stability-maintaining ability. We install the gripper on our robot platform and conduct various grasp experiments by utilizing proposed control methods. Experimental results verify the reliability of the GelStereo gripper and also prove the effectiveness of the proposed strategy for experimental objects with different features.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125174560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Optimized Fingering Planning for Automatic Piano Playing Using Dual-arm Robot System 利用双臂机器人系统优化钢琴自动弹奏指法规划
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011881
Wenjing Shi, Yihui Li, Y. Guan, Xiaohan Chen, Shengtian Yang, Senyu Mo
Robots can be used to play musical instruments such as the piano, but existing robots are not automated enough for this purpose. In this paper, we design an automatic finger and arm planning system for dual-arm robots, whose input object is a commonly used bi-phonic musical score with high-pitched and low-pitched voices. The digital score can be obtained from methods in the field of Optical Score Recognition. We combine the characteristics of the score and the robot to automatically generate fingering using a Dynamic Planning approach. Then we generate the movements of the robot's arms based on the annotated fingering. Finally, it is demonstrated by simulated experiments. Our method is more applicable to robots than general fingering generation algorithms.
机器人可以用来演奏乐器,比如钢琴,但现有的机器人在这方面的自动化程度还不够。本文设计了一种双臂机器人手指手臂自动规划系统,该系统的输入对象是常用的带有高音和低音的双音乐谱。数字分数可以从光学分数识别领域的方法中获得。我们结合了乐谱和机器人的特点,使用动态规划方法自动生成指法。然后根据标注的指法生成机器人手臂的运动。最后,通过仿真实验进行了验证。我们的方法比一般的指法生成算法更适用于机器人。
{"title":"Optimized Fingering Planning for Automatic Piano Playing Using Dual-arm Robot System","authors":"Wenjing Shi, Yihui Li, Y. Guan, Xiaohan Chen, Shengtian Yang, Senyu Mo","doi":"10.1109/ROBIO55434.2022.10011881","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011881","url":null,"abstract":"Robots can be used to play musical instruments such as the piano, but existing robots are not automated enough for this purpose. In this paper, we design an automatic finger and arm planning system for dual-arm robots, whose input object is a commonly used bi-phonic musical score with high-pitched and low-pitched voices. The digital score can be obtained from methods in the field of Optical Score Recognition. We combine the characteristics of the score and the robot to automatically generate fingering using a Dynamic Planning approach. Then we generate the movements of the robot's arms based on the annotated fingering. Finally, it is demonstrated by simulated experiments. Our method is more applicable to robots than general fingering generation algorithms.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"223 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125832515","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Precise LiDAR SLAM in Structured Scene Using Finite Plane and Prior Constraint 基于有限平面和先验约束的结构场景精确激光雷达SLAM
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011847
Yuhui Xie, Wentao Zhao, Jiahao Wang, Jingchuan Wang, Weidong Chen
In this paper, we propose a precise LiDAR SLAM in optimization framework using plane-like object as landmark. Compared to general methods, finite plane feature is used to represent landmark and a new residual model is designed, making constraint from edge of landmark can be used to limit the parallel position between LiDAR and landmark, leading to a more accurate result. Moreover, floor plan is used to provide global pose for reduction of drift, and additionally feature orientation prior is used to prevent map distortion when updating the inaccurate part of floor plan. Experiments are conducted using data collected in real environment. The result qualitatively shows that proposed method can build a corrected map from floor plan without distortion, and quantitatively verifies that proposed method can outperform other baseline methods in accuracy.
本文提出了一种以类平面目标为地标的精确激光雷达SLAM优化框架。与一般方法相比,该方法利用有限平面特征来表示地标,并设计了新的残差模型,利用地标边缘约束来限制激光雷达与地标之间的平行位置,从而获得更精确的结果。此外,平面图提供全局姿态以减少漂移,另外,在更新平面图的不准确部分时,使用特征取向先验来防止地图失真。实验采用在真实环境中采集的数据进行。定性地验证了该方法可以在不失真的情况下从平面图中生成校正图,定量地验证了该方法在精度上优于其他基线方法。
{"title":"Precise LiDAR SLAM in Structured Scene Using Finite Plane and Prior Constraint","authors":"Yuhui Xie, Wentao Zhao, Jiahao Wang, Jingchuan Wang, Weidong Chen","doi":"10.1109/ROBIO55434.2022.10011847","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011847","url":null,"abstract":"In this paper, we propose a precise LiDAR SLAM in optimization framework using plane-like object as landmark. Compared to general methods, finite plane feature is used to represent landmark and a new residual model is designed, making constraint from edge of landmark can be used to limit the parallel position between LiDAR and landmark, leading to a more accurate result. Moreover, floor plan is used to provide global pose for reduction of drift, and additionally feature orientation prior is used to prevent map distortion when updating the inaccurate part of floor plan. Experiments are conducted using data collected in real environment. The result qualitatively shows that proposed method can build a corrected map from floor plan without distortion, and quantitatively verifies that proposed method can outperform other baseline methods in accuracy.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126650035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Channel-distribution Hybrid Deep Learning for sEMG-based Gesture Recognition 基于表面肌电信号的手势识别的通道分布混合深度学习
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011951
Keyi Lu, Hao Guo, Fei Qi, Peihao Gong, Zhihao Gu, Lining Sun, Haibo Huang
In recent years, CNNs (Convolutional Neural Networks) with their powerful feature representation and feature learning capabilities, have played an important role in gesture recognition tasks based on sparse multichannel surface EMG signals. As each muscle group in the upper limb plays a different role in a particular hand movement, we propose a hybrid CNN model that considers the spatial distribution of muscle groups in the myoelectric channel to improve the accuracy of hand gesture recognition. The model takes the spectrogram of CWT (Continuous Wavelet Transform) as input, based on the spatial distribution of channels, decomposes all channels into multiple input streams, lets the CNN learn the features of each stream separately, and gradually fuses (slowly fusion) the features learned by each stream, and then performs gesture classification. Finally, the results of several of these stream-division methods are fused for decision making to obtain classification accuracies. The proposed model was validated and tested on the Nina Pro DB4 dataset, and the average accuracy was improved compared to both traditional machine learning methods and multi-stream CNN models that do not take into account the spatial distribution of channels.
近年来,卷积神经网络(cnn)以其强大的特征表示和特征学习能力,在基于稀疏多通道表面肌电信号的手势识别任务中发挥了重要作用。由于上肢的每个肌肉群在特定的手部运动中发挥着不同的作用,我们提出了一种混合CNN模型,该模型考虑了肌电通道中肌肉群的空间分布,以提高手势识别的准确性。该模型以CWT (Continuous Wavelet Transform)的谱图作为输入,基于通道的空间分布,将所有通道分解成多个输入流,让CNN分别学习每个流的特征,并将每个流学习到的特征逐渐融合(slowly fusion),然后进行手势分类。最后,将几种划分方法的结果进行融合,以获得分类精度。在Nina Pro DB4数据集上对该模型进行了验证和测试,与传统机器学习方法和不考虑频道空间分布的多流CNN模型相比,该模型的平均准确率有所提高。
{"title":"Channel-distribution Hybrid Deep Learning for sEMG-based Gesture Recognition","authors":"Keyi Lu, Hao Guo, Fei Qi, Peihao Gong, Zhihao Gu, Lining Sun, Haibo Huang","doi":"10.1109/ROBIO55434.2022.10011951","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011951","url":null,"abstract":"In recent years, CNNs (Convolutional Neural Networks) with their powerful feature representation and feature learning capabilities, have played an important role in gesture recognition tasks based on sparse multichannel surface EMG signals. As each muscle group in the upper limb plays a different role in a particular hand movement, we propose a hybrid CNN model that considers the spatial distribution of muscle groups in the myoelectric channel to improve the accuracy of hand gesture recognition. The model takes the spectrogram of CWT (Continuous Wavelet Transform) as input, based on the spatial distribution of channels, decomposes all channels into multiple input streams, lets the CNN learn the features of each stream separately, and gradually fuses (slowly fusion) the features learned by each stream, and then performs gesture classification. Finally, the results of several of these stream-division methods are fused for decision making to obtain classification accuracies. The proposed model was validated and tested on the Nina Pro DB4 dataset, and the average accuracy was improved compared to both traditional machine learning methods and multi-stream CNN models that do not take into account the spatial distribution of channels.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126956445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Speech-Vision Based Multi-Modal AI Control of a Magnetic Anchored and Actuated Endoscope 基于语音视觉的磁锚定驱动内窥镜多模态人工智能控制
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011904
Jixiu Li, Yisen Huang, W. Ng, T. Cheng, Xixin Wu, Q. Dou, Helen M. Meng, P. Heng, Yunhui Liu, S. Chan, D. Navarro-Alarcon, Calvin Sze Hang Ng, Philip Wai Yan Chiu, Zheng Li
In minimally invasive surgery (MIS), controlling the endoscope view is crucial for the operation. Many robotic endoscope holders were developed aiming to address this prob-lem,. These systems rely on joystick, foot pedal, simple voice command, etc. to control the robot. These methods requires surgeons extra effort and are not intuitive enough. In this paper, we propose a speech-vision based multi-modal AI approach, which integrates deep learning based instrument detection, automatic speech recognition and robot visual servo control. Surgeons could communicate with the endoscope by speech to indicate their view preference, such as the instrument to be tracked. The instrument is detected by the deep learning neural network. Then the endoscope takes the detected instrument as the target and follows it with the visual servo controller. This method is applied to a magnetic anchored and guided endoscope and evaluated experimentally. Preliminary results demonstrated this approach is effective and requires little efforts for the surgeon to control the endoscope view intuitively.
在微创手术(MIS)中,控制内窥镜视野对手术至关重要。许多机器人内窥镜支架都是为了解决这个问题而开发的。这些系统依靠操纵杆、脚踏板、简单的语音指令等来控制机器人。这些方法需要外科医生额外的努力,而且不够直观。在本文中,我们提出了一种基于语音视觉的多模态人工智能方法,该方法集成了基于深度学习的仪器检测、自动语音识别和机器人视觉伺服控制。外科医生可以通过语音与内窥镜交流,以表明他们的视图偏好,例如要跟踪的仪器。采用深度学习神经网络对仪器进行检测。内窥镜以被检测仪器为目标,通过视觉伺服控制器对其进行跟踪。将该方法应用于磁锚定引导内窥镜,并进行了实验验证。初步结果表明,该方法是有效的,并且只需很少的努力,外科医生可以直观地控制内窥镜视图。
{"title":"Speech-Vision Based Multi-Modal AI Control of a Magnetic Anchored and Actuated Endoscope","authors":"Jixiu Li, Yisen Huang, W. Ng, T. Cheng, Xixin Wu, Q. Dou, Helen M. Meng, P. Heng, Yunhui Liu, S. Chan, D. Navarro-Alarcon, Calvin Sze Hang Ng, Philip Wai Yan Chiu, Zheng Li","doi":"10.1109/ROBIO55434.2022.10011904","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011904","url":null,"abstract":"In minimally invasive surgery (MIS), controlling the endoscope view is crucial for the operation. Many robotic endoscope holders were developed aiming to address this prob-lem,. These systems rely on joystick, foot pedal, simple voice command, etc. to control the robot. These methods requires surgeons extra effort and are not intuitive enough. In this paper, we propose a speech-vision based multi-modal AI approach, which integrates deep learning based instrument detection, automatic speech recognition and robot visual servo control. Surgeons could communicate with the endoscope by speech to indicate their view preference, such as the instrument to be tracked. The instrument is detected by the deep learning neural network. Then the endoscope takes the detected instrument as the target and follows it with the visual servo controller. This method is applied to a magnetic anchored and guided endoscope and evaluated experimentally. Preliminary results demonstrated this approach is effective and requires little efforts for the surgeon to control the endoscope view intuitively.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124699025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Kinematic Modeling of a Concentric Torsionally-Steerable Flexible Surgical Robot 同心扭控柔性手术机器人的设计与运动学建模
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011976
Ning Zhang, Yixuan Kong, Hailin Huang, Shuang Song, Bing Li
Flexible robots with torsional motion can be used in transnasal surgery which can improve the flexibility of the end-effector during the operation. However, the torsion or twisting function still can not satisfy the requirement of the complex cavities with a different structure. This paper proposed a concentric torsionally-steer able (CTS) flexible surgical robot with novel concentric tendon-driven tubes. A 2L-RPRPR model based on the rigidized equivalence model is established to guide the spatial motion of the CTS robot. On the basis of this model, the cooperative motion between the inner and outer tubes can be realized, such as linear movement and rotation. In the meanwhile, the concentric tendon-driven tubes can perform different bending directions and curvatures according to various cavities. And the C-shape or S-shape with different curvatures required by the surgery operation can also be achieved. The results of the simulation and experiments show that the proposed CTS robot has larger workspace and higher operational flexibility, which are sufficient for surgical operation.
具有扭转运动的柔性机器人可用于经鼻手术,可提高末端执行器在手术过程中的灵活性。然而,扭转或扭转功能仍不能满足具有不同结构的复杂腔体的要求。提出了一种具有新型同心肌腱驱动管的同心扭转导向柔性手术机器人。为指导CTS机器人的空间运动,建立了基于刚性等效模型的2L-RPRPR模型。在此模型的基础上,可以实现内外管之间的协同运动,如直线运动和旋转。同时,根据不同的腔体,同心肌腱驱动管具有不同的弯曲方向和曲率。并可实现手术所需的不同曲率的c形或s形。仿真和实验结果表明,所设计的CTS机器人具有更大的工作空间和更高的操作灵活性,足以进行外科手术。
{"title":"Design and Kinematic Modeling of a Concentric Torsionally-Steerable Flexible Surgical Robot","authors":"Ning Zhang, Yixuan Kong, Hailin Huang, Shuang Song, Bing Li","doi":"10.1109/ROBIO55434.2022.10011976","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011976","url":null,"abstract":"Flexible robots with torsional motion can be used in transnasal surgery which can improve the flexibility of the end-effector during the operation. However, the torsion or twisting function still can not satisfy the requirement of the complex cavities with a different structure. This paper proposed a concentric torsionally-steer able (CTS) flexible surgical robot with novel concentric tendon-driven tubes. A 2L-RPRPR model based on the rigidized equivalence model is established to guide the spatial motion of the CTS robot. On the basis of this model, the cooperative motion between the inner and outer tubes can be realized, such as linear movement and rotation. In the meanwhile, the concentric tendon-driven tubes can perform different bending directions and curvatures according to various cavities. And the C-shape or S-shape with different curvatures required by the surgery operation can also be achieved. The results of the simulation and experiments show that the proposed CTS robot has larger workspace and higher operational flexibility, which are sufficient for surgical operation.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129918384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1