首页 > 最新文献

2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)最新文献

英文 中文
DeFCN-nano: An End-to-End Real-Time Object Detection for Insulator Defects DeFCN-nano:针对绝缘体缺陷的端到端实时目标检测
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354899
Xiongxin Zou, Yimin Zhou
It is important to achieve real-time and accurate detection of the insulator defects via the unmanned aerial vehicles (UAVs) so as to improve the inspection efficiency of the large-scale power grids. This paper studies the You Only Look Once version 8 (YOLOv8) and DeFCN object detection algorithms based on the deep learning techniques, then an end-to-end real-time insulator defect detection method is proposed based on the DeFCN. The DeFCN model is lightweighted referring to the design of YOLOv8-n, which can balance the accuracy and real-time performance in the model structure. The proposed DeFCN-nano is validated on an open-source dataset and the experimental results demonstrate that the mean Average Precision (mAP) of the insulator detection is 97.51%, the mAP for detecting defects is 99.26% and the overall mAP is 98.39%. Compared with the baseline models, the proposed model has higher detection speed with a real-time detection speed of 58 frames per second.
通过无人机(UAV)实现绝缘子缺陷的实时、准确检测,对提高大规模电网的巡检效率具有重要意义。本文研究了基于深度学习技术的 You Only Look Once version 8(YOLOv8)和 DeFCN 物体检测算法,提出了一种基于 DeFCN 的端到端实时绝缘子缺陷检测方法。DeFCN模型参照YOLOv8-n的设计进行了轻量化,在模型结构上兼顾了精度和实时性。实验结果表明,绝缘体检测的平均精度(mAP)为 97.51%,缺陷检测的平均精度(mAP)为 99.26%,总体平均精度(mAP)为 98.39%。与基线模型相比,拟议模型的检测速度更高,实时检测速度为每秒 58 帧。
{"title":"DeFCN-nano: An End-to-End Real-Time Object Detection for Insulator Defects","authors":"Xiongxin Zou, Yimin Zhou","doi":"10.1109/ROBIO58561.2023.10354899","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354899","url":null,"abstract":"It is important to achieve real-time and accurate detection of the insulator defects via the unmanned aerial vehicles (UAVs) so as to improve the inspection efficiency of the large-scale power grids. This paper studies the You Only Look Once version 8 (YOLOv8) and DeFCN object detection algorithms based on the deep learning techniques, then an end-to-end real-time insulator defect detection method is proposed based on the DeFCN. The DeFCN model is lightweighted referring to the design of YOLOv8-n, which can balance the accuracy and real-time performance in the model structure. The proposed DeFCN-nano is validated on an open-source dataset and the experimental results demonstrate that the mean Average Precision (mAP) of the insulator detection is 97.51%, the mAP for detecting defects is 99.26% and the overall mAP is 98.39%. Compared with the baseline models, the proposed model has higher detection speed with a real-time detection speed of 58 frames per second.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"100 10","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visual Servo Control for Ball-on-Plate Balancing: Effect of PID Controller Gain on Tracking Performance 用于板上球平衡的可视化伺服控制:PID 控制器增益对跟踪性能的影响
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354893
Sarin Kitchatr, Aphiphu Sirimangkalalo, R. Chaichaowarat
Ball-on-plate balancing is a popular challenge for the implementation of control systems. In this paper, the Universal Robots UR3 industrial arm is set up for the challenge. An acrylic plate is firmly grasped by the robot’s gripper. The pure rotation about three axes is achieved at the center of the plate by considering the offset of the plate from the tool frame. A web camera is mounted on the last link to observe the position of a ping pong ball moving on top of the plate. The color-based object detection is used with OpenCV and the coordinates of the ball are mapped to the pixel of the camera. At the beginning of each test, the ball was placed away from the center of the plate. Considering the x-axis and y-axis error of the ball position away from the center of the plate, the robot arm stabilizes the ball to the center according to the PID controller gain configurations. The effect of the proportional gain on reducing the rise time of the response is observed. The advantage of the derivative gain on reducing the response overshoot is observed. The advantage of the integral gain on reducing the steady-state error is not clearly observed for this ball-on-plate balancing problem. The implemented controller is robust against the small vibration of the camera with respect to the robot arm.
板上球平衡是实施控制系统的一项常见挑战。在本文中,Universal Robots 的 UR3 工业机械臂就是为应对这一挑战而设置的。机器人的抓手牢牢抓住一块亚克力板。通过考虑板材与工具框架的偏移量,在板材中心实现了三轴纯旋转。在最后一个环节上安装了一个网络摄像头,用于观察在盘子顶部移动的乒乓球的位置。使用 OpenCV 进行基于颜色的物体检测,并将乒乓球的坐标映射到摄像头的像素上。每次测试开始时,乒乓球都被放置在远离盘子中心的位置。考虑到小球远离盘子中心位置的 x 轴和 y 轴误差,机械臂根据 PID 控制器增益配置将小球稳定在中心位置。可以观察到比例增益对缩短响应上升时间的作用。可以观察到导数增益在减少响应超调方面的优势。积分增益在减少稳态误差方面的优势在这个球-板平衡问题上并不明显。所实现的控制器对摄像机相对于机械臂的微小振动具有鲁棒性。
{"title":"Visual Servo Control for Ball-on-Plate Balancing: Effect of PID Controller Gain on Tracking Performance","authors":"Sarin Kitchatr, Aphiphu Sirimangkalalo, R. Chaichaowarat","doi":"10.1109/ROBIO58561.2023.10354893","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354893","url":null,"abstract":"Ball-on-plate balancing is a popular challenge for the implementation of control systems. In this paper, the Universal Robots UR3 industrial arm is set up for the challenge. An acrylic plate is firmly grasped by the robot’s gripper. The pure rotation about three axes is achieved at the center of the plate by considering the offset of the plate from the tool frame. A web camera is mounted on the last link to observe the position of a ping pong ball moving on top of the plate. The color-based object detection is used with OpenCV and the coordinates of the ball are mapped to the pixel of the camera. At the beginning of each test, the ball was placed away from the center of the plate. Considering the x-axis and y-axis error of the ball position away from the center of the plate, the robot arm stabilizes the ball to the center according to the PID controller gain configurations. The effect of the proportional gain on reducing the rise time of the response is observed. The advantage of the derivative gain on reducing the response overshoot is observed. The advantage of the integral gain on reducing the steady-state error is not clearly observed for this ball-on-plate balancing problem. The implemented controller is robust against the small vibration of the camera with respect to the robot arm.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"90 6","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Model identification and validation of cascade control schemes for a differential drive mobile robot 差分驱动移动机器人级联控制方案的模型识别与验证
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354643
Bhalekar Vaibhav Bhausaheb, Ps Saikrishna
This paper presents a reduced order dynamic model of a differential drive mobile robot (DDMR). The model is validated with data collected from a mobile robot in real time. Based on the obtained model, a controller for tracking DDMR trajectory is designed and implemented. This paper presents a cascade control scheme for trajectory tracking control for a variety of complex trajectory tracking applications. Experimental and simulation results show that control design is able to track several challenging reference paths successfully with an acceptable tracking error.
本文介绍了差分驱动移动机器人(DDMR)的减阶动态模型。该模型通过移动机器人实时采集的数据进行了验证。根据获得的模型,设计并实现了用于跟踪 DDMR 轨迹的控制器。本文提出了一种用于轨迹跟踪控制的级联控制方案,适用于各种复杂的轨迹跟踪应用。实验和仿真结果表明,控制设计能够以可接受的跟踪误差成功跟踪多个具有挑战性的参考路径。
{"title":"Model identification and validation of cascade control schemes for a differential drive mobile robot","authors":"Bhalekar Vaibhav Bhausaheb, Ps Saikrishna","doi":"10.1109/ROBIO58561.2023.10354643","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354643","url":null,"abstract":"This paper presents a reduced order dynamic model of a differential drive mobile robot (DDMR). The model is validated with data collected from a mobile robot in real time. Based on the obtained model, a controller for tracking DDMR trajectory is designed and implemented. This paper presents a cascade control scheme for trajectory tracking control for a variety of complex trajectory tracking applications. Experimental and simulation results show that control design is able to track several challenging reference paths successfully with an acceptable tracking error.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"65 7","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Universal Dynamic Model Predictive Control Framework for Quadruped Robot Locomotion 四足机器人运动的通用动态模型预测控制框架
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354635
Zehua Huang, Ran Huang
Quadruped Robots require the capability to traverse complex and demanding surroundings found in natural landscapes, urban areas, and industrial facilities. However, achieving efficient and flexible control of these systems remains an ongoing challenge. In this paper, we present a novel Universal Dynamic Model Predictive Control (UDMPC) Framework designed specifically for quadruped robot locomotion, aiming to address the controller design problems caused by the diversity of quadruped robots and the complexity of terrains. Even within intricate terrains, this framework guarantees accurate tracing of reference velocity commands, augmenting locomotion prowess. The MPC controller’s parameters are dynamically fine-tuned through reinforcement learning, enhancing control reliability. Our proposed approach was subjected to rigorous testing and evaluation using the Go1 quadruped robot model within a simulation environment. The findings showcased its exceptional dynamic adaptability, surpassing fixed-parameter controllers. Notably, this work considerably enhances command tracking precision and stability.
四足机器人需要有能力穿越自然景观、城市区域和工业设施中复杂而严苛的环境。然而,实现对这些系统的高效、灵活控制仍然是一个持续的挑战。在本文中,我们提出了一个专为四足机器人运动设计的新型通用动态模型预测控制(UDMPC)框架,旨在解决因四足机器人的多样性和地形的复杂性而造成的控制器设计问题。即使在错综复杂的地形中,该框架也能保证准确跟踪参考速度指令,从而增强运动能力。MPC 控制器的参数可通过强化学习进行动态微调,从而提高控制的可靠性。我们提出的方法在模拟环境中使用 Go1 四足机器人模型进行了严格的测试和评估。测试结果表明,该方法具有卓越的动态适应性,超越了固定参数控制器。值得注意的是,这项工作大大提高了指令跟踪精度和稳定性。
{"title":"An Universal Dynamic Model Predictive Control Framework for Quadruped Robot Locomotion","authors":"Zehua Huang, Ran Huang","doi":"10.1109/ROBIO58561.2023.10354635","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354635","url":null,"abstract":"Quadruped Robots require the capability to traverse complex and demanding surroundings found in natural landscapes, urban areas, and industrial facilities. However, achieving efficient and flexible control of these systems remains an ongoing challenge. In this paper, we present a novel Universal Dynamic Model Predictive Control (UDMPC) Framework designed specifically for quadruped robot locomotion, aiming to address the controller design problems caused by the diversity of quadruped robots and the complexity of terrains. Even within intricate terrains, this framework guarantees accurate tracing of reference velocity commands, augmenting locomotion prowess. The MPC controller’s parameters are dynamically fine-tuned through reinforcement learning, enhancing control reliability. Our proposed approach was subjected to rigorous testing and evaluation using the Go1 quadruped robot model within a simulation environment. The findings showcased its exceptional dynamic adaptability, surpassing fixed-parameter controllers. Notably, this work considerably enhances command tracking precision and stability.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"54 6","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bifurcation variation of a novel line-symmetric double-centered 6R metamorphic mechanism based on ellipses 基于椭圆的新型线对称双心 6R 变质机制的分岔变化
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354943
Song Lin, Yifeng Song, Hongguang Wang, Bingbing Yuan, Jiansheng Dai, Fengren Jing
This paper proposed a line-symmetric double-centered 6R metamorphic mechanism with bifurcation properties. The mechanism is constructed based on elliptical geometric properties, which is a comprehensive design method for constructing novel metamorphic mechanisms through intuitive geometric figures. Firstly, the geometric constraints of the 6R metamorphic mechanism are revealed, and the parameter constraints and closed-loop kinematic equations of the 6R metamorphic mechanism are deduced. Through the analysis of mechanism geometric constraints, four motion branches of the 6R metamorphic mechanism are obtained: collinear deployable motion branch MB1, spherical 4R motion branch MB2, spherical 4R motion branch MB3, and line-symmetrical Bricard motion branch MB4. Meanwhile, according to the screw theory, the analytical expressions and mobility of the constraint-screw systems under different motion branches are deduced. This led to the identification of the constraint and motion branch variations of the 6R metamorphic mechanism. Finally, the four serial link 4R singular configurations of the 6R metamorphic mechanism are specially studied, and the characteristics of the mutual reconfiguration of these four singular configurations are revealed.
本文提出了一种具有分叉特性的线对称双中心 6R 变质机制。该机构基于椭圆几何特性构建,是一种通过直观几何图形构建新型变质机构的综合设计方法。首先揭示了 6R 变质机构的几何约束,推导出 6R 变质机构的参数约束和闭环运动学方程。通过对机构几何约束条件的分析,得到了 6R 变质机构的四个运动分支:碰撞可展开运动分支 MB1、球形 4R 运动分支 MB2、球形 4R 运动分支 MB3 和线对称布里卡运动分支 MB4。 同时,根据螺杆理论,推导出了不同运动分支下约束-螺杆系统的解析表达式和运动性。从而确定了 6R 变质机制的约束和运动分支变化。最后,对 6R 变形机构的四个串联 4R 奇异构型进行了专门研究,并揭示了这四个奇异构型相互重构的特点。
{"title":"Bifurcation variation of a novel line-symmetric double-centered 6R metamorphic mechanism based on ellipses","authors":"Song Lin, Yifeng Song, Hongguang Wang, Bingbing Yuan, Jiansheng Dai, Fengren Jing","doi":"10.1109/ROBIO58561.2023.10354943","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354943","url":null,"abstract":"This paper proposed a line-symmetric double-centered 6R metamorphic mechanism with bifurcation properties. The mechanism is constructed based on elliptical geometric properties, which is a comprehensive design method for constructing novel metamorphic mechanisms through intuitive geometric figures. Firstly, the geometric constraints of the 6R metamorphic mechanism are revealed, and the parameter constraints and closed-loop kinematic equations of the 6R metamorphic mechanism are deduced. Through the analysis of mechanism geometric constraints, four motion branches of the 6R metamorphic mechanism are obtained: collinear deployable motion branch MB1, spherical 4R motion branch MB2, spherical 4R motion branch MB3, and line-symmetrical Bricard motion branch MB4. Meanwhile, according to the screw theory, the analytical expressions and mobility of the constraint-screw systems under different motion branches are deduced. This led to the identification of the constraint and motion branch variations of the 6R metamorphic mechanism. Finally, the four serial link 4R singular configurations of the 6R metamorphic mechanism are specially studied, and the characteristics of the mutual reconfiguration of these four singular configurations are revealed.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"75 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of Visual and Audio Notifications in the User Command Interface Integrated with the Industrial Exoskeleton Shoulder-sideWINDER 评估与工业外骨骼肩侧 WINDER 集成的用户命令界面中的视觉和音频通知
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354678
Olmo A. Moreno Franco, Daegeun Park, C. Di Natali, Darwin G. Caldwell, J. Ortiz
Industrial exoskeletons are becoming increasingly important for preventing workers from developing musculoskeletal disorders when performing manual material handling. Because the exoskeletons are task dependent, there is versatility of use in the performance according to the type of movement that the user executes. The user command interface is a wearable device for industrial exoskeletons. It is an adaptable setup system between users and occupational wearable robots. The main purpose is to provide access to users in some domains of the exoskeleton configuration system. Areas such as secure user identification, parameter configuration, and signal visualization are well structured in the interface. Shoulder-sideWINDER is an active exoskeleton for shoulder support that was developed in collaboration between XoLab and the Italian Worker’s Compensation Authority. This exoskeleton requires a guided calibration process before the operation. In this paper, we present an evaluation of two novel features of the UCI: (a) tutorial and (b) audio notifications for calibration. These new features are integrated into the upper-limb industrial exoskeleton Shoulder-sideWINDER. Participants performed experiments to assess the interface comprehensibility and usability of the tutorial and sound notifications by wearing the Shoulder-sideWINDER exoskeleton and the user command interface. The results presented in this study show that the user command interface is a highly intuitive control device that guides the calibration sequence of the exoskeleton.
工业外骨骼对于防止工人在进行手动材料搬运时患上肌肉骨骼疾病越来越重要。由于外骨骼依赖于任务,因此可根据用户执行的运动类型提供多用途性能。用户指令界面是工业外骨骼的可穿戴设备。它是用户与职业可穿戴机器人之间的一个适应性设置系统。其主要目的是为用户提供外骨骼配置系统某些领域的访问权限。安全用户识别、参数配置和信号可视化等领域在界面中都有很好的结构。肩侧风轮(Shoulder-sideWINDER)是一种用于肩部支撑的主动外骨骼,由 XoLab 和意大利工人赔偿局合作开发。这种外骨骼需要在操作前进行引导校准。在本文中,我们对 UCI 的两个新功能进行了评估:(a)教程和(b)校准音频通知。这些新功能已集成到上肢工业外骨骼肩侧 WINDER 中。参与者通过佩戴肩侧风扇外骨骼和用户指令界面进行了实验,以评估教程和声音通知的界面可理解性和可用性。研究结果表明,用户指令界面是一种高度直观的控制装置,可引导外骨骼的校准顺序。
{"title":"Evaluation of Visual and Audio Notifications in the User Command Interface Integrated with the Industrial Exoskeleton Shoulder-sideWINDER","authors":"Olmo A. Moreno Franco, Daegeun Park, C. Di Natali, Darwin G. Caldwell, J. Ortiz","doi":"10.1109/ROBIO58561.2023.10354678","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354678","url":null,"abstract":"Industrial exoskeletons are becoming increasingly important for preventing workers from developing musculoskeletal disorders when performing manual material handling. Because the exoskeletons are task dependent, there is versatility of use in the performance according to the type of movement that the user executes. The user command interface is a wearable device for industrial exoskeletons. It is an adaptable setup system between users and occupational wearable robots. The main purpose is to provide access to users in some domains of the exoskeleton configuration system. Areas such as secure user identification, parameter configuration, and signal visualization are well structured in the interface. Shoulder-sideWINDER is an active exoskeleton for shoulder support that was developed in collaboration between XoLab and the Italian Worker’s Compensation Authority. This exoskeleton requires a guided calibration process before the operation. In this paper, we present an evaluation of two novel features of the UCI: (a) tutorial and (b) audio notifications for calibration. These new features are integrated into the upper-limb industrial exoskeleton Shoulder-sideWINDER. Participants performed experiments to assess the interface comprehensibility and usability of the tutorial and sound notifications by wearing the Shoulder-sideWINDER exoskeleton and the user command interface. The results presented in this study show that the user command interface is a highly intuitive control device that guides the calibration sequence of the exoskeleton.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"64 3","pages":"1-7"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation MSMB-GCN:用于三维人体姿态估计的多尺度多分支融合图卷积网络
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354638
Shanshan Ji, Qiwei Meng, Wen Wang, Zheyuan Lin, Te Li, Minhong Wan, Chunlong Zhang, J. Gu
In human-robot interaction (HRI), human pose estimation is a necessary technology for the robot to perceive the dynamic environment and make interactive actions. Recently, graph convolutional networks (GCNs) have been increasingly used for 2D to 3D pose estimation tasks since the skeleton topologies can be viewed as graph structures. In this paper, we propose a novel graph convolutional network architecture, Multi-scale Multi-branch Fusion Graph Convolutional Networks (MSMB-GCN), for 3D Human Pose Estimation(3D HPE) task. The proposed model consists of multiple GCN blocks with a multi-branch architecture. This multi-branch architecture enables the model to get multi-scale features for human skeletal representations. The group of GCN blocks, which has strong multi-level feature extraction capabilities, allows the model to learn global and local features, lower-level and higher-level features. Experiment results on the HumanPose benchmark demonstrate that our model outperforms the state-of-the-art and ablation studies validate the effectiveness of our approach.
在人机交互(HRI)中,人体姿态估计是机器人感知动态环境并做出交互动作的必要技术。最近,图卷积网络(GCN)被越来越多地用于二维到三维的姿态估计任务,因为骨架拓扑结构可以看作是图结构。本文针对三维人体姿态估计(3D HPE)任务提出了一种新型图卷积网络架构--多尺度多分支融合图卷积网络(MSMB-GCN)。所提出的模型由多个具有多分支架构的 GCN 块组成。这种多分支架构使模型能够获得人体骨骼表征的多尺度特征。GCN 块组具有强大的多级特征提取能力,可让模型学习全局和局部特征、低级和高级特征。HumanPose 基准的实验结果表明,我们的模型优于最先进的模型,而消融研究则验证了我们方法的有效性。
{"title":"MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation","authors":"Shanshan Ji, Qiwei Meng, Wen Wang, Zheyuan Lin, Te Li, Minhong Wan, Chunlong Zhang, J. Gu","doi":"10.1109/ROBIO58561.2023.10354638","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354638","url":null,"abstract":"In human-robot interaction (HRI), human pose estimation is a necessary technology for the robot to perceive the dynamic environment and make interactive actions. Recently, graph convolutional networks (GCNs) have been increasingly used for 2D to 3D pose estimation tasks since the skeleton topologies can be viewed as graph structures. In this paper, we propose a novel graph convolutional network architecture, Multi-scale Multi-branch Fusion Graph Convolutional Networks (MSMB-GCN), for 3D Human Pose Estimation(3D HPE) task. The proposed model consists of multiple GCN blocks with a multi-branch architecture. This multi-branch architecture enables the model to get multi-scale features for human skeletal representations. The group of GCN blocks, which has strong multi-level feature extraction capabilities, allows the model to learn global and local features, lower-level and higher-level features. Experiment results on the HumanPose benchmark demonstrate that our model outperforms the state-of-the-art and ablation studies validate the effectiveness of our approach.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"72 5","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Pneumatically Driven Arm Motion Teaching System Using Visual and Torque Feedback 利用视觉和扭矩反馈的气动驱动手臂运动教学系统
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354627
Yoshihide Tomita, Tetsuro Miyazaki, Maina Sogabe, Kenji Kawashima
Machine-human interaction systems have been proposed to improve motion learning efficiency by providing feedback on motion misalignment between a learner and an instructor. Conventional motion teaching systems based on haptic information presentation generally use electrical sensors and motors, which causes the exoskeleton suit weight and the scale of the entire system to become large. In this study, we proposed a pneumatic-driven motion teaching system that provides feedback to the learner by simultaneously presenting visual and torque information to the learner. We achieved a lightweight, soft, and user-safety haptic system using pneumatic artificial muscles (PAMs) as actuators. PAMs’ shrink force generates external torque on the learner’s joint to correct the elbow flexion and extension motion misalignment between the instructor and the learner. We conducted a motion teaching experiment to verify the effectiveness of the proposed method. Specifically, we performed motion instruction on eight subjects using three patterns: a visual-only presentation method, a conventional method that simultaneously presents visual and vibrotactile presentation, and the proposed method that simultaneously presents visual and torque. The experimental results showed that the proposed method reduced the angle and angular velocity tracking errors compared to the visual-only method and visual-vibrotactile method.
有人提出了人机交互系统,通过提供学习者与指导者之间的运动错位反馈来提高运动学习效率。传统的基于触觉信息呈现的运动教学系统一般使用电子传感器和电机,这会导致外骨骼套装重量和整个系统的规模变得庞大。在这项研究中,我们提出了一种气动驱动的运动教学系统,该系统通过同时向学习者呈现视觉和扭矩信息来为学习者提供反馈。我们使用气动人工肌肉(PAMs)作为执行器,实现了一个轻便、柔软、用户安全的触觉系统。气动人工肌肉的收缩力会在学习者的关节上产生外部扭矩,从而纠正教师与学习者之间的肘关节屈伸运动偏差。我们进行了运动教学实验,以验证所提方法的有效性。具体来说,我们使用三种模式对八名受试者进行了动作教学:纯视觉呈现法、同时呈现视觉和振动触觉的传统方法以及同时呈现视觉和扭矩的建议方法。实验结果表明,与纯视觉方法和视觉-振动触觉方法相比,建议的方法减少了角度和角速度跟踪误差。
{"title":"A Pneumatically Driven Arm Motion Teaching System Using Visual and Torque Feedback","authors":"Yoshihide Tomita, Tetsuro Miyazaki, Maina Sogabe, Kenji Kawashima","doi":"10.1109/ROBIO58561.2023.10354627","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354627","url":null,"abstract":"Machine-human interaction systems have been proposed to improve motion learning efficiency by providing feedback on motion misalignment between a learner and an instructor. Conventional motion teaching systems based on haptic information presentation generally use electrical sensors and motors, which causes the exoskeleton suit weight and the scale of the entire system to become large. In this study, we proposed a pneumatic-driven motion teaching system that provides feedback to the learner by simultaneously presenting visual and torque information to the learner. We achieved a lightweight, soft, and user-safety haptic system using pneumatic artificial muscles (PAMs) as actuators. PAMs’ shrink force generates external torque on the learner’s joint to correct the elbow flexion and extension motion misalignment between the instructor and the learner. We conducted a motion teaching experiment to verify the effectiveness of the proposed method. Specifically, we performed motion instruction on eight subjects using three patterns: a visual-only presentation method, a conventional method that simultaneously presents visual and vibrotactile presentation, and the proposed method that simultaneously presents visual and torque. The experimental results showed that the proposed method reduced the angle and angular velocity tracking errors compared to the visual-only method and visual-vibrotactile method.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"61 9","pages":"1-7"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance of BVC-based Obstacle Avoidance for a Quadrotor Relative to LiDAR Data Volume 基于 BVC 的四旋翼飞行器避障性能与激光雷达数据量的关系
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354867
Shosuke Inoue, K. Motonaka, Seiji Miyoshi
Among the various collision avoidance algorithms available, those based on "buffered Voronoi cells (BVC)" have been successful in terms of performance. In this approach, the control input can be determined easily using only the relative positions of the quadrotors. However, this approach, when applied to quadrotors in an environment with stationary obstacles, causes occasional "deadlocks", wherein the quadrotors can not reach the goal. Moreover, it was assumed that each quadrotor could use the relative positions of the obstacles at any time; however, how to obtain this information using the conventional method was not discussed. In this study, we propose an algorithm to tackle deadlocks. Furthermore, to tackle wall-like obstacles that can not be handled by conventional methods, we propose using all point-cloud data obtained by LiDAR as Voronoi seeds. Additionally, because the calculation cost increases as the number of Voronoi seeds increases, we verify the relationship between the calculation time of the control input and the behavior of the quadrotor with respect to the number of used LiDAR data points.
在现有的各种避免碰撞算法中,基于 "缓冲沃罗诺单元(BVC)"的算法在性能方面取得了成功。在这种方法中,只需利用四旋翼飞行器的相对位置就能轻松确定控制输入。然而,当这种方法应用于四旋翼飞行器在有静止障碍物的环境中飞行时,偶尔会出现 "死锁 "现象,即四旋翼飞行器无法达到目标。此外,假设每个四旋翼飞行器可以随时使用障碍物的相对位置,但如何使用传统方法获取这些信息却没有讨论。在本研究中,我们提出了一种解决死锁的算法。此外,为了解决传统方法无法处理的墙状障碍物,我们建议使用激光雷达获得的所有点云数据作为 Voronoi 种子。此外,由于计算成本会随着 Voronoi 种子数量的增加而增加,我们验证了控制输入的计算时间和四旋翼飞行器的行为与所使用的激光雷达数据点数量之间的关系。
{"title":"Performance of BVC-based Obstacle Avoidance for a Quadrotor Relative to LiDAR Data Volume","authors":"Shosuke Inoue, K. Motonaka, Seiji Miyoshi","doi":"10.1109/ROBIO58561.2023.10354867","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354867","url":null,"abstract":"Among the various collision avoidance algorithms available, those based on \"buffered Voronoi cells (BVC)\" have been successful in terms of performance. In this approach, the control input can be determined easily using only the relative positions of the quadrotors. However, this approach, when applied to quadrotors in an environment with stationary obstacles, causes occasional \"deadlocks\", wherein the quadrotors can not reach the goal. Moreover, it was assumed that each quadrotor could use the relative positions of the obstacles at any time; however, how to obtain this information using the conventional method was not discussed. In this study, we propose an algorithm to tackle deadlocks. Furthermore, to tackle wall-like obstacles that can not be handled by conventional methods, we propose using all point-cloud data obtained by LiDAR as Voronoi seeds. Additionally, because the calculation cost increases as the number of Voronoi seeds increases, we verify the relationship between the calculation time of the control input and the behavior of the quadrotor with respect to the number of used LiDAR data points.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"61 8","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relative Pose Detection of Pipe Interfaces Based on Point Laser Ranging Sensors 基于点激光测距传感器的管道接口相对姿态检测
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10355019
Yuhan Hou, Pengcheng Ye, Wenda Ye, Shixin Mao, Yisheng Guan, Haifei Zhu
For solving the problem of low efficiency and poor accuracy of adjacent pipe interface alignment when laying large-bore pipelines, a method of relative pose detection of adjacent pipe interfaces based on the point laser ranging sensors was proposed. The method adopts the data from point laser ranging sensors to fit an ellipse of the pipe to be aligned and compare the ellipse with the cross-sectional circle to obtain the relative pose of two adjacent pipe interfaces. The analytical model of the relative pose between the ellipse axis of the pipe to be measured and the cross-sectional circle axis was constructed, and a pipe interface relative pose detection device was designed and built. Finally, an experiment of measuring the angle between axis vectors of two pipes was designed to verify the accuracy and robustness of the proposed method. The experimental results indicated that the measurement error of the angle between axis vectors of two pipes is 0.3°, which can meet the requirements of the standard of large pipe interface alignment operation.
为解决大口径管道铺设时相邻管道接口对中效率低、精度差的问题,提出了一种基于点激光测距传感器的相邻管道接口相对姿态检测方法。该方法利用点激光测距传感器的数据拟合出待对准管道的椭圆,并将椭圆与横截面圆进行比较,从而得到相邻两个管道接口的相对姿态。构建了待测管道椭圆轴线与横截面圆轴线相对姿态的解析模型,并设计和制造了管道接口相对姿态检测装置。最后,设计了测量两根管道轴矢量夹角的实验,以验证所提方法的准确性和鲁棒性。实验结果表明,两根管道轴向量间夹角的测量误差为 0.3°,可以满足大型管道接口对中作业标准的要求。
{"title":"Relative Pose Detection of Pipe Interfaces Based on Point Laser Ranging Sensors","authors":"Yuhan Hou, Pengcheng Ye, Wenda Ye, Shixin Mao, Yisheng Guan, Haifei Zhu","doi":"10.1109/ROBIO58561.2023.10355019","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10355019","url":null,"abstract":"For solving the problem of low efficiency and poor accuracy of adjacent pipe interface alignment when laying large-bore pipelines, a method of relative pose detection of adjacent pipe interfaces based on the point laser ranging sensors was proposed. The method adopts the data from point laser ranging sensors to fit an ellipse of the pipe to be aligned and compare the ellipse with the cross-sectional circle to obtain the relative pose of two adjacent pipe interfaces. The analytical model of the relative pose between the ellipse axis of the pipe to be measured and the cross-sectional circle axis was constructed, and a pipe interface relative pose detection device was designed and built. Finally, an experiment of measuring the angle between axis vectors of two pipes was designed to verify the accuracy and robustness of the proposed method. The experimental results indicated that the measurement error of the angle between axis vectors of two pipes is 0.3°, which can meet the requirements of the standard of large pipe interface alignment operation.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"60 11","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1