首页 > 最新文献

2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)最新文献

英文 中文
DenseXFormer: An Effective Occluded Human Instance Segmentation Network based on Density Map for Nursing Robot DenseXFormer:基于密度图的护理机器人有效遮挡人体实例分割网络
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354873
Sihao Qi, Jiexin Xie, Haitao Yan, Shijie Guo
Human instance segmentation in occlusion scenarios remains a challenging task, especially in nursing scenarios, which hinders the development of nursing robots. Existing approaches are unable to focus the network’s attention on the occluded areas, which leads to unsatisfactory results. To address this issue, this paper proposes a novel and effective network based on density map in the instance segmentation task. Density map-based neural networks perform well in cases where human bodies occlude each other and can be trained without additional annotation information. Firstly, a density map generator (DMG) is introduced to generate accurate density information from feature maps computed by the backbone. Secondly, using density map enhances features in the density fusion module (DFM), which focuses the network on high-density areas as well as occluded areas. Additionally, to remedy the lack of occlusion-based dataset of nursing instance segmentation, a new dataset NSR-dataset is proposed. A large amount experiments on the public datasets (NSR and COCO-PersonOcc) show that the proposed method can be a powerful instrument for human instance segmentation. The improvements of efficiency with respect to accuracy are both prominent. The dataset can be got at https://github.com/Monkey0806/NSR-dataset.
遮挡场景下的人体实例分割仍然是一项具有挑战性的任务,尤其是在护理场景中,这阻碍了护理机器人的发展。现有的方法无法将网络的注意力集中在闭塞区域,导致效果不理想。针对这一问题,本文提出了一种基于密度图的新型有效网络,用于实例分割任务。基于密度图的神经网络在人体相互遮挡的情况下表现良好,而且无需额外的注释信息即可进行训练。首先,引入密度图生成器(DMG),从骨干计算的特征图中生成精确的密度信息。其次,使用密度图可以增强密度融合模块(DFM)中的特征,从而使网络聚焦于高密度区域和闭塞区域。此外,为了弥补基于闭塞的护理实例分割数据集的不足,我们提出了一个新的数据集 NSR-数据集。在公共数据集(NSR 和 COCO-PersonOcc)上进行的大量实验表明,所提出的方法可以成为人体实例分割的有力工具。效率和准确性都有显著提高。数据集可从 https://github.com/Monkey0806/NSR-dataset 获取。
{"title":"DenseXFormer: An Effective Occluded Human Instance Segmentation Network based on Density Map for Nursing Robot","authors":"Sihao Qi, Jiexin Xie, Haitao Yan, Shijie Guo","doi":"10.1109/ROBIO58561.2023.10354873","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354873","url":null,"abstract":"Human instance segmentation in occlusion scenarios remains a challenging task, especially in nursing scenarios, which hinders the development of nursing robots. Existing approaches are unable to focus the network’s attention on the occluded areas, which leads to unsatisfactory results. To address this issue, this paper proposes a novel and effective network based on density map in the instance segmentation task. Density map-based neural networks perform well in cases where human bodies occlude each other and can be trained without additional annotation information. Firstly, a density map generator (DMG) is introduced to generate accurate density information from feature maps computed by the backbone. Secondly, using density map enhances features in the density fusion module (DFM), which focuses the network on high-density areas as well as occluded areas. Additionally, to remedy the lack of occlusion-based dataset of nursing instance segmentation, a new dataset NSR-dataset is proposed. A large amount experiments on the public datasets (NSR and COCO-PersonOcc) show that the proposed method can be a powerful instrument for human instance segmentation. The improvements of efficiency with respect to accuracy are both prominent. The dataset can be got at https://github.com/Monkey0806/NSR-dataset.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"44 4","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-Time RGB-D Pedestrian Tracking for Mobile Robot 移动机器人的实时 RGB-D 行人跟踪
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354856
Wenhao Liu, Wanlei Li, Tao Wang, Jun He, Yunjiang Lou
Pedestrian tracking is an important research direction in the field of mobile robotics. In order to complete tasks more efficiently and without hindering the original intention of pedestrians, mobile robots need to track pedestrians accurately in real time. In this paper, we propose a real-time RGB-D pedestrian tracking framework. First, we propose a pedestrian segmentation detection algorithm to detect pedestrians and obtain their two-dimensional positions. Second, due to limited computational resources and the rarity of missed detection for pedestrians, we use an nearest neighbor tracker for pedestrian tracking. To address the issue of inaccurate pedestrian localization, we use our detection algorithm to obtain the center of pedestrians from RGB images. By combining them with point clouds, the 2D coordinates of pedestrians are obtained. Our method enables accurate pedestrian tracking in the world coordinate, by adaptively fusing RGB images with their corresponding depth-based point clouds. Besides, our light-weight detection and tracking algorithm guarantee the real-time pedestrian tracking for realistic mobile robot applications. To validate the effectiveness and real-time performance of tracking algorithm, we conduct experiments using multiple pedestrian datasets of approximately half a minute in length, captured from two different perspectives. To validate the practicality and accuracy of the tracking algorithm in real-world scenarios, we extend our tracking algorithm to apply it to trajectory prediction.
行人跟踪是移动机器人领域的一个重要研究方向。为了更高效地完成任务,同时不妨碍行人的原意,移动机器人需要实时准确地跟踪行人。在本文中,我们提出了一种实时 RGB-D 行人跟踪框架。首先,我们提出了一种行人分割检测算法来检测行人并获取其二维位置。其次,由于计算资源有限以及行人漏检的罕见性,我们使用近邻跟踪器进行行人跟踪。为了解决行人定位不准确的问题,我们使用检测算法从 RGB 图像中获取行人的中心点。将它们与点云相结合,就能得到行人的二维坐标。我们的方法通过自适应融合 RGB 图像和相应的基于深度的点云,实现了在世界坐标上对行人的精确跟踪。此外,我们的轻量级检测和跟踪算法保证了行人跟踪的实时性,适用于现实的移动机器人应用。为了验证跟踪算法的有效性和实时性,我们使用从两个不同视角捕捉到的长度约为半分钟的多个行人数据集进行了实验。为了验证跟踪算法在现实世界中的实用性和准确性,我们扩展了跟踪算法,将其应用于轨迹预测。
{"title":"Real-Time RGB-D Pedestrian Tracking for Mobile Robot","authors":"Wenhao Liu, Wanlei Li, Tao Wang, Jun He, Yunjiang Lou","doi":"10.1109/ROBIO58561.2023.10354856","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354856","url":null,"abstract":"Pedestrian tracking is an important research direction in the field of mobile robotics. In order to complete tasks more efficiently and without hindering the original intention of pedestrians, mobile robots need to track pedestrians accurately in real time. In this paper, we propose a real-time RGB-D pedestrian tracking framework. First, we propose a pedestrian segmentation detection algorithm to detect pedestrians and obtain their two-dimensional positions. Second, due to limited computational resources and the rarity of missed detection for pedestrians, we use an nearest neighbor tracker for pedestrian tracking. To address the issue of inaccurate pedestrian localization, we use our detection algorithm to obtain the center of pedestrians from RGB images. By combining them with point clouds, the 2D coordinates of pedestrians are obtained. Our method enables accurate pedestrian tracking in the world coordinate, by adaptively fusing RGB images with their corresponding depth-based point clouds. Besides, our light-weight detection and tracking algorithm guarantee the real-time pedestrian tracking for realistic mobile robot applications. To validate the effectiveness and real-time performance of tracking algorithm, we conduct experiments using multiple pedestrian datasets of approximately half a minute in length, captured from two different perspectives. To validate the practicality and accuracy of the tracking algorithm in real-world scenarios, we extend our tracking algorithm to apply it to trajectory prediction.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"43 3","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139187405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Feature Fusion Module Based on Gate Mechanism for Object Detection 基于门机制的物体检测特征融合模块
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354575
Zepeng Sun, Dongyin Jin, Jian Deng, Mengyang Zhang, Zhenzhou Shao
In recent years, deep learning based feature fusion has drawn significant attention in the field of information integration due to its robust representational and generative capabilities. However, existing methods struggle to effectively preserve essential information. To this end, this paper proposes a gate-based fusion module for object detection to integrate the information from distinct feature layers of convolutional neural networks. The gate structure of the fusion module adaptively selects features from neighboring layers, storing valuable information in memory units and passing it to the subsequent layer. This approach facilitates the fusion of high-level semantic and low-level detailed features. Experimental validation is conducted on the public Pascal VOC dataset. Experiments results demonstrate that the addition of the gate-based fusion module to the detection task leads to an average accuracy increment of up to 5%.
近年来,基于深度学习的特征融合因其强大的表征和生成能力而在信息整合领域备受关注。然而,现有的方法难以有效保留基本信息。为此,本文提出了一种基于门的物体检测融合模块,用于整合卷积神经网络不同特征层的信息。融合模块的门结构能自适应地选择相邻层的特征,将有价值的信息存储在内存单元中,并传递给后续层。这种方法有助于融合高层语义特征和低层细节特征。实验验证是在公开的 Pascal VOC 数据集上进行的。实验结果表明,在检测任务中添加基于门的融合模块后,平均准确率可提高 5%。
{"title":"Feature Fusion Module Based on Gate Mechanism for Object Detection","authors":"Zepeng Sun, Dongyin Jin, Jian Deng, Mengyang Zhang, Zhenzhou Shao","doi":"10.1109/ROBIO58561.2023.10354575","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354575","url":null,"abstract":"In recent years, deep learning based feature fusion has drawn significant attention in the field of information integration due to its robust representational and generative capabilities. However, existing methods struggle to effectively preserve essential information. To this end, this paper proposes a gate-based fusion module for object detection to integrate the information from distinct feature layers of convolutional neural networks. The gate structure of the fusion module adaptively selects features from neighboring layers, storing valuable information in memory units and passing it to the subsequent layer. This approach facilitates the fusion of high-level semantic and low-level detailed features. Experimental validation is conducted on the public Pascal VOC dataset. Experiments results demonstrate that the addition of the gate-based fusion module to the detection task leads to an average accuracy increment of up to 5%.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"17 6","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fog-based Distributed Camera Network system for Surveillance Applications 用于监控应用的基于雾的分布式摄像机网络系统
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10355008
Mvs Sakethram, Ps Saikrishna
The Internet of Things (IoT) refers to a network of interconnected physical devices embedded with sensors, software, and network connectivity that enables them to collect and exchange data. Cloud computing refers to the delivery of computing resources and services over the Internet. The time it takes for IoT data to transit to the cloud and back might have a substantial influence on the performance, especially for applications that need low latency. Fog computing has been proposed for this constraint. Many issues need to be resolved in order to fully utilize the real-time analytics capabilities of the fog and IoT paradigms. In this paper, we worked extensively using a simulator called iFogsim, to model IoT and Fog environments with real-world challenges and discussed mainly the data transmission between the fog nodes. We describe a case study and added constraints that make the a realistic fog environment with a Distributed Camera Network System (DCNS).
物联网(IoT)是指由嵌入了传感器、软件和网络连接的互联物理设备组成的网络,使这些设备能够收集和交换数据。云计算是指通过互联网提供计算资源和服务。物联网数据传输到云端再返回所需的时间可能会对性能产生重大影响,尤其是对于需要低延迟的应用而言。针对这一限制,有人提出了雾计算。要充分利用雾和物联网范例的实时分析能力,还需要解决许多问题。在本文中,我们广泛使用了名为 iFogsim 的模拟器来模拟物联网和雾环境,并主要讨论了雾节点之间的数据传输问题。我们描述了一个案例研究,并添加了一些约束条件,使分布式摄像机网络系统(DCNS)成为一个真实的雾环境。
{"title":"Fog-based Distributed Camera Network system for Surveillance Applications","authors":"Mvs Sakethram, Ps Saikrishna","doi":"10.1109/ROBIO58561.2023.10355008","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10355008","url":null,"abstract":"The Internet of Things (IoT) refers to a network of interconnected physical devices embedded with sensors, software, and network connectivity that enables them to collect and exchange data. Cloud computing refers to the delivery of computing resources and services over the Internet. The time it takes for IoT data to transit to the cloud and back might have a substantial influence on the performance, especially for applications that need low latency. Fog computing has been proposed for this constraint. Many issues need to be resolved in order to fully utilize the real-time analytics capabilities of the fog and IoT paradigms. In this paper, we worked extensively using a simulator called iFogsim, to model IoT and Fog environments with real-world challenges and discussed mainly the data transmission between the fog nodes. We describe a case study and added constraints that make the a realistic fog environment with a Distributed Camera Network System (DCNS).","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"111 12","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Shape Analysis and Control of a Continuum Objects* 连续物体的形状分析和控制 *
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354616
Yuqiao Dai, Peng Li, Shilin Zhang, Yunhui Liu
Soft robots are a hot spot in today's robotic research, because most of them exist in the form of continuums, and the current continuum is difficult to recognize the shape and reproduce the corresponding shape. In this paper, we propose a method, in which the shape features of the flexible continuum are obtained by contour centerline extraction and binocular camera reconstruction and the modeling of the relationship between the motor input and the shape output of the continuum is completed using neural networks. Simulation environment is set up to test the shape estimation and shape control of the flexible continuum. Results show that this method can prediction and reproduce the shape of the continuum well. This method can be used in shape control of the continuum robot.
软体机器人是当今机器人研究的一个热点,因为软体机器人大多以连续体的形式存在,而目前的连续体很难识别形状并再现相应的形状。本文提出了一种方法,通过轮廓中心线提取和双目摄像头重建获得柔性连续体的形状特征,并利用神经网络完成电机输入与连续体形状输出之间关系的建模。建立了仿真环境来测试柔性连续体的形状估计和形状控制。结果表明,这种方法可以很好地预测和再现连续体的形状。这种方法可用于连续体机器人的形状控制。
{"title":"Shape Analysis and Control of a Continuum Objects*","authors":"Yuqiao Dai, Peng Li, Shilin Zhang, Yunhui Liu","doi":"10.1109/ROBIO58561.2023.10354616","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354616","url":null,"abstract":"Soft robots are a hot spot in today's robotic research, because most of them exist in the form of continuums, and the current continuum is difficult to recognize the shape and reproduce the corresponding shape. In this paper, we propose a method, in which the shape features of the flexible continuum are obtained by contour centerline extraction and binocular camera reconstruction and the modeling of the relationship between the motor input and the shape output of the continuum is completed using neural networks. Simulation environment is set up to test the shape estimation and shape control of the flexible continuum. Results show that this method can prediction and reproduce the shape of the continuum well. This method can be used in shape control of the continuum robot.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"111 7","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research on Horizontal Following Control of a Suspended Robot for Self-Momentum Targets 悬挂式机器人对自重目标的水平跟随控制研究
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354971
Dan Xiong, Yiyong Huang, Yanjie Yang, Hongwei Liu, Zhijie Jiang, Wei Han
Micro/low gravity is one of the most prominent features of the outer space environment, and it significantly alters the force state and dynamics of spacecraft or astronauts compared to the Earth’s gravitational environment. It is crucial to simulate the micro/low gravity environment on the ground for astronaut training or spacecraft testing. The suspension method utilizes a pulley and sling mechanism to create a micro-low gravity environment. This method counteracts the gravitational force exerted by the object based on rope tension. The simulation effect greatly depends on the accuracy of the horizontal following system, which serves as the central subsystem of the suspension device. In this paper, we propose a dual-arm following system to solve the issue of horizontal following for self-momentum targets. In addition, we conduct research on adaptive inhibition technology for flexible rope swing, and coupling control between a robotic arm and a crane. Physical experiments are conducted on the robotic system to verify the effectiveness of the proposed approach.
微/低重力是外层空间环境最突出的特征之一,与地球重力环境相比,它极大地改变了航天器或宇航员的受力状态和动力学特性。在地面模拟微重力/低重力环境对于宇航员训练或航天器测试至关重要。悬挂法利用滑轮和吊索装置来创造微低重力环境。这种方法根据绳索张力抵消物体施加的重力。模拟效果在很大程度上取决于水平跟随系统的精度,该系统是悬挂装置的核心子系统。本文提出了一种双臂跟随系统,以解决自动量目标的水平跟随问题。此外,我们还对柔性摆绳的自适应抑制技术以及机械臂与起重机之间的耦合控制进行了研究。我们在机器人系统上进行了物理实验,以验证所提方法的有效性。
{"title":"Research on Horizontal Following Control of a Suspended Robot for Self-Momentum Targets","authors":"Dan Xiong, Yiyong Huang, Yanjie Yang, Hongwei Liu, Zhijie Jiang, Wei Han","doi":"10.1109/ROBIO58561.2023.10354971","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354971","url":null,"abstract":"Micro/low gravity is one of the most prominent features of the outer space environment, and it significantly alters the force state and dynamics of spacecraft or astronauts compared to the Earth’s gravitational environment. It is crucial to simulate the micro/low gravity environment on the ground for astronaut training or spacecraft testing. The suspension method utilizes a pulley and sling mechanism to create a micro-low gravity environment. This method counteracts the gravitational force exerted by the object based on rope tension. The simulation effect greatly depends on the accuracy of the horizontal following system, which serves as the central subsystem of the suspension device. In this paper, we propose a dual-arm following system to solve the issue of horizontal following for self-momentum targets. In addition, we conduct research on adaptive inhibition technology for flexible rope swing, and coupling control between a robotic arm and a crane. Physical experiments are conducted on the robotic system to verify the effectiveness of the proposed approach.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"88 12","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of Deformation for Self-balancing Lower Limb Exoskeleton Only Using Force/Torque Sensors 仅使用力/扭矩传感器估算自平衡下肢外骨骼的形变
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354999
Ziqiang Chen, Ming Yang, Feng Li, Wentao Li, Jinke Li, Dingkui Tian, Jianquan Sun, Yong He, Xinyu Wu
This paper presents a general estimation method of deformation for the self-balancing lower limb exoskeleton (SBLLE). In particular, we propose a Bi-LSTM deformation estimator (BLDE) to predict and compensate for the deformation of SBLLE based on the current force and torque data measured by force/torque (F/T) sensors. First, we choose four movements including squatting down and up, waist twisting, left foot lifting, and right foot lifting to mimic the constituent action of walking motion. The deformation data set is obtained through the motion capture analysis system and offline planning trajectories, and the relative F/T data set is obtained by the F/T sensors embedded in the feet of SBLLE. Second, the BiLSTM network is trained to learn the relationship between the deformation and F/T and verified on the test set. After that, BLDE is added to the control system of SBLLE to estimate and compensate for the deformation. Finally, four same movements and the walking experiment are conducted on the exoskeleton AutoLEE-G2 with BLDE. The experimental results have proven that BLDE can predict and compensate for deformation by only using F/T sensors.
本文介绍了自平衡下肢外骨骼(SBLLE)的一般变形估计方法。其中,我们提出了一种 Bi-LSTM 形变估算器(BLDE),根据力/力矩(F/T)传感器测量到的当前力和力矩数据来预测和补偿 SBLLE 的形变。首先,我们选择了四个动作,包括下蹲、上蹲、扭腰、左脚抬起和右脚抬起,以模拟行走运动的组成动作。变形数据集通过运动捕捉分析系统和离线规划轨迹获得,相对 F/T 数据集通过嵌入 SBLLE 脚部的 F/T 传感器获得。其次,训练 BiLSTM 网络以学习变形与 F/T 之间的关系,并在测试集上进行验证。然后,将 BLDE 添加到 SBLLE 的控制系统中,以估计和补偿形变。最后,在带有 BLDE 的外骨骼 AutoLEE-G2 上进行了四个相同的动作和行走实验。实验结果证明,仅使用 F/T 传感器,BLDE 就能预测和补偿形变。
{"title":"Estimation of Deformation for Self-balancing Lower Limb Exoskeleton Only Using Force/Torque Sensors","authors":"Ziqiang Chen, Ming Yang, Feng Li, Wentao Li, Jinke Li, Dingkui Tian, Jianquan Sun, Yong He, Xinyu Wu","doi":"10.1109/ROBIO58561.2023.10354999","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354999","url":null,"abstract":"This paper presents a general estimation method of deformation for the self-balancing lower limb exoskeleton (SBLLE). In particular, we propose a Bi-LSTM deformation estimator (BLDE) to predict and compensate for the deformation of SBLLE based on the current force and torque data measured by force/torque (F/T) sensors. First, we choose four movements including squatting down and up, waist twisting, left foot lifting, and right foot lifting to mimic the constituent action of walking motion. The deformation data set is obtained through the motion capture analysis system and offline planning trajectories, and the relative F/T data set is obtained by the F/T sensors embedded in the feet of SBLLE. Second, the BiLSTM network is trained to learn the relationship between the deformation and F/T and verified on the test set. After that, BLDE is added to the control system of SBLLE to estimate and compensate for the deformation. Finally, four same movements and the walking experiment are conducted on the exoskeleton AutoLEE-G2 with BLDE. The experimental results have proven that BLDE can predict and compensate for deformation by only using F/T sensors.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"87 6","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic Control System for Reach-to-Grasp Movement of a 7-DOF Robotic Arm Using Object Pose Estimation with an RGB Camera 利用 RGB 摄像机进行物体姿态估计的 7-DOF 机械臂伸抓运动自动控制系统
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354531
Shuting Bai, Jiazhen Guo, Yinlai Jiang, Hiroshi Yokoi, Shunta Togo
In this study, we develop an automatic control system to perform the reach-to-grasp movement of a 7-DOF (Degrees of Freedom) robotic arm that has the same DOFs as a human arm, and an end-effector with the same shape as a human hand. The 6-DOF pose of the object to be grasped is estimated in real time only from RGB images using a neural network based object pose estimation model. Based on this information, motion planning is performed to automatically control the reach-to-grasp movement of the robotic arm. In the evaluation experiment, the 7-DOF robotic arm performs reach-to-grasp movements for a household object in different poses using the developed control system. The results show that the control system developed in this study can automatically control the reach-to-grasp movement to an object in a certain arbitrary pose.
在本研究中,我们开发了一种自动控制系统,用于执行 7-DOF (自由度)机械臂的伸抓运动,该机械臂具有与人类手臂相同的 DOF,其末端执行器具有与人类手部相同的形状。要抓取的物体的 6-DOF 姿态仅通过基于神经网络的物体姿态估计模型从 RGB 图像中进行实时估计。在此基础上进行运动规划,自动控制机械臂的伸抓运动。在评估实验中,7-DOF 机械臂利用所开发的控制系统以不同的姿势对一个家用物品进行了伸抓运动。结果表明,本研究中开发的控制系统可以自动控制机械臂以某一任意姿势对物体进行伸抓运动。
{"title":"Automatic Control System for Reach-to-Grasp Movement of a 7-DOF Robotic Arm Using Object Pose Estimation with an RGB Camera","authors":"Shuting Bai, Jiazhen Guo, Yinlai Jiang, Hiroshi Yokoi, Shunta Togo","doi":"10.1109/ROBIO58561.2023.10354531","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354531","url":null,"abstract":"In this study, we develop an automatic control system to perform the reach-to-grasp movement of a 7-DOF (Degrees of Freedom) robotic arm that has the same DOFs as a human arm, and an end-effector with the same shape as a human hand. The 6-DOF pose of the object to be grasped is estimated in real time only from RGB images using a neural network based object pose estimation model. Based on this information, motion planning is performed to automatically control the reach-to-grasp movement of the robotic arm. In the evaluation experiment, the 7-DOF robotic arm performs reach-to-grasp movements for a household object in different poses using the developed control system. The results show that the control system developed in this study can automatically control the reach-to-grasp movement to an object in a certain arbitrary pose.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"13 2","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Decoupled Control of Bipedal Locomotion Based on HZD and H-LIP 基于 HZD 和 H-LIP 的双足运动解耦控制
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354624
Yinong Ye, Yongming Yue, Wei Gao, Shiwu Zhang
The walking control of bipedal robots poses challenges due to inherent coupling among the robot’s degrees of freedom. This paper introduces an approach to address this challenge by using decoupled control in the sagittal and frontal planes. The proposed control method takes advantage of Hybrid Zero Dynamics and Hybrid-Linear Inverted Pendulum for sagittal and frontal plane dynamics, respectively. The hybrid controller is successfully validated on a bipedal robot RobBIE, whose torso inertia is relatively high and if not adequately controlled can easily violate the point mass assumption in many reduced-order model based walking controllers developed previously. With the help of full-model based Hybrid Zero Dynamics, the robot can achieve stable walking behaviors at different velocities and adapt to various terrains and even moderate disturbances.
由于机器人自由度之间固有的耦合关系,双足机器人的行走控制面临挑战。本文介绍了一种通过在矢状面和正面使用解耦控制来应对这一挑战的方法。所提出的控制方法利用了混合零动力学和混合线性倒立摆的优势,分别用于矢状面和正面的动力学。混合控制器在双足机器人 RobBIE 上得到了成功验证,该机器人的躯干惯性相对较大,如果控制不当,很容易违反之前开发的许多基于模型的减阶行走控制器中的点质量假设。在基于全模型的混合零动力学的帮助下,机器人可以在不同速度下实现稳定的行走行为,并适应各种地形,甚至是中等程度的干扰。
{"title":"Decoupled Control of Bipedal Locomotion Based on HZD and H-LIP","authors":"Yinong Ye, Yongming Yue, Wei Gao, Shiwu Zhang","doi":"10.1109/ROBIO58561.2023.10354624","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354624","url":null,"abstract":"The walking control of bipedal robots poses challenges due to inherent coupling among the robot’s degrees of freedom. This paper introduces an approach to address this challenge by using decoupled control in the sagittal and frontal planes. The proposed control method takes advantage of Hybrid Zero Dynamics and Hybrid-Linear Inverted Pendulum for sagittal and frontal plane dynamics, respectively. The hybrid controller is successfully validated on a bipedal robot RobBIE, whose torso inertia is relatively high and if not adequately controlled can easily violate the point mass assumption in many reduced-order model based walking controllers developed previously. With the help of full-model based Hybrid Zero Dynamics, the robot can achieve stable walking behaviors at different velocities and adapt to various terrains and even moderate disturbances.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"109 4","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimum Design and Stiffness Analysis of a 3-RCU Parallel Manipulator * 3-RCU 平行机械手的优化设计和刚度分析 *
Pub Date : 2023-12-04 DOI: 10.1109/ROBIO58561.2023.10354888
Chenhao Xu, F. Xie, Xin-Jun Liu
Large tilt angle is required for parallel manipulators in many applications, this is a challenging issue in the field. In this paper, the optimum design of a 3-RCU parallel manipulator with 1T2R DoFs is carried out to realize the performance of large tilt angle output. The parameter-finiteness normalization method is used to build the parameter design space, and the motion/force transmission and constraint performance indices are used as the evaluation criterion. On these bases, the performance charts have been generated. Taking the constraint condition of achieving 45° tilt angle in all directions into consideration, an optimum region in the parameter design space has been derived and a group of optimized parameters is obtained. According to the results of optimum design, an CAD model of the manipulator is built. Based on perturbation method and principle of virtual work, a stiffness analytical model is established. Finally, the stiffness has been investigated, and the accuracy of the stiffness analytical model has been verified by comparing with the stiffness calculation using finite element analysis method. The work in this paper lays the foundation for the development of the manipulator.
在许多应用中,并联机械手都需要大倾角,这在该领域是一个具有挑战性的问题。本文对具有 1T2R DoFs 的 3-RCU 并联机械手进行了优化设计,以实现大倾角输出的性能。采用参数有限性归一化方法构建参数设计空间,并以运动/力传递和约束性能指标作为评价标准。在此基础上,生成了性能图表。考虑到在所有方向上实现 45° 倾角的约束条件,在参数设计空间中得出了一个最佳区域,并获得了一组优化参数。根据优化设计的结果,建立了机械手的 CAD 模型。根据扰动法和虚功原理,建立了刚度分析模型。最后,对刚度进行了研究,并通过与使用有限元分析方法进行的刚度计算进行比较,验证了刚度分析模型的准确性。本文的工作为机械手的开发奠定了基础。
{"title":"Optimum Design and Stiffness Analysis of a 3-RCU Parallel Manipulator *","authors":"Chenhao Xu, F. Xie, Xin-Jun Liu","doi":"10.1109/ROBIO58561.2023.10354888","DOIUrl":"https://doi.org/10.1109/ROBIO58561.2023.10354888","url":null,"abstract":"Large tilt angle is required for parallel manipulators in many applications, this is a challenging issue in the field. In this paper, the optimum design of a 3-RCU parallel manipulator with 1T2R DoFs is carried out to realize the performance of large tilt angle output. The parameter-finiteness normalization method is used to build the parameter design space, and the motion/force transmission and constraint performance indices are used as the evaluation criterion. On these bases, the performance charts have been generated. Taking the constraint condition of achieving 45° tilt angle in all directions into consideration, an optimum region in the parameter design space has been derived and a group of optimized parameters is obtained. According to the results of optimum design, an CAD model of the manipulator is built. Based on perturbation method and principle of virtual work, a stiffness analytical model is established. Finally, the stiffness has been investigated, and the accuracy of the stiffness analytical model has been verified by comparing with the stiffness calculation using finite element analysis method. The work in this paper lays the foundation for the development of the manipulator.","PeriodicalId":505134,"journal":{"name":"2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"108 9","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139186782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2023 IEEE International Conference on Robotics and Biomimetics (ROBIO)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1