首页 > 最新文献

2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)最新文献

英文 中文
Typical Topology Variation and Dynamic Transformation Method for Multi-arm Space Robot 多臂空间机器人典型拓扑变化及动态变换方法
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011696
Hongxu Wang, Jinsheng Guo, Ziran Liu, T. Lin, Chengfei Yue, Xibin Cao
Dynamic modeling is the key technology in studying multi-arm space robots with variable topology. The difficulty lies in establishing the transformation from one topology to the other one. In this paper, typical configurations applied in orbit manipulation are demonstrated and the corresponding dynamic model are built based on spatial operator algebra(SOA). Then a general topological transformation method is proposed via factored serial topological variation. Finally, listed dynamic model of the configuration verifies the transformation result.
动态建模是研究变拓扑多臂空间机器人的关键技术。难点在于建立从一种拓扑到另一种拓扑的转换。本文介绍了轨道操纵中应用的典型构型,并基于空间算子代数(SOA)建立了相应的动态模型。在此基础上,提出了一种基于因子序列拓扑变异的通用拓扑变换方法。最后,给出了配置的动态模型,验证了转换结果。
{"title":"Typical Topology Variation and Dynamic Transformation Method for Multi-arm Space Robot","authors":"Hongxu Wang, Jinsheng Guo, Ziran Liu, T. Lin, Chengfei Yue, Xibin Cao","doi":"10.1109/ROBIO55434.2022.10011696","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011696","url":null,"abstract":"Dynamic modeling is the key technology in studying multi-arm space robots with variable topology. The difficulty lies in establishing the transformation from one topology to the other one. In this paper, typical configurations applied in orbit manipulation are demonstrated and the corresponding dynamic model are built based on spatial operator algebra(SOA). Then a general topological transformation method is proposed via factored serial topological variation. Finally, listed dynamic model of the configuration verifies the transformation result.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114848303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Decomposed Soft Compression for Remote Sensing Image 遥感图像的分解软压缩
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011758
Guang-Xing Liu, Wenyu Li, Fen Duan
Modern imaging modalities from airborne or space platforms generate a large amount of remote sensing images, which places a burden on storage and transmission. These remote sensing images contain lots of ground targets which cannot tolerate fidelity loss in many fields. In this paper, a novel lossless compression method named Decomposed Soft Compression is proposed which takes advantage of rich details in images. The proposed method exploits image redundancy through integer wavelet transform. Then the decomposed images are encoded with shape-based encoder. Transformation on image layers can increase the sparsity and improve the compression ratio. Ex-periments on large-scale remote sensing image datasets show that the proposed method achieves up to 17.1 % improvement in compression ratio compared with JPEG 2000.
现代机载或空间平台成像方式产生了大量的遥感图像,给存储和传输带来了负担。这些遥感图像包含大量的地面目标,在许多领域无法承受保真度的损失。本文利用图像中丰富的细节,提出了一种新的无损压缩方法——分解软压缩。该方法通过整数小波变换利用图像冗余。然后用基于形状的编码器对分解后的图像进行编码。对图像图层进行变换可以增加稀疏度,提高压缩比。在大规模遥感图像数据集上的实验表明,与JPEG 2000相比,该方法的压缩比提高了17.1%。
{"title":"Decomposed Soft Compression for Remote Sensing Image","authors":"Guang-Xing Liu, Wenyu Li, Fen Duan","doi":"10.1109/ROBIO55434.2022.10011758","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011758","url":null,"abstract":"Modern imaging modalities from airborne or space platforms generate a large amount of remote sensing images, which places a burden on storage and transmission. These remote sensing images contain lots of ground targets which cannot tolerate fidelity loss in many fields. In this paper, a novel lossless compression method named Decomposed Soft Compression is proposed which takes advantage of rich details in images. The proposed method exploits image redundancy through integer wavelet transform. Then the decomposed images are encoded with shape-based encoder. Transformation on image layers can increase the sparsity and improve the compression ratio. Ex-periments on large-scale remote sensing image datasets show that the proposed method achieves up to 17.1 % improvement in compression ratio compared with JPEG 2000.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116859852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dual manipulator collaborative shaft slot assembly via MADDPG 双机械手协同轴槽装配madpg
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011768
Junying Yao, Xiaojuan Wang, Renqiang Li, Wenxiao Wang, X. Ping, Yongkui Liu
The traditional dual manipulator control systems have not only complex motion coupling problems, but also larger computational burden, and hence it is difficult to meet the requirements of intelligent assembly. In this paper, based on multi-agent reinforcement learning theory, Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm is investigated in the collaborative assembly shaft slot assembly via dual manipulator system. For the collaborative shaft slot assembly in the dual manipulator system, sparse rewards in traditional multi-agent reinforcement learning often exist because of the long sequence decision-making problem. For the above problems, this paper considers the influence of the decision-making of a single manipulator on the overall task rewards when the overall rewards of multi -agent reinforcement learning are designed. In the proposed algorithm, by calculating the difference before and after the state of each manipulator, and applying the difference as the internal state excitation to the overall task rewards, the traditional reward function of multi-agent reinforcement learning is improved. In order to verify the designed algorithm, the dual manipulator shaft slot assembly system and test scenario are established on the CoppeliaSim simulation platform. Simulation results show that the success rate of the shaft slot assembly via the improved MADDPG algorithm is about 83 % *
传统的双机械手控制系统不仅存在复杂的运动耦合问题,而且计算量较大,难以满足智能装配的要求。基于多智能体强化学习理论,研究了双机械臂协同装配轴槽装配中的多智能体深度确定性策略梯度(madpg)算法。对于双机械臂系统下的协作轴槽装配,传统的多智能体强化学习由于决策过程的长序列问题,往往存在奖励稀疏的问题。针对上述问题,本文在设计多智能体强化学习的整体奖励时,考虑了单个机械手的决策对整体任务奖励的影响。该算法通过计算各机械手状态前后的差值,并将差值作为整体任务奖励的内部状态激励,对传统的多智能体强化学习奖励函数进行了改进。为了验证所设计的算法,在CoppeliaSim仿真平台上建立了双机械手轴槽装配系统和测试场景。仿真结果表明,改进的madpg算法对轴槽装配的成功率约为83% *
{"title":"Dual manipulator collaborative shaft slot assembly via MADDPG","authors":"Junying Yao, Xiaojuan Wang, Renqiang Li, Wenxiao Wang, X. Ping, Yongkui Liu","doi":"10.1109/ROBIO55434.2022.10011768","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011768","url":null,"abstract":"The traditional dual manipulator control systems have not only complex motion coupling problems, but also larger computational burden, and hence it is difficult to meet the requirements of intelligent assembly. In this paper, based on multi-agent reinforcement learning theory, Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm is investigated in the collaborative assembly shaft slot assembly via dual manipulator system. For the collaborative shaft slot assembly in the dual manipulator system, sparse rewards in traditional multi-agent reinforcement learning often exist because of the long sequence decision-making problem. For the above problems, this paper considers the influence of the decision-making of a single manipulator on the overall task rewards when the overall rewards of multi -agent reinforcement learning are designed. In the proposed algorithm, by calculating the difference before and after the state of each manipulator, and applying the difference as the internal state excitation to the overall task rewards, the traditional reward function of multi-agent reinforcement learning is improved. In order to verify the designed algorithm, the dual manipulator shaft slot assembly system and test scenario are established on the CoppeliaSim simulation platform. Simulation results show that the success rate of the shaft slot assembly via the improved MADDPG algorithm is about 83 % *","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"318 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115026022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Semantic Segmentation of Sea Ice Based on U-net Network Modification 基于U-net网络修正的海冰语义分割
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011899
Jun Zhao, Le Chen, Jinhao Li, Yuliang Zhao
Sea ice detection is essential to ensure the safe navigation of ships in mid- and high-latitude ice areas. In the face of complex sea ice information, how to use the sea ice images by shipboard cameras to comprehensively, accurately and efficiently identify four types of sea ice information (Ice skin, Nile ice, Grey ice and White ice)and two kinds of sea ice background information (sea water and sky), it remains a major challenge. This study proposes an automatic semantic segmentation method for sea ice images, which first uses Rsenet50 as well as Vgg-16 network to pre-train the model and improve the network training efficiency. Then modifications to U-Net network, improvement of the coding phase of the U-Net by introducing Vgg-16 and the residual structure, construction of the new network RU-Net and VU-Net. Compared with traditional classification methods, the experimental results show that the network can accurately identify all sea ice information in sea ice images. In particular, multi-scale sea ice types can be identified in real time, greatly improving the efficiency and accuracy of the identification of sea ice types. The MIoU values were 0.73 and 0.87 and the MPA values were 0.87 and 0.94 respectively.
海冰探测是保证船舶在中高纬度冰区安全航行的重要手段。面对复杂的海冰信息,如何利用船载相机的海冰图像,全面、准确、高效地识别四种海冰信息(冰皮、尼罗河冰、灰冰和白冰)和两种海冰背景信息(海水和天空),仍然是一个重大挑战。本研究提出了一种海冰图像自动语义分割方法,首先使用Rsenet50和Vgg-16网络对模型进行预训练,提高了网络训练效率。然后对U-Net网络进行修改,通过引入Vgg-16和残余结构改进U-Net的编码相位,构建新的网络RU-Net和VU-Net。实验结果表明,与传统的分类方法相比,该网络能够准确识别海冰图像中的所有海冰信息。特别是可以实时识别多尺度海冰类型,大大提高了海冰类型识别的效率和准确性。MIoU分别为0.73和0.87,MPA分别为0.87和0.94。
{"title":"Semantic Segmentation of Sea Ice Based on U-net Network Modification","authors":"Jun Zhao, Le Chen, Jinhao Li, Yuliang Zhao","doi":"10.1109/ROBIO55434.2022.10011899","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011899","url":null,"abstract":"Sea ice detection is essential to ensure the safe navigation of ships in mid- and high-latitude ice areas. In the face of complex sea ice information, how to use the sea ice images by shipboard cameras to comprehensively, accurately and efficiently identify four types of sea ice information (Ice skin, Nile ice, Grey ice and White ice)and two kinds of sea ice background information (sea water and sky), it remains a major challenge. This study proposes an automatic semantic segmentation method for sea ice images, which first uses Rsenet50 as well as Vgg-16 network to pre-train the model and improve the network training efficiency. Then modifications to U-Net network, improvement of the coding phase of the U-Net by introducing Vgg-16 and the residual structure, construction of the new network RU-Net and VU-Net. Compared with traditional classification methods, the experimental results show that the network can accurately identify all sea ice information in sea ice images. In particular, multi-scale sea ice types can be identified in real time, greatly improving the efficiency and accuracy of the identification of sea ice types. The MIoU values were 0.73 and 0.87 and the MPA values were 0.87 and 0.94 respectively.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"08 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115021565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Recognition of Degradation Scenarios for LiDAR SLAM Applications 激光雷达SLAM应用中退化场景的识别
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011727
Chenglin Yang, Zihao Chai, Xiaoxiao Yang, Hanyang Zhuang, Ming Yang
The SLAM system, which uses 3D LiDAR as the only sensor, is prone to degradation when facing a scenario with sparse structure and fewer constraints. It cannot solve the robot pose based on limited LiDAR constraint information, which leads to the localization failure and mapping failure of the SLAM system. Due to the limitations of LiDAR, it is difficult to only rely on the point cloud data provided by LiDAR to solve the problem of localization and mapping of degraded scenarios. Currently, the mainstream is to provide additional information through multi-sensor fusion and other schemes to restrict and correct the system's attitude. In the multi-source fusion system, it is still essential to determine the information reliability of each sensor source in different directions. Hence, the recognition of the degradation scenario has significant research value. In this paper, three schemes, geometric information, constraint distur-bance, and residual disturbance, are designed to quantitatively identify the degradation state of the system and estimate the degradation direction. Through experimental verification, the proposed schemes have a favorable recognition effect in the degradation scenario of the simulation environment and real environment.
SLAM系统使用3D激光雷达作为唯一的传感器,在面对稀疏结构和较少约束的场景时容易退化。基于有限的LiDAR约束信息无法求解机器人位姿,导致SLAM系统定位失败和测绘失败。由于激光雷达的局限性,仅依靠激光雷达提供的点云数据很难解决退化场景的定位和制图问题。目前,主流是通过多传感器融合等方案提供附加信息来约束和纠正系统的姿态。在多源融合系统中,确定各个传感器源在不同方向上的信息可靠性仍然是至关重要的。因此,识别退化情景具有重要的研究价值。本文设计了几何信息、约束干扰和残余干扰三种方案来定量识别系统的退化状态和估计退化方向。通过实验验证,所提方案在仿真环境和真实环境的退化场景下都具有良好的识别效果。
{"title":"Recognition of Degradation Scenarios for LiDAR SLAM Applications","authors":"Chenglin Yang, Zihao Chai, Xiaoxiao Yang, Hanyang Zhuang, Ming Yang","doi":"10.1109/ROBIO55434.2022.10011727","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011727","url":null,"abstract":"The SLAM system, which uses 3D LiDAR as the only sensor, is prone to degradation when facing a scenario with sparse structure and fewer constraints. It cannot solve the robot pose based on limited LiDAR constraint information, which leads to the localization failure and mapping failure of the SLAM system. Due to the limitations of LiDAR, it is difficult to only rely on the point cloud data provided by LiDAR to solve the problem of localization and mapping of degraded scenarios. Currently, the mainstream is to provide additional information through multi-sensor fusion and other schemes to restrict and correct the system's attitude. In the multi-source fusion system, it is still essential to determine the information reliability of each sensor source in different directions. Hence, the recognition of the degradation scenario has significant research value. In this paper, three schemes, geometric information, constraint distur-bance, and residual disturbance, are designed to quantitatively identify the degradation state of the system and estimate the degradation direction. Through experimental verification, the proposed schemes have a favorable recognition effect in the degradation scenario of the simulation environment and real environment.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121142959","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MR-GMMExplore: Multi-Robot Exploration System in Unknown Environments based on Gaussian Mixture Model MR-GMMExplore:基于高斯混合模型的未知环境多机器人探索系统
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011789
Yichun Wu, Qiuyi Gu, Jincheng Yu, Guangjun Ge, Jian Wang, Q. Liao, Chun Zhang, Yu Wang
Collaborative exploration in an unknown environ-ment is an essential task for mobile robotic systems. Without external positioning, multi-robot mapping methods have relied on the transfer of place descriptors and sensor data for relative pose estimation, which is not feasible in communication-limited environments. In addition, existing frontier-based exploration strategies are mostly designed for occupancy grid maps, thus failing to use surface information of obstacles in complex three-dimensional scenes. To address these limitations, we utilize Gaussian Mixture Model (GMM) as the map form for both mapping and exploration. We extend our previous mapping work to exploration setting by introducing MR-GMMExplore, a Multi-Robot GMM-based Exploration system in which robots transfer GMM submaps to reduce data transmission and perform exploration directly using the generated GMM map. Specifically, we propose a GMM spatial information extraction strategy that efficiently extracts obstacle probability information from GMM submaps. Then we present a goal selection method that allows robots to explore different areas, and a GMM-based local planner that realizes local planning using GMM maps instead of converting them into grid maps. Simulation results show that the transmission of GMM submaps reduces approximately 96% communication load compared with point clouds and our mean-based extraction strategy is 4 times faster than the traversal-based one. We also conduct comparative experiments to demonstrate the effectiveness of our approach in reducing backtracking paths and enhancing cooperation. MR-GMMExplore is published as an open-source ROS package at https://github.com/efc-robot/gmm_explore.
在未知环境下的协同探索是移动机器人系统的一项重要任务。在没有外部定位的情况下,多机器人映射方法依赖于位置描述符和传感器数据的传递来进行相对姿态估计,这在通信受限的环境中是不可行的。此外,现有的基于边界的探测策略大多是针对占用网格地图设计的,无法利用复杂三维场景中障碍物的表面信息。为了解决这些限制,我们使用高斯混合模型(GMM)作为映射和探索的地图形式。我们将以前的测绘工作扩展到勘探设置,引入了MR-GMMExplore,这是一个基于多机器人GMM的勘探系统,在该系统中,机器人传输GMM子地图以减少数据传输,并直接使用生成的GMM地图进行勘探。具体而言,我们提出了一种从GMM子地图中高效提取障碍概率信息的GMM空间信息提取策略。然后,我们提出了一种允许机器人探索不同区域的目标选择方法,以及一种基于GMM的局部规划器,该规划器使用GMM地图而不是将其转换为网格地图来实现局部规划。仿真结果表明,与点云相比,GMM子图的传输减少了约96%的通信负荷,基于均值的提取策略比基于遍历的提取策略快4倍。我们还进行了对比实验,以证明我们的方法在减少回溯路径和加强合作方面的有效性。MR-GMMExplore作为开源ROS包发布在https://github.com/efc-robot/gmm_explore。
{"title":"MR-GMMExplore: Multi-Robot Exploration System in Unknown Environments based on Gaussian Mixture Model","authors":"Yichun Wu, Qiuyi Gu, Jincheng Yu, Guangjun Ge, Jian Wang, Q. Liao, Chun Zhang, Yu Wang","doi":"10.1109/ROBIO55434.2022.10011789","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011789","url":null,"abstract":"Collaborative exploration in an unknown environ-ment is an essential task for mobile robotic systems. Without external positioning, multi-robot mapping methods have relied on the transfer of place descriptors and sensor data for relative pose estimation, which is not feasible in communication-limited environments. In addition, existing frontier-based exploration strategies are mostly designed for occupancy grid maps, thus failing to use surface information of obstacles in complex three-dimensional scenes. To address these limitations, we utilize Gaussian Mixture Model (GMM) as the map form for both mapping and exploration. We extend our previous mapping work to exploration setting by introducing MR-GMMExplore, a Multi-Robot GMM-based Exploration system in which robots transfer GMM submaps to reduce data transmission and perform exploration directly using the generated GMM map. Specifically, we propose a GMM spatial information extraction strategy that efficiently extracts obstacle probability information from GMM submaps. Then we present a goal selection method that allows robots to explore different areas, and a GMM-based local planner that realizes local planning using GMM maps instead of converting them into grid maps. Simulation results show that the transmission of GMM submaps reduces approximately 96% communication load compared with point clouds and our mean-based extraction strategy is 4 times faster than the traversal-based one. We also conduct comparative experiments to demonstrate the effectiveness of our approach in reducing backtracking paths and enhancing cooperation. MR-GMMExplore is published as an open-source ROS package at https://github.com/efc-robot/gmm_explore.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121504453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Acoustic Beamforming via Interference-Plus-Noise Covariance Matrix Construction for Interferences and Noise Attenuation 通过干涉加噪声协方差矩阵构建的干扰和噪声衰减声波束形成
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10012011
Yongxiong Xiao, Shiqiang Zhu, Wei Song, Minhong Wan, J. Gu, Te Li
The interference-plus-noise covariance matrix (INCM) is essential in improving an acoustic beamformer's interference and noise attenuation performance. In practical implementation, INCM reconstruction is required to remove the signal of interest (SOI) components from the sample covariance matrix. However, some of the interference and noise components are inevitably removed during the INCM reconstruction process to avoid distortion of the desired speech, which deteriorates the interference and noise attenuation performance of the beamformer. This paper proposes constructing an INCM with as much information on the interferences and noise as possible by adding covariance matrices of the spherically diffuse noise, background noise, and interferences. The final INCM is reconstructed by using the principal eigenvector and definition of INCM. The beamformer's weight coefficients are computed by the linearly constrained minimum variance (LCMV) formulation. The proposed method is validated by experiments using a circular microphone array mounted on a tour robot in an exhibition hall. The results show that the proposed beamformer improves the robustness of automatic speech recognition and the performance of robot audition.
干涉加噪声协方差矩阵(INCM)是提高声波束形成器的干扰和噪声抑制性能的关键。在实际实现中,INCM重构需要从样本协方差矩阵中去除感兴趣信号(SOI)分量。然而,在INCM重建过程中,为了避免期望语音的失真,不可避免地要去除一些干扰和噪声成分,从而降低了波束形成器的干扰和噪声衰减性能。本文提出通过添加球面漫射噪声、背景噪声和干扰的协方差矩阵,构建一个包含尽可能多的干扰和噪声信息的INCM。利用主特征向量和INCM的定义重构最终的INCM。采用线性约束最小方差(LCMV)公式计算波束形成器的权重系数。利用安装在展馆漫游机器人上的圆形麦克风阵列进行了实验,验证了该方法的有效性。结果表明,所提出的波束形成器提高了自动语音识别的鲁棒性和机器人试听的性能。
{"title":"Acoustic Beamforming via Interference-Plus-Noise Covariance Matrix Construction for Interferences and Noise Attenuation","authors":"Yongxiong Xiao, Shiqiang Zhu, Wei Song, Minhong Wan, J. Gu, Te Li","doi":"10.1109/ROBIO55434.2022.10012011","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10012011","url":null,"abstract":"The interference-plus-noise covariance matrix (INCM) is essential in improving an acoustic beamformer's interference and noise attenuation performance. In practical implementation, INCM reconstruction is required to remove the signal of interest (SOI) components from the sample covariance matrix. However, some of the interference and noise components are inevitably removed during the INCM reconstruction process to avoid distortion of the desired speech, which deteriorates the interference and noise attenuation performance of the beamformer. This paper proposes constructing an INCM with as much information on the interferences and noise as possible by adding covariance matrices of the spherically diffuse noise, background noise, and interferences. The final INCM is reconstructed by using the principal eigenvector and definition of INCM. The beamformer's weight coefficients are computed by the linearly constrained minimum variance (LCMV) formulation. The proposed method is validated by experiments using a circular microphone array mounted on a tour robot in an exhibition hall. The results show that the proposed beamformer improves the robustness of automatic speech recognition and the performance of robot audition.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123315047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A software framework for internet telerobot based on ROS 基于ROS的互联网远程机器人软件框架
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011856
Sheng Bi, Chuanhong Guo, Wenxing Yang, Geoge Zhang, Jiangcheng Chen, Yu Wang, I. Elhajj, Roy Vellaisamy
ROS is widely used in robot development. However, ROS is mainly based on LAN. So, an internet software framework needs to be designed based on ROS for telerobot development. An internet software framework based on ROS is proposed in this paper, including network communication system and robot internet software system. The network communication system implements a latency-optimized hierarchical data transmission protocol suitable for internet teleoperation and remote control, while the robot internet software system implements the internet teleoperation and remote control based on ROS. Finally, the experiment verifies the effectiveness of the system in data transmission and remote human-computer interaction under the internet environment.
ROS在机器人开发中有着广泛的应用。然而,ROS主要是基于局域网的。因此,需要设计一个基于ROS的网络软件框架用于远程机器人的开发。本文提出了一种基于ROS的网络软件框架,包括网络通信系统和机器人网络软件系统。网络通信系统实现了适合互联网遥操作和远程控制的时延优化分层数据传输协议,机器人互联网软件系统实现了基于ROS的互联网遥操作和远程控制。最后通过实验验证了该系统在互联网环境下数据传输和远程人机交互方面的有效性。
{"title":"A software framework for internet telerobot based on ROS","authors":"Sheng Bi, Chuanhong Guo, Wenxing Yang, Geoge Zhang, Jiangcheng Chen, Yu Wang, I. Elhajj, Roy Vellaisamy","doi":"10.1109/ROBIO55434.2022.10011856","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011856","url":null,"abstract":"ROS is widely used in robot development. However, ROS is mainly based on LAN. So, an internet software framework needs to be designed based on ROS for telerobot development. An internet software framework based on ROS is proposed in this paper, including network communication system and robot internet software system. The network communication system implements a latency-optimized hierarchical data transmission protocol suitable for internet teleoperation and remote control, while the robot internet software system implements the internet teleoperation and remote control based on ROS. Finally, the experiment verifies the effectiveness of the system in data transmission and remote human-computer interaction under the internet environment.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123579790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Multiple Synchronous Compliant and Passive Propeller Inspired by Loons for Swimming Robot 一种以潜水器为灵感的多同步柔性被动游泳机器人螺旋桨
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011708
Yaohui Xu, Junzhe Hu, Jinhua Song, Fengran Xie, Qiyang Zuo, Kai He
Animals living around water and marine environments have undergone a long evolutionary process and have developed a variety of propellers to enable rapid movement through the water. Loons, a kind of diving birds, use deformable, propulsion-generating feet to move through highly viscous fluid environments, and rely on the strong propulsion generated by the feet of this structure to enable them to dive to 70 meters and hunt fish in the water. Inspired by loons, a novel propeller for swimming robot was designed. A linkage with non-linear compliant oscillatory paddles mimicking loon's propelling mechanics, for thrust-efficient and agile locomotion, was firstly proposed. Arming to greater thrust and miniaturization, the method connecting linkage and the paddles is proposed which enables all the paddles oscillator synchronously to produce more thrust in the power stroke. Meanwhile, each compliant paddle, featured one-sided jointed limits, could create asymmetric gait cycle that avoids greater resistance in the recovery stroke. Furthermore, to analyze and evaluate the movement as well as the deformation and propelling force, the blade element theory was utilized to describe the dynamic model of the proposed propellers. Finally, experiments were carried out to verify the design and dynamic model. Overall, this paper offers a feasible and pragmatic design for biomimetic robot with multiple propellers synchronous propelling.
生活在水和海洋环境中的动物经历了漫长的进化过程,并发展出各种螺旋桨,以便在水中快速移动。潜鸟是一种潜水鸟类,它们使用可变形的、产生推进力的足部在高粘性的流体环境中移动,依靠这种结构的足部产生的强大推进力,使它们能够下潜到70米深的地方,在水中捕食鱼。受潜水器的启发,设计了一种新型的游泳机器人螺旋桨。首先提出了一种模拟潜鸟推进机制的非线性柔性摆动桨连杆机构,以实现高效的推力和敏捷运动。为了实现更大推力和小型化,提出了连杆与桨片连接的方法,使所有桨片同步振荡,在动力行程中产生更大的推力。同时,每一个柔顺的划桨,具有单侧关节限制,可以产生不对称的步态周期,避免在恢复划水时产生更大的阻力。为了分析和评价螺旋桨的运动、变形和推进力,利用叶片单元理论对螺旋桨的动力学模型进行了描述。最后,通过实验对设计和动力学模型进行了验证。总体而言,本文为多螺旋桨同步推进仿生机器人提供了一种切实可行的设计方案。
{"title":"A Novel Multiple Synchronous Compliant and Passive Propeller Inspired by Loons for Swimming Robot","authors":"Yaohui Xu, Junzhe Hu, Jinhua Song, Fengran Xie, Qiyang Zuo, Kai He","doi":"10.1109/ROBIO55434.2022.10011708","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011708","url":null,"abstract":"Animals living around water and marine environments have undergone a long evolutionary process and have developed a variety of propellers to enable rapid movement through the water. Loons, a kind of diving birds, use deformable, propulsion-generating feet to move through highly viscous fluid environments, and rely on the strong propulsion generated by the feet of this structure to enable them to dive to 70 meters and hunt fish in the water. Inspired by loons, a novel propeller for swimming robot was designed. A linkage with non-linear compliant oscillatory paddles mimicking loon's propelling mechanics, for thrust-efficient and agile locomotion, was firstly proposed. Arming to greater thrust and miniaturization, the method connecting linkage and the paddles is proposed which enables all the paddles oscillator synchronously to produce more thrust in the power stroke. Meanwhile, each compliant paddle, featured one-sided jointed limits, could create asymmetric gait cycle that avoids greater resistance in the recovery stroke. Furthermore, to analyze and evaluate the movement as well as the deformation and propelling force, the blade element theory was utilized to describe the dynamic model of the proposed propellers. Finally, experiments were carried out to verify the design and dynamic model. Overall, this paper offers a feasible and pragmatic design for biomimetic robot with multiple propellers synchronous propelling.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123945787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research on Stereo 3D Display for Augmented Reality Surgical Navigation 增强现实手术导航的立体三维显示技术研究
Pub Date : 2022-12-05 DOI: 10.1109/ROBIO55434.2022.10011711
Lixi Chen, Wei Fang, Zhan Teng
Limitations exist in the application of surgical robots in clinical practice such as doctors' limited field of vision, lack of depth information, and the need to constantly switch the field of vision in the process of surgery, which affects the efficiency of surgery. In this paper, research on stereo 3D display for augmented reality (AR) surgical navigation is carried out to address the issues, which combines the technology of AR to overlay the virtual 3D model with the actual image of the operation area, providing doctors and surgical assistants with a more intuitive display method of the lesion location of patients during the operation. The stereo 3D display is presented in detail, including the theoretical research, the algorithm model, the AR effect test, and the positioning error analysis. The simulation and experiments are conducted to evaluate the performance of the stereo 3D display, which verified the practicability and effectiveness of the system and showed that the system can correctly realize pose estimation, virtual model projection, and presentation of AR effect.
手术机器人在临床应用中存在着医生视野有限、缺乏深度信息、手术过程中需要不断切换视野等局限性,影响了手术效率。针对这一问题,本文开展了增强现实(AR)手术导航的立体3D显示研究,结合AR技术将虚拟3D模型与手术区域的实际图像叠加,为医生和手术助手在手术过程中更直观地显示患者病变位置提供了一种方法。详细介绍了立体三维显示系统,包括理论研究、算法模型、增强现实效果测试和定位误差分析。通过仿真和实验对立体3D显示的性能进行了评价,验证了系统的实用性和有效性,表明系统能够正确实现姿态估计、虚拟模型投影和AR效果呈现。
{"title":"Research on Stereo 3D Display for Augmented Reality Surgical Navigation","authors":"Lixi Chen, Wei Fang, Zhan Teng","doi":"10.1109/ROBIO55434.2022.10011711","DOIUrl":"https://doi.org/10.1109/ROBIO55434.2022.10011711","url":null,"abstract":"Limitations exist in the application of surgical robots in clinical practice such as doctors' limited field of vision, lack of depth information, and the need to constantly switch the field of vision in the process of surgery, which affects the efficiency of surgery. In this paper, research on stereo 3D display for augmented reality (AR) surgical navigation is carried out to address the issues, which combines the technology of AR to overlay the virtual 3D model with the actual image of the operation area, providing doctors and surgical assistants with a more intuitive display method of the lesion location of patients during the operation. The stereo 3D display is presented in detail, including the theoretical research, the algorithm model, the AR effect test, and the positioning error analysis. The simulation and experiments are conducted to evaluate the performance of the stereo 3D display, which verified the practicability and effectiveness of the system and showed that the system can correctly realize pose estimation, virtual model projection, and presentation of AR effect.","PeriodicalId":151112,"journal":{"name":"2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"153 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124460837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1