{"title":"OMS-SLAM:基于多重几何特征约束和统计阈值分割的物体检测的动态场景视觉 SLAM","authors":"Jialiang Tang, Zhengyong Feng, Peng Liao, Liheng Chen, Xiaomei Xiao","doi":"10.1088/1361-6501/ad5de5","DOIUrl":null,"url":null,"abstract":"\n SLAM technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the GMS (Grid-based Motion Statistics) matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system's robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the Absolute Trajectory Error (ATE) in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.","PeriodicalId":18526,"journal":{"name":"Measurement Science and Technology","volume":null,"pages":null},"PeriodicalIF":2.7000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"OMS-SLAM: Dynamic Scene Visual SLAM Based on Object Detection with Multiple Geometric Feature Constraints and Statistical Threshold Segmentation\",\"authors\":\"Jialiang Tang, Zhengyong Feng, Peng Liao, Liheng Chen, Xiaomei Xiao\",\"doi\":\"10.1088/1361-6501/ad5de5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n SLAM technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the GMS (Grid-based Motion Statistics) matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system's robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the Absolute Trajectory Error (ATE) in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.\",\"PeriodicalId\":18526,\"journal\":{\"name\":\"Measurement Science and Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Measurement Science and Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1088/1361-6501/ad5de5\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6501/ad5de5","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
SLAM 技术对机器人导航至关重要。尽管传统的 SLAM 算法在静态环境中性能良好,但在现实操作环境中通常存在动态物体。这些物体可能会导致误关联特征,进而严重影响系统的定位精度和鲁棒性。为了更好地应对这一挑战,我们提出了 OMS-SLAM。在 OMS-SLAM 中,我们采用 YOLOv8 目标检测网络从环境中提取物体信息,并设计了一个动态概率传播模型,该模型与目标检测和多重几何约束相结合,以确定环境中的动态物体。对于识别出的动态物体,我们设计了一种基于深度图像直方图统计的前景图像分割算法,以提取物体轮廓并消除轮廓内的特征点。然后,我们使用 GMS(基于网格的运动统计)匹配对作为过滤策略来增强特征点的质量,并使用增强后的特征点进行跟踪。这种组合方法能准确识别动态物体并提取相关特征点,大大减少了干扰,从而提高了系统的鲁棒性和定位精度。我们还建立了静态密集点云图,以支持机器人的高级任务。最后,通过对 TUM RGB-D 高速数据集的测试发现,与 ORB-SLAM2 相比,本研究中的绝对轨迹误差(ATE)的均方根误差平均降低了 97.10%。此外,实际场景中的测试也证实了 OMS-SLAM 算法在动态环境中的有效性。
OMS-SLAM: Dynamic Scene Visual SLAM Based on Object Detection with Multiple Geometric Feature Constraints and Statistical Threshold Segmentation
SLAM technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the GMS (Grid-based Motion Statistics) matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system's robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the Absolute Trajectory Error (ATE) in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.
期刊介绍:
Measurement Science and Technology publishes articles on new measurement techniques and associated instrumentation. Papers that describe experiments must represent an advance in measurement science or measurement technique rather than the application of established experimental technique. Bearing in mind the multidisciplinary nature of the journal, authors must provide an introduction to their work that makes clear the novelty, significance, broader relevance of their work in a measurement context and relevance to the readership of Measurement Science and Technology. All submitted articles should contain consideration of the uncertainty, precision and/or accuracy of the measurements presented.
Subject coverage includes the theory, practice and application of measurement in physics, chemistry, engineering and the environmental and life sciences from inception to commercial exploitation. Publications in the journal should emphasize the novelty of reported methods, characterize them and demonstrate their performance using examples or applications.