OMS-SLAM: Dynamic Scene Visual SLAM Based on Object Detection with Multiple Geometric Feature Constraints and Statistical Threshold Segmentation

IF 2.7 3区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY Measurement Science and Technology Pub Date : 2024-07-02 DOI:10.1088/1361-6501/ad5de5
Jialiang Tang, Zhengyong Feng, Peng Liao, Liheng Chen, Xiaomei Xiao
{"title":"OMS-SLAM: Dynamic Scene Visual SLAM Based on Object Detection with Multiple Geometric Feature Constraints and Statistical Threshold Segmentation","authors":"Jialiang Tang, Zhengyong Feng, Peng Liao, Liheng Chen, Xiaomei Xiao","doi":"10.1088/1361-6501/ad5de5","DOIUrl":null,"url":null,"abstract":"\n SLAM technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the GMS (Grid-based Motion Statistics) matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system's robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the Absolute Trajectory Error (ATE) in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.","PeriodicalId":18526,"journal":{"name":"Measurement Science and Technology","volume":null,"pages":null},"PeriodicalIF":2.7000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6501/ad5de5","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

SLAM technology is crucial to robot navigation. Despite the good performance of traditional SLAM algorithms in static environments, dynamic objects typically exist in realistic operating environments. These objects can lead to misassociated features, which in turn considerably impact the system’s localization accuracy and robustness. To better address this challenge, we have proposed the OMS-SLAM. In OMS-SLAM, we adopted the YOLOv8 target detection network to extract object information from environment and designed a dynamic probability propagation model that is coupled with target detection and multiple geometric constrains to determine the dynamic objects in the environment. For the identified dynamic objects, we have designed a foreground image segmentation algorithm based on depth image histogram statistics to extract the object contours and eliminate the feature points within these contours. We then use the GMS (Grid-based Motion Statistics) matching pair as the filtering strategy to enhance the quality of the feature points and use the enhanced feature points for tracking. This combined method can accurately identify dynamic objects and extract related feature points, significantly reducing its interference and consequently enhancing the system's robustness and localization accuracy. We also built static dense point cloud maps to support advanced tasks of robots. Finally, through testing on the high-speed dataset of TUM RGB-D, it was found that the root mean square error of the Absolute Trajectory Error (ATE) in this study decreased by an average of 97.10%, compared to ORB-SLAM2. Moreover, tests in real-world scenarios also confirmed the effectiveness of the OMS-SLAM algorithm in dynamic environments.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
OMS-SLAM:基于多重几何特征约束和统计阈值分割的物体检测的动态场景视觉 SLAM
SLAM 技术对机器人导航至关重要。尽管传统的 SLAM 算法在静态环境中性能良好,但在现实操作环境中通常存在动态物体。这些物体可能会导致误关联特征,进而严重影响系统的定位精度和鲁棒性。为了更好地应对这一挑战,我们提出了 OMS-SLAM。在 OMS-SLAM 中,我们采用 YOLOv8 目标检测网络从环境中提取物体信息,并设计了一个动态概率传播模型,该模型与目标检测和多重几何约束相结合,以确定环境中的动态物体。对于识别出的动态物体,我们设计了一种基于深度图像直方图统计的前景图像分割算法,以提取物体轮廓并消除轮廓内的特征点。然后,我们使用 GMS(基于网格的运动统计)匹配对作为过滤策略来增强特征点的质量,并使用增强后的特征点进行跟踪。这种组合方法能准确识别动态物体并提取相关特征点,大大减少了干扰,从而提高了系统的鲁棒性和定位精度。我们还建立了静态密集点云图,以支持机器人的高级任务。最后,通过对 TUM RGB-D 高速数据集的测试发现,与 ORB-SLAM2 相比,本研究中的绝对轨迹误差(ATE)的均方根误差平均降低了 97.10%。此外,实际场景中的测试也证实了 OMS-SLAM 算法在动态环境中的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Measurement Science and Technology
Measurement Science and Technology 工程技术-工程:综合
CiteScore
4.30
自引率
16.70%
发文量
656
审稿时长
4.9 months
期刊介绍: Measurement Science and Technology publishes articles on new measurement techniques and associated instrumentation. Papers that describe experiments must represent an advance in measurement science or measurement technique rather than the application of established experimental technique. Bearing in mind the multidisciplinary nature of the journal, authors must provide an introduction to their work that makes clear the novelty, significance, broader relevance of their work in a measurement context and relevance to the readership of Measurement Science and Technology. All submitted articles should contain consideration of the uncertainty, precision and/or accuracy of the measurements presented. Subject coverage includes the theory, practice and application of measurement in physics, chemistry, engineering and the environmental and life sciences from inception to commercial exploitation. Publications in the journal should emphasize the novelty of reported methods, characterize them and demonstrate their performance using examples or applications.
期刊最新文献
Morphological characterization of concave particle based on convex decomposition TSMDA: intelligent fault diagnosis of rolling bearing with two stage multi-source domain adaptation Precise orbit determination of integrated BDS-3 and LEO satellites with ambiguity fixing under regional ground stations High-accuracy and lightweight weld surface defect detector based on graph convolution decoupling head Gap Measurement Method Based on Projection Lines and Convex Analysis of 3D Points Cloud
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1