Xuanzhi Peng;Pengfei Tong;Xuerong Yang;Chen Wang;An-Min Zou
{"title":"IDMF-VINS: Improving Visual-Inertial SLAM for Complex Dynamic Environments With Motion Consistency and Feature Filtering","authors":"Xuanzhi Peng;Pengfei Tong;Xuerong Yang;Chen Wang;An-Min Zou","doi":"10.1109/JSEN.2024.3525063","DOIUrl":null,"url":null,"abstract":"The detection of dynamic feature points presents a substantial challenge to dynamic scene analysis for simultaneous localization and mapping (SLAM). Conventional methods based on semantic segmentation, which are capable of producing complete object outlines, are expensive and not compatible with applications that run in real time. This study proposes a novel method combining YOLOv5 object detection information with motion consistency results to accurately differentiate between dynamic feature points and the corresponding states of predefined objects. To roughly distinguish background and dynamic objects within the object detection bounding boxes, a deep clustering approach is employed. The cluster centers have been optimized through iterative computation. In addition, a depth-based anomaly outlier filtering algorithm is employed to exclude stationary points in extremely close proximity to dynamic objects, thereby enhancing the capacity to distinguish between dynamic objects. The proposed method effectively minimizes the distortion resulting from dynamic feature points throughout pose estimation, which enhances the overall performance of the system while preserving a comparable quantity of feature points.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 4","pages":"6995-7005"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10836179/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The detection of dynamic feature points presents a substantial challenge to dynamic scene analysis for simultaneous localization and mapping (SLAM). Conventional methods based on semantic segmentation, which are capable of producing complete object outlines, are expensive and not compatible with applications that run in real time. This study proposes a novel method combining YOLOv5 object detection information with motion consistency results to accurately differentiate between dynamic feature points and the corresponding states of predefined objects. To roughly distinguish background and dynamic objects within the object detection bounding boxes, a deep clustering approach is employed. The cluster centers have been optimized through iterative computation. In addition, a depth-based anomaly outlier filtering algorithm is employed to exclude stationary points in extremely close proximity to dynamic objects, thereby enhancing the capacity to distinguish between dynamic objects. The proposed method effectively minimizes the distortion resulting from dynamic feature points throughout pose estimation, which enhances the overall performance of the system while preserving a comparable quantity of feature points.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice