GFA-SMT: Geometric Feature Aggregation and Self-Attention in a Multi-Head Transformer for 3D Object Detection in Autonomous Vehicles

Abstract

3D object detection by autonomous vehicles is integral to intelligent transportation. Existing systems often compromise essential foreground point features and local spatial interactions through random down-sampling, focusing primarily on local feature extraction. However, this neglects interactions among distant yet significant points, limiting semantic information and detection performance due to inherent point cloud data sparsity. Addressing this, our proposed Geometric Feature Aggregation and Self-Attention in a Multi-Head Transformer (GFA-SMT) architecture leverages Graph Convolutional Networks and multi-channel transformers to enhance weak semantic information of distant sparse objects. GFA-SMT comprises three modules: Distance Suppression for Local Receptive Fields (DsLRF), Geometric Feature Aggregator with Multi-head Self Attention (GFaSA), and Predicted Key-point Weighting and Refinement (PKwR). DsLRF preserves foreground features, GFaSA encodes similar features and aggregates edge features, while PKwR focuses on key-points for enhancing geometric knowledge of distant and sparse objects. Extensive experiments on KITTI, DIARV2X-I and NuScenes datasets show significant enhancements in widely used techniques, resulting in notable increases in average precision (AP) for 3D object detection: 4.08%, 5.56%, and 4.62%, respectively, on the KITTI test dataset. GFA-SMT enhances point cloud detection accuracy, particularly at medium and long distances, with minimal impact on run-time performance and model parameters.