Field Test Validations of Vision-based Multi-camera Multi-drone Tracking and 3D Localizing with Concurrent Camera Pose Estimation

Abstract

This paper reports the field test validations of the recently proposed vision-based real-time multi-camera setups for detecting, tracking and 3D localizing multiple aerial targets (mainly drones). We also propose the additional concurrent camera pose estimation when the camera poses are not known beforehand. This extra step can be used alongside (in parallel) with the drone tracking and localizing process. We conducted flight tests using 2 drones flying in 2 specific scenarios, and used 3 cameras to observe, detect, track and locate the positions of both drones in global frame. The efficacy of our technique is measured by the accuracy of the temporal and spatial positions of the observed drones, against the drones’ own GPS recordings. Our initial results show reasonable accuracy, i.e. ±1m at 50m, as such, the proposed vision-based methods can be used for drone detection and tracking.