Towards Dense Point Correspondence with PatchMatch in Low-Resolution Sonar Images

Abstract

Robust feature correspondences between 2D sonar imagery are important for perception tasks in the underwater domain such as 3D reconstruction but involve open challenges, in particular, low-resolution as well as the fact that object appearance is view-dependent. Although sonars in the MHz range would allow for higher resolution imagery, in this paper we focus on scenarios with a lower frequency kHz sensor, in which the longer visual range is gained at the sacrifice of image resolution. To this end, we first propose to solve the correspondence task using the PatchMatch algorithm for the first time in sonar imagery, and then propose a method for feature extraction based on IC. We then compare the proposed methods against conventional methods from computer vision. We evaluate our method on data from a lake experiment with objects captured with an FLS sensor. Our results show that the proposed combination of IC together with PatchMatch is well-suited for point feature extraction and correspondence in sonar imagery. Further, we also evaluate the different methods for point correspondence with a 3D object reconstruction task.