Parallelization Strategy of Non-Local Means Filtering Algorithm for Real-Time Denoising of Forward-Looking Multi-Beam Sonar Images

Abstract

Obtaining clear sonar images is crucial for ocean exploration applications, such as marine resource detection and underwater target searches. Traditional filtering methods cannot effectively eliminate the noise generated by the complex underwater environment in sonar images and can potentially result in problems such as image blurring. Existing methods that effectively filter sonar image noise often lack real-time performance, making them impractical for ocean exploration. To address these limitations, this study proposes a real-time denoising technique for forward-looking multi-beam sonar images based on a non-local means filtering algorithm. The integral image is used to calculate the mean square error (MSE), which improves algorithm efficiency and ensures that the runtime remains unaffected by the neighbourhood window size. To further improve real-time performance, the algorithm is migrated to a graphics processing unit (GPU) and a block-wise computation method is proposed to calculate the integral image. Simultaneously, to enhance GPU thread utilisation, the three-dimensional thread structure from the compute unified device architecture (CUDA) programming model is utilised and additional threads are allocated to enhance computation. The captured images are filtered using an M1200d sonar device manufactured by Oculus. Extensive experiments demonstrate that the proposed method achieves excellent performance regarding both denoising accuracy and efficiency. Specifically, the proposed method achieves a peak signal-to-noise ratio higher than 25 dB and a structural similarity index of more than 0.85 at 50 frames per second, thus demonstrating its significant potential for real-time sonar image denoising.