Underwater Image Enhancement (UIE) methods and Underwater Object Detection (UOD) algorithms are used to monitor the growth of marine aquaculture organisms. However, compared to the original underwater image, image enhancement affects the accuracy of object detection. This paper proposes a Multimodal Enhanced Underwater Image Generation method based on flow matching (MEUIG) to generate enhanced underwater images containing object feature information. Firstly, a dual-branch flow matching model is designed which includes feature extraction branch and image enhancement branch. The feature extraction branch extracts the object feature information in the original underwater images. The enhanced underwater image in the image enhancement branch is achieved through the color-line method. Then, we proposed a fusion module to combine the information of the different modalities. This module fuses multimodal feature information which contains image generated by flow matching, feature information and enhanced image. Additionally, we construct a feature extraction module to extract the object features in the original image. Finally, a new loss function is designed, which considers the pixel movement path, the feature difference between the condition image and the output image and the reconstruction loss. Qualitative and quantitative evaluations show that MEUIG improves image quality while retaining the original information. Our method achieves significantly higher detection accuracy on YOLOv11 compared to existing underwater enhancement methods. In the detection of echinus, MEUIG method is 18.8% and 9.7% higher than the contrast enhancement method, respectively. The code of the MEUIG model and the 4889 dataset used for training the MEUIG model can be found at: https://github.com/Warmth-0213/MEUIG.git. The link of the 5455 underwater objects detection dataset is: https://github.com/Warmth-0213/data1.git.
扫码关注我们
求助内容:
应助结果提醒方式:
