{"title":"FREGNet: Ship Recognition Based on Feature Representation Enhancement and GCN Combiner in Complex Environment","authors":"Yang Tian;Hao Meng;Fei Yuan","doi":"10.1109/TITS.2024.3454016","DOIUrl":null,"url":null,"abstract":"Harsh sea conditions, uneven illumination, and the variable spatial positions of ships result in ship images captured by imaging systems that contain not only the ship targets but also complex environmental information. This environmental complexity, intertwined with the ship targets, significantly undermines the accuracy of ship target recognition. However, existing methods for recognizing ships are mainly designed to identify large targets in clear weather with uniform illumination. They rarely account for the aforementioned complex environmental information, leading to the loss of critical detailed features in the ship’s target area, particularly in adverse weather and uneven illumination scenarios. To address these challenges, we propose a novel method for recognizing ship targets in complex environments: the Feature Representation Enhancement and Graph Convolutional Combiner Network (FREGNet). We introduce a Feature Representation Enhancement (FRE) module to the backbone of the feature extraction network to enhance the capture of detailed features in the ship’s target area, particularly under illumination noise and cloud-covered conditions. Furthermore, we design a GCN Combiner module based on a Graph Convolutional Network to dynamically combine global feature key points and local detailed feature key points output by the FRE, thereby increasing the quantity of detailed feature information in the ship’s target area. This approach facilitates the accurate classification of ship categories. Experiments were conducted using the CIB-ships, MAR-ships, and Game-of-ships datasets. Compared to suboptimal transformer-based ship target recognition methods, FREGNet improves ship target recognition accuracy by 2.8%, 0.99%, and 1.38%, respectively. The FREGNet method achieves high recognition accuracy at a faster rate.","PeriodicalId":13416,"journal":{"name":"IEEE Transactions on Intelligent Transportation Systems","volume":"25 11","pages":"15641-15653"},"PeriodicalIF":7.9000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10680454/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0
Abstract
Harsh sea conditions, uneven illumination, and the variable spatial positions of ships result in ship images captured by imaging systems that contain not only the ship targets but also complex environmental information. This environmental complexity, intertwined with the ship targets, significantly undermines the accuracy of ship target recognition. However, existing methods for recognizing ships are mainly designed to identify large targets in clear weather with uniform illumination. They rarely account for the aforementioned complex environmental information, leading to the loss of critical detailed features in the ship’s target area, particularly in adverse weather and uneven illumination scenarios. To address these challenges, we propose a novel method for recognizing ship targets in complex environments: the Feature Representation Enhancement and Graph Convolutional Combiner Network (FREGNet). We introduce a Feature Representation Enhancement (FRE) module to the backbone of the feature extraction network to enhance the capture of detailed features in the ship’s target area, particularly under illumination noise and cloud-covered conditions. Furthermore, we design a GCN Combiner module based on a Graph Convolutional Network to dynamically combine global feature key points and local detailed feature key points output by the FRE, thereby increasing the quantity of detailed feature information in the ship’s target area. This approach facilitates the accurate classification of ship categories. Experiments were conducted using the CIB-ships, MAR-ships, and Game-of-ships datasets. Compared to suboptimal transformer-based ship target recognition methods, FREGNet improves ship target recognition accuracy by 2.8%, 0.99%, and 1.38%, respectively. The FREGNet method achieves high recognition accuracy at a faster rate.
期刊介绍:
The theoretical, experimental and operational aspects of electrical and electronics engineering and information technologies as applied to Intelligent Transportation Systems (ITS). Intelligent Transportation Systems are defined as those systems utilizing synergistic technologies and systems engineering concepts to develop and improve transportation systems of all kinds. The scope of this interdisciplinary activity includes the promotion, consolidation and coordination of ITS technical activities among IEEE entities, and providing a focus for cooperative activities, both internally and externally.