{"title":"Faster R–CNN, RetinaNet and Single Shot Detector in different ResNet backbones for marine vessel detection using cross polarization C-band SAR imagery","authors":"Richard Dein Altarez","doi":"10.1016/j.rsase.2024.101297","DOIUrl":null,"url":null,"abstract":"<div><p>Detection of marine vessels plays an important role in monitoring, managing and securing seas and oceans, and forms the foundation of Maritime Domain Awareness (MDA). Although marine vessel detection has remained an active area of research for many years, unlike other object detectors, techniques of detection have been left far behind and lack systematic robustness. Hence, this study compared the performance of Faster R–CNN, RetinaNet and Single Shot Detector (SSD) across different epochs and complexities of ResNet architectures using Sentinel-1 VH polarization in one of the busiest ports in the Philippines. In particular, the models were created from the training samples dataset derived from Sentinel-1 VH imagery captured on January 12, 2024 in ResNet-34, -50, and −101 backbones, and 20 and 100 epochs. In this study, a total of 18 different object detector models were created for the comparative analysis. The models were tested with respect to different dates but having the same imagery type to determine their applicability across other base maps. Faster R–CNN with the highest F1 score of 0.85 outperformed RetinaNet with a highest F1 score of 0.74 and SSD with the highest F1 score of 0.38. The fastest model created was SSD, with an average speed of 9 to 44 minutes, followed by RetinaNet with an average speed of 8 to 58 minutes; the slowest is Faster R–CNN with an average speed of 25 minutes to 1 hour and 3 minutes. The use of Sentinel-1 VH imagery for marine vessel detection is a viable alternative, but the choice of object detectors should be carefully considered. The presence of geospatial software with advance deep learning tools improves remote sensing applications and allows non-programmers to optimize their competence. This study highlights the potential utilization of other imagery with higher spatial resolution, testing of other deep learning algorithms, finetuning of parameters, and utilization of higher computing infrastructure. The findings of this study can be applied in other areas for MDA, particularly in regions where advanced remote sensing applications have yet to be extensively explored.</p></div>","PeriodicalId":53227,"journal":{"name":"Remote Sensing Applications-Society and Environment","volume":"36 ","pages":"Article 101297"},"PeriodicalIF":3.8000,"publicationDate":"2024-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing Applications-Society and Environment","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352938524001617","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Detection of marine vessels plays an important role in monitoring, managing and securing seas and oceans, and forms the foundation of Maritime Domain Awareness (MDA). Although marine vessel detection has remained an active area of research for many years, unlike other object detectors, techniques of detection have been left far behind and lack systematic robustness. Hence, this study compared the performance of Faster R–CNN, RetinaNet and Single Shot Detector (SSD) across different epochs and complexities of ResNet architectures using Sentinel-1 VH polarization in one of the busiest ports in the Philippines. In particular, the models were created from the training samples dataset derived from Sentinel-1 VH imagery captured on January 12, 2024 in ResNet-34, -50, and −101 backbones, and 20 and 100 epochs. In this study, a total of 18 different object detector models were created for the comparative analysis. The models were tested with respect to different dates but having the same imagery type to determine their applicability across other base maps. Faster R–CNN with the highest F1 score of 0.85 outperformed RetinaNet with a highest F1 score of 0.74 and SSD with the highest F1 score of 0.38. The fastest model created was SSD, with an average speed of 9 to 44 minutes, followed by RetinaNet with an average speed of 8 to 58 minutes; the slowest is Faster R–CNN with an average speed of 25 minutes to 1 hour and 3 minutes. The use of Sentinel-1 VH imagery for marine vessel detection is a viable alternative, but the choice of object detectors should be carefully considered. The presence of geospatial software with advance deep learning tools improves remote sensing applications and allows non-programmers to optimize their competence. This study highlights the potential utilization of other imagery with higher spatial resolution, testing of other deep learning algorithms, finetuning of parameters, and utilization of higher computing infrastructure. The findings of this study can be applied in other areas for MDA, particularly in regions where advanced remote sensing applications have yet to be extensively explored.
期刊介绍:
The journal ''Remote Sensing Applications: Society and Environment'' (RSASE) focuses on remote sensing studies that address specific topics with an emphasis on environmental and societal issues - regional / local studies with global significance. Subjects are encouraged to have an interdisciplinary approach and include, but are not limited by: " -Global and climate change studies addressing the impact of increasing concentrations of greenhouse gases, CO2 emission, carbon balance and carbon mitigation, energy system on social and environmental systems -Ecological and environmental issues including biodiversity, ecosystem dynamics, land degradation, atmospheric and water pollution, urban footprint, ecosystem management and natural hazards (e.g. earthquakes, typhoons, floods, landslides) -Natural resource studies including land-use in general, biomass estimation, forests, agricultural land, plantation, soils, coral reefs, wetland and water resources -Agriculture, food production systems and food security outcomes -Socio-economic issues including urban systems, urban growth, public health, epidemics, land-use transition and land use conflicts -Oceanography and coastal zone studies, including sea level rise projections, coastlines changes and the ocean-land interface -Regional challenges for remote sensing application techniques, monitoring and analysis, such as cloud screening and atmospheric correction for tropical regions -Interdisciplinary studies combining remote sensing, household survey data, field measurements and models to address environmental, societal and sustainability issues -Quantitative and qualitative analysis that documents the impact of using remote sensing studies in social, political, environmental or economic systems