Negative Class Guided Spatial Consistency Network for Sparsely Supervised Semantic Segmentation of Remote Sensing Images

Abstract

Deep neural networks (DNNs) have been successfully applied in the remote sensing semantic segmentation. However, training DNNs requires a large number of densely labeled samples, which is laborious and time-consuming. Sparsely supervised semantic segmentation (SSSS) can train deep segmentation networks using only sparse annotations. In this paper, we propose a negative class guided spatial consistency network (NCG-SCNet) for semantic segmentation with sparse annotations. Specifically, we introduce a spatial consistency enhancement module (SCEM) to enhance network features by non-linearly combining spatially similar features. Thus, it could provide better representations of the boundaries and the shape of the target. Additionally, a channel compression module (CCM) is proposed to reduce channel redundancy while preserving the network’s feature extraction capability. A negative class guided loss function (NCG Loss) is constructed to provide extra supervisory information, where the negative classes are defined as the classes with lower probability in the prediction. Extensive experiments on two widely used remote sensing datasets show that the proposed NCG-SCNet outperforms the comparison methods.