Multi-Task Deep Network for Semantic Segmentation of Building in Very High Resolution Imagery

Abstract

Building extraction from very high resolution (VHR) imagery plays an important role in urban planning, disaster management, navigation, updating geographic databases, and several other geospatial applications. The automatic generation of buildings from satellite images presents a considerable challenge due to the complexity of building shapes. Compared with the traditional building extraction approaches, deep learning networks have shown outstanding performance in this task by using both high-level and low-level feature maps. Recently, many deep networks derived from U-Net has been extensively used in various buildings segmentation tasks. However, in most of the cases, U-net produce coarse and non-smooth segmentations with lots of discontinuities. To improve and refine the performance of U-Net network, we propose a deep end-to-end network, which use a single encoder and two parallel decoders along with performing the mask predictions also perform distance map estimation. The distance map aid in ensuring smoothness in the segmentation predictions. We also propose a new joint loss function for the proposed architecture. Experimental results based on public international society for photogrammetry and remote sensing (ISPRS) datasets with only (RGB) images demonstrated that the proposed framework can significantly improve the quality of building segmentation.