LayerNet: A One-Step Layered Network for Semantic Segmentation at Night.

Abstract

We have collected a novel, nighttime scene dataset, called Rebecca, including 600 real images captured at night with pixel-level semantic annotations, which is currently scarce and can be invoked as a new benchmark. In addition, we proposed a one-step layered network, named LayerNet, to combine local features rich in appearance information in the shallow layer, global features abundant in semantic information in the deep layer, and middle-level features in between by explicitly modeling multistage features of objects in the nighttime. In addition, a multihead decoder and a well-designed hierarchical module are utilized to extract and fuse features of different depths. Numerous experiments show that our dataset can significantly improve the segmentation ability of the existing models for nighttime images. Meanwhile, our LayerNet achieves the state-of-the-art accuracy on Rebecca (65.3% mIOU). The dataset is available at https://github.com/Lihao482/REebecca.