Long and short-range relevance context network for semantic segmentation

Abstract

Abstract The semantic information can ensure better pixel classification, and the spatial information of the low-level feature map can ensure the detailed location of the pixels. However, this part of spatial information is often ignored in capturing semantic information, it is a huge loss for the spatial location of the image semantic category itself. To better alleviate this problem, we propose a Long and Short-Range Relevance Context Network. Specifically, we first construct a Long-Range Relevance Context Module to capture the global semantic context of the high-level feature and the ignored local spatial context information. At the same time, we build a Short-Range Relevance Context Module to capture the piecewise spatial context information in each stage of the low-level features in the form of jump connections. The whole network adopts a coding and decoding structure to better improve the segmentation results. Finally, we conduct a large number of experiments on three semantic segmentation datasets (PASCAL VOC2012, Cityscapes and ADE20K datasets) to verify the effectiveness of the network.

Keywords

• Semantic segmentation
• Context information
• Convolutional neural network
• Attention mechanism