Selective feature fusion network for salient object detection

Abstract

Abstract Fully convolutional neural networks have achieved great success in salient object detection, in which the effective use of multi‐layer features plays a critical role. Based on this advantage, many saliency detectors have emerged in recent years, and most of them designed a series of network structures to integrate the multi‐level features generated by the backbone network. However, information in different layer play different roles in saliency object detection, how to integrate them effectively is still a great challenge. In this article, a selective feature fusion network which consists of a selective feature fusion module (SFM) and an attention‐guide hierarchical feature emphasis module (AEM) is proposed. Most of the previous works mainly integrate multi‐level feature by addition and concatenation, as a difference, SFM adaptively selects the important information from the input features in the fusion, which effectively avoids introducing too much redundant information. Besides, AEM combines spatial attention and channel attention to enhance features simply and effectively by hierarchical iteration, and further improve the accuracy of salient object detection. Experiments on five datasets show that the proposed selective feature fusion method achieve satisfactory results when comparing to other state‐of‐the‐art salient object detection approaches.

Keywords

• attention mechanism
• feature fusion
• multi‐level feature
• salient object detection