Applied Sciences (Nov 2022)

Image Semantic Segmentation Fusion of Edge Detection and AFF Attention Mechanism

  • Yijie Jiao,
  • Xiaohua Wang,
  • Wenjie Wang,
  • Shuang Li

DOI
https://doi.org/10.3390/app122111248
Journal volume & issue
Vol. 12, no. 21
p. 11248

Abstract

Read online

Deep learning has been widely used in various fields because of its accuracy and efficiency. At present, the improvement of image semantic segmentation accuracy has become the area of most concern. In terms of increasing accuracy, improved semantic segmentation models have attracted more attention. In this paper, a hybrid model is proposed to solve the problems of edge splitting and small objects disappearing from complex scene images. The hybrid model consists of three parts: (1) an improved HED network, (2) an improved PSP-Net, (3) an AFF attention mechanism. Continuous edges can be obtained by combining the improved HED network with an improved PSP-Net. The AFF attention mechanism can improve the segmentation effect of small target objects by enhancing its response recognition ability for specific semantic scenes. The experiments were carried out on Cityspaces, SIFT Flow, NYU-V2 and CamVid datasets, and the experimental results show that the segmentation accuracy of our method is improved by 2% for small target objects, and by 3% for scenes with complex object edges.

Keywords