IEEE Access (Jan 2023)

Advertising Image Saliency Prediction Method Based on Score Level Fusion

  • Qiqi Kou,
  • Ruihang Liu,
  • Chen Lv,
  • He Jiang,
  • Deqiang Cheng

DOI
https://doi.org/10.1109/ACCESS.2023.3236807
Journal volume & issue
Vol. 11
pp. 8455 – 8466

Abstract

Read online

At present, visual saliency prediction algorithms have been developed more and more mature, but most of the current saliency prediction algorithms are aimed at natural images. Due to the inconsistency of elements and features between natural images and advertising images, the existing saliency prediction algorithms show poor robustness and low inference speed to advertising images, which severely limits its commercial application in advertising design and evaluation. In view of this, a saliency prediction algorithm for advertisement images is proposed in this paper. In the feature extraction stage, two text candidate regions based on intensity feature and improved MESR algorithm are first obtained and further integrated to produce a two-dimensional text confidence score. Meanwhile, a saliency confidence score is also obtained by an improved natural image saliency prediction network. Then, the score level fusion strategy was adopted to fuse the two confidence scores to get the final saliency prediction map. The experimental results show that the proposed model has good accuracy and robustness in advertising images, as well as the most remarkable inference speed, which can meet the demand for real-time performance of advertising image saliency prediction, leading to great practical and commercial value.

Keywords