IEEE Access (Jan 2020)

Multi-Focus Color Image Fusion Algorithm Based on Super-Resolution Reconstruction and Focused Area Detection

  • Shuaiqi Liu,
  • Jian Ma,
  • Lu Yin,
  • Hailiang Li,
  • Shuai Cong,
  • Xiaole Ma,
  • Shaohai Hu

DOI
https://doi.org/10.1109/ACCESS.2020.2993404
Journal volume & issue
Vol. 8
pp. 90760 – 90778

Abstract

Read online

Multi-focus image fusion is an image processing that generates an integrated image by merging multiple images from different focus area in the same scene. For most fusion methods, the detection of the focus area is a critical step. In this paper, we propose a multi-focus image fusion algorithm based on a dual convolutional neural network (DualCNN), in which the focus area is detected from super-resolved images. Firstly, the source image is input into a DualCNN to restore the details and structure from its super-resolved image, as well as to improve the contrast of the source image. Secondly, the bilateral filter is used to reduce noise on the fused image, and the guided filter is used to detect the focus area of the image and refine the decision map. Finally, the fused image is obtained by weighting the source image according to the decision map. Experimental results show that our algorithm can well retain image details and maintain spatial consistency. Compared with existing methods in multiple groups of experiments, our algorithm can achieve better visual perception according to subjective evaluation and objective indexes.

Keywords