IET Image Processing (Jan 2023)

A multi‐view image fusion algorithm for industrial weld

  • Qingchun Zheng,
  • Yangyang Zhao,
  • Xu Zhang,
  • Peihao Zhu,
  • Wenpeng Ma

DOI
https://doi.org/10.1049/ipr2.12627
Journal volume & issue
Vol. 17, no. 1
pp. 193 – 203

Abstract

Read online

Abstract Multi‐view image fusion can be used to extract features from redundant and complementary multisource images. And the technique of obtaining high quality fusion images has become one of the research hotspots for image processing. In order to realize defect detection and intelligent grinding smoothly, multi‐view fusion technology was applied in the field of overexposure and underexposure industrial welds, achieving high quality image enhancement. When preparing the data set of multi‐view images, a hybrid registration algorithm with high matching ability is proposed. The data set of overexposure and underexposure weld images was obtained successfully by using the registration algorithm. In order to improve the fusion ability of overexposure and underexposure industrial welds, we propose a novel multi‐view image fusion algorithm based on deep learning. The multi‐view fusion algorithm uses an autoencoder network structure, and its innovation lies in a parallel branch network with lightweight structure and strong generalization ability. The experimental results demonstrate that compared with other classical multi‐view algorithms, our proposed algorithm gets the best parameters on the industrial weld data set in peak signal to noise ratio (PSNR) and root mean square error (RMSE), reaching 59.12 and 0.084, respectively. And the ablation and performance comparison experiments verify that the proposed parallel branch network has better generalization ability and fusion accuracy than other classical multi branch networks.