Journal of Marine Science and Engineering (Jul 2024)

Underwater Unsupervised Stereo Matching Method Based on Semantic Attention

  • Qing Li,
  • Hongjian Wang,
  • Yao Xiao,
  • Hualong Yang,
  • Zhikang Chi,
  • Dongchen Dai

DOI
https://doi.org/10.3390/jmse12071123
Journal volume & issue
Vol. 12, no. 7
p. 1123

Abstract

Read online

A stereo vision system provides important support for underwater robots to achieve autonomous navigation, obstacle avoidance, and precise operation in complex underwater environments. This article proposes an unsupervised underwater stereo matching method based on semantic attention. By combining deep learning and semantic information, it fills the challenge of insufficient training data, enhances the intelligence level of underwater robots, and promotes the progress of underwater scientific research and marine resource development. This article proposes an underwater unsupervised stereo matching method based on semantic attention, targeting the missing training supervised dataset for underwater stereo matching. An adaptive double quadtree semantic attention model for the initial estimation of semantic disparity is designed, and an unsupervised AWLED semantic loss function is proposed, which is more robust to noise and textureless regions. Through quantitative and qualitative evaluations in the underwater stereo matching dataset, it was found that D1 all decreased by 0.222, EPE decreased by 2.57, 3px error decreased by 1.53, and the runtime decreased by 7 ms. This article obtained advanced results.

Keywords