IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2024)

DiffWater: Underwater Image Enhancement Based on Conditional Denoising Diffusion Probabilistic Model

  • Meisheng Guan,
  • Haiyong Xu,
  • Gangyi Jiang,
  • Mei Yu,
  • Yeyao Chen,
  • Ting Luo,
  • Xuebo Zhang

DOI
https://doi.org/10.1109/JSTARS.2023.3344453
Journal volume & issue
Vol. 17
pp. 2319 – 2335

Abstract

Read online

Underwater imaging is often affected by light attenuation and scattering in water, leading to degraded visual quality, such as color distortion, reduced contrast, and noise. Existing underwater image enhancement (UIE) methods often lack generalization capabilities, making them unable to adapt to various underwater images captured in different aquatic environments and lighting conditions. To address these challenges, a UIE method based on the conditional denoising diffusion probabilistic model (DDPM) is proposed (DiffWater), which leverages the advantages of DDPM and trains a stable and well-converged model capable of generating high-quality and diverse samples. Considering the multiple distortion issues in underwater imaging, unconditional DDPM may not achieve satisfactory enhancement and restoration results. Therefore, DiffWater utilizes the degraded underwater image with added color compensation as a conditional guide, through which the DiffWater achieves high-quality restoration of degraded underwater images. Particularly, the proposed DiffWater introduces a color compensation method that performs channelwise color compensation in the RGB color space, tailored to different water conditions and lighting scenarios, and utilizes this condition to guide the denoising process. In the experimental section, the proposed DiffWater method is tested on four real underwater image datasets and compared against existing methods. Experimental results demonstrate that DiffWater outperforms existing comparison methods in terms of enhancement quality and effectiveness, exhibiting stronger generalization capabilities and robustness.

Keywords