Scientific Reports (Jul 2024)

Enhanced low-light image fusion through multi-stage processing with Bayesian analysis and quadratic contrast function

  • Apoorav Maulik Sharma,
  • Renu Vig,
  • Ayush Dogra,
  • Bhawna Goyal,
  • Ahmed Alkhayyat,
  • Vinay Kukreja,
  • Manob Jyoti Saikia

DOI
https://doi.org/10.1038/s41598-024-67502-y
Journal volume & issue
Vol. 14, no. 1
pp. 1 – 29

Abstract

Read online

Abstract This manuscript introduces an innovative multi-stage image fusion framework that adeptly integrates infrared (IR) and visible (VIS) spectrum images to surmount the difficulties posed by low-light settings. The approach commences with an initial preprocessing stage, utilizing an Efficient Guided Image Filter for the infrared (IR) images to amplify edge boundaries and a function for the visible (VIS) images to boost local contrast and brightness. Utilizing a two-scale decomposition technique that incorporates Lipschitz constraints-based smoothing, the images are effectively divided into distinct base and detail layers, thereby guaranteeing the preservation of essential structural information. The process of fusion is carried out in two distinct stages: firstly, a method grounded in Bayesian theory is employed to effectively combine the base layers, so effectively addressing any inherent uncertainty. Secondly, a Surface from Shade (SfS) method is utilized to ensure the preservation of the scene's geometry by enforcing integrability on the detail layers. Ultimately a Choose Max principle is employed to determine the most prominent textural characteristics, resulting in the amalgamation of the base and detail layers to generate an image that exhibits a substantial enhancement in both clarity and detail. The efficacy of our strategy is substantiated by rigorous testing, showcasing notable progressions in edge preservation, detail enhancement, and noise reduction. Consequently, our method presents significant advantages for real-world applications in image analysis.

Keywords