Sensors (Apr 2024)

<i>S</i>-LIGHT: Synthetic Dataset for the Separation of Diffuse and Specular Reflection Images

  • Sangho Jo,
  • Ohtae Jang,
  • Chaitali Bhattacharyya,
  • Minjun Kim,
  • Taeseok Lee,
  • Yewon Jang,
  • Haekang Song,
  • Hyukmin Kwon,
  • Saebyeol Do,
  • Sungho Kim

DOI
https://doi.org/10.3390/s24072286
Journal volume & issue
Vol. 24, no. 7
p. 2286

Abstract

Read online

Several studies in computer vision have examined specular removal, which is crucial for object detection and recognition. This research has traditionally been divided into two tasks: specular highlight removal, which focuses on removing specular highlights on object surfaces, and reflection removal, which deals with specular reflections occurring on glass surfaces. In reality, however, both types of specular effects often coexist, making it a fundamental challenge that has not been adequately addressed. Recognizing the necessity of integrating specular components handled in both tasks, we constructed a specular-light (S-Light) DB for training single-image-based deep learning models. Moreover, considering the absence of benchmark datasets for quantitative evaluation, the multi-scale normalized cross correlation (MS-NCC) metric, which considers the correlation between specular and diffuse components, was introduced to assess the learning outcomes.

Keywords