Deep Highlight Removal Using Temporal Dark Prior in High-Speed Domain

Abstract

This paper proposes a deep highlight removal method based on the dichromatic model under alternating current (AC) light sources with a new diffuse prior on temporal domain, temporal dark prior. An input image is decomposed into specular and diffuse components using a deep network. Due to AC powered lights, both incident and reflected lights are time-varying. We exploit the periodic variation property of the specular and diffuse reflections as a prior for dichromatic model based image decomposition. In addition, we propose a new temporal dark prior as a pseudo-diffuse reflection. Unlike the conventional prior in the spatial domain, to the best of our knowledge, this is the first study to utilize a diffuse prior on the temporal domain for highlight removal. The blurred version of the temporal dark prior is additionally fed to the network to alleviate hole artifacts. It is demonstrated through diverse experiments that these temporal priors can strongly contribute to accurate image decomposition, leading to better highlight removal.

Keywords

• Dichromatic model
• highlight removal
• high-speed camera