Face illumination processing via dense feature maps and multiple receptive fields

Abstract

Abstract Recently, illumination processing of facial image based on generative adversarial networks has made favourable progress. However, the image quality is not so satisfactory and the recognition accuracy is low when the face image under extreme illumination conditions. For these reasons, an elaborately‐designed architecture based on convolutional neural network and generative adversarial networks for processing face illumination is presented. A novel dense feature maps loss that computes loss by using the varisized feature maps extracted from different convolutional layers of pre‐trained feature network is put forward. Moreover, multiple‐receptive‐fields‐based generator that uses multiple encoders during encoding phase is also proposed, and these encoders have the same structure with different kernel size. A variety of experimental results demonstrate that the method is superior to the state‐of‐the‐art methods under various illumination challenges. Code will be available soon at https://github.com/ling20cn/IP‐GAN

Keywords

• Image and video coding
• Image recognition
• Computer vision and image processing techniques
• Neural nets