Generating Users’ Desired Face Image Using the Conditional Generative Adversarial Network and Relevance Feedback

Abstract

In this study, we propose a novel method for generating an image of the target face by using the generative adversarial network (GAN) and relevance feedback. Combining GAN with relevance feedback compensates for the lack of user intervention in GAN and the low image quality in traditional methods. The feature points of face images, namely, the landmarks, are used as the conditional information for GAN to control the detailed features of the generated face image. An optimum-path forest classifier is applied to categorize the relevance of training images based on the user's feedback so that the user can quickly retrieve the training images that are most similar to the target face. The retrieved training images are then used to create a new landmark for synthesizing the target face image. The experimental results showed that users can generate images of their desired faces, including the faces in their memory, with a reasonable number of iterations, therefore demonstrating the potential of applying the proposed method for forensic purposes, such as creating the face images of criminals based on the memories of witnesses or victims.

Keywords

• Face image generation
• relevance feedback
• optimum-path forest
• conditional generative adversarial network
• landmark