FD-GAN: Face De-Morphing Generative Adversarial Network for Restoring Accomplice’s Facial Image

Abstract

Face morphing attack is proved to be a serious threat to the existing face recognition systems. Although a few face morphing detection methods have been put forward, the face morphing accomplice's facial restoration remains a challenging problem. In this paper, a face de-morphing generative adversarial network (FD-GAN) is proposed to restore the accomplice's facial image. It utilizes the symmetric dual network architecture and two levels of restoration losses to separate the identity feature of the morphing accomplice. By exploiting the captured facial image (containing the criminal's identity) from the face recognition system and the morphed image stored in the e-passport system (containing both criminal and accomplice's identities), the FD-GAN can effectively restore the accomplice's facial image. The experimental results and analysis demonstrate the effectiveness of the proposed scheme. It has great potential to be applied for tracing the identity of face morphing attack's accomplice in criminal investigation and judicial forensics.

Keywords

• Face de-morphing
• face morphing attack
• facial restoration
• generative adversarial network