MFNet‐LE: Multilevel fusion network with Laplacian embedding for face presentation attacks detection

Abstract

Abstract Face detection is playing a pivotal role for crowd counting and abnormal events detection. However, it is vulnerable to face presentation attacks by printed photos, videos, and 3D masks of real human faces. Although numerous detection techniques based on deep learning have been employed to address the problem of face presentation attacks, there are still several weaknesses in these approaches, such as high algorithm complexity and a lack of detection ability. To overcome these weaknesses, a method based on a multilevel fusion network with Laplacian embedding (MFNet‐LE) for the detection of face presentation attacks is proposed. First, a shallow network that contains just three layers was developed, which makes the model faster. Then, an optimised multilevel fusion strategy was developed to combine the input with the output of all previous layers to improve the detection ability of the method. Finally, a Laplacian embedding algorithm is introduced to maintain the inter‐class discrimination and penalise the intra‐class distance. Under the joint supervision of Laplacian loss and softmax loss, the proposed approach can obtain more discriminative features, which enhance the accuracy of attack detection. Experiments were conducted with three public databases for face presentation attacks: CASIA FASD, Idiap Replay Attack database and MSU USSA. The results demonstrate that the MFNet‐LE model can outperform the state‐of‐the‐art methods.

Keywords

• Algebra
• Integral transforms
• Optical, image and video signal processing
• Image recognition
• Image sensors
• Integral transforms