Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques

Abstract

Facial recognition is a critical biometric identification method in modern security systems, yet it faces significant challenges under varying lighting conditions, particularly when dealing with near-infrared (NIR) images, which exhibit reduced illumination compared to visible light (VIS) images. This study aims to evaluate the performance of Convolutional Neural Networks (CNNs) in addressing the Cross-Spectral Cross-Distance (CSCD) challenge, which involves face identification across different spectra (NIR and VIS) and varying distances. Three CNN models—VGG16, ResNet50, and EfficientNetB0—were assessed using a dataset comprising 800 facial images from 100 individuals, captured at four different distances (1m, 60m, 100m, and 150m) and across two wavelengths (NIR and VIS). The Multi-task Cascaded Convolutional Networks (MTCNN) algorithm was employed for face detection, followed by image preprocessing steps including resizing to 224x224 pixels, normalization, and homomorphic filtering. Two distinct data augmentation strategies were applied: one utilizing 10 different augmentation techniques and the other with 4 techniques, trained with a batch size of 32 over 100 epochs. Among the tested models, VGG16 demonstrated superior performance, achieving 100% accuracy in both training and validation phases, with a training loss of 0.55 and a validation loss of 0.612. These findings underscore the robustness of VGG16 in effectively adapting to the CSCD setting and managing variations in both lighting and distance.

Keywords

• cross spectral
• cnn architecture
• face recognition
• data augmentation technique
• deep learning