Face Recognition in an Unconstrained and Real-Time Environment Using Novel <i>BMC-LBPH</i> Methods Incorporates with DJI Vision Sensor

Abstract

Face recognition (FR) in an unconstrained environment, such as low light, illumination variations, and bad weather is very challenging and still needs intensive further study. Previously, numerous experiments on FR in an unconstrained environment have been assessed using Eigenface, Fisherface, and Local binary pattern histogram (LBPH) algorithms. The result indicates that LBPH FR is the optimal one compared to others due to its robustness in various lighting conditions. However, no specific experiment has been conducted to identify the best setting of four parameters of LBPH, radius, neighbors, grid, and the threshold value, for FR techniques in terms of accuracy and computation time. Additionally, the overall performance of LBPH in the unconstrained environments are usually underestimated. Therefore, in this work, an in-depth experiment is carried out to evaluate the four LBPH parameters using two face datasets: Lamar University data base (LUDB) and 5_celebrity dataset, and a novel Bilateral Median Convolution-Local binary pattern histogram (BMC-LBPH) method was proposed and examined in real-time in rainy weather using an unmanned aerial vehicle (UAV) incorporates with 4 vision sensors. The experimental results showed that the proposed BMC-LBPH FR techniques outperformed the traditional LBPH methods by achieving the accuracy of 65%, 98%, and 78% in 5_celebrity dataset, LU dataset, and rainy weather, respectively. Ultimately, the proposed method provides a promising solution for facial recognition using UAV.

Keywords

• face recognition
• OpenCV
• LBPH
• feature extraction
• UAV
• vision sensor