Real-Time Face Recognition Civil Servant Presence System Using DNN Algorithm

Abstract

Facial recognition has become a growing topic among Computer Vision researchers because it can solve real-life problems, including during the COVID-19 pandemic. The pandemic is why the Indonesian government has imposed social restrictions and physical contact in public places. Before the pandemic, most touch-based attendance systems used fingerprints or Radio Frequency Identification (RFID) cards. The solution proposed in this study is to identify real-time facial recognition of the Civil Service presence system using a Deep Neural Network. The goal is to minimize physical contact. The research stages include data collection, augmentation and preprocessing, CNN modeling and training, model evaluation, converting to OpenCV DNN, implementation of transfer learning, and identification of test data. This research contributes to testing variations in distance and position so it can recognize a person's face even when wearing a mask and glasses. This DNN model produces a validation accuracy value of 99.48% and a validation loss of 0.0273 with a data training process of 10 times. Tests for variations in distance, position, use of masks, and glasses on MTCNN detection provide an average accuracy for each trial of 100%, 96%, and 100%, respectively. Therefore, the average accuracy of the Haar Cascades detection test is 100%, 85%, and 100%.

Keywords

• face recognition
• deep neural network
• real-time
• mtcnn
• haar cascades