Real-Time Monitoring of Personal Protective Equipment Compliance in Surveillance Cameras

Abstract

Worker safety in the industrial, construction, and energy sectors is the primary concern of governments, organizations, and project managers. Traditional monitoring systems are tedious, laborious, subjective, expensive, and inaccurate. Therefore, the development of automated and accurate systems for real-time monitoring and detecting personal protective equipment (PPE) compliance is urgently needed. This study provides valuable insights and contributions to the field of workers’ safety in the industrial, construction, and energy sectors. It aims to evaluate the potential contribution of providing a robust and accurate real-time PPE compliance monitoring system using state-of-the-art deep learning techniques with real-world videos collected from surveillance cameras. Furthermore, it presents a systematic framework for developing, evaluating, and selecting the most suitable model for real-world applications, starting from data collection and ending with system deployment and maintenance. To the best of our knowledge, the collected dataset in this work is the largest PPE’s dataset, with approximately 7.7 million labels representing different PPEs in 386,011 video frames collected from several surveillance cameras. The techniques adopted to generate different models and evaluated for PPE are CenterNet, Vision Transformer, and YOLOv7. Moreover, an optimized real-time inference engine is developed leveraging the high-computing power of GPUs in the system. The experimental results demonstrate that the models developed using YOLO are the most accurate and can be better generalized to detect PPE compliance in new working environments, achieving mean average precisions of 92.36% and 66.70% on Test Set I and Test Set II, respectively. In addition, they achieve real-time detection of PPE compliance.

Keywords

• PPE monitoring
• PPE detection
• multithreading
• vision transformers
• objects as points