Development of a Mathematical Model for Detecting Moving Objects in Video Streams in Real-Time

Abstract

The development of mathematical models for detecting moving objects in real-time video streams is a significant task, especially in light of the growing demands for security and process automation. This paper proposes a detection system based on the Faster Region-Based Convolutional Neural Network (Faster R-CNN) model, utilizing various backbone architectures, including Residual Network-50 (ResNet-50), Feature Pyramid Network (FPN), MobileNet Version 3 Large, and Efficient Network-B0 (EfficientNetB0) with a Self-Attention mechanism. The model extracts object features by combining deep neural networks and scaling mechanisms, enabling adaptation to various operating conditions. Experimental results demonstrate that the proposed approach achieves high accuracy, with the MobileNet Version 3 Large model achieving 95.70% accuracy and the Residual Network-50 model reaching 100% accuracy within the first three training cycles (epochs). The Faster Region-Based Convolutional Neural Network model using Efficient Network-B0 with the Self-Attention mechanism reaches 100% accuracy by the third training cycle, maintaining consistent performance throughout the remaining training cycles. The model with the Residual Network-50 and Feature Pyramid Network backbone architecture shows an average loss reduction from 0.0922 in the first training cycle to 0.0102 by the 15th training cycle, confirming its high stability and performance. Future research could focus on optimizing the proposed approach to handle even more complex and dynamic video sequences and improving data processing to reduce computational costs and increase processing speed.

Keywords

• Real-time object detection
• video stream processing
• face embeddings
• multi-threaded recognition
• machine learning
• object classification