Measurement: Sensors (Jun 2023)

Remote monitoring system using slow-fast deep convolution neural network model for identifying anti-social activities in surveillance applications

  • Edeh Michael Onyema,
  • Sundaravadivazhagn Balasubaramanian,
  • Kanimozhi Suguna S,
  • Celestine Iwendi,
  • B.V.V. Siva Prasad,
  • Chinecherem Deborah Edeh

Journal volume & issue
Vol. 27
p. 100718

Abstract

Read online

Remote monitoring is the process that monitors and observes information from a distance utilizing sensors or electronic types of equipment. Remote monitoring is used in real-time applications like traffic, forest, military, shops, and hospitals to determine abnormal activities. Earlier research has done video processing methods based on computer vision techniques, but the computational complexity regarding time and memory is high. This paper designs and implements a novel Slow-Fast Convolution Neural Network (SF–CNN) to identify, detect, and classify abnormal behaviours from a surveillance video. The proposed CNN architecture learns the video frames automatically, obtains the most appropriate properties about various objects' behaviour from a large set of videos. The learning process of SF-CNN is carried out in two ways, such as slow learning and fast learning. The slow learning process is enabled when the frame rate is less, and the rapid learning process is enabled when the frame rate is high. Both the learning processes learn spatial and temporal information from the input video. Different objects, such as humans, vehicles, and animals, are detected and recognized according to their actions. All the videos have normal and abnormal activities that vary in various contexts. The proposed SF-CNN architecture provides an end-to-end solution to dealing with multiple constraints abnormal movements. The experiment is carried out on several benchmark datasets, and the performance of the SF-CNN architecture is evaluated. The proposed approach obtained 99.6% of accuracy, which is higher than the other existing techniques.

Keywords