Applied Sciences (May 2024)

Multi-Perspective Adaptive Paperless Examination Cheating Detection System Based on Image Recognition

  • Zuhui Hu,
  • Yaguang Jing,
  • Guoqing Wu,
  • Han Wang

DOI
https://doi.org/10.3390/app14104048
Journal volume & issue
Vol. 14, no. 10
p. 4048

Abstract

Read online

This paper proposes a multi-perspective adaptive examination cheating behavior detection method to meet the demand for automated monitoring throughout the entire process in paperless online exams. Unlike current dual-perspective cheating behavior detection methods, we expand the monitoring field of view by using three cameras with different perspectives: the overhead perspective, the horizontal perspective, and the face perspective. This effectively covers areas where cheating may occur. An adaptive cheating behavior detection system based on three perspectives is proposed, including a gaze direction recognition model based on Swin Transformer, a cheating tool detection model based on Lightweight-YOLOv5-Coordinate Attention, and a cheating behavior determination model based on Multilayer Perceptron. To reduce computational complexity and ensure efficient processing while expanding the monitoring field of view, the system uses the results of the gaze direction recognition model to adaptively select the cheating behavior detection model from different perspectives, reducing the three-perspective system to dual-perspective. In online simulation tests, our method achieves cheating behavior determination at 35 frames per second, with an average recognition rate of 95%. It has good real-time performance, accuracy, and a large monitoring range.

Keywords