Visible part prediction and temporal calibration for pedestrian detection

Abstract

Abstract Despite their great advancement, current pedestrian detection methods focus on single static images, which fail to employ richer information available from the video sequences. Compared with still images, videos can offer temporal information of objects in the time dimension, thus providing the potential to obtain more robust detection performance. Here, a novel pedestrian detection method based on visible part detection and temporal calibration is proposed. Specifically, a part‐aware module to predict the visible body part of each pedestrian instance, which enables us to obtain precise motion information of partially occluded pedestrians in a video sequence, is first developed. Then, the temporal coherence for each pedestrian instance based on the predicted motion information is constructed. After that, an adaptive temporal calibration method is introduced to effectively calibrate the final detection result. This method on two video pedestrian detection benchmarks, that is, Caltech‐New and MOT17Det, is evaluated. Experimental results show that this method performs favourably against existing pedestrian detection approaches.