Pedestrian Group Re-Identification and Trajectory Prediction Through Zone-Based Clustering

Abstract

Pedestrian trajectory prediction is a critical aspect of computer vision, aimed at predicting a pedestrian’s future locations by analyzing their past movements. Traditional trajectory prediction models primarily focus on individuals, which can be challenging in densely populated areas due to occlusions. These occlusions not only complicate the re-identification of pedestrians once they reappear but also increase processing times due to the more complex procedures and the greater number of objects involved. However, a common observation is that pedestrians often travel in groups. This insight led us to propose a novel approach, predicting the future trajectories of pedestrian groups instead of individuals. This strategy effectively addresses the complexities of predicting movements in crowded environments and the issues related to pedestrian occlusion. In this work, we introduced a distinctive methodology for identifying pedestrian groups, re-identifying them, and predicting their future trajectories. Our approach, unlike traditional state-of-the-art re-identification and trajectory prediction methods of individual pedestrians, focuses on re-identifying pedestrian groups and predicting their future trajectories while emphasizing processing time reduction with great accuracy. The process started with object detection to ascertain pedestrian coordinates. Subsequently, a zone-based clustering method was employed to form groups. Following this, a specific group re-identification was utilized to construct continuous trajectories for these groups, rather than for individual pedestrians. Finally, the group trajectory prediction technique was applied to estimate the future movements of these groups. Both the object detection and group detection methods were applied every five frames to generate these trajectories. The effectiveness of our approach has been validated using several evaluation metrics, including Average Displacement Error (ADE), Final Displacement Error (FDE), Cumulative Matching Characteristics (CMC) scores, IDF1 scores, and IDs, all assessed using the MOT17 dataset. These evaluations not only confirm the practicality and accuracy of our method in predicting pedestrian trajectories but also highlight its efficiency, with a reduction in processing time by 7.6% compared to individual trajectory prediction. This efficiency demonstrates the potential of our method for real-time applications and underscores its capacity to prevent accidents.

Keywords

• Hungarian algorithm
• human view camera
• LSTM
• re-identification
• trajectory prediction
• zone-based group detection