Human Motion Prediction by Combining Spatial and Temporal Information With Independent Global Orientation

Abstract

In this study, we address the challenge of 3D human motion prediction from motion capture data, which has become critical in various applications such as autonomous vehicles and human-robot interaction. Previous deep learning-based methods have improved prediction accuracy, but require significant network parameters and do not effectively consider independent joint movements. To overcome the limitations, we propose two lightweight network structures for human motion prediction: LG-Net and LGT-Net, which focus on the individual movements of distinct human limbs and their inter-dependencies. The LG-Net comprises local and global networks, while the LGT-Net combines the proposed LG-Net structure with Long and Short Term Memory (LSTM) cells to exploit temporal information. Our networks, designed to be extremely lightweight with only 0.08M and 0.5M parameters, achieve higher prediction performance compared to state-of-the-art methods. In addition, this study is the first to consider the root joint to improve motion prediction performance. The proposed approach demonstrates the potential for efficient and accurate human motion prediction in various applications.

Keywords

• Human motion prediction
• lightweight network
• spatial and temporal information