Human activity recognition with analysis of angles between skeletal joints using a RGB‐depth sensor

Abstract

Human activity recognition (HAR) has become effective as a computer vision tool for video surveillance systems. In this paper, a novel biometric system that can detect human activities in 3D space is proposed. In order to implement HAR, joint angles obtained using an RGB‐depth sensor are used as features. Because HAR is operated in the time domain, angle information is stored using the sliding kernel method. Haar‐wavelet transform (HWT) is applied to preserve the information of the features before reducing the data dimension. Dimension reduction using an averaging algorithm is also applied to decrease the computational cost, which provides faster performance while maintaining high accuracy. Before the classification, a proposed thresholding method with inverse HWT is conducted to extract the final feature set. Finally, the K‐nearest neighbor (k‐NN) algorithm is used to recognize the activity with respect to the given data. The method compares favorably with the results using other machine learning algorithms.

Keywords

• activity recognition
• dimension reduction
• haar‐wavelet transform
• k‐nearest neighbour
• rgb‐d sensor