Discriminative feature learning‐based pixel difference representation for facial expression recognition

Abstract

Recently, researchers have proposed different feature descriptors to achieve robust performance for facial expression recognition (FER). However, finding a discriminative feature descriptor remains one of the critical tasks. In this paper, we propose a discriminative feature learning scheme to improve the representation power of expressions. First, we obtain a discriminative feature matrix (DFM) based pixel difference representation. Subsequently, all DFMs corresponding to the training samples are used to construct a discriminative feature dictionary (DFD). Next, DFD is projected on a vertical two‐dimensional linear discriminant analysis in direction (V‐2DLDA) space to compute between and within‐class scatter because V‐2DLDA works well with the DFD in matrix representation and achieves good efficiency. Finally, nearest neighbor (NN) classifier is used to determine the labels of the query samples. DFD represents the local feature changes that are robust to the expression, illumination et al. Besides, we exploit V‐2DLDA to find an optimal projection matrix since it not only protects the discriminative features but reduces the dimensions. The proposed method achieves satisfying recognition results, reaching accuracy rates as high as 91.87% on CK+ database, 82.24% on KDEF database, and 78.94% on CMU Multi‐PIE database in the LOSO scenario, which perform better than other comparison methods.

Keywords

• facial expression recognition
• discriminative feature learning-based pixel difference representation
• human–computer interaction
• FER
• discriminative feature descriptor
• expression representation power improvement