Low‐rank constrained weighted discriminative regression for multi‐view feature learning

Abstract

Abstract In recent years, multi‐view learning has attracted much attention in the fields of data mining, knowledge discovery and machine learning, and been widely used in classification, clustering and information retrieval, and so forth. A new supervised feature learning method for multi‐view data, called low‐rank constrained weighted discriminative regression (LWDR), is proposed. Different from previous methods handling each view separately, LWDR learns a discriminative projection matrix by fully exploiting the complementary information among all views from a unified perspective. Based on least squares regression model, the high‐dimensional multi‐view data is mapped into a common subspace, in which different views have different weights in projection. The weights are adaptively updated to estimate the roles of all views. To improve the intra‐class similarity of learned features, a low‐rank constraint is designed and imposed on the multi‐view features of each class, which improves the feature discrimination. An iterative optimization algorithm is designed to solve the LWDR model efficiently. Experiments on four popular datasets, including Handwritten, Caltech101, PIE and AwA, demonstrate the effectiveness of the proposed method.

Keywords

• optimisation
• image representation
• feature extraction
• iterative methods
• least squares approximations
• pattern classification