Projection spectral analysis: A unified approach to PCA and ICA with incremental learning

Abstract

Projection spectral analysis is investigated and refined in this paper, in order to unify principal component analysis and independent component analysis. Singular value decomposition and spectral theorems are applied to nonsymmetric correlation or covariance matrices with multiplicities or singularities, where projections and nilpotents are obtained. Therefore, the suggested approach not only utilizes a sum‐product of orthogonal projection operators and real distinct eigenvalues for squared singular values, but also reduces the dimension of correlation or covariance if there are multiple zero eigenvalues. Moreover, incremental learning strategies of projection spectral analysis are also suggested to improve the performance.

Keywords

• independent component analysis
• machine learning
• neural network
• principal component analysis
• projection spectral analysis
• singular value decomposition
• spectral theorem