Feature Selection Methods for Extreme Learning Machines

Abstract

Extreme learning machines (ELMs) have gained acceptance owing to their high efficiency and outstanding generalization ability. As a key component of data preprocessing, feature selection methods can decrease the noise or irrelevant data for ELMs. However, ELMs still do not have their own practical feature selection method for their special mechanism. In this study, we proposed a feature selection method for the ELM, named FELM. The proposed algorithm achieves highly efficient dimensionality reduction due to the feature ranking strategy. The FELM can simultaneously complete the feature selection and classification processes. In addition, by incorporating a memorization–generalization kernel into the FELM, the nonlinear case of it is issued (called FKELM). The FKELM can achieve high classification accuracy and extensive generalization by applying the property of memorization of training data. According to the experimental results on different artificial and benchmark datasets, the proposed algorithms achieve significantly better classification accuracy and faster training than the other methods.

Keywords

• feature selection
• extreme learning machine
• memorization–generalization kernel