A Collective Intelligence Based Differential Evolution Algorithm for Optimizing the Structure and Parameters of a Neural Network

Abstract

In this paper, a Self-learning Collective Intelligence Differential Evolution (SLCIDE) algorithm was proposed to optimize both the architecture and parameters of a Feedforward Neural Network (FNN). In order to improve the exploration-exploitation capability, a new Collective Intelligence (CI) based mutation operator was proposed by mixing some promising donor vectors in the current population. Besides, a self-learning mechanism which was designed to adaptively select m top ranked donor vectors was developed by using a widely used unsupervised learning method, k-means. As a result, the proposed approach can be more adaptive and statistically powerful on versatile problems. Then, we evaluated the performances of the proposed SLCIDE approach by studying some numerical optimization problems of CEC 2013 with D = 30 and D = 50. Further, the proposed SLCIDE method was applied to train a FNN on four most popular datasets, resulting in very competitive performances. The comprehensive experimental results have demonstrated that the presented SLCIDE method obtain better results compared with other state-of-the-art algorithms.

Keywords

• Evolutionary artificial neural network
• global optimization
• collective intelligence (CI)
• differential evolution (DE)