Recurrent Kernel Extreme Reservoir Machine for Time Series Prediction

Abstract

This paper proposes a novel recurrent multi-step-ahead prediction model called recurrent kernel extreme reservoir machine (RKERM) with quantum particle swarm optimization (QPSO). This model combines the strengths of recurrent kernel extreme learning machine (RKELM) and modified reservoir computing to overcome the limitations of prediction horizon with increased prediction accuracy based on reservoir computing theory. Furthermore, QPSO is used to optimize the parameters of kernel method and leaking rate of reservoir computing in the RKERM. In the experiment, we apply two synthetic benchmark data sets and five real-world time series data sets, including Malaysia palm oil price, ozone concentration in Toronto, sunspots, Standard & Poor's 500, and water level at Phra Chulachomklao Fort in Thailand to evaluate the echo state network, recurrent support vector regression, recurrent extreme learning machine, RKELM, and RKERM. The experimental results show that the RKERM with QPSO has superior abilities in the different predicting horizons than others.

Keywords

• Extreme learning machine
• kernel method
• recurrent neural network
• reservoir computing
• time series prediction