Performance Enhancement of a Delay-Based Reservoir Computing System by Using Gradient Boosting Technology

Abstract

Gradient boosting technology has been proved to be an effective scheme for enhancing the performances of spatially distributed reservoir computing (RC) systems. In this work, a gradient boosting scheme by combining two reservoirs is proposed and numerically investigated in a delayed-based RC system. The original reservoir in the delayed-based RC system is a vertical-cavity surface-emitting laser (VCSEL) under polarization-rotated optical feedback (PR-OF), and it is trained on the desired output. The other VCSEL under PR-OF or polarization-preserved optical feedback (PP-OF) is supplemented to be an extra reservoir, which is trained on the remaining error of the original reservoir. Via Santa-Fe time series prediction task and 10th-order nonlinear autoregressive moving average (NARMA10) task, the performances of the delay-based RC system are evaluated before and after supplementing the extra reservoir, and then the effectiveness of the gradient boosting technology in the delayed RC system can be analyzed. The simulated results demonstrate that adopting gradient boosting technology is effective in a delay-based RC system. Comparatively speaking, the enhanced effect is more obvious under taking a VCSEL with PR-OF as the extra reservoir.

Keywords

• Delay-based reservoir computing (RC)
• vertical-cavity surface-emitting laser (VCSEL)
• gradient boosting technology
• performance enhancement