Minimization Algorithm for Training Feed Forward Neural Network

Abstract

Abstract In this paper we suggested a new learning rate , which improves the classical Backpropagation algorithm (BP). The derivatation of are based on approximating the error function to the quadratic one in sufficiently small neighborhood for the optimal weight vector. The suggested algorithm (Spectral Backpropagation SBP say) is tested and the experimental results show that the SBP learning strategy improves the considered methods.

Keywords

• training feed forward neural network
• weight vector
• small neighborhood