Algorithms (May 2024)

An Integer-Fractional Gradient Algorithm for Back Propagation Neural Networks

  • Yiqun Zhang,
  • Honglei Xu,
  • Yang Li,
  • Gang Lin,
  • Liyuan Zhang,
  • Chaoyang Tao,
  • Yonghong Wu

DOI
https://doi.org/10.3390/a17050220
Journal volume & issue
Vol. 17, no. 5
p. 220

Abstract

Read online

This paper proposes a new optimization algorithm for backpropagation (BP) neural networks by fusing integer-order differentiation and fractional-order differentiation, while fractional-order differentiation has significant advantages in describing complex phenomena with long-term memory effects and nonlocality, its application in neural networks is often limited by a lack of physical interpretability and inconsistencies with traditional models. To address these challenges, we propose a mixed integer-fractional (MIF) gradient descent algorithm for the training of neural networks. Furthermore, a detailed convergence analysis of the proposed algorithm is provided. Finally, numerical experiments illustrate that the new gradient descent algorithm not only speeds up the convergence of the BP neural networks but also increases their classification accuracy.

Keywords