Algorithms (May 2019)

Improved Neural Networks Based on Mutual Information via Information Geometry

  • Meng Wang,
  • Chuang-Bai Xiao,
  • Zhen-Hu Ning,
  • Jing Yu,
  • Ya-Hao Zhang,
  • Jin Pang

DOI
https://doi.org/10.3390/a12050103
Journal volume & issue
Vol. 12, no. 5
p. 103

Abstract

Read online

This paper presents a new algorithm based on the theory of mutual information and information geometry. This algorithm places emphasis on adaptive mutual information estimation and maximum likelihood estimation. With the theory of information geometry, we adjust the mutual information along the geodesic line. Finally, we evaluate our proposal using empirical datasets that are dedicated for classification and regression. The results show that our algorithm contributes to a significant improvement over existing methods.

Keywords