Entropy (Oct 2014)

On Some Properties of Tsallis Hypoentropies and Hypodivergences

  • Shigeru Furuichi,
  • Flavia-Corina Mitroi-Symeonidis,
  • Eleutherius Symeonidis

DOI
https://doi.org/10.3390/e16105377
Journal volume & issue
Vol. 16, no. 10
pp. 5377 – 5399

Abstract

Read online

Both the Kullback–Leibler and the Tsallis divergence have a strong limitation: if the value zero appears in probability distributions (p1, ··· , pn) and (q1, ··· , qn), it must appear in the same positions for the sake of significance. In order to avoid that limitation in the framework of Shannon statistics, Ferreri introduced in 1980 hypoentropy: “such conditions rarely occur in practice”. The aim of the present paper is to extend Ferreri’s hypoentropy to the Tsallis statistics. We introduce the Tsallis hypoentropy and the Tsallis hypodivergence and describe their mathematical behavior. Fundamental properties, like nonnegativity, monotonicity, the chain rule and subadditivity, are established.

Keywords