A Possible Extension of Shannon's Information Theory

Abstract

Abstract: As a possible generalization of Shannon's information theory, we review the formalism based on the non-logarithmic information content parametrized by a real number q, which exhibits nonadditivity of the associated uncertainty. Moreover it is shown that the establishment of the concept of the mutual information is of importance upon the generalization.

Keywords

• information theory
• Tsallis entropy
• nonadditivity
• source coding theorem
• mutual information