On Joint and Conditional Entropies

Abstract

Abstract: It is shown that if the conditional densities of a bivariate random variable have maximum entropies, subject to certain constraints, then the bivariate density also maximizes entropy, subject to appropriate constraints. Some examples are discussed.

Keywords

• joint and conditional entropies
• maximum entropy subject to constraints