Estimation of Information Measures for Power-Function Distribution in Presence of Outliers and Their Applications

Abstract

The measure of entropy has an undeniable pivotal role in the field of information theory. This article estimates the Rényi and q-entropies of the power function distribution in the presence of s outliers. The maximum likelihood estimators as well as the Bayesian estimators under uniform and gamma priors are derived. The proposed Bayesian estimators of entropies under symmetric and asymmetric loss functions are obtained. These estimators are computed empirically using Monte Carlo simulation based on Gibbs sampling. Outcomes of the study showed that the precision of the maximum likelihood and Bayesian estimates of both entropies measures improves with sample sizes. The behavior of both entropies estimates increase with number of outliers. Further, Bayesian estimates of the Rényi and q-entropies under squared error loss function are preferable than the other Bayesian estimates under the other loss functions in most of cases. Eventually, real data examples are analyzed to illustrate the theoretical results.

Keywords

• bayesian estimators
• maximum likelihood estimators
• outliers
• power-function distribution
• rényi entropy