(Multiscale) Cross-Entropy Methods: A Review

Abstract

Cross-entropy was introduced in 1996 to quantify the degree of asynchronism between two time series. In 2009, a multiscale cross-entropy measure was proposed to analyze the dynamical characteristics of the coupling behavior between two sequences on multiple scales. Since their introductions, many improvements and other methods have been developed. In this review we offer a state-of-the-art on cross-entropy measures and their multiscale approaches.

Keywords

• cross-entropy
• multiscale cross-entropy
• asynchrony
• complexity
• coupling
• cross-sample entropy
• cross-approximate entropy
• cross-distribution entropy
• cross-fuzzy entropy
• cross-conditional entropy