On the optimal number estimation of selected features using joint histogram based mutual information for speech emotion recognition

Abstract

Mutual information (MI) has been previously used to select the relevant features for the task of speech emotion recognition (SER). However, the procedure does not deliver the optimal number of relevant features. We propose MI based criterion for estimating this number defined as the minimum number of features that explains the variable of the class indices. In order to minimize the MI estimation errors, we also search the best histogram binning choice considering three formulas: Sturges, Scott and LMSE. Four selection strategies MMI, CMI, JMI and TMI have been implemented and applied on 39-features vectors and on large dimension vectors. The feature selection results have been validated on independent text SER system, based on GMM classifier and evaluated on EMO-db database. Results demonstrate that LMSE bin choice gives the best MI estimation and ensures a minimal number of features with slight performance drop. Particularly, using the proposed stopping criterion, the CMI strategy achieves reduction of 48.72% in the case of the 39-features vectors size and 67.86% in the case of large dimension vectors. Moreover, using the recognition rate criterion, the JMI strategy gives a comparable feature reduction with slight improvement of performance but requiring very high computation capabilities.

Keywords

• Speech emotion recognition
• Mutual information
• Binning of joint histogram
• Features selection
• MFCC coefficients
• GMM models