Class-Specific Deep Feature Weighting for Naïve Bayes Text Classifiers

Abstract

Feature weighting is used to alleviate the conditional independence assumption of Naïive Bayes text classifiers and consequently improve their generalization performance. Most traditional feature weighting algorithms use general feature weighting, which assigns the same weight to each feature for all classes. We focus on class-specific feature weighting approaches, which discriminatively assign each feature a specific weight for each class. This paper uses a statistical feature weighting technique and proposes a new class-specific deep feature weighting method for Multinomial Naïve Bayes text classifiers. In this deep feature weighting method, feature weights are not only incorporated into the classification formulas but they are also incorporated into the conditional probability estimates of Multinomial Naïve Bayes text classifiers. Experimental results for a large number of text classification datasets validate the effectiveness and efficiency of our method.

Keywords

• Multinomial Naïve Bayes text classifiers
• class-specific feature weighting
• statistic
• deep feature weighting