SPSO-EFVM: A Particle Swarm Optimization- Based Ensemble Fusion Voting Model for Sentence-Level Sentiment Analysis

Abstract

Sentiment analysis has received incremental growth in recent years for emerging applications, including human-robot integration, social platforms monitoring, and decision-support systems. Several neural or transformer model-based solutions have been provided in the field of sentiment analysis that relies on the decision of a single classifier or neural model. These are erroneous to encode contextual information into appropriate dialogues and increase extra computational cost and time. Hence, we proposed a compact and parameter-effective Particle Swarm Optimization-based Ensemble Fusion Voting Model (PSO-EFVM) that exploited the combined properties of four ensemble techniques, namely Adaptive-Boost, Gradient-Boost, Random-Forest, and Extremely-Randomized Tree with Particle Swarm Optimization (PSO)-based hyperparameter selection. The proposed model is investigated on five cross-domain datasets after applying the foremost initialization and feature extraction using Information Gain (IG). It employs adaptive and gradient learning to incorporate the automatic attribute selection with the arbitrary loss function optimization. In short, a generalized two-block composite classifier is designed to perform context compositionality and sentiment classification. A population-based meta-heuristic optimization PSO is applied to each base ensemble learner that calculates weights for the best parameter selection. Comprehensive investigations of different domains reveal the superiority of the proposed PSO-EFVM over established baselines and the latest state-of-the-art models.

Keywords

• Natural language processing
• sentiment analysis
• adaptive-boosting
• gradient-boosting
• ensemble learning
• particle swarm optimization