IEEE Access (Jan 2023)
Deep-Sentiment: An Effective Deep Sentiment Analysis Using a Decision-Based Recurrent Neural Network (D-RNN)
Abstract
Sentiment analysis is a sub-domain in opinion mining that extracts sentiments from the users’ opinions from text messages. Opinions from E-commerce websites, blogs, online social media, etc., and these opinions are in the form of text, suggestions, and comments. This paper describes the new sentiment analysis model to predict sentiments effectively that can be used to improve product quality and sales. The proposed approach is an integrated model combining several techniques, such as the pre-trained model BERT-large-cased (BLC) for training the dataset. BLC model contains 24-layer, 1024-hidden, 16-heads, 340M parameters. Optimization algorithms can fine-tune pre-trained models, such as BERT, for sentiment analysis tasks. Fine-tuning involves training the pre-trained model on a specific sentiment analysis task to improve performance. Stochastic Gradient Descent (SGD) is the optimized algorithm that helps to analyze the sentiments effectively from the given datasets. The next step is the combination of pre-processing techniques such as Tokenization, Stop Word Removal, etc. The next step focused on Bag-of-Words (BoW) and word embedding techniques like Word2Vec used to extract the features from the datasets. The deep sentiment analysis (DSA) based classification is designed to classify the sentiments based on aspect and priority model to achieve better results. The proposed model combines Aspect and Priority-based Sentiment analysis with a Decision-based Recurrent Neural Network (D-RNN). The experiments are conducted using Twitter, Restaurant, and Laptop datasets available publicly on Kaggle—the proposed model’s performance is analyzed using a confusion matrix. The proposed approach addresses various challenges in analyzing the sentiment analysis. Python programming language with several libraries such as Keras, Pandas, and others extracts the sentiments from given datasets. The comparison between the existing and proposed models shows the effectiveness of the sentiment outputs.
Keywords