Data Augmentation for Sentiment Analysis Using Sentence Compression-Based SeqGAN With Data Screening

Abstract

Sentiment analysis refers to the process of automatically identifying the emotions expressed by people. Its accuracy is highly dependent on the amount of training data. However, it takes time and cost for humans to collect a large number of data. Many research works used generative models to generate a large amount of data based on a small amount of data for sentiment analysis. However, training on long texts and inaccurate sentiment information that might be generated are two severe challenges. It is difficult to improve the sentiment analysis accuracy effectively. In this paper, we propose a novel data augmentation framework based on Sequence generative adversarial networks (SeqGAN) to improve the sentiment analysis accuracy when the dataset already has a certain amount of data and contains long texts. Penalty-based SeqGAN is used to generate high-quality and diversified text data. Long short-term memory (LSTM) networks with attention mechanisms are used to conduct sentence compression for the training data of SeqGAN. A sentiment dictionary is used to retain the sentiment words for compressed data. We also propose a data screening method to obtain more accurate data from the generated data. The results of the usability, novelty, and diversity of the generated data show that the proposed sentence compression method can help SeqGAN learn more information from the long text data. The data generated by the proposed framework improve the classification accuracy of four classifiers applied on two distinct text datasets.

Keywords

• Data augmentation
• hate speech detection
• long short-term memory
• machine learning
• sequence generative adversarial network
• sentence compression