Aspect Category Detection Based on Attention Mechanism and Bi-Directional LSTM

Abstract

Online reviews play an increasingly important role in users' purchase decisions. E-commerce websites provide massive user reviews, but it is hard for individuals to make full use of the information. Therefore, it is an urgent task to classify, analyze and summarize the massive comments. In this paper, a model based on attention mechanism and bi-directional long short-term memory (BLSTM) is used to identify the categories of these review objects for the classification of the reviews. The model first uses BLSTM to train the review in the form of word vectors; then according to the part-of-speech, the output vectors of the BLSTM are given corresponding weights. The weights as prior knowledge can guide the learning of attention mechanism to enhance the classification accuracy; finally, the attention mechanism is used to capture category-related important features which are used for category determination. Experiments on the SemEval data set show that our model outperforms the state-of-the-art methods on aspect category detection.

Keywords

• user review
• aspect category detection
• attention mechanism
• bi-directional long short-term memory
• classification accuracy