Towards a Deep Attention-Based Sequential Recommender System

Abstract

With the availability of a large amount of user-generated online data, discovering users’ sequential behaviour has become an integral part of a Sequential Recommender System (SRS). Combining the recent observed items (i.e., short-term preferences) with prior interacted items (i.e., long-term preferences) has gained increasing attention in recent years. However, the existing methods mostly assume that all the adjacent items in a sequence are highly dependent, which may not be practical in real-world scenarios due to the uncertainty of customers’ shopping behaviours. A user-item interaction sequence may contain some irrelevant items which may in turn lead to false dependencies between items. Moreover, current studies usually assign a static representation to each item when modeling a user’s long-term preferences. Therefore, they cannot differentiate the contributions of the items. Specifically, these two types of users’ preferences have been separately modeled and then linearly combined, which may fail to model complicated user-item interactions. In order to overcome the above mentioned problems, we propose a novel Deep Attention-based Sequential (DAS) model. DAS consists of three different blocks, $(i)$ an embedding block: which embeds users and items into low-dimensional spaces; $(ii)$ an attention block: which aims to discriminatively learn dependencies among items in both users’ long-term and short-term item sets; and $(iii)$ a fully-connected block: which first learns a mixture of users’ preferences representation through a nonlinear way and then combines it with users’ embeddings to have a personalized recommendation. Extensive experiments demonstrate the superiority of our proposed model compared to the state-of-the-art approaches in SRSs.

Keywords

• Attention network
• dependency modeling
• sequential recommender systems