Personalized News Recommendation Method with Double-Layer Residual Connections and Double Multi-Head Self-Attention Mechanisms

Abstract

In today’s society, there is an urgent need to help users better access information that they are interested in, as there is an increasing amount of news and messages available with the development of the Internet. Many existing methods involve directly inputting text into a pre-trained model, which limits the effectiveness of text feature extraction. The personalized news recommendation model discussed in this article is a model that can enhance feature extraction from news articles. It consists of a candidate news module, a historically accessed news module, and an access prediction module. Using news titles that accurately summarize news content, a model with double multi-head attention mechanisms and double residual structures (DDM) is utilized to better capture the features of news articles historically accessed by users, thereby achieving an improved recommendation functionality. The candidate news module aims to help the model learn representations of news that users are likely to select from the news titles. The user historical click news module primarily serves to enable the model to learn personalized representations of users from news they have previously browsed. The model has been tested on MIND-small. The AUC reached 0.6665, the MRR reached 0.3205, the nDCG@5 reached 0.3532, and the nDCG@10 reached 0.4158. The results indicate this model has achieved good results in the downstream tasks of preprocessing news-title texts.

Keywords

• news recommendation
• feature extraction capability
• multi-head attention
• residual structures