Autoencoder-Based Recommender System Exploiting Natural Noise Removal

Abstract

Collaborative filtering (CF) is a widely used technique in recommender systems by automatically predicting the user’s latent interests based on many users’ historical rating data. To improve the performance of the CF-based recommender systems, users’ rating data should be pre-processed to avoid noise and enhance data reliability. Many researchers studied anomaly detection to remove malicious noise caused by shilling attacks, but anomalies can still exist in non-attacked real user data, which is called natural noise, as the ratings of users can be impacted by unpredictable factors such as other users’ ratings and anchoring bias. In this paper, we propose an autoencoder-based recommendation system for exploiting the ability of both anomaly detection and CF. The proposed system detects the natural noise in the rating data based on the reconstruction errors after training. By removing the detected natural noise, CF can predict the unrated ratings with noise-free data. Our experiments show that the proposed model showed better performance than the traditional method by reducing the error by up to 5% compared to the method that does not consider natural noise detection and reducing the error by up to 4% compared to the conventional rating classification based natural noise detection methods.

Keywords

• Collaborative filtering
• recommender system
• natural noise
• autoencoder
• anomaly detection