Learning implicit recommenders from massive unobserved feedback

Yuan, Fajie (2018) Learning implicit recommenders from massive unobserved feedback. PhD thesis, University of Glasgow.

Abstract

In this thesis we investigate implicit feedback techniques for real-world recommender systems. However, learning a recommender system from implicit feedback is very challenging, primarily due to the lack of negative feedback. While a common strategy is to treat the unobserved feedback (i.e., missing data) as a source of negative signal, the technical difficulties cannot be overlooked: (1) the ratio of positive to negative feedback in practice is highly imbalanced, and (2) learning through all unobserved feedback (which easily scales to billion level or higher) is computationally expensive.

To effectively and efficiently learn recommender models from implicit feedback, two types of methods are presented, that is, negative sampling based stochastic gradient descent (NS-SGD) and whole sample based batch gradient descent (WS-BGD). Regarding the NS-SGD method, how to effectively sample informative negative examples to improve recommendation algorithms is investigated. More specifically, three learning models called Lambda Factorization Machines (lambdaFM), Boosting Factorization Machines (BoostFM) and Geographical Bayesian Personalized Ranking (GeoBPR) are described. While regarding the WS-BGD method, how to efficiently use all unobserved implicit feedback data rather than resorting to negative sampling is studied. A fast BGD learning algorithm is proposed, which can be applied to both basic collaborative filtering and content/context-aware recommendation settings.

The last research work is on the session-based item recommendation, which is also an implicit feedback scenario. However, different from above four works based on shallow embedding models, we apply deep learning based sequence-to-sequence model to directly generate the probability distribution of next item. The proposed generative model can be applied to various sequential recommendation scenarios.

To support the main arguments, extensive experiments are carried out based on real-world recommendation datasets. The proposed recommendation algorithms have achieved significant improvements in contrast with strong benchmark models. Moreover, these models can also serve as generic solutions and solid baselines for future implicit recommendation problems.

• Item Type: Thesis (PhD)
• Qualification Level: Doctoral
• Keywords: Recommender system, implicit feedback, unobserved example, negative sampling, batch gradient descent, deep learning, LambdaFM, BoostFM, GeoBPR, Fast BGD, NextItNet.
• Subjects: Q Science > Q Science (General); Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• Colleges/Schools: College of Science and Engineering > School of Computing Science
• Supervisor's Name: Jose, Prof. Joemon
• Date of Award: 2018
• Depositing User: MR FAJIE YUAN
• Unique ID: glathesis:2018-30862
• Copyright: Copyright of this thesis is held by the author.
• Date Deposited: 08 Oct 2018 11:39
• Last Modified: 17 Apr 2024 11:06
• Thesis DOI: 10.5525/gla.thesis.30862
• URI: https://theses.gla.ac.uk/id/eprint/30862

Related URLs

• Conference proceeding
• Conference proceeding
• Conference proceeding
• Conference proceeding
• Conference proceeding
• Enlighten Publications Record
• Conference proceeding
• Pre-print