Orthogonal inductive matrix completion

• Main Authors: LEDENT, Antoine, ALVES, Rrodrigo, KLOFT, Marius
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: Optimization; Recommender systems; Training; Social networking (online); Predictive models; Learning systems; Machine learning; recommender systems; statistical learning; Artificial Intelligence and Robotics
• Online Access: https://ink.library.smu.edu.sg/sis_research/7197; https://ink.library.smu.edu.sg/context/sis_research/article/8200/viewcontent/2004.01653.pdf
• Institution: Singapore Management University

We propose orthogonal inductive matrix completion (OMIC), an interpretable approach to matrix completion based on a sum of multiple orthonormal side information terms, together with nuclear-norm regularization. The approach allows us to inject prior knowledge about the singular vectors of the ground-truth matrix. We optimize the approach by a provably converging algorithm, which optimizes all components of the model simultaneously. We study the generalization capabilities of our method in both the distribution-free setting and in the case where the sampling distribution admits uniform marginals, yielding learning guarantees that improve with the quality of the injected knowledge in both cases. As particular cases of our framework, we present models that can incorporate user and item biases or community information in a joint and additive fashion. We analyze the performance of OMIC on several synthetic and real datasets. On synthetic datasets with a sliding scale of user bias relevance, we show that OMIC better adapts to different regimes than other methods. On real-life datasets containing user/items recommendations and relevant side information, we find that OMIC surpasses the state of the art, with the added benefit of greater interpretability.