Macau: Scalable Bayesian Factorization with High-Dimensional Side Information Using MCMC

© 2017 IEEE. Bayesian matrix factorization is a method of choice for making predictions for large-scale incomplete matrices, due to availability of efficient Gibbs sampling schemes and its robustness to overfitting. In this paper, we consider factorization of large scale matrices with high-dimensional side information. However, sampling the link matrix for the side information with standard approaches costs O(F 3 ) time, where F is the dimensionality of the features. To overcome this limitation we, firstly, propose a prior for the link matrix whose strength is proportional to the scale of latent variables. Secondly, using this prior we derive an efficient sampler, with linear complexity in the number of non-zeros, O(N nz ), by leveraging Krylov subspace methods, such as block conjugate gradient, allowing us to handle million-dimensional side information. We demonstrate the effectiveness of our proposed method in drug-protein interaction prediction task.

ISBN:9781509063413

Publication year:2017

BOF-keylabel:yes

IOF-keylabel:yes

Authors from:Government, Private, Higher Education

Accessibility:Closed