Skip to main content

Research Repository

Advanced Search

Learning Latent Features With Infinite Nonnegative Binary Matrix Trifactorization

Yang, Xi; Huang, Kaizhu; Zhang, Rui; Hussain, Amir

Authors

Xi Yang

Kaizhu Huang

Rui Zhang



Abstract

Nonnegative matrix factorization (NMF) has been widely exploited in many computational intelligence and pattern recognition problems. In particular, it can be used to extract latent features from data. However, previous NMF models often assume a fixed number of features, which are normally tuned and searched using a trial and error approach. Learning binary features is also difficult, since the binary matrix posits a more challenging optimization problem. In this paper, we propose a new Bayesian model, termed the infinite nonnegative binary matrix trifactorization (iNBMT) model. This can automatically learn both latent binary features and feature numbers, based on the Indian buffet process (IBP). It exploits a trifactorization process that decomposes the nonnegative matrix into a product of three components: two binary matrices and a nonnegative real matrix. In contrast to traditional bifactorization, trifactorization can better reveal latent structures among samples and features. Specifically, an IBP prior is imposed on two infinite binary matrices, while a truncated Gaussian distribution is assumed on the weight matrix. To optimize the model, we develop a modified variational-Bayesian algorithm, with iteration complexity one order lower than the recently proposed maximization-expectation-IBP model [1] and the correlated IBP-IBP model [2]. A series of simulation experiments are carried out, both qualitatively and quantitatively, using benchmark feature extraction, reconstruction, and clustering tasks. Comparative results show that our proposed iNBMT model significantly outperforms state-of-the-art algorithms on a range of synthetic and real-world data. The new Bayesian model can thus serve as a benchmark technique for the computational intelligence research community.

Journal Article Type Article
Online Publication Date Mar 21, 2018
Publication Date 2018-12
Deposit Date Aug 16, 2019
Journal IEEE Transactions on Emerging Topics in Computational Intelligence
Print ISSN 2471-285X
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 2
Issue 6
Pages 450-463
DOI https://doi.org/10.1109/tetci.2018.2806934
Keywords Infinite non-negative binary matrix tri-factori-zation, Infinite latent feature model, Indian Buffet Process prior
Public URL http://researchrepository.napier.ac.uk/Output/1382470