Xi Yang
Learning Latent Features With Infinite Nonnegative Binary Matrix Trifactorization
Yang, Xi; Huang, Kaizhu; Zhang, Rui; Hussain, Amir
Abstract
Nonnegative matrix factorization (NMF) has been widely exploited in many computational intelligence and pattern recognition problems. In particular, it can be used to extract latent features from data. However, previous NMF models often assume a fixed number of features, which are normally tuned and searched using a trial and error approach. Learning binary features is also difficult, since the binary matrix posits a more challenging optimization problem. In this paper, we propose a new Bayesian model, termed the infinite nonnegative binary matrix trifactorization (iNBMT) model. This can automatically learn both latent binary features and feature numbers, based on the Indian buffet process (IBP). It exploits a trifactorization process that decomposes the nonnegative matrix into a product of three components: two binary matrices and a nonnegative real matrix. In contrast to traditional bifactorization, trifactorization can better reveal latent structures among samples and features. Specifically, an IBP prior is imposed on two infinite binary matrices, while a truncated Gaussian distribution is assumed on the weight matrix. To optimize the model, we develop a modified variational-Bayesian algorithm, with iteration complexity one order lower than the recently proposed maximization-expectation-IBP model [1] and the correlated IBP-IBP model [2]. A series of simulation experiments are carried out, both qualitatively and quantitatively, using benchmark feature extraction, reconstruction, and clustering tasks. Comparative results show that our proposed iNBMT model significantly outperforms state-of-the-art algorithms on a range of synthetic and real-world data. The new Bayesian model can thus serve as a benchmark technique for the computational intelligence research community.
Citation
Yang, X., Huang, K., Zhang, R., & Hussain, A. (2018). Learning Latent Features With Infinite Nonnegative Binary Matrix Trifactorization. IEEE Transactions on Emerging Topics in Computational Intelligence, 2(6), 450-463. https://doi.org/10.1109/tetci.2018.2806934
Journal Article Type | Article |
---|---|
Online Publication Date | Mar 21, 2018 |
Publication Date | 2018-12 |
Deposit Date | Aug 16, 2019 |
Journal | IEEE Transactions on Emerging Topics in Computational Intelligence |
Print ISSN | 2471-285X |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
Volume | 2 |
Issue | 6 |
Pages | 450-463 |
DOI | https://doi.org/10.1109/tetci.2018.2806934 |
Keywords | Infinite non-negative binary matrix tri-factori-zation, Infinite latent feature model, Indian Buffet Process prior |
Public URL | http://researchrepository.napier.ac.uk/Output/1382470 |
You might also like
Guided Policy Search for Sequential Multitask Learning
(2018)
Journal Article
Cross-modality interactive attention network for multispectral pedestrian detection
(2018)
Journal Article
Toward's Arabic multi-modal sentiment analysis
(2018)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search