Ren Diao
Feature selection Inspired classifier ensemble reduction.
Diao, Ren; Chao, Fei; Peng, Taoxin; Snooke, Neal; Shen, Qiang
Abstract
Classifier ensembles constitute one of the main research directions in machine learning and data mining. The use of multiple classifiers generally allows better predictive performance than that achievable with a single model. Several approaches exist in the literature that provide means to construct and aggregate such ensembles. However, these ensemble systems contain redundant members that, if removed, may further increase group diversity and produce better results. Smaller ensembles also relax the memory and storage requirements, reducing system’s run-time overhead while improving overall efficiency. This paper extends the ideas developed for feature selection problems to support classifier ensemble reduction, by transforming ensemble predictions into training samples, and treating classifiers as features. Also, the global heuristic harmony search is used to select a reduced subset of such artificial features, while attempting to maximize the feature subset evaluation. The resulting technique is systematically evaluated using high dimensional and large sized benchmark datasets, showing a superior classification performance against both original, unreduced ensembles, and randomly formed subsets.
Citation
Diao, R., Chao, F., Peng, T., Snooke, N., & Shen, Q. (2014). Feature selection Inspired classifier ensemble reduction. IEEE Transactions on Cybernetics, 44, 1259-1268. https://doi.org/10.1109/TCYB.2013.2281820
Journal Article Type | Article |
---|---|
Publication Date | Jul 15, 2014 |
Deposit Date | Feb 27, 2014 |
Print ISSN | 2168-2267 |
Electronic ISSN | 2168-2275 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
Volume | 44 |
Pages | 1259-1268 |
DOI | https://doi.org/10.1109/TCYB.2013.2281820 |
Keywords | Classifiers; machine learning; data mining; ensemble predictions; |
Public URL | http://researchrepository.napier.ac.uk/id/eprint/6599 |
Publisher URL | http://dx.doi.org/10.1109/TCYB.2013.2281820 |
You might also like
Progressive Web Apps to Support (Critical) Systems in Low or No Connectivity Areas
(2023)
Conference Proceeding
Multi-Objective Evolutionary Optimisation for Prototype-Based Fuzzy Classifiers
(2022)
Journal Article
Semantic-Aware Real-Time Correlation Tracking Framework for UAV Videos
(2020)
Journal Article
A tool for generating synthetic data
(2018)
Conference Proceeding
Visualization of Online Datasets
(2017)
Conference Proceeding
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search