Skip to main content

Research Repository

Advanced Search

Feature selection Inspired classifier ensemble reduction.

Diao, Ren; Chao, Fei; Peng, Taoxin; Snooke, Neal; Shen, Qiang

Authors

Ren Diao

Fei Chao

Neal Snooke

Qiang Shen



Abstract

Classifier ensembles constitute one of the main research directions in machine learning and data mining. The use of multiple classifiers generally allows better predictive performance than that achievable with a single model. Several approaches exist in the literature that provide means to construct and aggregate such ensembles. However, these ensemble systems contain redundant members that, if removed, may further increase group diversity and produce better results. Smaller ensembles also relax the memory and storage requirements, reducing system’s run-time overhead while improving overall efficiency. This paper extends the ideas developed for feature selection problems to support classifier ensemble reduction, by transforming ensemble predictions into training samples, and treating classifiers as features. Also, the global heuristic harmony search is used to select a reduced subset of such artificial features, while attempting to maximize the feature subset evaluation. The resulting technique is systematically evaluated using high dimensional and large sized benchmark datasets, showing a superior classification performance against both original, unreduced ensembles, and randomly formed subsets.

Citation

Diao, R., Chao, F., Peng, T., Snooke, N., & Shen, Q. (2014). Feature selection Inspired classifier ensemble reduction. IEEE Transactions on Cybernetics, 44, 1259-1268. https://doi.org/10.1109/TCYB.2013.2281820

Journal Article Type Article
Publication Date Jul 15, 2014
Deposit Date Feb 27, 2014
Print ISSN 2168-2267
Electronic ISSN 2168-2275
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 44
Pages 1259-1268
DOI https://doi.org/10.1109/TCYB.2013.2281820
Keywords Classifiers; machine learning; data mining; ensemble predictions;
Public URL http://researchrepository.napier.ac.uk/id/eprint/6599
Publisher URL http://dx.doi.org/10.1109/TCYB.2013.2281820

You might also like



Downloadable Citations