Abstract
This paper explores the automatic construction of multi-classifiers systems based on a combination of selection and fusion. The method proposed is composed by two phases: one for designing the individual classifiers and one for clustering patterns of training set and search a set of classifiers for each cluster found. In our experiments, we adopted the artificial neural networks in the classification phase and self-organizing maps in clustering phase. Differential evolution with global and local neighborhoods has been used in this work in order to optimize the parameters and performance of the techniques used in classification and clustering phases. The experimental results have shown that the proposed method has better performance than manual methods and significantly outperforms most of the methods commonly used to combine multiple classifiers for a set of 4 benchmark problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Almeida, L.M., Ludermir, T.B.: A Multi-Objective Memetic and Hybrid Methodology for Optimizing the Parameters and Performance of Artificial Neural Networks. Neurocomputing 73(7-9), 1438–1450 (2010)
Brucker, P.: On the Complexity of Clustering Problems. Optimization and Operations Research 157, 45–54 (1978)
Chen, Y., Qin, B., Liu, T., Liy, Y., Li, S.: The Comparison of SOM and K-means for Text Clustering. Computer and Information Science 3(2), 268–274 (2010)
Cong, A., Cong, W., Lu, Y., Santago, P., Chatziioannou, A.: Differential Evolution Approach for Regularized Bioluminescence Tomography. IEEE Transactions on Biomedical Engineering 57(9), 2229–2238 (2010)
Cybenko, G.: Approximation by Superpositions of a Sigmoidal Function. Mathematics of Control, Signals, and Systems (MCSS) 2(4), 303–314 (1989)
Das, S., Abraham, A., Chakraborty, U., Konar, A.: Differential Evolution Using a Neighborhood-Based Mutation Operator. IEEE Transactions on Evolutionary Computation 13(3), 526–553 (2009)
Das, S., Suganthan, P.: Differential Evolution – A Survey of the State-of-the-Art. IEEE Transactions on Evolutionary Computation 15(1), 4–31 (2011)
Frank, A., Asuncion, A.: UCI Machine Learning Repository (2010), http://archive.ics.uci.edu/ml
Hruschka, E., Campello, R., Freitas, A., de Carvalho, A.: A Survey of Evolutionary Algorithms for Clustering. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 39(2), 133–155 (2009)
Kittler, J., Hatef, M., Duin, R., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3), 226–239 (1998)
Kuncheva, L.: Clustering-and-Selection Model for Classifier Combination. In: 4th International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies (KES 2000), vol. 1, pp. 185–188 (2000)
Kuncheva, L.: Combining Pattern Classifiers – Methods and Algorithms. Wiley-Interscience (2004)
Liao, K., Fildes, R.: The Accuracy of a Procedural Approach to Specifying Feedforward Neural Networks for Forecasting. Computers & Operations Research 32(8), 2151–2169 (2005)
da Silva, A., Mineu, N., Ludermir, T.: Evolving Artificial Neural Networks Using Adaptive Differential Evolution. In: Kuri-Morales, A., Simari, G.R. (eds.) IBERAMIA 2010. LNCS, vol. 6433, pp. 396–405. Springer, Heidelberg (2010)
Slowik, A.: Application of an Adaptive Differential Evolution Algorithm With Multiple Trial Vectors to Artificial Neural Network Training. IEEE Transactions on Industrial Electronics 58(8), 3160–3167 (2011)
Storn, R., Price, K.: Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces. Journal of Global Optimization 11, 341–359 (1997)
Vasile, M., Minisci, E., Locatelli, M.: An Inflationary Differential Evolution Algorithm for Space Trajectory Optimization. IEEE Transactions on Evolutionary Computation 15(2), 267–281 (2011)
Woods, K., Kegelmeyer Jr., W.P., Bowyer, K.: Combination of Multiple Classifiers Using Local Accuracy Estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(4), 405–410 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
de Lima, T.P.F., da Silva, A.J., Ludermir, T.B. (2012). Selection and Fusion of Neural Networks via Differential Evolution. In: Pavón, J., Duque-Méndez, N.D., Fuentes-Fernández, R. (eds) Advances in Artificial Intelligence – IBERAMIA 2012. IBERAMIA 2012. Lecture Notes in Computer Science(), vol 7637. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34654-5_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-34654-5_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34653-8
Online ISBN: 978-3-642-34654-5
eBook Packages: Computer ScienceComputer Science (R0)