Abstract
The latest research in neural networks demonstrates that the class imbalance problem is a critical factor in the classifiers performance when working with multi-class datasets. This occurs when the number of samples of some classes is much smaller compared to other classes. In this work, four different options to reduce the influence of the class imbalance problem in the neural networks are studied. These options consist of introducing several cost functions in the learning algorithm in order to improve the generalization ability of the networks and speed up the convergence process.
Chapter PDF
Similar content being viewed by others
References
Kotsiantis, S., Pintelas, P.: Mixture of expert agents for handling imbalanced data sets. Annals of Mathematics and Computing & TeleInformatics 1(1), 46–55 (2003)
Japkowicz, N., Stephen, S.: The class imbalance problem: a systematic study. Intelligent Data Analysis 6, 429–449 (2002)
Anand, R., Mehrotra, K.G., Mohan, C.K., Ranka, S.: An improved algorithm for neural network classification of imbalanced training sets. IEEE Transactions on Neural Networks 4, 962–969 (1993)
Bruzzone, L., Serpico, S.B.: Classification of imbalanced remote-sensing data by neural networks. Pattern Recognition Letters 18, 1323–1328 (1997)
Zhou, Z.-H., Liu, X.-Y.: Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Transactions on Knowledge and Data Engineering 18, 63–77 (2006)
Kukar, M., Kononenko, I.: Cost-sensitive learning with neural networks. In: 13th European Conference on Artificial Intelligence, pp. 445–449 (1998)
Looney, C.: Pattern Recognition Using Neuronal Networks - theory and algorithms for engineers and scientists, 1st edn. Oxford University Press, New York (1997)
Ding, C., Xiang, S.Q.: From multilayer perceptrons to radial basis function networks: a comparative study. In: IEEE Conference on Cybernetics and Intelligent Systems, vol. 1, pp. 69–74 (2004)
Pao, Y.-H., Park, G.H., Sobajic, D.J.: Learning and generalization characteristics of the random vector functional-link net. Neurocomputing 6(2), 163–180 (1994)
Alejo, R., García, V., Sotoca, J.M., Mollineda, R.A., Sánchez, J.S.: Improving the performance of the rbf neural networks with imbalanced samples. In: Sandoval, F., Gonzalez Prieto, A., Cabestany, J., Graña, M. (eds.) IWANN 2007. LNCS, vol. 4507, pp. 162–169. Springer, Heidelberg (2007)
Lawrence, S., Burns, I., Back, A.D., Tsoi, A.C., Lee Giles, C.: Neural network classification and unequal prior class probabilities. In: Orr, G.B., Müller, K.-R. (eds.) NIPS-WS 1996. LNCS, vol. 1524, pp. 299–314. Springer, Heidelberg (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alejo, R., Sotoca, J.M., Casañ, G.A. (2008). An Empirical Study for the Multi-class Imbalance Problem with Neural Networks. In: Ruiz-Shulcloper, J., Kropatsch, W.G. (eds) Progress in Pattern Recognition, Image Analysis and Applications. CIARP 2008. Lecture Notes in Computer Science, vol 5197. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85920-8_59
Download citation
DOI: https://doi.org/10.1007/978-3-540-85920-8_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85919-2
Online ISBN: 978-3-540-85920-8
eBook Packages: Computer ScienceComputer Science (R0)