Abstract
To develop a decision support system, various soft computing techniques are used like evolutionary computation, machine learning, deep learning, etc. To develop effective decision support system, classification and clustering is used in various applications. SVM is a binary classifier technique as it is based on separating hyperplane. Over time to enhance the applicability of SVM in multiclass classification, some methods have been discovered, but results in multiclass classification through SVM are not impressive like binary classification. This paper presents a clustering-based multiclass SVM classification. In this approach, to obtain better accuracy in multiclass problem, k-means clustering is used to partition the datasets based on properties of conditional attributes and then the SVM multiclass classifiers are developed for each partition. To make decision about testing instance, nearest cluster in each instance is searched and then the corresponding trained SVM model is used to assign the class value of instance. The simulation results of proposed approach show superior accuracy rate for both one-versus-one and one-versus-all SVM methods in comparison to normal SVM-based multiclass classification.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boser, B., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: ACM Workshop on Computational Learning Theory, pp. 144–152 (1992)
Knerr, S., Personnaz L., Dreyfus, G.: Single-layer learning revisited: a stepwise procedure for building and training a neural network. In: Proceeding of the Neurocomputing: Algorithms, Architectures and Applications, pp. 41–50. Springer (1990)
Bottou, L., et al.: Comparison of classifier methods: a case study in handwriting digit recognition. In: Proceeding of the International Conference on Pattern Recognition, pp. 77–87 (1994)
Platt, J., Cristianini N., Shawe-Taylor J.: Large margin DAGs for multiclass classification. In: Proceeding of the Advances in Neural Information Processing Systems, pp. 547–553. MIT Press (2000)
Hsu, C., Lin, C.: A comparison of methods for multiclass support vector machines. In: Proceeding of the IEEE Transactions on Neural Networks, pp. 415–425 (2002)
Friedman, J.: Another approach to polychotomous classification. Stanford University, Department of Statistics, Technical Report (1996)
Weston, J., Watkins, C.: Multi-class support vector machines. In: Proceeding of the European Symposium on Artificial Neural Networks, pp. 219–224 (1999)
Bredensteiner, E., Bennett, K.: Multicategory classification by support vector machines. J. Comput. Optim. Appl. 53–79 (1999)
Crammer, K., Singer, Y.: On the learnability and design of output codes for multiclass problems. J. Comput. Learn. Theory 35–46 (2000)
Guermeur, Y.: Combining discriminant models with new multiclass SVMs. Pattern Anal. Appl. 168–179 (2002)
Hsu, C., Lin, C.: A simple decomposition method for support vector machines. In: Machine Learning, pp. 291–314. Kluwer Academic Publisher (2002)
Mayoraz, E., Alpaydin, E.: Support vector machines for multi-class classification. In: Proceeding of the International Work Conference on Artificial Neural Networks, pp. 833–842 (1999)
Abe, S.: Fuzzy LP-SVMs for multiclass problems. In: Proceeding of the European Symposium on Artificial Neural Networks, pp. 429–434. Bruges, Belgium (2004)
Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
Lingras, P., Butz, C.: Interval set representations of 1-v-r support vector machine multi-classifiers. In: Proceeding of the IEEE International Conference on Granular Computing (2005)
Santosa, B.: Multiclass classification with cross entropy-support vector machines. In: Proceeding of the Third Information Systems International Conference, pp. 345–352. Elsevier (2015)
Ho, S., Yang, S.: The cross-entropy method and its application to inverse problems. IEEE Trans. Magn. 3401–3404 (2010)
Wang, J., Wu, X., Zhang, C.: Support vector machines based on K-means clustering for real-time business intelligence systems. Int. J. Bus. Intell. Data Min. 54–64 (2005)
Yu, H., Yanga, J., Han, J.: Classifying large data sets using SVMs with hierarchical clusters. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 306–315 (2003)
Hartigan, J.: Direct clustering of a data matrix. J. Am. Stat. Assoc. 123–129 (1972)
Jain, A., Murty M., Flynn, P.: Data clustering: a review. ACM Comput. Surv. (CSUR) 264–323 (1999)
Lloyd, S.: Least squares quantization in PCM. IEEE Trans. Inf. Theory 129–137. (1982)
https://cran.r-project.org/src/contrib/Archive/gmum.r/. Accessed 16 Jan 2018
https://cran.r-project.org/web/packages/pdist/index.html. Accessed 16 Jan 2018
https://archive.ics.uci.edu/ml/index.php. Accessed 18 Jan 2018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Jain, R.K., Singh, G.K. (2020). Clustering-Based Hybrid Approach for Multiclass Classification Using SVM. In: Iyer, B., Deshpande, P., Sharma, S., Shiurkar, U. (eds) Computing in Engineering and Technology. Advances in Intelligent Systems and Computing, vol 1025. Springer, Singapore. https://doi.org/10.1007/978-981-32-9515-5_35
Download citation
DOI: https://doi.org/10.1007/978-981-32-9515-5_35
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9514-8
Online ISBN: 978-981-32-9515-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)