Abstract
Nonparallel support vector machine based on one optimization problem (NSVMOOP) aims at finding two nonparallel hyper-planes by maximizing the intersection angle of their normal vectors w 1 and w 2. As maximum intersection angle preserves both compactness and separation of data, NSVMOOP yields good forecasting accuracy. However, as it solves one large quadratic programming problem (QPP), it costs high running time. In order to improve its learning speed, a novel nonparallel least square support vector machine (NLSSVM) is proposed in this paper. NLSSVM solves a linear system of equations instead of solving one large QPP. As both intersection angle and least square version are applied on our NLSSVM, it performs better generalization performance than other algorithms. Experimental results on twenty benchmark datasets demonstrate its validity.
Similar content being viewed by others
References
Vapnik V (1995) The Nature of Statistical Learning Theory. Springer, New York
Cristianini N, Shawe-Taylor J (2000) An introduction to support machines and other kernel-based learning methods. Cambridge University Press, Cambridge
Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297
Manevitz LM, Yousef M (2001) One-class SVMs for document classification. J Mach Learn Res 2(1):139–154
Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, Cambridge
Suykens J, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300
Jayadeva RK, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 29:905–910
Fung G, Mangasarian O (2001) Proximal support vector machine classifiers. In: Seven international proceedings on knowledge discovery and data mining, pp 77–86
Ghorai S, Mukherjee A, Dutta P (2009) Nonparallel plane proximal classifier. Sig Process 89:510–522
Tian Y, Qi Z, Ju X (2014) Nonparallel support vector machines for pattern classification. IEEE Transactions on Cybernetics 44(7):1067–1079
Shao Y, Chen W, Deng N (2014) Nonparallel hyperplane support vector machine for binary classification problems. Inf Sci 263:22–35
Jumutc V, Suykens J (2014) Multi-class supervised novelty detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 36(12):2510–2523
Tian Y, Ju X (2015) Nonparallel support vector machine based on one optimization problem for pattern recognition. Journal of the Operations Research Society of China 3(4):499–519
Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543
Shao Y, Deng N, Yang Z (2012) Least squares recursive projection twin support vector machine for classification. Pattern Recog 45(6):2299–2307
Shao Y, Wang Z, Chen W (2013) Least squares twin parametric-margin support vector machine for classification. Appl Intell 39(3):451–464
Xu Y, Xi W, Lv X (2012) An improved least squares twin support vector machine. Journal of Information and Computational Science 9(4):1063–1071
Xu Y, Pan X, Zhou Z, et al (2015) Structural least square twin support vector machine for classification. Appl Intell 42(3):527–536
Scholkopf B, Smola A, Bartlett P, Williamson R (2000) New support vector algorithms. Neural Comput 12:1207–1245
Peng X (2010) A ν-twin support vector machine clssifier and its geometric algorithms. Inform Sci 180:3863–3875
Xu Y, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput & Applic 21:1307–1317
Peng X (2010) TSVR: An efficient twin support vector machine for regression. Neural Netw 23:365–372
Kumar M, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36:7535–7543
Xu Y, Xi W, Lv X, Guo R (2012) An improved least squares twin support vector machine. Journal of Information and Computational Science 9(4):1063–1071
Xu Y, Wang L (2012) A weighted twin support vector regression. Knowl-Based Syst 33:92–101
Khemchandani R (2009) Jayadeva, and S. Chandra. Optimal kernel selection in twin support vector machines. Optimization Letters 3:77–88
Pan X, Luo Y, Xu Y (2015) K-nearest neighbor based structural twin support vector machine. Knowl-Based Syst 88:34–44
Dems̆ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
García S, Fernández A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180:2044–2064
Acknowledgments
The authors gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation. This work was supported by National Natural Science Foundation of China (No. 61153003) and Chinese Universities Scientific Fund (2016LX002).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhao, J., Yang, Z. & Xu, Y. Nonparallel least square support vector machine for classification. Appl Intell 45, 1119–1128 (2016). https://doi.org/10.1007/s10489-016-0820-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-016-0820-0