Abstract
To solve the classification accuracy instability problem of support vector machines (SVM) model caused by using original hyper-spectral data or a single spectral feature as modeling feature vector, an improved SVM model with multi-spectral parameters and joint kernel function is proposed in this paper. The feature vector of SVM model is built by multi-spectral parameters using feature selection method based on information quantity and between-class separability and feature extraction method based on minimum noise fraction. The kernel function of improved SVM model is optimized with linear combination of polynomial kernel function and radial basis kernel function to increase the learn ability and generalization ability. And the multi-class classification strategies based on an improved directed acyclic graph is presented in the proposed method. The airborne hyperspectral remote sensing images collected by pushbroom hyperspectral imager (PHI) and airborne visible infrared imaging spectrometer (AVIRIS) are applied to analyze and evaluate the performance of the proposed method in this paper. The experiment results show that the classification accuracy is better than 90% and the plant fine-classification ability for small sample and similar spectral features is realized.
Similar content being viewed by others
References
Zhang, H., Zhai, H., Zhang, L., Li, P.: Spectral-spatial sparse subspace clustering for hyperspectral remote sensing images. IEEE Trans. Geosci. Remote Sens. 54(6), 3672–3684 (2016)
Camps-Valls, G., Tuia, D., Bruzzone, L.: Advances in hyperspectral image classification: earth monitoring with statistical learning methods. IEEE Signal Process. Mag. 31(1), 45–54 (2014)
Xia, J., Chanussot, J., Du, P., He, X.: Rotation-based support vector machine ensemble in classification of hyperspectral data with limited training samples. IEEE Trans. Geosci. Remote Sens. 54(3), 1519–1531 (2016)
Camps-Valls, G., Bruzzone, L.: Kernel-based methods for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 43(6), 1351–1362 (2005)
Loosli, G., Canu, S., Ong, C.S.: Learning SVM in Kreĭn spaces. IEEE Trans. Pattern Anal. Mach. Intell. 38(6), 1204–1216 (2016)
Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifier. Neural Process. Lett. 9(3), 293–300 (1999)
Song, Q., Hu, W., Xie, W.: Robust support vector machine with bullet hole image classification. IEEE Trans. Syst. Man Cybern. C 32(4), 440–448 (2002)
Jie, S., Huan-Wen, T.: V-Support vector machine classifier based on linear programming. J. Dalian Univ. Technol. 45(2), 303–307 (2005)
Hsu, C., Lin, C.A.: comparision of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)
Grammer, K., Singer, Y.: On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2, 265–292 (2002)
Garcia-pedrajas, N., Ortis-Boyer, D.: Improving multiclass pattern recognition by the combination of two strategies. IEEE Trans. Pattern Anal. Mach. Intell. 28(6), 1001–1006 (2006)
Hofmann, M.: Support vector machines-kernels and the kernel trick. Technical report, University at Bamberg (2006)
Li, X.L., Li, Z.K., Yu, N.H., et al.: Image classification based on SVM with generalized kernel. Chin. J. Electron. 12(2), 200–202 (2003)
Chapelle, O., Vapnik, V., Mukherjee, S.: Choosing multiple parameters for support machines. Mach. Learn. 46(3), 131–159 (2002)
Sosa, G.D., Cruz-Roa, A., Gonzalez, F.A.: Automatic detection of wheezes by evaluation of multiple acoustic feature extraction methods and C-weighted SVM [C]. In: 10th International Symposium on Medical Information Processing and Analysis, Proc. of SPIE, 9287: 928709-1-6 (2015)
Hu, Y.-Y., Li, D.-S.: Bands selection and classification of hyperspectral images based on hybrid kernels SVM by evolutionary algorithm[C]. In: The Photoelectronic Technology Committee Conferences, Proc. of SPIE, 9796: 979616-1-10 (2015)
Bufler, T.D., Narayanan, R.M., Dogaru, T.: SVM based target classification using RCS feature vectors[C]. In: Radar Sensor Technology XIX, Proc. of SPIE, 9461: 946101-1-10 (2015)
Pal, M., Foody, G.M.: Feature selection for classification of hyperspectral data by SVM. IEEE Trans. Geosci. Remote Sens. 48(5), 2297–2307 (2010)
Bioucas-Dias, J.M., Plaza, A., Camps-Valls, G., Scheunders, P., Nasrabadi, N., Chanussot, J.: Hyperspectral remote sensing data analysis and future challenges. IEEE Geosci. Remote Sens. Mag. 1(2), 6–36 (2013)
Zhong, Z., Fan, B., Duan, J., et al.: Discriminant tensor spectral-spatial feature extraction for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 12(5), 1028–1032 (2015)
Gao, L., Li, J., Khodadadzadeh, M., et al.: Subspace-based support vector machines for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 12(2), 349–353 (2015)
Xue, Z., Li, J., Cheng, L., Peijun, D.: Spectral-spatial classification of hyperspectral data via morphological component analysis-based image separation. IEEE Trans. Geosci. Remote Sens. 53(1), 70–84 (2015)
Moughal, T.A.: Hyperspectral image classification using Support Vector Machine [C]. In: Journal of Physics: Conference Series (6th Vacuum and Surface Sciences Conference of Asia and Australia (VASSCAA-6)) 439 012042:1-9 (2013)
Dalponte, M., Ørka, H.O., Gobakken, T., Gianelle, D., Næsset, E.: Tree species classification in boreal forests with hyperspectral data. IEEE Trans. Geosci. Remote Sens. 51(5), 2632–2645 (2013)
Kuo, B.C., Ho, H.H., Li, C.H., Hung, C.C., Taur, J.S.: A kernel-based feature selection method for SVM With RBF kernel for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7(1), 317–326 (2014)
Wang, H., Sun, B., Gui, Y., Chen, Y., Zhou, D., et al.: An approach for hyperspectral image classification utilization spatial-spectral combined kernel SVM [C]. In: Proc. SPIE 9811, MIPPR 2015: Multispectral Image Acquisition, Processing, and Analysis, 98110H (2015)
Jia, S., Deng, B.: Framework, an efficient gabor feature-based multi-task joint support vector machines, for hyperspectral image classification [C]. Pattern recognition, CCPR: communications in computer and information. Science 2016(663), 14–25 (2016)
Acknowledgements
The authors would like to thank the National High Technology Research and Development Program (863 Program) (Grant Nos. 2012YQ05250, 2016YFF0103604), National Key Technologies R&D Program (Grant No. 2016YFB0500505), Open fund of Key Laboratory of Technology for Safeguarding of Maritime Rights and Interests and Application (SOA) and Program for Changjiang Scholars and Innovative Research Team (Grant No. IRT0705) and China Scholarship Council (File No. 201606025034) for financial support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, N., Xu, Z., Zhao, H. et al. Improved support vector machines model based on multi-spectral parameters. Cluster Comput 20, 1271–1280 (2017). https://doi.org/10.1007/s10586-017-0802-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-017-0802-y