Abstract
For recognition tasks with large amounts of data, the nonlinear discriminant feature extraction technique often suffers from large computational burden. Although some nonlinear accelerating methods have been presented, how to greatly reduce computing time and simultaneously keep favorable recognition result is still challenging. In this paper, we introduce parallel computing into nonlinear subspace learning and build a parallel nonlinear discriminant feature extraction framework. We firstly design a random non-overlapping equal data division strategy to divide the whole training sample set into several subsets and assign each computational node a subset. Then we separately learn nonlinear discriminant subspaces from these subsets without mutual communications, and finally select the most appropriate subspace for classification. Under this framework, we propose a novel nonlinear subspace learning approach, i.e., parallel nonlinear discriminant analysis(PNDA). Experimental results on three public face and handwritten digit image databases demonstrate the efficiency and effectiveness of the proposed approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Belhumeur, P.N., Hespanda, J., Kiregeman, D.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)
Zhang, T.H., Huang, K.Q., Li, X.L., Yang, J., Tao, D.C.: Discriminative Orthogonal Neighborhood-preserving Projections for Classification. IEEE Transactions on Systems Man and Cybernetics Part B 40(1), 253–263 (2010)
Zhong, F.J., Zhang, J.S.: Linear Discriminant Analysis Based on L1-norm Maximization. IEEE Transactions on Image Processing 22(8), 3018–3027 (2013)
Baudat, G., Anouar, F.: Generalized Discriminant Analysis Using A Kernel Approach. Neural Computation 12(10), 2385–2404 (2000)
Zheng, W.M., Lin, Z.C., Tang, X.O.: A Rank-one Update Algorithm for Fast Solving Kernel Foley-Sammon Optimal Discriminant Vectors. IEEE Transactions on Neural Networks 21(3), 393–403 (2010)
Li, J.B., Peng, Y., Liu, D.T.: Quasiconformal Kernel Common Locality Discriminant Analysis with Application to Breast Cancer Diagnosis. Information Sciences 223, 256–269 (2013)
Jiang, X.H., Snapp, R.R., Motai, Y.C., Zhu, X.Q.: Accelerated kernel feature analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 109–116 (2006)
Xu, Y., Zhang, D., Jin, Z., Li, M., Yang, J.Y.: A Fast Kernel-Based Nonlinear Discriminant Analysis for Multi-Class Problems. Pattern Recognition 39(6), 1026–1033 (2006)
Cai, D., He, X.F., Han, J.W.: Speed Up Kernel Discriminant Analysis. International Journal on Very Large Data Bases 20(1), 21–33 (2011)
Rahimi, A., Recht, B.: Random features for large-scale kernel machines. In: Advances in Neural Information Processing Systems, pp. 1–10 (2009)
Sun, P., Yao, X.: Sparse Approximation through Boosting for Learning Large Scale Kernel Machines. IEEE Transactions on Neural Networks 21(6), 883–894 (2010)
Fu, J.S., Yang, W.L.: Distributed kernel fisher discriminant analysis for radar image recognition. In: International Conference on Mechanic Automation and Control Engineering, pp. 1241–1244 (2011)
Taylor, J.S., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)
Chawla, N.V., Karakoulas, G.I.: Learning from Labeled and Unlabeled Data: An Empirical Study across Techniques and Domains. Journal of Artificial Intelligence Research 23, 331–366 (2005)
Ma, Z.Y., Leijion, A.: Bata mixture models and the application to image classification. In: International Conference on Image Processing, pp. 2045–2048 (2009)
Mizukami, Y., Tadamura, K., Warrell, J., Li, P., Prince, S.: CUDA implementation of deformable pattern recognition and its application to MNIST handwritten digit database. In: International Conference on Pattern Recognition, pp. 2001–2004 (2010)
Lee, K.C., Ho, J., Kriegman, D.: Acquiring Linear Subspaces for Face Recognition Under Variable Lighting. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(5), 684–698 (2005)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, Q. et al. (2015). Parallel Nonlinear Discriminant Feature Extraction for Face and Handwritten Digit Recognition. In: Yang, J., Yang, J., Sun, Z., Shan, S., Zheng, W., Feng, J. (eds) Biometric Recognition. CCBR 2015. Lecture Notes in Computer Science(), vol 9428. Springer, Cham. https://doi.org/10.1007/978-3-319-25417-3_63
Download citation
DOI: https://doi.org/10.1007/978-3-319-25417-3_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25416-6
Online ISBN: 978-3-319-25417-3
eBook Packages: Computer ScienceComputer Science (R0)