Abstract
Online sequential ELM (OS-ELM) provides a solution for streaming data application by only learning the newly arrived single or chunk of observations, and presents outstanding performance for learning problems. However, the algorithm relies on the labeled data, which usually involves high cost in labor and time. Moreover, manually labeled data suffers from inaccuracy caused by individual bias. Considering the semi-supervised ELM (SS-ELM) provides a way to fully utilize the easily acquired unlabeled data, the paper proposes a semi-supervised online sequential ELM, denoted as SOS-ELM. The proposed SOS-ELM not only has the advantage of learning in a sequential way, but also makes the most use of unlabeled data. Experiments have been done on benchmark problems of regression and classification and the results show that the proposed SOS-ELM outperforms OS-ELM in generalization performance with similar training speed and outperforms SS-ELM with much lower training time cost.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of International Joint Conference on Neural Networks (IJCNN 2004), vol. 2, pp. 985–990 (2004)
Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)
Huang, G.-B., Chen, L., Siew, C.-K.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw. 17(4), 879–892 (2006)
Huang, G.-B., Chen, L.: Convex incremental extreme learning machine. Neurocomputing 70, 3056–3062 (2007)
Huang, G.-B., Zhou, H., Ding, X., et al.: Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 42(2), 513–529 (2012)
Huang, G.-B., Ding, X., Zhou, H.: Optimization method based extreme learning machine for classification. Neurocomputing 74(1), 155–163 (2010)
Lan, Y., Soh, Y.C., Huang, G.-B.: Constructive hidden nodes selection of extreme learning machine for regression. Neurocomputing 73(16), 3191–3199 (2010)
Lan, Y., Soh, Y.C., Huang, G.-B.: Two-stage extreme learning machine for regression Neurocomputing 73(16), 3028–3038 (2010)
Huang, G.-B.: An insight into extreme learning machines: random neurons, random features and kernels. Cognitive Computation, pp. 1–15 (2014)
Liang, N.-Y., Huang, G.-B., Saratchandran, P., et al.: A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Transactions on Neural Networks 17(6), 1411–1423 (2006)
Li, K., Zhang, J., Xu, H., et al.: A Semi-supervised extreme learning machine method based on co-training. J Comput. Inf. Syst. 9(1), 207–214 (2013)
Huang, G., Song, S., Gupta, J.N.D., et al.: Semi-supervised and unsupervised extreme learning machines. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics (2014)
Tang, X., Han, M.: A semi-supervised learning method based on extreme learning machine. Journal of Dalian University of Technology 50(5), 771–776 (2010)
Liu, J.-F., Chen, Y.-Q., Liu, M.-J., et al.: SELM: Semi-supervised ELM with application in sparse calibrated location estimation. Neurocomputing 74(16), 2566–2572 (2011)
Blake, C., Merz, C.: UCI repository of machine learning databases Dept. Inf. Comp. Sci. Univ.California, Irvine (1998)
Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 469–501 (2006)
Vapnik, V.: The nature of statistical learning theory. Springer (2000)
Chapelle, O., Sch, B., Zien, A.: Semi-Supervised Learning. MIT Press (2006), http://www.kyb.tuebingen.mpg.de/ssl-book
Belkin, M., Matveeva, I., Niyogi, P.: Regularization and semi-supervised learning on large graphs. In: Shawe-Taylor, J., Singer, Y. (eds.) COLT 2004. LNCS (LNAI), vol. 3120, pp. 624–638. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Jia, X., Wang, R., Liu, J., Powers, D.M.W. (2015). A Semi-supervised Online Sequential Extreme Learning Machine Method. In: Cao, J., Mao, K., Cambria, E., Man, Z., Toh, KA. (eds) Proceedings of ELM-2014 Volume 1. Proceedings in Adaptation, Learning and Optimization, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-319-14063-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-14063-6_26
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14062-9
Online ISBN: 978-3-319-14063-6
eBook Packages: EngineeringEngineering (R0)