Changming Zhu
ABSTRACT
In multi-view learning field, preserving data privacy is an important topic and a good solution is rank-consistency-based multi-view learning (RANC). RANC exploits view relationship and preserves data privacy simultaneously and related experiments also validate that RANC improves the individual view-specific learners with the usage of information from other views and parts of features. While performance of RANC is still limited by the insufficient of prior knowledge. Thus we introduce Universum learning into RANC to create additional unlabeled instances which provide more useful prior knowledge. The developed RANC with Universum learning is abbreviated to RANCU. Related experiments on some multi-view data sets have validated the performance of our RANCU theoretically and empirically.
- G. Tzortzis and A. Likas, Kernel-based Weighted Multi-view Clustering, 2012 IEEE 12th International Conference on Data Mining, pp. 675--684, 2012.Google Scholar
Digital Library
- S.L. Sun and Q.J. Zhang, Multiple-view Multiple-learner Semi-supervised Learning, Neural Processing Letters, 34:229--240, 2011.Google ScholarDigital Library
- M.Q. Deng, C. Wang, and Q.F. Chen, Human Gait Recognition based on Deterministic Learning through Multiple Views Fusion, Pattern Recognition Letters, 78(C):56--63, 2016.Google ScholarDigital Library
- F. Wu, X.Y. Jing, X.G. You, D. Yue, R.M. Hu, and J.Y Yang, Multi-view low-rank dictionary learning for image classification, Pattern Recognition, 50:143--154, 2016.Google ScholarDigital Library
- S.H. Zhu, X. Sun, and D.L. jin, Multi-view semi-supervised learning for image classification, Neurocomputing, 208:136--142, 2016.Google ScholarDigital Library
- H.Y. Wang, X. Wang, J. Zheng, J.R. Deller, H.Y. Peng, L.Q. Zhu, W.G Chen, X.L. Li, R.J. Liu, and H.J. Bao, Video Object Matching across Multiple Non-overlapping Camera Views based on Multi-feature Fusion and Incremental Learning, Pattern Recognition, 47(12):3841--3851, 2014.Google ScholarCross Ref
- R. Sheikhpour, M.A. Sarram, S. Gharaghani, and M.A.Z. Chahooki, A Survey on semi-supervised feature selection methods, Pattern Recognition, 64:141--158, 2017.Google ScholarDigital Library
- H.J. Ye, D.C. Zhan, Y. Miao, Y. Jiang, and Z.H. Zhou, Rank Consistency based Multi-View Learning: A Privacy-Preserving Approach, ACM International on Conference on Information and Knowledge Management, pp. 991--1000, 2015.Google ScholarDigital Library
- R. Bach, G. R. Lanckriet, and M. I. Jordan, Multiple kernel learning, conic duality, and the SMO algorithm, In Proceedings of the 21st International Conference on Machine Learning, pp. 6--13, 2004.Google ScholarDigital Library
- C. Cortes, M. Mohri, and A. Rostamizadeh, Two-stage learning kernel algorithms, In Proceedings of the 27th International Conference on Machine Learning, pp. 239--246, 2010.Google ScholarDigital Library
- A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, SimpleMKL, Journal of Machine Learning Research, 9:2491--2521, 2008.Google Scholar
- M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, Non-sparse regularization and efficient training with multiple kernels, arxiv preprint arXiv:1003.0079.2010.Google Scholar
- M. Gönen and E. Alpaydin, Localized multiple kernel learning, In proceeding of the 25th International Conference on Machine Learning, pp. 352--359, 2008.Google ScholarDigital Library
- G. Ye, D. Liu, I.H. Jhuo, and S.F. Chang, Robust late fusion with rank minimization, In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 3021--3028, 2012.Google ScholarDigital Library
- A. Iosifidis, A. Tefas A, N. Nikolaidis, and I. Pitas, Multi-view human movement recognition based on fuzzy distances and linear discriminant analysis, Computer Vision and Image Understanding, 116(3):347--360, 2012.Google ScholarDigital Library
- J. Rupnik and J. Shawe-Taylor, Multi-View Canonical Correlation Analysis, In proceeding of Slovenian KDD Conference on Data Mining Data Warehouses, pp. 1--4, 2010.Google Scholar
- X. Yin, Q. Huang, and X. Chen, Multiple View Locality Preserving Projections with Pairwise Constraints, Communication Systems and Information Technology, 100:859--866, 2011.Google ScholarCross Ref
- A. Blum and T. Mitchell, Combining labeled and unlabeled data with co-training, Eleventh Conference on Computational Learning Theory, pp. 92--100, 1998.Google ScholarDigital Library
- M.L. Zhang and Z.H. Zhou, Cotrade: Confident co-training with data editing, IEEE Transaction on Systems, Man, and Cybernetics, Part B: Cybernetics, 41(6):1612--1626, 2011.Google ScholarDigital Library
- V. Sindhwani, P. Niyogi, and M. Belkin, A Co-Regularization Approach to Semi-supervised Learning with Multiple Views, In Proceeding of ICML workshop on Learning With Multiple Views, pp. 74--79, 2005.Google Scholar
- V. Vapnik and S. Kotz, Estimation of dependences based on empirical data, Springer, 1982.Google ScholarDigital Library
- V. Cherkassky and W.Y. Dai, Empirical Study of the Universum SVM Learning for High-Dimensional Data, Lecture Notes in Computer Science, 5768:932--941, 2009.Google ScholarDigital Library
- D. Zhang, J. Wang, and L. Si, Document clustering with universum, International Conference on Research and Development in Information Retrieval, pp. 873--882, 2011.Google ScholarDigital Library
- B. Peng, G. Qian, and Y.Q. Ma, View-invariant pose recognition using multilinear analysis and the universum, Advances in Visual Computing, 5359:581--591, 2008.Google ScholarDigital Library
- C. Shen, P. Wang, F. Shen, and H. Wang, Uboost: boosting with the universum, IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(4):825--832, 2012.Google ScholarDigital Library
- X.H. Chen, S.C. Chen, and H. Xue, Universum linear discriminant analysis, Electronics Letters, 48(22):1407--1409, 2012.Google ScholarCross Ref
- Z. Wang, Y.J. Zhu, W.W. Liu, Z.H. Chen, and D.Q. Gao, Multi-view learning with universum, Knowledge-Based Systems, 70:376--391, 2014.Google ScholarDigital Library
- J. Weston, R. Collobert, F. Sinz, L. Bottou, and V. Vapnik, Inference with the universum, The 23rd International Conference on Machine Learning, pp. 1009--1016, 2006.Google ScholarDigital Library
- D.L. Liu, Y.J. Tian, R.F. Bie, and Y. Shi, Self-Universum support vector machine, Personal and Ubiquitous Computing, 18:1813--1819, 2014.Google ScholarDigital Library
- Y.M. Xu, C.D. Wang, and J.H. Lai, Weighted Multi-view Clustering with Feature Selection, Pattern Recognition, 53:25--35, 2016.Google ScholarDigital Library
- A. Beck and M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM Journal on Imaging Sciences, 2(1):183--202, 2009.Google ScholarDigital Library
- S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, Distributed optimization and statistical learning via the alternating direction method of multipliers, Foundations and Trends in Machine Learning, 3(1):1--122, 2011.Google ScholarDigital Library
- Q. Gu, L. Zhu, and Z.H. Cai, Evaluation Measures of the Classification Performance of Imbalanced Data Sets, Computational Intelligence and Intelligent Systems, 51:461--471, 2009.Google ScholarCross Ref
- L.A. Jeni, J.F. Cohn, and F.D.L. Torre, Facing Imbalanced Data-Recommendations for the Use of Performance Metrics. Humaine Association Conference on Affective Computing and Intelligent Interaction, pp. 245--251, 2013.Google Scholar
- C. Carpineto and G. Romano, A Survey of Automatic Query Expansion in Information Retrieval, ACM Computing Surveys, 44(1):159--170, 2012.Google ScholarDigital Library
- R. Barandela, J.S. Sanchez, V. Garcia, and E. Rangel, Strategies for Learning in Class Imbalance Problems, Pattern Recognition, 36(3):849--851, 2003.Google ScholarCross Ref
Index Terms
- Rank-consistency-based multi-view learning with Universum
Recommendations
Rank Consistency based Multi-View Learning: A Privacy-Preserving Approach
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementComplex media objects are often described by multi-view feature groups collected from diverse domains or information channels. Multi-view learning, which attempts to exploit the relationship among multiple views to improve learning performance, has ...
Multi-view learning with Universum
The traditional Multi-view Learning (MVL) studies how to process patterns with multiple information sources. In practice, the MVL is proven to have a significant advantage over the Single-view Learning (SVL). But in most real-world cases, there are only ...
Multi-view dimensionality reduction based on Universum learning
Canonical correlation analysis (CCA) is a useful dimensionality reduction method and has been widely used in projecting multi-view data. However, CCA learns from training data consisting of only target classes, ignoring Universum data that belongs to ...
Comments