Skip to main content
SpringerLink
Log in

Semi-supervised nonnegative matrix factorization with positive and negative label propagations

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Semi-supervised nonnegative matrix factorization (SNMF) methods yield the enhanced representation ability over nonnegative matrix factorization (NMF) by incorporating the label information. Label propagation (LP) is a popular graph-based method used in SNMF to propagate label information from the labeled data to the unlabeled ones. However, label constraint propagation is always ignored to propagate label restrictions for the data. In this paper, a novel SNMF method, namely positive and negative label propagations based SNMF (PNLP-SNMF), is proposed to improve clustering performance by leveraging both positive and negative label information. The proposed method fulfills nonnegative matrix factorization and label constraint propagation in an unified optimization model. By the label indicator, PNLP-SNMF could guide the unlabeled data of the same predicted label to be mapped into the same class and enhance the discriminative ability of the representation in the feature space. Moreover, we further design an effective iterative updating optimization scheme to solve the objective function the the proposed PNLP-SNMF, whose convergence is theoretically proven. Extensive experimental results demonstrate the effectiveness of our proposed method in image clustering tasks by comparing with several state-of-the-art NMF-based methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php.

  2. http://vision.ucsd.edu/iskwak/ExtYaleDatabase/ExtYaleB.html.

  3. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html.

  4. http://www2.ece.ohio-state.edu/aleix/ARdatabase.html.

  5. http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html.

  6. http://yann.lecun.com/exdb/mnist.

References

  1. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791

    Article  Google Scholar 

  2. Wachsmuth E, Oram MW, Perrett DI (1994) Recognition of objects and their component parts: reponses of single units in the temporal cortex of the macaque. Cereb Cortex 4:509–522

    Article  Google Scholar 

  3. Logothetis NK, Sheinberg DL (1996) Visual object recognition. Ann Rev Neurosci 19:577–621

    Article  Google Scholar 

  4. Gillis N, Plemmons RJ (2013) Sparse nonnegative matrix underapproximation and its application to hyperspectral image analysis. Linear Algebra Appl 438(10):3991–4007

    Article  MathSciNet  Google Scholar 

  5. Feng X, Jiao Y, Lv C, Zhou D (2016) Label consistent semi-supervised non-negative matrix factorization for maintenance activities identification. Eng Appl Artif Intell 52:161–167

    Article  Google Scholar 

  6. Chen W, Liu J, Pan B, Chen B (2019) Face recognition using nonnegative matrix factorization with fractional power inner product kernel. Neurocomputing 348(5):40–53

    Article  Google Scholar 

  7. Wu W, Jia Y, Wang S, Fan H, Kwong S (2021) Positive and negative label-driven nonnegative matrix factorization. IEEE Trans Circ Syst Video Technol 31(7):2698–2710

    Article  Google Scholar 

  8. Peng S, Ser W, Chen B, Sun L, Lin Z (2020) Robust nonnegative matrix factorization with local coordinate constraint for image clustering. Eng Appl Artif Intell 88:103354

  9. Peng S, Ser W, Chen B, Lin Z (2020) Robust orthogonal nonnegative matrix tri-factorization for data representation. Knowl -Based Syst 201-202:106054

  10. Cai D, He X, Han J, Huang TS (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560

    Article  Google Scholar 

  11. Li Z, Liu J, Lu H (2013) Structure preserving non-negative matrix factorization for dimensionality reduction. Comput Vis Image Underst 117(9):1175–1189

    Article  Google Scholar 

  12. Tolic D, Antulov-Fantulin N, Kopriva I (2018) A nonlinear orthogonal Non-Negative matrix factorization approach to subspace clustering. Pattern Recogn 82:40–55

    Article  Google Scholar 

  13. Huang Q, Yin X, Chen S, Wang Y, Chen B (2020) Robust nonnegative matrix factorization with structure regularization. Neurocomputing 412:72–90

    Article  Google Scholar 

  14. Wang D, Gao X, Wang X (2016) Semi-Supervised Nonnegative matrix factorization via constraint propagation. IEEE Trans Cybern 46(1):233–244

    Article  Google Scholar 

  15. Li H, Zhang J, Shi G, Liu J (2017) Graph-based discriminative nonnegative matrix factorization with label information. Neurocomputing 266:91–100

    Article  Google Scholar 

  16. Li Z, Tang J, He X (2018) Robust structured nonnegative matrix factorization for image representation. IEEE Trans Neural Netw Learn Syst (5):1–14

  17. Jia Y, Kwong S, Hou J, Wu W (2020) Semi-Supervised Non-Negative Matrix factorization with dissimilarity and similarity regularization. IEEE Trans Neural Netw Learn Syst 31(7):2510–2521

    MathSciNet  Google Scholar 

  18. Peng X, Xu D, Chen D (2020) Progressive transduction nonnegative matrix factorization for dimensionality reduction. Neurocomputing 414:76–89

    Article  Google Scholar 

  19. Jia Y, Liu H, Hou J, Kwong S (2020) Semisupervised adaptive symmetric Non-Negative matrix factorization. IEEE Trans Cybern 99:1–1

    Google Scholar 

  20. Tian Z, Kuang R (2012) Global linear neighborhoods for efficient label propagation. 12th SIAM Int Conf Data Min:863– 872

  21. Yi Y, Shi Y, Zhang H, Wang J, Kong J (2015) Label propagation based semi-supervised non-negative matrix factorization for feature extraction. Neurocomputing 149:1021–1037

    Article  Google Scholar 

  22. Lan L, Liu T, Zhang X, Xu C, Luo Z (2020) Label propagated nonnegative matrix factorization for clustering. IEEE Trans Knowl Data Eng 99:1–1

    Article  Google Scholar 

  23. Zoidi O, Tefas A, Nikolaidis N, Pitas I (2018) Positive and negative label propagation. IEEE Trans Circ Syst Video Technol 28(2):342–355

    Article  Google Scholar 

  24. Lee H, Yoo J, Choi S (2010) Semi-Supervised Nonnegative matrix factorization. IEEE Signal Process Lett 17(1):4–7

    Article  Google Scholar 

  25. Liu H, Wu Z, Li X, Cai D, Huang TS (2011) Constrained nonnegative matrix factorization for Image Representation. IEEE Trans Pattern Anal Mach Intell 34(7):1299–1311

    Article  Google Scholar 

  26. Ze T, Kuang R (2012) Global linear neighborhoods for efficient label propagation. Proceedings of the 2012 SIAM International Conference on Data Mining, pp 863–872

  27. Depster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the em algorithm. J R Stat Soc B 39:1– 38

    MathSciNet  MATH  Google Scholar 

  28. Cai D, He X, Han J (2005) Document clustering using locality preserving indexing. IEEE Trans Knowl Data Eng 17(12):1624–1637

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant no. 12001057 and 61976174, the Fundamental Research Funds for the Central Universities in Chang’an University under Grant no. 300102120201, the Natural Science Basic Research Plan in Shaanxi Province of China under Grant no. 2019JQ-625, the Key Research and Development of Shaanxi Province of China under Grant no. 2021NY-170.

Author information

Authors and Affiliations

  1. School of Science, Chang’an University, Xi’an, 710064, China

    Changpeng Wang, Tianjun Wu & Meng Zhang

  2. School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an, 710064, China

    Jiangshe Zhang & Guang Shi

Authors
  1. Changpeng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiangshe Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tianjun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Meng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guang Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Changpeng Wang: Conceptualization, Writing - review & editing. Jiangshe Zhang: Formal analysis, Investigation. Tianjun Wu: Methodology, Supervision. Meng Zhang: Software, Validation. Guang Shi: Software, Validation.

Corresponding author

Correspondence to Changpeng Wang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, C., Zhang, J., Wu, T. et al. Semi-supervised nonnegative matrix factorization with positive and negative label propagations. Appl Intell 52, 9739–9750 (2022). https://doi.org/10.1007/s10489-021-02940-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02940-z

Keywords

Search

Navigation