Skip to main content
SpringerLink
Log in

A local-to-global scheme-based multi-objective evolutionary algorithm for overlapping community detection on large-scale complex networks

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Recently, multi-objective evolutionary algorithms (MOEAs) have been shown promising performance for detecting overlapping community structure in complex networks. However, it is still challenging to design MOEAs for overlapping community detection on large-scale complex networks due to the curse of dimensionality. Along this avenue, this paper proposes a local-to-global scheme-based MOEA named LG-MOEA for overlapping community detection on large-scale complex networks, which mainly consists of two stages: a local community structure detection stage and a global community structure determination stage. To be specific, in the local community structure detection stage, the key nodes that are central to community and essential to the connectedness of community are firstly identified. Then for each key node, an MOEA with the proposed community boundary control strategy is suggested to detect a set of local overlapping communities through local expansion around the key node. In the global community structure determination stage, a single objective evolutionary algorithm is adopted to search for a suitable local overlapping community for each key node and combine them as one global community partition of the whole network. The proposed LG-MOEA is compared with several competitive overlapping community detection algorithms on both real-world small-scale and large-scale networks, and the experimental results show its superiority for overlapping community detection in terms of the generalized normalized mutual information gNMI and the extended modularity \(Q_{ov}\), especially has competitive superiority for large-scale complex networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Zhang X, Zhou K, Pan H, Zhang L, Zeng X, Jin Y (2020) A network reduction-based multiobjective evolutionary algorithm for community detection in large-scale complex networks. IEEE Trans Syst Man Cybern 50(2):703–716

    Google Scholar 

  2. Wasserman S, Faust K (2015) Social network analysis methods and applications. Struct Anal Soc Sci 24(435):219–220

    MATH  Google Scholar 

  3. Pastorsatorras R, Vespignani A (2007) Evolution and structure of the Internet: a statistical physics approach. Cambridge University Press, Cambridge

    Google Scholar 

  4. Clara P, Rombo S SE (2014) Algorithms and tools for protein-protein interaction networks clustering, with a special focus on population-based stochastic methods. Bioinformatics 30(10):1343–1352

    Article  Google Scholar 

  5. Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821–7826

    Article  MathSciNet  Google Scholar 

  6. Pizzuti C (2012) A multiobjective genetic algorithm to find communities in complex networks. IEEE Trans Evol Comput 16(3):418–430

    Article  Google Scholar 

  7. Gong M, Ma L, Zhang Q, Jiao L, Gong M, Ma L, Zhang Q, Jiao L (2012) Community detection in networks by using multiobjective evolutionary algorithm with decomposition. Physica A 391(15):4050–4060

    Article  Google Scholar 

  8. Shi C, Yan Z, Cai Y, Wu B (2012) Multi-objective community detection in complex networks. Appl Soft Comput 12(2):850–859

    Article  Google Scholar 

  9. Gong M, Cai Q, Chen X, Ma L (2014) Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Trans Evol Comput 18(1):82–97

    Article  Google Scholar 

  10. Rosvall M, Bergstrom CT (2007) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci USA 105(4):1118–1123

    Article  Google Scholar 

  11. Pons P, Latapy M (2005) Computing communities in large networks using random walks. In: Proceedings of 20th international symposium on computer and information sciences, pp 284–293

  12. Karrer B, Newman MEJ (2011) Stochastic blockmodels and community structure in networks. Phys Rev E 83(1):016107

    Article  MathSciNet  Google Scholar 

  13. JöRg R, Stefan B (2006) Statistical mechanics of community detection. Phys Rev E Stat Nonlinear Soft Matter Phys 74(1):016110

    Article  MathSciNet  Google Scholar 

  14. Su Y, Zhou K, Zhang X, Cheng R, Zheng C (2020) A parallel multi-objective evolutionary algorithm for community detection in large-scale complex networks. Information Science (Major Revision)

  15. Wen X, Chen W, Lin Y, Gu T, Zhang H, Li Y, Yin Y, Zhang J (2017) A maximal clique based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Evol Comput 21(3):363–377

    Google Scholar 

  16. Ren W, Yan G, Liao X et al (2009) Simple probabilistic algorithm for detecting community structure. Phys Rev E 79(33):036111

    Article  Google Scholar 

  17. Lu M, Zhang Z, Qu Z, Kang Y (2019) Lpanni: overlapping community detection using label propagation in large-scale complex networks. IEEE Trans Knowl Data Eng 31(9):1736–1749

    Article  Google Scholar 

  18. Brian K, Newman MEJ (2005) Uncovering the overlapping community structures of complex networks in nature and society. Nature 435(7043):814–818

    Article  Google Scholar 

  19. Shen H, Cheng X, Cai K (2009) Detect overlapping and hierarchical community structure in networks. Physica A 388(8):1706–1712

    Article  Google Scholar 

  20. Zhang X, Wang C, Su Y, Pan L, Zhang H (2017) A fast overlapping community detection algorithm based on weak cliques for large-scale networks. IEEE Trans Comput Soc Syst 4(4):218–230

    Article  Google Scholar 

  21. Shi C, Cai Y, Fu D, Dong Y, Wu B (2013) A link clustering based overlapping community detection algorithm. Data Knowl Eng 87:394–404

    Article  Google Scholar 

  22. Jin D, Gabrys B, Dang J (2015) Combined node and link partitions method for finding overlapping communities in complex networks. Sci Rep 5(1):8600–8600

    Article  Google Scholar 

  23. Bandyopadhyay S, Chowdhary G, Sengupta D (2015) Focs: fast overlapped community search. IEEE Trans Knowl Data Eng 27(11):2974–2985

    Article  Google Scholar 

  24. Liu Z, Xiang B, Guo W, Chen Y, Guo K, Zheng J (2019) Overlapping community detection algorithm based on coarsening and local overlapping modularity. IEEE Access 7:57943–57955

    Article  Google Scholar 

  25. Li Y, Wang Y, Chen J, Jiao L, Shang R (2015) Overlapping community detection through an improved multi-objective quantum-behaved particle swarm optimization. J Heuristics 21(4):549–575

    Article  Google Scholar 

  26. Liu C, Liu J, Jiang Z (2014) A multiobjective evolutionary algorithm based on similarity for community detection from signed social networks. IEEE Trans Cybern 44(12):2274–2287

    Article  Google Scholar 

  27. Liu J, Zhong W, Abbass HA, Green DG (2010) Separated and overlapping community detection in complex networks using multiobjective evolutionary algorithms. In: Proceedings of 2010 congress on evolutionary computation, pp 1–7

  28. Zhang L, Pan H, Su Y, Zhang X, Niu Y (2017) A mixed representation-based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Syst Man Cybern 47(9):2703–2716

    Google Scholar 

  29. Fortunato S, Barthelemy M (2007) Resolution limit in community detection. Proc Natl Acad Sci USA 104(1):36–41

    Article  Google Scholar 

  30. Pizzuti C (2009) A multi-objective genetic algorithm for community detection in networks. In: Proceedings of 21st international conference on tools with artificial intelligence, pp 379–386

  31. Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197

    Article  Google Scholar 

  32. Corne DW, Jerram NR, Knowles JD, Oates MJ (2001) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the 3rd annual conference on genetic and evolutionary computation, pp 283–290

  33. Zhang T, Wu B (2012) A method for local community detection by finding core nodes. In: International conference on advances in social networks analysis and mining, pp 1171–1176

  34. Luo W, Zhang D, Hao J, Li N, Hu Y (2018) Local community detection with the dynamic membership function. IEEE Trans Fuzzy Syst 26(5):3136–3150

    Article  Google Scholar 

  35. Palazuelos C, Zorrilla M (2011) Fringe: a new approach to the detection of overlapping communities in graphs. In: International conference on computational science & its applications, pp 638–653

  36. Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731

    Article  Google Scholar 

  37. Whang JJ, Gleich DF, Dhillon IS (2016) Overlapping community detection using neighborhood-inflated seed expansion. IEEE Trans Knowl Data Eng 28(5):1272–1284

    Article  Google Scholar 

  38. Newman M (2011) Communities, modules and large-scale structure in networks. Nat Phys 8:25–31

    Article  Google Scholar 

  39. Lancichinetti A, Fortunato S, Kertész J (2008) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015

    Article  Google Scholar 

  40. Ahn Y, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in networks. Nature 466(7307):761–764

    Article  Google Scholar 

  41. Yang J, Leskovec J (2013) Overlapping community detection at scale: a nonnegative matrix factorization approach. In: Web search and data mining, pp 587–596

  42. Chen Q, Wu T, Fang M (2013) Detecting local community structures in complex networks based on local degree central nodes. Physica A Stat Mech Appl 392(3):529–537

    Article  Google Scholar 

  43. Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33(4):452–473

    Article  Google Scholar 

  44. Lusseau D (2003) The emergent properties of a dolphin social network. Proc R Soc B Biol Sci 270(2):186–188

    Google Scholar 

  45. Newman MEJ (2006) Modularity and community structure in networks. Proc Natl Acad Sci 103(23):8577–8582

    Article  Google Scholar 

  46. Gregory S (2007) An algorithm to find overlapping community structure in networks. In: European conference on principles of data mining and knowledge discovery, pp 91–102

  47. Leskovec J, Krevl A (2014) SNAP datasets: Stanford large network dataset collection. http://snap.stanford.edu/data

  48. Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015

    Article  Google Scholar 

  49. Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (61976001, 61876184, 61672033 and 61822301, and also supported by Excellent Youth Foundation of Anhui Scientific Committee (1808085J06) and the Natural Science Foundation of Anhui Province (2008085QF309).

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, 230039, China

    Haiping Ma

  2. Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, School of Computer Science and Technology, Anhui University, Hefei, 230039, China

    Haipeng Yang, Kefei Zhou, Lei Zhang & Xingyi Zhang

Authors
  1. Haiping Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haipeng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kefei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xingyi Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Zhang.

Ethics declarations

Conflict of interest

The authors declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, H., Yang, H., Zhou, K. et al. A local-to-global scheme-based multi-objective evolutionary algorithm for overlapping community detection on large-scale complex networks. Neural Comput & Applic 33, 5135–5149 (2021). https://doi.org/10.1007/s00521-020-05311-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05311-w

Keywords

Search

Navigation