Skip to main content
SpringerLink
Log in

Mitigating sparsity using Bhattacharyya Coefficient and items’ categorical attributes: improving the performance of collaborative filtering based recommendation systems

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Collaborative filtering has been the most popular and effective recommendation technique to predict ratings using similar users or items. But in a sparse dataset, due to fewer co-rated items, the traditional similarity measures fail to compute the similarity between a pair of users. This influences the predicted rating negatively, which results in degraded recommendation performance. Similarity calculation using Bhattacharya Coefficient can be a more judicious approach because it works well with few or no co-rated items between a pair of users. However, Bhattacharya Coefficient also fails to compute the similarity between a pair of users when co-rated items are zero and the rating vector of items are disjoint. In this paper, we propose a novel approach to address the limitation of the Bhattacharya Coefficient with improved rating prediction accuracy in collaborative filtering. Instead of using only user ratings, to have more rating prediction accuracy, we use categorical attributes of rated items in findings of k-nearest neighbors. The performance of the proposed approach is evaluated on the collected datasets of MovieLens and LDOS-CoMoDa and compared with recent approaches. The comparative results corroborate the anticipated performance of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Patra BK, Launonen R, Ollikainen V, Nandi S (2014) Exploiting bhattacharyya similarity measure to diminish user cold-start problem in sparse data. In: International conference on discovery science. Springer, pp 252–263

  2. Singh PK, Setta S, Pramanik PKD, Choudhury P (2019) Proceedings of the international conference on innovative computing and communication (ICICC-2019), Vol. 1087 of advances in intelligent systems and computing. In: Khanna A, Gupta D, Bhattacharyya S, Snasel V, Platos J, Hassanien A (eds). https://doi.org/10.1007/978-981-15-1286-5_1. Springer, pp 1–10

  3. Singh PK, KD Pramanik P, Debnath NC, Choudhury P (2019) A novel neighborhood calculation method by assessing users’ varying preferences in collaborative filtering. In: Proceedings of the 34th international conference on computers and their applications (CATA 2019), no. 58 in EPiC series in computing, Honolulu, Hawaii. https://doi.org/10.29007/3xfj, pp 345–355

  4. Aggarwal CC (2016) Model-based collaborative filtering. In: Springer International Publishing, Cham, pp 71–138

  5. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 426–434

  6. Paterek A (2007) Improving regularized singular value decomposition for collaborative filtering. In: Proceedings of KDD cup and workshop, vol 2007, pp 5–8

  7. Singh PK, Pramanik PKD, Choudhury P (2019) Collaborative filtering in recommender systems: Technicalities, challenges, applications and research trends. In: Shrivastava G, Peng S. L., Bansal H., Sharma K., Sharma M. (eds) Transforming Internet through Machine Learning, IoT, and Trust Modeling. Apple Academic Press, pp 183–215

  8. Koren Y (2010) Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Transactions on Knowledge Discovery from Data (TKDD) 4(1):1

    Article  Google Scholar 

  9. Patra BK, Launonen R, Ollikainen V, Nandi S (2015) A new similarity measure using bhattacharyya coefficient for collaborative filtering in sparse data. Knowl-Based Syst 82:163–177

    Article  Google Scholar 

  10. Lu J, Wu D, Mao M, Wang W, Zhang G (2015) Recommender system application developments: a survey. Decis. Support. Syst. 74:12–32

    Article  Google Scholar 

  11. Singh PK, Sinha M, Das S, Choudhury P (2020) Enhancing recommendation accuracy of item-based collaborative filtering using bhattacharyya coefficient and most similar item. Appl Intell: 1–24

  12. Ye F, Zhang H (2017) A collaborative filtering recommendation based on users’ interest and correlation of items. In: International conference on audio, language and image processing. IEEE

  13. Cao H, Deng J, Guo H, He B, Wang Y (2016) An improved recommendation algorithm based on bhattacharyya coefficient. In: IEEE International Conference on Knowledge Engineering and Applications (ICKEA). IEEE, pp 241–244

  14. Jain P, Dixit VS (2019) Proposed similarity measure using bhattacharyya coefficient for context aware recommender system. Journal of Intelligent & Fuzzy Systems (Preprint): 1–12

  15. Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inform. Sci. 178(1):37–51

    Article  Google Scholar 

  16. Sun H-F, Chen J-L, Yu G, Liu C-C, Peng Y, Chen G, Cheng B (2012) Jacuod: a new similarity measurement for collaborative filtering. J. Comput. Sci. Technol. 27(6):1252–1260

    Article  Google Scholar 

  17. Choi K, Suh Y (2013) A new similarity function for selecting neighbors for each target item in collaborative filtering. Knowl.-Based Syst. 37:146–153

    Article  Google Scholar 

  18. Liu H, Hu Z, Mian AU, Tian H, Zhu X (2014) A new user similarity model to improve the accuracy of collaborative filtering. Knowl.-Based Syst. 56:156–166

    Article  Google Scholar 

  19. Wang W, Lu J, Zhang G (2014) A new similarity measure-based collaborative filtering approach for recommender systems. In: Foundations of intelligent systems. Springer, pp 443–452

  20. Gazdar A, Hidri L (2020) A new similarity measure for collaborative filtering based recommender systems. Knowledge-Based Systems 188:105058

    Article  Google Scholar 

  21. Margaris D, Spiliotopoulos D, Karagiorgos G, Vassilakis C (2020) An algorithm for density enrichment of sparse collaborative filtering datasets using robust predictions as derived ratings. Algorithms 13(7):174

    Article  Google Scholar 

  22. Iftikhar A, MA Ghazanfar, Ayub M, Mehmood Z, Maqsood M (2020) An improved product recommendation method for collaborative filtering. IEEE Access 8:123841–123857

    Article  Google Scholar 

  23. Goldberg D, Nichols D, Oki BM, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun. ACM 35(12):61–70

    Article  Google Scholar 

  24. Al-Shamri MYH (2016) User profiling approaches for demographic recommender systems. Knowl.-Based Syst. 100:175–187

    Article  Google Scholar 

  25. Salter J, Antonopoulos N (2006) Cinemascreen recommender agent: combining collaborative and content-based filtering. IEEE Intell. Syst. 21(1):35–41

    Article  Google Scholar 

  26. Kim H-N, Ha I, Lee K-S, Jo G-S, El-Saddik A (2011) Collaborative user modeling for enhanced content filtering in recommender systems. Decis. Support. Syst. 51(4):772–781

    Article  Google Scholar 

  27. Wang H.-C., Jhou H.-T., Tsai Y.-S. Adapting topic map and social influence to the personalized hybrid recommender system, Information Sciences

  28. Ekstrand MD, Riedl JT, Konstan JA, et al. (2011) Collaborative filtering recommender systems. Foundations and Trends®; in Human–Computer Interaction 4(2):81–173

    Article  Google Scholar 

  29. Salton G, J McGill M Introduction to modern information retrieval

  30. Shardanand U, Maes P (1995) Social information filtering: Algorithms for automating” word of mouth”. In: Chi, vol 95. Citeseer, pp 210–217

  31. Yildirim H, Krishnamoorthy MS (2008) A random walk method for alleviating the sparsity problem in collaborative filtering. In: Proceedings of the 2008 ACM conference on recommender systems. ACM, pp 131–138

  32. Ortega F, SáNchez J-L, Bobadilla J, GutiéRrez A (2013) Improving collaborative filtering-based recommender systems results using pareto dominance. Inform. Sci. 239:50–61

    Article  Google Scholar 

  33. Bobadilla J, Serradilla F, Bernal J, new collaborative filtering metric A (2010) that improves the behavior of recommender systems. Knowl-Based Syst 23(6):520–528

    Article  Google Scholar 

  34. Bobadilla J, Ortega F, Hernando A, Bernal J (2012) A collaborative filtering approach to mitigate the new user cold start problem. Knowl-Based Syst 26:225–238

    Article  Google Scholar 

  35. Mahara T, et al. (2016) A new similarity measure based on mean measure of divergence for collaborative filtering in sparse environment. Procedia Computer Science 89:450–456

    Article  Google Scholar 

  36. Singh PK, Pramanik PKD, Choudhury P (2018) A comparative study of different similarity metrics in highly sparse rating dataset. In: Balas V, Sharma N, Chakrabarti A (eds) Data management, analytics and innovation (vol. 2)), Vol. 839 of advances in intelligent systems and computing. Springer, pp 45–60, DOI https://doi.org/10.1007/978-981-13-1274-8_4, (to appear in print)

  37. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web. ACM, pp 285–295

  38. Bobadilla J, Hernando A, Ortega F, Gutiérrez A (2012) Collaborative filtering based on significances. Inform. Sci. 185(1):1–17

    Article  Google Scholar 

  39. Ricci F, Rokach L, Shapira B, Kantor PB (2010) Recommender systems handbook, 1st edn. Springer, New York

    MATH  Google Scholar 

  40. Choi K, Suh Y (2013) A new similarity function for selecting neighbors for each target item in collaborative filtering. Knowl-Based Syst 37:146–153

    Article  Google Scholar 

  41. Herlocker JL, Konstan J, Borchers A, Riedl J (1999) An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval, pp 230–237

  42. Jamalzehi S, Menhaj MB (2016) A new similarity measure based on item proximity and closeness for collaborative filtering recommendation. In: 2016 4th International conference on control, instrumentation, and automation (ICCIA). IEEE, pp 445–450

  43. Cheng Q, Wang X, Yin D, Niu Y, Xiang X, Yang J, Shen L (2015) The new similarity measure based on user preference models for collaborative filtering. In: 2015 IEEE International Conference on Information and Automation. IEEE, pp 577–582

  44. Al-Bashiri H, Abdulgabber MA, Romli A, Salehudin N (2018) A developed collaborative filtering similarity method to improve the accuracy of recommendations under data sparsity. International Journal of Advanced Computer Science and Applications (IJACSA) 9(4):135–42

    Google Scholar 

  45. Kumar NP, Fan Z (2015) Hybrid user-item based collaborative filtering. Procedia Computer Science 60:1453–1461

    Article  Google Scholar 

  46. Wu X, Huang Y, Wang S (2017) A new similarity computation method in collaborative filtering based recommendation system. In: 2017 IEEE 86th vehicular technology conference (VTC-Fall). IEEE, pp 1–5

  47. Singh PK, Pramanik PKD, Choudhury P (2019) An improved similarity calculation method for collaborative filtering-based recommendation, considering the liking and disliking of categorical attributes of items. J Inf Optim Sci 40(2):397–412. https://doi.org/10.1080/02522667.20191580881

    Article  Google Scholar 

  48. Yu Y, Wang C, Wang H, Gao Y (2017) Attributes coupling based matrix factorization for item recommendation. Appl Intell 46(3):521–533

    Article  Google Scholar 

  49. Singh M, Sahu H, Sharma N (2019) A personalized context-aware recommender system based on user-item preferences: Proceedings of ICDMAI 2018 2:357–374

  50. H Wu, X Liu, Y Pei, B Li (2014) Enhancing context-aware recommendation via a unified graph model. In: 2014 International conference on identification, information and knowledge in the internet of things, pp 76–79

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology, Durgapur, India

    Pradeep Kumar Singh, Pijush Kanti Dutta Pramanik & Prasenjit Choudhury

  2. Department of Computer Science and Engineering, Kamla Nehru Institute of Technology, Sultanpur, India

    Pradeep Kumar Singh

Authors
  1. Pradeep Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pijush Kanti Dutta Pramanik
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Prasenjit Choudhury
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Prasenjit Choudhury.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, P.K., Pramanik, P.K.D. & Choudhury, P. Mitigating sparsity using Bhattacharyya Coefficient and items’ categorical attributes: improving the performance of collaborative filtering based recommendation systems. Appl Intell 52, 5513–5536 (2022). https://doi.org/10.1007/s10489-021-02462-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02462-8

Keywords

Search

Navigation