Skip to main content
SpringerLink
Log in

DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

To enhance the recommendation performance, session-based recommendations typically model based on graph neural networks (GNN). These models use the most recently clicked item as the user’s short-term interest, as well as the query vector in the attention mechanism. Based on it, the attention score is calculated with the remaining items to obtain the user’s long-term interest. However, the obtained representation of long-term interest is one-sided. Furthermore, unlike other recommendation technology, such as collaborative filtering that includes the user’s entire history information, the session-based recommendation is more vulnerable to data sparsity. Existing models primarily make predictions based on observable user-item interactions and ignore items not interacted with by users. To address the aforementioned issues, we propose the denoising autoencoder integrated with self-supervised learning (SSL) in graph neural networks (DAS-GNN). In DAS-GNN, the query extraction module based on denoising autoencoder can mine multiple user interests and assist long-term interest to express user needs more comprehensively. We propose an effective way of dividing positive and negative samples in the SSL module and use adaptive thresholds to mine negative hard samples, thereby improving training efficiency and alleviating data sparsity. Extensive experiments demonstrate that the proposed DAS-GNN outperforms state-of-the-art models on four benchmarks. The source code is available at: https://github.com/daijiuqian/DAS-GNN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. http://cikm2016.cs.iupui.edu/cikm-cup

  2. https://snap.stanford.edu/data/loc-gowalla.html

  3. http://dbis-nowplaying.uibk.ac.at/#nowplaying

  4. https://www.kaggle.com/retailrocket/ecommerce-dataset

References

  1. Lops P, De Gemmis M, Semeraro G (2011) Content-based recommender systems: State of the art and trends. In: Recommender systems handbook. Springer, pp 73–105

  2. Schafer JB, Frankowski D, Herlocker J et al (2007) Collaborative filtering recommender systems [M]. The adaptive web. Springer. 291–324

  3. Burke R (2002) Hybrid recommender systems: Survey and experiments [J]. User Model User-Adap Inter 12(4):331–370

    Article  MATH  Google Scholar 

  4. Wang S, Cao L, Wang Y et al (2021) A survey on session-based recommender systems [J]. ACM Comput Surv 54(7):1–38

    Article  Google Scholar 

  5. Qiu R, Li J, Huang Z et al (2019) Rethinking the item order in session-based recommendation with graph neural networks; proceedings of the Proceedings of the 28th ACM International Conference on Information and Knowledge Management, F, [C]

  6. Wu S, Tang Y, Zhu Y et al (2019) Session-based recommendation with graph neural networks; proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, F, [C]

  7. Huang C, Chen J, Xia L et al (2021) Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation; proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, F, [C]

  8. Wang Z, Wei W, Cong G, Li X-L, Mao X-L, Qiu M, Feng S (2020d) Exploring global information for session based recommendation. arXiv preprint arXiv:2011.10173

  9. Xia X, Yin H, Yu J et al (2021) Self-Supervised Graph Co-Training for Session-based Recommendation; proceedings of the Proceedings of the 30th ACM International Conference on Information & Knowledge Management, F, [C]

  10. Xia X, Yin H, Yu J et al (2021) Self-supervised hypergraph convolutional networks for session-based recommendation; proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, F, [C]

  11. Chen T, Wong RC-W (2020) Handling information loss of graph neural networks for session-based recommendation; proceedings of the Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, F, [C]

  12. Liu Q, Zeng Y, Mokhosi R et al (2018) STAMP: short-term attention/memory priority model for session-based recommendation; proceedings of the Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, F, [C]

  13. Yuan J, Song Z, Sun M, et al. Dual Sparse Attention Network For Session-based Recommendation; proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, F, 2021 [C]

  14. He X, Deng K, Wang X et al (2020) Lightgcn: Simplifying and powering graph convolution network for recommendation; proceedings of the Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, F, [C]

  15. Mao K, Zhu J, Xiao X et al (2021) UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendation; proceedings of the Proceedings of the 30th ACM International Conference on Information & Knowledge Management, F, [C]

  16. Mao K, Zhu J, Wang J et al (2021) SimpleX: A Simple and Strong Baseline for Collaborative Filtering; proceedings of the Proceedings of the 30th ACM International Conference on Information & Knowledge Management, F, [C]

  17. Gao Z, Cheng Z, Pérez F et al (2022) MCL: Mixed-centric loss for collaborative filtering. In: Proceedings of the ACM Web Conference 2022, pp 2339–2347

  18. Yang Z, Ding M, Zou X et al (2022) Region or global A principle for negative sampling in graph-based recommendation. IEEE Transactions on Knowledge and Data Engineering

  19. He K, Fan H, Wu Y et al (2020) Momentum contrast for unsupervised visual representation learning; proceedings of the Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, F, [C]

  20. He K, Chen X, Xie S et al (2022) Masked auto encoders are scalable vision learners. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 16000–16009

  21. Chen T, Kornblith S, Norouzi M et al (2020) A simple framework for contrastive learning of visual representations; proceedings of the International conference on machine learning, F, [C]. PMLR

  22. Sang S, Liu N, Li W et al (2022) High-order attentive graph neural network for session-based recommendation [J]. Appl Intell 52:16975–16989

    Article  Google Scholar 

  23. Sedhain S, Menon A K, Sanner S et al (2015) Autorec: Autoencoders meet collaborative filtering; proceedings of the Proceedings of the 24th international conference on World Wide Web, F, [C]

  24. Li S, Kawale J, Fu Y (2015) Deep collaborative filtering via marginalized denoising auto-encoder; proceedings of the Proceedings of the 24th ACM international on conference on information and knowledge management, F, [C]

  25. Wu Y, Dubois C, Zheng AX et al (2016) Collaborative denoising auto-encoders for top-n recommender systems; proceedings of the Proceedings of the ninth ACM international conference on web search and data mining, F, [C]

  26. Liang D, Krishnan RG, Hoffman MD et al (2018) Variational autoencoders for collaborative filtering; proceedings of the Proceedings of the 2018 world wide web conference, F, [C]

  27. Zhou W, Lee D-H, Selvam RK, Lee S, Lin BY, Ren X (2021) Pre-training text-to-text transformers for concept-centric common sense. International Conference for Learning Representation

  28. Oord A, Li Y, Vinyals O (2018) Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748

  29. Zhou K, Wang H, Zhao WX et al (2020) S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization; proceedings of the Proceedings of the 29th ACM International Conference on Information & Knowledge Management, F, [C]

  30. Wu J, Wang X, Feng F et al (2021) Self-supervised graph learning for recommendation; proceedings of the Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, F, [C]

  31. Luo J, Zhang X (2022) Convolutional neural network based on attention mechanism and Bi-LSTM for bearing remaining life prediction [J]. Appl Intell 52(1):1076–1091

    Article  Google Scholar 

  32. Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need; proceedings of the Advances in neural information processing systems, F, [C]

  33. Yao T, Yi X, Cheng DZ et al (2021) Self-supervised Learning for Large-scale Item Recommendations; proceedings of the Proceedings of the 30th ACM International Conference on Information & Knowledge Management, F, [C]

  34. Zhuo J, Zhu Q, Yue Y et al (2022) Learning explicit user interest boundary for recommendation. In: Proceedings of the ACM Web Conference 2022, pp 193–202

  35. Wang X, He X, Wang M et al (2019) Neural graph collaborative filtering; proceedings of the Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval, F, [C]

  36. Ren P, Chen Z, Li J et al (2019) Repeatnet: A repeat aware neural recommendation machine for session-based recommendation; proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, F, [C]

  37. Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations; proceedings of the Proceedings of the 1st workshop on deep learning for recommender systems, F, [C]

  38. Yu F, Zhu Y, Liu Q et al (2020) TAGNN: Target attentive graph neural networks for session-based recommendation; proceedings of the Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, F, [C]

  39. Wang Z, Wei W, Cong G et al. (2020) Global context enhanced graph neural networks for session-based recommendation; proceedings of the Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, F, [C]

  40. Vo DV, Tran TT, Shirai K et al (2022) Deep generative networks coupled with evidential reasoning for dynamic user preferences using short texts. IEEE Transactions on Knowledge and Data Engineering

  41. Liang S, Ren Z, Zhao Y et al (2017) Inferring dynamic user interests in streams of short texts for user clustering [J]. ACM Trans Inf Syst 36(1):1–37

    Google Scholar 

  42. Sarwar B, Karypis G, Konstan J et al (2001) Item-based collaborative filtering recommendation algorithms; proceedings of the Proceedings of the 10th international conference on World Wide Web, F, [C]

  43. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation; proceedings of the Proceedings of the 19th international conference on World wide web, F, [C]

  44. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. ICLR

  45. Li J, Ren P, Chen Z et al (2017) Neural attentive session-based recommendation; proceedings of the Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, F, [C]

  46. Wang J, Ding K, Zhu Z et al (2021) Session-based recommendation with hypergraph attention networks; proceedings of the Proceedings of the 2021 SIAM international conference on data mining (SDM), F, [C]. SIAM

  47. Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding; proceedings of the Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, F, [C]

  48. Chen F, Wang YC, Wang B et al (2020) Graph representation learning: a survey. APSIPA Transactions on Signal and Information Processing:9

  49. Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis [J]. J Comput Appl Math 20:53–65

    Article  MATH  Google Scholar 

  50. Holzinger A, Saranti A, Molnar C et al (2022) Explainable AI methods-a brief overview; proceedings of the International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers, F, [C]. Springer

  51. Holzinger A, Malle B, Saranti A et al (2021) Towards multi-modal causability with graph neural networks enabling information fusion for explainable AI [J]. Inf Fusion 71:28–37

    Article  Google Scholar 

Download references

Acknowledgments

This paper is partially supported by the National Natural Science Foundation of China (61902221, 62177031), the Natural Science Foundation of Shandong Province (ZR2021MF099, ZR2022MF334), and Undergraduate Education Reform Project of Shandong Province (M2021130).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Shandong Jianzhu University, Jinan, 250001, Shandong, China

    Jiuqian Dai, Weihua Yuan, Chen Bao & Zhijun Zhang

Authors
  1. Jiuqian Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weihua Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chen Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhijun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhijun Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Jiuqian Dai and Weihua Yuan these authors contributed to the work equally and should be regarded as co-first authors

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dai, J., Yuan, W., Bao, C. et al. DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations. Appl Intell 53, 17292–17309 (2023). https://doi.org/10.1007/s10489-022-04399-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-04399-y

Keywords

Search

Navigation