Skip to main content
Log in

Dynamic time-aware collaborative sequential recommendation with attention-based network

  • Regular paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

A natural way of user modeling in sequential recommendation is to capture long-term and short-term preferences, respectively, given user historical behaviors and then fuse them together. Most existing approaches building on attention-based network focus only on exploring item–item relations within each user sequence and ignore collaborative relations among different user sequences, which restricts the improvement of recommendation quality, especially on sparse datasets. Moreover, construction and utilization of collaborative signals including the integration with the original information greatly impact the recommendation effects. In this paper, we propose a novel method named dynamic time-aware collaborative sequential recommendation with attention-based network(DTCoSR) to further address the issues. Specifically, we first design a time-aware collaborative item module to gain collaborative item representations for both long- and short-term interests, consisting of neighborhood selection and neighborhood information aggregation. Then, we utilize two independent self-attention networks to extract the two different levels of short-term interests dependent on the item representation and collaborative item representation, respectively, and then adaptively merge them as the final short-term interests. We achieve long-term interest via the correlation between the user embedding and its collaborative item embedding. Finally, DTCoSR fuses long- and short-term interests in an adaptive method. Extensive experiments on three real-world datasets show that DTCoSR outperforms state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Availability of supporting data

The data that support the findings of this study are available from websites http://jmcauley.ucsd.edu/data/amazon/ and https://grouplens.org/datasets/movielens/.

Notes

  1. http://jmcauley.ucsd.edu/data/amazon/.

  2. https://grouplens.org/datasets/movielens/.

References

  1. Wang S, Hu L, Wang Y, Cao L, Sheng QZ, Orgun M (2019) Sequential recommender systems: challenges, progress and prospects. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI-19, pp 6332–6338. https://doi.org/10.24963/ijcai.2019/883

  2. He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM), pp 191–200. https://doi.org/10.1109/ICDM.2016.0030

  3. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820. https://doi.org/10.1145/1772690.1772773

  4. Wang D, Xu D, Yu D, Xu G (2021) Time-aware sequence model for next-item recommendation. Appl Intell 51:906–920. https://doi.org/10.1145/3336191.3371786

    Article  Google Scholar 

  5. Wu C-Y, Ahmed A, Beutel A, Smola AJ, Jing H (2017) Recurrent recommender networks. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 495–503. https://doi.org/10.1145/3018661.3018689

  6. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939. https://doi.org/10.48550/arXiv.1511.06939

  7. Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 17–22. https://doi.org/10.1145/2988450.2988452

  8. Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv (CSUR) 52(1):1–38. https://doi.org/10.1145/3285029

    Article  ADS  Google Scholar 

  9. Loyola P, Liu C, Hirate Y (2017) Modeling user session and intent with an attention-based encoder-decoder architecture. In: Proceedings of the eleventh ACM conference on recommender systems, pp 147–151. https://doi.org/10.1145/3109859.3109917

  10. Zhou G, Mou N, Fan Y, Pi Q, Bian W, Zhou C, Zhu X, Gai K (2019) Deep interest evolution network for click-through rate prediction. In: Proceedings of the AAAI conference on artificial intelligence, vol. 33, pp 5941–5948. https://doi.org/10.1609/aaai.v33i01.33015941

  11. Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM), pp 197–206. https://doi.org/10.1109/ICDM.2018.00035

  12. Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839. https://doi.org/10.1145/3219819.3219950

  13. Yu Z, Lian J, Mahmoody A, Liu G, Xie X (2019) Adaptive user modeling with long and short-term preferences for personalized recommendation. In: IJCAI, pp 4213–4219. https://doi.org/10.24963/ijcai.2019/585

  14. Lei J, Li Y, Yang S, Shi W, Wu Y (2022) Two-stage sequential recommendation for side information fusion and long-term and short-term preferences modeling. J Intell Inf Syst. https://doi.org/10.1007/s10844-022-00723-7

    Article  Google Scholar 

  15. Yu D, Chen J, Wang D, Xu Y, Xiang Z, Deng S (2022) Dsim: dynamic and static interest mining for sequential recommendation. Knowl Inf Syst 64(8):2267–2288. https://doi.org/10.1007/s10115-022-01715-3

    Article  Google Scholar 

  16. Lin J, Pan W, Ming Z (2020) Fissa: fusing item similarity models with self-attention networks for sequential recommendation. In: Proceedings of the 14th ACM conference on recommender systems, pp 130–139. https://doi.org/10.1145/3383313.3412247

  17. Zheng Y, Gao C, Chang J, Niu Y, Song Y, Jin D, Li Y (2022) Disentangling long and short-term interests for recommendation. In: Proceedings of the ACM web conference 2022, pp 2256–2267. https://doi.org/10.1145/3485447.3512098

  18. Zhang S, Tay Y, Yao L, Sun A, An J (2019) Next item recommendation with self-attentive metric learning. In: Thirty-third AAAI conference on artificial intelligence, vol. 9. https://doi.org/10.48550/arXiv.1808.06414

  19. Liu C, Li X, Cai, G, Dong Z, Zhu H, Shang L (2021) Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol. 35, pp 4249–4256. https://doi.org/10.1609/aaai.v35i5.16549

  20. Xie Y, Zhou P, Kim S (2022) Decoupled side information fusion for sequential recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, pp. 1611–1621

  21. Zhang M, Wu S, Yu X, Liu Q, Wang L (2022) Dynamic graph neural networks for sequential recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3151618

    Article  PubMed  Google Scholar 

  22. Chi H, Xu H, Fu H, Liu M, Zhang M, Yang Y, Hao Q, Wu W (2022) Long short-term preference modeling for continuous-time sequential recommendation. arXiv preprint arXiv:2208.00593. https://doi.org/10.48550/arXiv.2208.00593

  23. Luo A, Zhao P, Liu Y, Zhuang F, Wang D, Xu J, Fang J, Sheng VS (2020) Collaborative self-attention network for session-based recommendation. In: IJCAI, pp 2591–2597. https://doi.org/10.24963/ijcai.2020/359

  24. Bogina V, Kuflik T (2017) Incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecTemp@ RecSys, pp 57–59. https://ceur-ws.org/Vol-1922/paper11.pdf

  25. Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 1419–1428. https://doi.org/10.1145/3132847.3132926

  26. Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450. https://doi.org/10.1145/3357384.3357895

  27. Li Y, Chen T, Zhang P-F, Yin H (2021) Lightweight self-attentive sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 967–977. https://doi.org/10.1145/3459637.3482448

  28. Lin Z, Zang S, Wang R, Sun Z, Senthilnath J, Xu C, Kwoh CK (2022) Attention over self-attention: intention-aware re-ranking with dynamic transformer encoders for recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3208633

    Article  Google Scholar 

  29. Fan Z, Liu Z, Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference, pp 2036–2047. https://doi.org/10.1145/3485447.3512077

  30. Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330. https://doi.org/10.1145/3336191.3371786

  31. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) Bpr: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618

  32. Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, pp. 659–667

  33. Lin Zhuoyi, Feng Lei, Yin Rui, Xu Chi, Kwoh Chee Keong (2021) GLIMG: global and local item graphs for top-N recommender systems. Inf Sci 580:1–14. https://doi.org/10.1016/j.ins.2021.08.018

    Article  MathSciNet  Google Scholar 

  34. Chang J, Gao C, Zheng Y, Hui Y, Niu Y, Song Y, Jin D, Li Y (2021) Sequential recommendation with graph neural networks. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pp. 378–387. https://doi.org/10.1145/3404835.3462968

  35. Bai B, Zhang G, Lin Y, Li H, Bai K, Luo B (2020) Csrn: collaborative sequential recommendation networks for news retrieval. arXiv preprint arXiv:2004.04816

  36. Wang M, Ren P, Mei L, Chen Z, Ma J, De Rijke M (2019) A collaborative session-based recommendation approach with parallel memory modules. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 345–354. https://doi.org/10.1145/3331184.3331210

  37. McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52. https://doi.org/10.1145/2766462.2767755

Download references

Acknowledgements

This research is supported by Education Research Project of Young and Middle-aged Teachers of the Education Department of Fujian Province (JAT210420).

Funding

This research is supported by Education Research Project of Young and Middle-aged Teachers of the Education Department of Fujian Province (JAT210420).

Author information

Authors and Affiliations

Authors

Contributions

LL is the only author and finishes the whole article independently.

Corresponding author

Correspondence to Li Liu.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Ethical approval

The research involves no human participants and/or animals.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, L. Dynamic time-aware collaborative sequential recommendation with attention-based network. Knowl Inf Syst 66, 1639–1655 (2024). https://doi.org/10.1007/s10115-023-01996-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-023-01996-2

Keywords

Navigation