Abstract
A natural way of user modeling in sequential recommendation is to capture long-term and short-term preferences, respectively, given user historical behaviors and then fuse them together. Most existing approaches building on attention-based network focus only on exploring item–item relations within each user sequence and ignore collaborative relations among different user sequences, which restricts the improvement of recommendation quality, especially on sparse datasets. Moreover, construction and utilization of collaborative signals including the integration with the original information greatly impact the recommendation effects. In this paper, we propose a novel method named dynamic time-aware collaborative sequential recommendation with attention-based network(DTCoSR) to further address the issues. Specifically, we first design a time-aware collaborative item module to gain collaborative item representations for both long- and short-term interests, consisting of neighborhood selection and neighborhood information aggregation. Then, we utilize two independent self-attention networks to extract the two different levels of short-term interests dependent on the item representation and collaborative item representation, respectively, and then adaptively merge them as the final short-term interests. We achieve long-term interest via the correlation between the user embedding and its collaborative item embedding. Finally, DTCoSR fuses long- and short-term interests in an adaptive method. Extensive experiments on three real-world datasets show that DTCoSR outperforms state-of-the-art methods.
Similar content being viewed by others
Availability of supporting data
The data that support the findings of this study are available from websites http://jmcauley.ucsd.edu/data/amazon/ and https://grouplens.org/datasets/movielens/.
References
Wang S, Hu L, Wang Y, Cao L, Sheng QZ, Orgun M (2019) Sequential recommender systems: challenges, progress and prospects. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI-19, pp 6332–6338. https://doi.org/10.24963/ijcai.2019/883
He R, McAuley J (2016) Fusing similarity models with Markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mining (ICDM), pp 191–200. https://doi.org/10.1109/ICDM.2016.0030
Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820. https://doi.org/10.1145/1772690.1772773
Wang D, Xu D, Yu D, Xu G (2021) Time-aware sequence model for next-item recommendation. Appl Intell 51:906–920. https://doi.org/10.1145/3336191.3371786
Wu C-Y, Ahmed A, Beutel A, Smola AJ, Jing H (2017) Recurrent recommender networks. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 495–503. https://doi.org/10.1145/3018661.3018689
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939. https://doi.org/10.48550/arXiv.1511.06939
Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: Proceedings of the 1st workshop on deep learning for recommender systems, pp 17–22. https://doi.org/10.1145/2988450.2988452
Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv (CSUR) 52(1):1–38. https://doi.org/10.1145/3285029
Loyola P, Liu C, Hirate Y (2017) Modeling user session and intent with an attention-based encoder-decoder architecture. In: Proceedings of the eleventh ACM conference on recommender systems, pp 147–151. https://doi.org/10.1145/3109859.3109917
Zhou G, Mou N, Fan Y, Pi Q, Bian W, Zhou C, Zhu X, Gai K (2019) Deep interest evolution network for click-through rate prediction. In: Proceedings of the AAAI conference on artificial intelligence, vol. 33, pp 5941–5948. https://doi.org/10.1609/aaai.v33i01.33015941
Kang W-C, McAuley J (2018) Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM), pp 197–206. https://doi.org/10.1109/ICDM.2018.00035
Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839. https://doi.org/10.1145/3219819.3219950
Yu Z, Lian J, Mahmoody A, Liu G, Xie X (2019) Adaptive user modeling with long and short-term preferences for personalized recommendation. In: IJCAI, pp 4213–4219. https://doi.org/10.24963/ijcai.2019/585
Lei J, Li Y, Yang S, Shi W, Wu Y (2022) Two-stage sequential recommendation for side information fusion and long-term and short-term preferences modeling. J Intell Inf Syst. https://doi.org/10.1007/s10844-022-00723-7
Yu D, Chen J, Wang D, Xu Y, Xiang Z, Deng S (2022) Dsim: dynamic and static interest mining for sequential recommendation. Knowl Inf Syst 64(8):2267–2288. https://doi.org/10.1007/s10115-022-01715-3
Lin J, Pan W, Ming Z (2020) Fissa: fusing item similarity models with self-attention networks for sequential recommendation. In: Proceedings of the 14th ACM conference on recommender systems, pp 130–139. https://doi.org/10.1145/3383313.3412247
Zheng Y, Gao C, Chang J, Niu Y, Song Y, Jin D, Li Y (2022) Disentangling long and short-term interests for recommendation. In: Proceedings of the ACM web conference 2022, pp 2256–2267. https://doi.org/10.1145/3485447.3512098
Zhang S, Tay Y, Yao L, Sun A, An J (2019) Next item recommendation with self-attentive metric learning. In: Thirty-third AAAI conference on artificial intelligence, vol. 9. https://doi.org/10.48550/arXiv.1808.06414
Liu C, Li X, Cai, G, Dong Z, Zhu H, Shang L (2021) Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the AAAI conference on artificial intelligence, vol. 35, pp 4249–4256. https://doi.org/10.1609/aaai.v35i5.16549
Xie Y, Zhou P, Kim S (2022) Decoupled side information fusion for sequential recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, pp. 1611–1621
Zhang M, Wu S, Yu X, Liu Q, Wang L (2022) Dynamic graph neural networks for sequential recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3151618
Chi H, Xu H, Fu H, Liu M, Zhang M, Yang Y, Hao Q, Wu W (2022) Long short-term preference modeling for continuous-time sequential recommendation. arXiv preprint arXiv:2208.00593. https://doi.org/10.48550/arXiv.2208.00593
Luo A, Zhao P, Liu Y, Zhuang F, Wang D, Xu J, Fang J, Sheng VS (2020) Collaborative self-attention network for session-based recommendation. In: IJCAI, pp 2591–2597. https://doi.org/10.24963/ijcai.2020/359
Bogina V, Kuflik T (2017) Incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecTemp@ RecSys, pp 57–59. https://ceur-ws.org/Vol-1922/paper11.pdf
Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 1419–1428. https://doi.org/10.1145/3132847.3132926
Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P (2019) Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1441–1450. https://doi.org/10.1145/3357384.3357895
Li Y, Chen T, Zhang P-F, Yin H (2021) Lightweight self-attentive sequential recommendation. In: Proceedings of the 30th ACM international conference on information & knowledge management, pp 967–977. https://doi.org/10.1145/3459637.3482448
Lin Z, Zang S, Wang R, Sun Z, Senthilnath J, Xu C, Kwoh CK (2022) Attention over self-attention: intention-aware re-ranking with dynamic transformer encoders for recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2022.3208633
Fan Z, Liu Z, Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu PS (2022) Sequential recommendation via stochastic self-attention. In: Proceedings of the ACM web conference, pp 2036–2047. https://doi.org/10.1145/3485447.3512077
Li J, Wang Y, McAuley J (2020) Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, pp 322–330. https://doi.org/10.1145/3336191.3371786
Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2012) Bpr: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618
Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, pp. 659–667
Lin Zhuoyi, Feng Lei, Yin Rui, Xu Chi, Kwoh Chee Keong (2021) GLIMG: global and local item graphs for top-N recommender systems. Inf Sci 580:1–14. https://doi.org/10.1016/j.ins.2021.08.018
Chang J, Gao C, Zheng Y, Hui Y, Niu Y, Song Y, Jin D, Li Y (2021) Sequential recommendation with graph neural networks. In: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pp. 378–387. https://doi.org/10.1145/3404835.3462968
Bai B, Zhang G, Lin Y, Li H, Bai K, Luo B (2020) Csrn: collaborative sequential recommendation networks for news retrieval. arXiv preprint arXiv:2004.04816
Wang M, Ren P, Mei L, Chen Z, Ma J, De Rijke M (2019) A collaborative session-based recommendation approach with parallel memory modules. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 345–354. https://doi.org/10.1145/3331184.3331210
McAuley J, Targett C, Shi Q, Van Den Hengel A (2015) Image-based recommendations on styles and substitutes. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval, pp 43–52. https://doi.org/10.1145/2766462.2767755
Acknowledgements
This research is supported by Education Research Project of Young and Middle-aged Teachers of the Education Department of Fujian Province (JAT210420).
Funding
This research is supported by Education Research Project of Young and Middle-aged Teachers of the Education Department of Fujian Province (JAT210420).
Author information
Authors and Affiliations
Contributions
LL is the only author and finishes the whole article independently.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare that are relevant to the content of this article.
Ethical approval
The research involves no human participants and/or animals.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, L. Dynamic time-aware collaborative sequential recommendation with attention-based network. Knowl Inf Syst 66, 1639–1655 (2024). https://doi.org/10.1007/s10115-023-01996-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-023-01996-2