Skip to main content
Log in

Mining multiple sequential patterns through multi-graph representation for next point-of-interest recommendation

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Next point-of-interest (POI) recommendation is important for users to help them find interesting venues to visit in the near future. Most previous work on this subject has incorporated geographical and temporal information into sequential patterns to predict next POIs. However, few studies have considered the influence of important factors such as users’ reviews or POIs’ popularity on sequential patterns, nor distinguished between factors of different importance for prediction. In addition, the relationships between entities in location-based social networks have been ignored in most previous work. To overcome these limitations, we proposed a model called MGCAN to flexibly incorporate various influential factors into different sequential patterns for next POI recommendation. We first used multiple graph convolutional networks and independent attention networks to model multiple sequential patterns with different influential factors. Furthermore, we designed corresponding modules to simultaneously capture general preferences of users and determine the impact of different influential factors on each user. Finally, we used multiple sequential patterns and the general preferences of users in the prediction module to predict the next POI. Experimental results on two datasets showed that the MGCAN model achieved better recommendation performance than benchmark models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Seo, Y. -D., Cho, Y. -S.: Point of interest recommendations based on the anchoring effect in location-based social network services. Expert Syst. Appl. 114018, 164 (2021)

    Google Scholar 

  2. Qiao, S., Han, N., Zhou, J., Li, R. -H., Jin, C., Gutierrez, L. A.: Socialmix: a familiarity-based and preference-aware location suggestion approach. Eng. Appl. Artif. Intel. 68, 192–204 (2018). https://doi.org/10.1016/j.engappai.2017.11.006

    Article  Google Scholar 

  3. Yang, K., Zhu, J.: Next poi recommendation via graph embedding representation from h-deepwalk on hybrid network. IEEE Access 7, 171105–171113 (2019)

    Article  Google Scholar 

  4. Aliannejadi, M., Rafailidis, D., Crestani, F.: A joint two-phase time-sensitive regularized collaborative ranking model for point of interest recommendation. IEEE Trans. Knowl. Data Eng. 32, 1050–1063 (2020)

    Article  Google Scholar 

  5. Mingxin, G., Ling, G.: Discovering memory-based preferences for poi recommendation in location-based social networks. ISPRS International Journal of Geo-Information, 8 (2019)

  6. Wang, W., Chen, J., Wang, J., Chen, J., Gong, Z.: Geography-aware inductive matrix completion for personalized point-of-interest recommendation in smart cities. IEEE Internet Things J. 7, 4361–4370 (2020)

    Article  Google Scholar 

  7. Jiao, X., Xiao, Y., Zheng, W., Wang, H., Hsu, C. -H.: A novel next new point-of-interest recommendation system based on simulated user travel decision-making process. Futur. Gener. Comput. Syst. 100, 982–993 (2019)

    Article  Google Scholar 

  8. Yu, F., Cui, L., Guo, W., Lu, X., Li, Q., Lu, H.: A category-aware deep model for successive poi recommendation on sparse check-in data. In: Proceedings of The Web Conference 2020. WWW ’20, pp. 1264–1274. Association for Computing Machinery (2020)

  9. Cheng, C., Yang, H., Lyu, M. R., King, I.: Where you like to go next: Successive point-of-interest recommendation. In: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. IJCAI ’13, pp. 2605–2611 (2013)

  10. Cui, Q., Tang, Y., Wu, S., Wang, L.: Distance2pre: Personalized spatial preference for next point-of-interest prediction. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 289–301. Springer (2019)

  11. Wu, Y., Li, K., Zhao, G., Qian, X.: Long-and short-term preference learning for next poi recommendation. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2301–2304 (2019)

  12. Zhu, Y., Li, H., Liao, Y., Wang, B., Guan, Z., Liu, H., Cai, D.: What to do next: Modeling user behaviors by time-lstm. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, pp. 3602–3608 (2017)

  13. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., Polosukhin, I.: Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS’17, pp. 6000–6010. Curran Associates Inc. (2017)

  14. Kang, W. -C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206 (2018)

  15. Wu, J., Cai, R., Wang, H.: Déjà vu: a contextualized temporal attention mechanism for sequential recommendation. In: Proceedings of The Web Conference 2020, pp. 2199–2209 (2020)

  16. Ji, M., Joo, W., Song, K., Kim, Y. -Y., Moon, I. -C.: Sequential recommendation with relation-aware kernelized self-attention. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 4304–4311 (2020)

  17. Gao, R., Li, J., Li, X., Song, C., Chang, J., Liu, D., Wang, C.: Stscr: Exploring spatial-temporal sequential influence and social information for location recommendation. Neurocomputing 319, 118–133 (2018)

    Article  Google Scholar 

  18. Hosseini, S., Yin, H., Zhou, X., Sadiq, S., Kangavari, M. R., Cheung, N. -M.: Leveraging multi-aspect time-related influence in location recommendation. World Wide Web 22(3), 1001–1028 (2019)

    Article  Google Scholar 

  19. Han, H., Zhang, M., Hou, M., Zhang, F., Wang, Z., Chen, E., Wang, H., Ma, J., Liu, Q.: Stgcn: A spatial-temporal aware graph learning method for poi recommendation. In: 2020 IEEE International Conference on Data Mining (ICDM), pp. 1052–1057. IEEE (2020)

  20. Zhong, T., Zhang, S., Zhou, F., Zhang, K., Trajcevski, G., Wu, J.: Hybrid graph convolutional networks with multi-head attention for location recommendation. World Wide Web 23(6), 3125–3151 (2020)

    Article  Google Scholar 

  21. Zhao, P., Luo, A., Liu, Y., Zhuang, F., Xu, J., Li, Z., Sheng, V. S., Zhou, X.: Where to go next: A spatio-temporal gated network for next poi recommendation. IEEE Transactions on Knowledge and Data Engineering (2020)

  22. Cui, Q., Zhang, C., Zhang, Y., Wang, J., Cai, M.: St-pil: Spatial-temporal periodic interest learning for next point-of-interest recommendation. arXiv:2104.02262 (2021)

  23. Liu, T., Liao, J., Wu, Z., Wang, Y., Wang, J.: Exploiting geographical-temporal awareness attention for next point-of-interest recommendation. Neurocomputing 400, 227–237 (2020)

    Article  Google Scholar 

  24. Ye, M., Yin, P., Lee, W. -C., Lee, D. -L.: Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 325–334 (2011)

  25. Cai, L., Wen, W., Wu, B., Yang, X.: A coarse-to-fine user preferences prediction method for point-of-interest recommendation. Neurocomputing 422, 1–11 (2021)

    Article  Google Scholar 

  26. Liu, W., Wang, Z. -J., Yao, B., Yin, J.: Geo-Alm: Poi recommendation by fusing geographical information and adversarial learning mechanism. In: IJCAI, vol. 7, pp. 1807–1813 (2019)

  27. Zhang, J. -D., Chow, C. -Y., Li, Y.: Lore: Exploiting sequential influence for location recommendations. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. SIGSPATIAL ’14, pp. 103–112. Association for Computing Machinery. https://doi.org/10.1145/2666310.2666400(2014)

  28. Feng, S., Li, X., Zeng, Y., Cong, G., Chee, Y. M., Yuan, Q.: Personalized ranking metric embedding for next new poi recommendation. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)

  29. Zhao, S., Zhao, T., Yang, H., Lyu, M. R., King, I.: Stellar: Spatial-temporal latent ranking for successive point-of-interest recommendation. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. AAAI’16, pp. 315–321 (2016)

  30. Chang, B., Park, Y., Park, D., Kim, S., Kang, J.: Content-aware hierarchical point-of-interest embedding model for successive poi recommendation. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence. IJCAI’18, pp. 3301–3307. AAAI Press (2018)

  31. Zhang, S., Xiong, H., Computer, S. O.: Geo-social-temporal sequential embedding rank for point-of-interest recommendation. Appl. Res. Comput. 36, 2618–2624 (2019)

    Google Scholar 

  32. Gan, M., Cui, H.: Exploring user movie interest space: a deep learning based dynamic recommendation model. Expert Syst. Appl. 173, 114695 (2021). https://doi.org/10.1016/j.eswa.2021.114695

    Article  Google Scholar 

  33. Zhang, J., Mu, X., Zhao, P., Kang, K., Ma, C.: Improving current interest with item and review sequential patterns for sequential recommendation. Eng. Appl. Artif. Intel. 104, 104348 (2021). https://doi.org/10.1016/j.engappai.2021.104348

    Article  Google Scholar 

  34. Sun, K., Qian, T., Chen, T., Liang, Y., Yin, H.: Where to go next: Modeling long- and short-term user preferences for point-of-interest recommendation. Proc. AAAI Conf. Artif. Intell. 34(1), 214–221 (2020)

    Google Scholar 

  35. Manotumruksa, J., Macdonald, C., Ounis, I.: A contextual recurrent collaborative filtering framework for modelling sequences of venue checkins. Inf. Process. Manag. 57(6), 102092 (2020)

    Article  Google Scholar 

  36. Ma, Y., Gan, M.: Deepassociate: a deep learning model exploring sequential influence and history-candidate association for sequence recommendation. Expert Syst. Appl. 115587, 185 (2021). https://doi.org/10.1016/j.eswa.2021.115587

    Google Scholar 

  37. Liu, T., Liao, J., Wu, Z., Wang, Y., Wang, J.: A geographical-temporal awareness hierarchical attention network for next point-of-interest recommendation. In: Proceedings of the 2019 on International Conference on Multimedia Retrieval. ICMR ’19, pp. 7–15. Association for Computing Machinery (2019)

  38. Zhao, K., Zhang, Y., Yin, H., Wang, J., Zheng, K., Zhou, X., Xing, C.: Discovering subsequence patterns for next poi recommendation. In: Bessiere, C (ed.) Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, pp. 3216–3222. International Joint Conferences on Artificial Intelligence Organization, Ma (2020)

  39. Ren, R., Liu, Z., Li, Y., Zhao, W. X., Wang, H., Ding, B., Wen, J. -R.: Sequential recommendation with self-attentive multi-adversarial network. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 89–98 (2020)

  40. Li, Z., Cheng, W., Xiao, H., Yu, W., Chen, H., Wang, W.: You are what and where you are: Graph enhanced attention network for explainable poi recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3945–3954 (2021)

  41. Wang, W. X. X. Z. Y. D. D. S. X. G. D.: Attentive sequential model based on graph neural network for next poi recommendation. World Wide Web 24, 2161–2184 (2021). https://doi.org/10.1007/s11280-021-00961-9

    Article  Google Scholar 

  42. Xu, Y., Li, X., Li, J., Wang, C., Gao, R., Yu, Y.: Ssser: Spatiotemporal sequential and social embedding rank for successive point-of-interest recommendation. IEEE Access 7, 156804–156823 (2019). https://doi.org/10.1109/ACCESS.2019.2950061

    Article  Google Scholar 

  43. Liu, Y., Pei, A., Wang, F., Yang, Y., Zhang, X., Wang, H., Dai, H., Qi, L., Ma, R.: An attention-based category-aware gru model for the next poi recommendation. International Journal of Intelligent Systems (2021)

  44. Zang, H., Han, D., Li, X., Wan, Z., Wang, M.: Cha: Categorical hierarchy-based attention for next poi recommendation. ACM Trans. Inf. Syst. (TOIS) 40(1), 1–22 (2021)

    Article  Google Scholar 

  45. Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., Vandergheynst, P.: Geometric deep learning: going beyond euclidean data. IEEE Signal Process. Mag. 34(4), 18–42 (2017)

    Article  Google Scholar 

  46. Kipf, T. N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv:1609.02907 (2016)

  47. Marcheggiani, D., Bastings, J., Titov, I.: Exploiting semantics in neural machine translation with graph convolutional networks. arXiv:1804.08313(2018)

  48. Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv:1709.04875(2017)

  49. Alex Fout, J.B.S.: Protein interface prediction using graph convolutional networks (2018)

  50. Li, S., Pan, X.: A computational drug repositioning model based on hybrid similarity side information powered graph neural network. Futur. Gener. Comput. Syst. 125, 24–31 (2021)

    Article  Google Scholar 

  51. Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W. L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974–983 (2018)

  52. Wu, Q., Zhang, H., Gao, X., He, P., Weng, P., Gao, H., Chen, G.: Dual Graph Attention Networks for Deep Latent Representation of Multifaceted Social Effects in Recommender Systems. In: The World Wide Web Conference. WWW ’19, pp. 2091–2102. Association for Computing Machinery (2019)

  53. Qian, T., Liang, Y., Li, Q.: Solving cold start problem in recommendation with attribute graph neural networks. arXiv:1912.12398 (2019)

  54. Ji, Z., Wu, M., Yang, H., Íñigo, J.E.A.: Temporal sensitive heterogeneous graph neural network for news recommendation. Futur. Gener. Comput. Syst. 125, 324–333 (2021)

    Article  Google Scholar 

  55. Dong, Y., Chawla, N. V., Swami, A.: Metapath2vec: Scalable representation learning for heterogeneous networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’17, pp. 135–144. Association for Computing Machinery (2017)

  56. Zhou, C., Bai, J., Song, J., Liu, X., Zhao, Z., Chen, X., Gao, J.: Atrank: an attention-based user behavior modeling framework for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)

  57. Maas, A.L., Hannun, A.Y., Ng, A.Y., et al: Rectifier nonlinearities improve neural network acoustic models. In: Proc. Icml, vol. 30, p. 3. Citeseer (2013)

  58. Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196. PMLR (2014)

  59. Si, Y., Zhang, F., Liu, W.: An adaptive point-of-interest recommendation method for location-based social networks based on user activity and spatial features. Knowl.-Based Syst. 163, 267–282 (2019)

    Article  Google Scholar 

  60. Tang, J., Belletti, F., Jain, S., Chen, M., Beutel, A., Xu, C., Chi, H. E.: Towards neural mixture recommender for long range dependent user sequences. In: The World Wide Web Conference, Pp. 1782–1793 (2019)

  61. Zhao, P., Zhu, H., Liu, Y., Li, Z., Xu, J., Sheng, V. S.: Where to go next: A spatio-temporal lstm model for next poi recommendation. arXiv:1806.06671 (2018)

  62. Yuan, F., Karatzoglou, A., Arapakis, I., Jose, J. M., He, X.: A simple convolutional generative network for next item recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 582–590 (2019)

  63. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  64. Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: Bpr: Bayesian personalized ranking from implicit feedback. arXiv:1205.2618 (2012)

  65. Cheng, C., Yang, H., King, I., Lyu, M.: Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 26 (2012)

  66. Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 194–200 (2016)

  67. Li, R., Shen, Y., Zhu, Y.: Next point-of-interest recommendation with temporal and multi-level context attention. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 1110–1115. https://doi.org/10.1109/ICDM.2018.00144 (2018)

  68. Huang, L., Ma, Y., Wang, S., Liu, Y.: An attention-based spatiotemporal lstm network for next poi recommendation. IEEE Trans. Serv. Comput., 1–1. https://doi.org/10.1109/TSC.2019.2918310 (2019)

Download references

Acknowledgements

This research was supported in part by the National Natural Science Foundation of China, under Grants Nos. 71871019, 71471016.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mingxin Gan.

Ethics declarations

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Caiping Tan contributed equally to this work.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gan, M., Tan, C. Mining multiple sequential patterns through multi-graph representation for next point-of-interest recommendation. World Wide Web 26, 1345–1370 (2023). https://doi.org/10.1007/s11280-022-01094-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-022-01094-3

Keywords

Navigation