Yifang Qin
Skip Abstract Section
Abstract
Next Point-of-Interest (POI) recommendation is a critical task in location-based services that aim to provide personalized suggestions for the user’s next destination. Previous works on POI recommendation have laid focus on modeling the user’s spatial preference. However, existing works that leverage spatial information are only based on the aggregation of users’ previous visited positions, which discourages the model from recommending POIs in novel areas. This trait of position-based methods will harm the model’s performance in many situations. Additionally, incorporating sequential information into the user’s spatial preference remains a challenge. In this article, we propose Diff-POI: a Diffusion-based model that samples the user’s spatial preference for the next POI recommendation. Inspired by the wide application of diffusion algorithm in sampling from distributions, Diff-POI encodes the user’s visiting sequence and spatial character with two tailor-designed graph encoding modules, followed by a diffusion-based sampling strategy to explore the user’s spatial visiting trends. We leverage the diffusion process and its reverse form to sample from the posterior distribution and optimized the corresponding score function. We design a joint training and inference framework to optimize and evaluate the proposed Diff-POI. Extensive experiments on four real-world POI recommendation datasets demonstrate the superiority of our Diff-POI over state-of-the-art baseline methods. Further ablation and parameter studies on Diff-POI reveal the functionality and effectiveness of the proposed diffusion-based sampling strategy for addressing the limitations of existing methods.
- [1] . 1982. Reverse-time diffusion equation models. Stochastic Processes and Their Applications 12, 3 (1982), 313–326.Google Scholar
Cross Ref
- [2] . 2020. Structural deep clustering network. In Proceedings of The Web Conference 2020. 1400–1410.Google ScholarDigital Library
- [3] . 2013. Where you like to go next: Successive point-of-interest recommendation. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence.Google Scholar
- [4] . 2021. Diffusion models beat GANs on image synthesis. Advances in Neural Information Processing Systems 34 (2021), 8780–8794.Google Scholar
- [5] . 2018. DeepMove: Predicting human mobility with attentional recurrent networks. In Proceedings of the 2018 World Wide Web Conference. 1459–1468.Google ScholarDigital Library
- [6] . 2015. Personalized ranking metric embedding for next new POI recommendation. In Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI ’15). ACM, New York, NY, 2069–2075.Google ScholarDigital Library
- [7] . 2020. Generative adversarial networks. Communications of the ACM 63, 11 (2020), 139–144.Google ScholarDigital Library
- [8] . 2020. An attentional recurrent neural network for personalized next location recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 83–90.Google ScholarCross Ref
- [9] . 2020. STGCN: A spatial-temporal aware graph learning method for POI recommendation. In Proceedings of the 2020 IEEE International Conference on Data Mining (ICDM ’20). IEEE, Los Alamitos, CA, 1052–1057.Google ScholarCross Ref
- [10] . 2016. Fusing similarity models with Markov chains for sparse sequential recommendation. In Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM ’16). IEEE, Los Alamitos, CA, 191–200.Google ScholarCross Ref
- [11] . 2020. LightGCN: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639–648.Google ScholarDigital Library
- [12] . 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).Google Scholar
- [13] . 2020. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems 33 (2020), 6840–6851.Google Scholar
- [14] . 2022. Empowering next POI recommendation with multi-relational modeling. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2034–2038.Google ScholarDigital Library
- [15] . 2023. A comprehensive survey on deep graph representation learning. arXiv preprint arXiv:2304.05055 (2023).Google Scholar
- [16] . 2023. GLCC: A general framework for graph-level clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 4391–4399.Google ScholarDigital Library
- [17] . 2023. Few-shot molecular property prediction via hierarchically structured learning on relation graphs. Neural Networks 163 (2023), 122–131.Google ScholarDigital Library
- [18] . 2023. TGNN: A joint semi-supervised framework for graph-level classification. arXiv preprint arXiv:2304.11688 (2023).Google Scholar
- [19] . 2022. Kernel-based substructure exploration for next POI recommendation. arXiv preprint arXiv:2210.03969 (2022).Google Scholar
- [20] . 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).Google Scholar
- [21] . 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).Google Scholar
- [22] . 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI ’18). 2341–2347.Google ScholarCross Ref
- [23] . 2020. DiffWave: A versatile diffusion model for audio synthesis. arXiv preprint arXiv:2009.09761 (2020).Google Scholar
- [24] . 2022. Diffusion-LM improves controllable text generation. arXiv preprint arXiv:2205.14217 (2022).Google Scholar
- [25] . 2021. Discovering collaborative signals for next POI recommendation with iterative Seq2Graph augmentation. arXiv preprint arXiv:2106.15814 (2021).Google Scholar
- [26] . 2020. Geography-aware sequential location recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2009–2019.Google ScholarDigital Library
- [27] . 2014. GeoMF: Joint geographical modeling and matrix factorization for point-of-interest recommendation. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 831–840.Google ScholarDigital Library
- [28] . 2013. Collaborative filtering meets next check-in location prediction. In Proceedings of the 22nd International Conference on World Wide Web. 231–232.Google ScholarDigital Library
- [29] . 2022. Hierarchical multi-task graph recurrent network for next POI recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval.Google ScholarDigital Library
- [30] . 2020. STP-UDGAT: Spatial-temporal-preference user dimensional graph attention network for next POI recommendation. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management. 845–854.Google ScholarDigital Library
- [31] . 2016. Predicting the next location: A recurrent model with spatial and temporal contexts. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30.Google ScholarCross Ref
- [32] . 2022. Flow straight and fast: Learning to generate and transfer data with rectified flow. arXiv preprint arXiv:2209.03003 (2022).Google Scholar
- [33] . 2022. DualGraph: Improving semi-supervised graph classification via dual contrastive learning. In Proceedings of the 2022 IEEE 38th International Conference on Data Engineering (ICDE ’22). IEEE, Los Alamitos, CA, 699–712.Google ScholarCross Ref
- [34] . 2023. Towards semi-supervised universal graph classification. IEEE Transactions on Knowledge and Data Engineering. Published online May 31, 2023.Google ScholarDigital Library
- [35] . 2021. STAN: Spatio-temporal attention network for next location recommendation. In Proceedings of The Web Conference 2021. 2177–2185.Google ScholarDigital Library
- [36] . 2021. SDEdit: Image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073 (2021).Google Scholar
- [37] . 2007. Probabilistic matrix factorization. Advances in Neural Information Processing Systems 20 (2007), 1–8.Google Scholar
- [38] . 2022. Next point-of-interest recommendation with auto-correlation enhanced multi-modal transformer network. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2612–2616.Google ScholarDigital Library
- [39] . 2023. Learning graph ODE for continuous-time sequential recommendation. arXiv preprint arXiv:2304.07042 (2023).Google Scholar
- [40] . 2023. DisenPOI: Disentangling sequential and geographical influence for point-of-interest recommendation. In Proceedings of the 16th ACM International Conference on Web Search and Data Mining. 508–516.Google ScholarDigital Library
- [41] . 2020. GAG: Global attributed graph neural network for streaming session-based recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 669–678.Google ScholarDigital Library
- [42] . 2022. Graph-flashback network for next location recommendation. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1463–1471.Google ScholarDigital Library
- [43] . 2010. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web. 811–820.Google ScholarDigital Library
- [44] . 2014. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the International Conference on Machine Learning. 1278–1286.Google Scholar
- [45] . 2015. Deep unsupervised learning using nonequilibrium thermodynamics. In Proceedings of the International Conference on Machine Learning. 2256–2265.Google Scholar
- [46] . 2023. Consistency models. arXiv preprint arXiv:2303.01469 (2023).Google Scholar
- [47] . 2019. Generative modeling by estimating gradients of the data distribution. Advances in Neural Information Processing Systems 32 (2019), 1–13.Google Scholar
- [48] . 2020. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 (2020).Google Scholar
- [49] . 2019. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1441–1450.Google ScholarDigital Library
- [50] . 2020. Where to go next: Modeling long-and short-term user preferences for point-of-interest recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 214–221.Google ScholarCross Ref
- [51] . 2022. DiGress: Discrete denoising diffusion for graph generation. arXiv preprint arXiv:2209.14734 (2022).Google Scholar
- [52] . 2018. Exploiting POI-specific geographical influence for point-of-interest recommendation. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI ’18). 3877–3883.Google ScholarDigital Library
- [53] . 2020. Disentangled graph collaborative filtering. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1001–1010.Google ScholarDigital Library
- [54] . 2022. DisenCTR: Dynamic graph-based disentangled representation for click-through rate prediction. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2314–2318.Google ScholarDigital Library
- [55] . 2022. Learning graph-based disentangled representations for next POI recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1154–1163.Google ScholarDigital Library
- [56] . 2022. Graph-enhanced spatial-temporal network for next POI recommendation. ACM Transactions on Knowledge Discovery from Data 16, 6 (2022), 1–21.Google ScholarDigital Library
- [57] . 2011. Bayesian learning via stochastic gradient Langevin dynamics. In Proceedings of the 28th International Conference on Machine Learning (ICML ’11). 681–688.Google Scholar
- [58] . 2019. Session-based recommendation with graph neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 346–353.Google ScholarDigital Library
- [59] . 2016. Learning graph-based POI embedding for location-based recommendation. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 15–24.Google ScholarDigital Library
- [60] . 2022. GeoDiff: A geometric diffusion model for molecular conformation generation. arXiv preprint arXiv:2203.02923 (2022).Google Scholar
- [61] . 2022. GETNext: Trajectory flow map enhanced transformer for next POI recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1144–1153.Google ScholarDigital Library
- [62] . 2023. Learning on graphs under label noise. In Proceedings of the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP ’23). IEEE, Los Alamitos, CA, 1–5.Google ScholarCross Ref
- [63] . 2014. Graph-based point-of-interest recommendation with geographical and temporal influences. In Proceedings of the 23rd ACM International Conference on Information and Knowledge Management. 659–668.Google ScholarDigital Library
- [64] . 2022. EGSDE: Unpaired image-to-image translation via energy-guided stochastic differential equations. arXiv preprint arXiv:2207.06635 (2022).Google Scholar
- [65] . 2020. Where to go next: A spatio-temporal gated network for next POI recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 5 (2020), 2512–2524.Google ScholarCross Ref
- [66] . 2016. STELLAR: Spatial-temporal latent ranking for successive point-of-interest recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30.Google ScholarCross Ref
- [67] . 2023. Dynamic hypergraph structure learning for traffic flow forecasting. In Proceedings of the 2023 IEEE International Conference on Data Engineering (ICDE ’23).Google Scholar
Index Terms
- A Diffusion Model for POI Recommendation
Recommendations
HOPE: a hybrid deep neural model for out-of-town next POI recommendation
AbstractNext Point-of-interest (POI) recommendation has been recognized as an important technique in location-based services, and existing methods aim to utilize sequential models to return meaningful recommendation results. But these models fail to fully ...
Social Personalized Ranking Embedding for Next POI Recommendation
Web Information Systems Engineering – WISE 2017AbstractAs the increasing popularity of the applications of location-based services, points-of-interest (POI) recommendation has become a great value part to help users explore their surrounding living environment and improve the quality of life. Recently,...
Feature-based POI grouping with transformer for next point of interest recommendation
AbstractWith the increasing prevalence of location-based services, Point of Interest (POI) recommendation has become an active research topic. While Graph Neural Networks (GNNs) have been widely used in POI recommendation models, they suffer from ...
Highlights- A Feature-based POI Grouping method is proposed in modeling POIs similarities;
- We propose an FPGT model by combining FPG with the Transformer framework;
- FPGT model performs better and reduces training time consumption;
- We ...
Comments