Daizong Ding
ABSTRACT
Friendship is the cornerstone to build a social network. In online social networks, statistics show that the leading reason for user to create a new friendship is due to recommendation. Thus the accuracy of recommendation matters. In this paper, we propose a Bayesian Personalized Ranking Deep Neural Network (BayDNN) model for friend recommendation in social networks. With BayDNN, we achieve significant improvement on two public datasets: Epinions and Slashdot. For example, on Epinions dataset, BayDNN significantly outperforms the state-of-the-art algorithms, with a 5% improvement on NDCG over the best baseline.
The advantages of the proposed BayDNN mainly come from its underlying convolutional neural network (CNN), which offers a mechanism to extract latent deep structural feature representations of the complicated network data, and a novel Bayesian personalized ranking idea, which precisely captures the users' personal bias based on the extracted deep features. To get good parameter estimation for the neural network, we present a fine-tuned pre-training strategy for the proposed BayDNN model based on Poisson and Bernoulli probabilistic models.
- Lada A Adamic and Eytan Adar. 2003. Friends and neighbors on the Web. Social Networks 25, 3 (2003), 211--230.Google Scholar
Cross Ref
- Yoshua Bengio, Nicolas Le Roux, Olivier Delalleau, Patrice Marcotte, and Pascal Vincent. 2005. Convex Neural Networks. Advances in Neural Information Processing Systems (2005), 123--130. Google ScholarDigital Library
- Ali Taylan Cemgil. 2009. Bayesian Inference for Nonnegative Matrix Factorisation Models. Intell. Neuroscience 2009, Article 4 (Jan. 2009), 17 pages. Google ScholarDigital Library
- Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Computer Science (2014).Google Scholar
- Ronan Collobert, Jason Weston, L Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research 12, 1 (2011), 2493--2537. Google ScholarDigital Library
- Malcolm Gladwell. 2000. The Tipping Point - How Little things Make a Big Difference. Little, Brown and Company (2000), 177--181,185--186.Google Scholar
- Stefan Gluge, Ronald Böck, and Andreas Wendemuth. 2013. Auto-encoder pre-training of segmented-memory recurrent neural networks.. In ESANN.Google Scholar
- Neil Zhenqiang Gong, Ameet Talwalkar, Lester Mackey, Ling Huang, Eui Chul Richard Shin, Emil Stefanov, Elaine, Shi, and Dawn Song. 2012. Jointly Predicting Links and Inferring Attributes using a Social-Attribute Network (SAN). Computer Science (2012).Google Scholar
- Mark Granovetter. 1973. The strength of weak ties. Amer. J. Sociology 78, 6 (1973), 1360--1380.Google ScholarCross Ref
- Siyao Han and Yan Xu. 2014. Friend recommendation of microblog in classification framework: Using multiple social behavior features. In International Conference on Behavior, Economic and Social Computing. 1--6.Google Scholar
- John Hannon, Mike Bennett, and Barry Smyth. 2010. Recommending Twitter Users to Follow Using Content and Collaborative Filtering Approaches. In Proceedings of the Fourth ACM Conference on Recommender Systems. 199--206. Google ScholarDigital Library
- Chaobo He, Hanchao Li, Xiang Fei, and Yong Tang. 2015. A Topic CommunityBased Method for Friend Recommendation in Online Social Networks via Joint Nonnegative Matrix Factorization. In third International Conference on Advanced Cloud and Big Data. 28--35.Google Scholar
- L. A. Jeni, J. F. Cohn, and La Torre F De. 2012. Facing Imbalanced Data Recommendations for the Use of Performance Metrics.. In Humaine Association Conference on Affective Computing and Intelligent Interaction. 245--251. Google ScholarDigital Library
- Leo Katz. 1953. A new status index derived from sociometric analysis. Psychometrika 18, 1 (1953), 39--43.Google ScholarCross Ref
- C. David Page Kendrick Boyd, Kevin H. Eng. 2013. Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals. 451--466. Google ScholarDigital Library
- Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 426--434. Google ScholarDigital Library
- Alex Krizhevsky and etc. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, 2 (2012), 2012. Google ScholarDigital Library
- Artus Krohn-Grimberghe, Lucas Drumond, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2012. Multi-relational matrix factorization using bayesian personalized ranking for social network data. In International Conference on Web Search and Web Data Mining. 173--182. Google ScholarDigital Library
- Daniel D. Lee and H. Sebastian Seung. 2001. Algorithms for Non-negative Matrix Factorization. In Advances in Neural Information Processing Systems. 556--562.Google Scholar
- Jure Leskovec, Kevin J. Lang, Anirban Dasgupta, and Michael W. Mahoney. 2008. Statistical properties of community structure in large social and information networks. In WWW'08. 695--704. Google ScholarDigital Library
- Wei Li and Sara Mcmains. 1963. Behavioral Study of obedience. Journal of Abnormal Psychology 67, 4 (1963), 371--378.Google ScholarCross Ref
- Zhepeng Li, Xiao Fang, and Olivia R. Liu Sheng. 2015. A Survey of Link Recommendation for Social Networks: Methods, theoretical Foundations, and Future Research Directions. Computer Science (2015).Google Scholar
- David Liben-Nowell and Jon Kleinberg. 2007. The link prediction problem for social networks. Journal of the Association for Information Science and Technology 58, 7 (2007), 1019C1031. Google ScholarDigital Library
- Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431--3440.Google ScholarCross Ref
- Aditya Krishna Menon and Charles Elkan. 2011. Link Prediction via Matrix Factorization. In European Conference on Machine Learning and Knowledge Discovery in Databases. 437--452. Google ScholarDigital Library
- Alan Mislove, Massimiliano Marcon, Krishna P. Gummadi, Peter Druschel, and Bobby Bhattacharjee. 2007. Measurement and analysis of online social networks. In ACM SIGCOMM Conference on Internet Measurement 2007. 1815--1816. Google ScholarDigital Library
- Mark EJ Newman. 2006. Modularity and community structure in networks. PNAS 103, 23 (2006), 8577--8582.Google ScholarCross Ref
- Lene Nielsen. 2012. Personas-user focused design. Vol. 15. Springer Science & Business Media. Google Scholar
- Joshua O'Madadhain, Jon Hutchins, and Padhraic Smyth. 2005. Prediction and ranking algorithms for event-based network data. Acm Sigkdd Explorations Newsletter 7, 2 (2005), 23--30. Google ScholarDigital Library
- Shuang Qiu and etc. 2014. Item Group Based Pairwise Preference Learning for Personalized Ranking. In Proceedings of the 37th International ACM SIGIR Conference on Research; Development in Information Retrieval. 1219--1222. Google ScholarDigital Library
- Matthew J. Rattigan and David Jensen. 2005. The case for anomalous link discovery. Acm Sigkdd Explorations Newsletter 7, 2 (2005), 41--47. Google ScholarDigital Library
- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems. 91--99. Google ScholarDigital Library
- Yafeng Ren, Yue Zhang, Meishan Zhang, and Donghong Ji. 2016. ContextSensitive Twitter Sentiment Classification Using Neural Network. AAAI. Google ScholarDigital Library
- Stetten Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Conference on Uncertainty in Artificial Intelligence. 452--461. Google ScholarDigital Library
- By Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. Advances in Neural Information Processing Systems (2007), 1257--1264. Google ScholarDigital Library
- Aliaksei Severyn and Alessandro Moschitti. 2015. Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks. In the International ACM SIGIR Conference. 373--382. Google ScholarDigital Library
- Dongjin Song, David A. Meyer, and Dacheng Tao. 2015. Efficient Latent Link Recommendation in Signed Networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1105--1114. Google ScholarDigital Library
- Suraj Srinivas and R. Venkatesh Babu. 2015. Deep Learning in Neural Networks: An Overview. Computer Science (2015).Google Scholar
- Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 1 (2014), 1929--1958. Google ScholarDigital Library
- Jie Tang, Tiancheng Lou, Jon Kleinberg, and Sen Wu. 2016. Transfer Learning to Infer Social Ties Across Heterogeneous Networks. ACM Trans. Inf. Syst. 34, 2 (2016), 7:1--7:43. Google ScholarDigital Library
- Caihua Wang, Juan Liu, Fei Luo, Yafang Tan, Zixin Deng, and Qian Nan Hu. 2014. Pairwise input neural network for target-ligand interaction prediction. In Bioinformatics and Biomedicine (BIBM), 2014 IEEE International Conference on. 67--70.Google ScholarCross Ref
- Nicolas Le Roux Yoshua Bengio, Olivier Delalleau. 2006. The Curse of Highly Variable Functions for Local Kernel Machines. 107--114.Google Scholar
- Matthew D. Zeiler. 2012. ADADELTA: An Adaptive Learning Rate Method. Computer Science (2012).Google Scholar
- Yu Zheng, Lizhu Zhang, Zhengxin Ma, Xing Xie, and Wei-Ying Ma. 2011. Recommending Friends and Locations Based on Individual Location History. ACM Trans. Web (2011), 5:1--5:44. Google ScholarDigital Library
Index Terms
- BayDNN: Friend Recommendation with Bayesian Personalized Ranking Deep Neural Network
Recommendations
A probabilistic music recommender considering user opinions and audio features
Special issue: AIRS2005: Information retrieval research in AsiaA recommender system has an obvious appeal in an environment where the amount of on-line information vastly outstrips any individual's capability to survey. Music recommendation is considered a popular application area. In order to make personalized ...
Clustering for probabilistic model estimation for CF
WWW '05: Special interest tracks and posters of the 14th international conference on World Wide WebBased on the type of collaborative objects, a collaborative filtering (CF) system falls into one of two categories: item-based CF and user-based CF. Clustering is the basic idea in both cases, where users or items are classified into user groups where ...
Collaborative filtering with decoupled models for preferences and ratings
CIKM '03: Proceedings of the twelfth international conference on Information and knowledge managementIn this paper, we describe a new model for collaborative filtering. The motivation of this work comes from the fact that two users with very similar preferences on items may have very different rating schemes. For example, one user may tend to assign a ...
Comments