Amin Javari
ABSTRACT
Personalized hashtag recommendation for users could substantially promote user engagement in microblogging websites; users can discover microblogs aligned with their interests. However, user profiling on microblogging websites is challenging because most users tend not to generate content. Our core idea is to build a graph-based profile of users and incorporate it into hashtag recommendation. Indeed, user’s followee/follower links implicitly indicate their interests. Considering that microblogging networks are scale-free networks, to maintain the efficiency and effectiveness of the model, rather than analyzing the entire network, we model users based on their links towards hub nodes. That is, hashtags and hub nodes are projected into a shared latent space. To predict the relevance of a user to a hashtag, a projection of the user is built by aggregating the embeddings of her hub neighbors guided by an attention model and then compared with the hashtag. Classically, attention models can be trained in an end to end manner. However, due to the high complexity of our problem, we propose a novel weak supervision model for the attention component, which significantly improves the effectiveness of the model. We performed extensive experiments on two datasets collected from Twitter and Weibo, and the results confirm that our method substantially outperforms the baselines.
- Hamidreza Alvari. 2017. Twitter hashtag recommendation using matrix factorization. arXiv preprint arXiv:1705.10453(2017).Google Scholar
- Sofía Aparicio, Javier Villazón-Terrazas, and Gonzalo Álvarez. 2015. A model for scale-free networks: application to twitter. Entropy 17, 8 (2015), 5848–5867.Google ScholarCross Ref
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. international conference on learning representations (2015).Google Scholar
- Albert-László Barabási and Eric Bonabeau. 2003. Scale-free networks. Scientific american 288, 5 (2003), 60–69.Google Scholar
- Nicola Barbieri, Francesco Bonchi, and Giuseppe Manco. 2014. Who to follow and why: link prediction with explanations. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 1266–1275.Google ScholarDigital Library
- Nada Ben-Lhachemi and El Habib Nfaoui. 2018. Using tweets embeddings for hashtag recommendation in Twitter. Procedia Computer Science 127 (2018), 7–15.Google ScholarDigital Library
- Jesús Bobadilla, Fernando Ortega, Antonio Hernando, and Abraham Gutiérrez. 2013. Recommender systems survey. Knowledge-based systems 46 (2013), 109–132.Google ScholarDigital Library
- Hong-Ming Chen, Ming-Hsiu Chang, Ping-Chieh Chang, Min-Chun Tien, Winston H. Hsu, and Ja-Ling Wu. 2008. SheepDog: group and tag recommendation for flickr photos by automatic search-based learning. In ACM Multimedia.Google Scholar
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 335–344.Google ScholarDigital Library
- Cesc Chunseong Park, Byeongchang Kim, and Gunhee Kim. 2017. Attend to you: Personalized image captioning with context sequence memory networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 895–903.Google Scholar
- Abhishek Das, Harsh Agrawal, Larry Zitnick, Devi Parikh, and Dhruv Batra. 2017. Human attention in visual question answering: Do humans and deep networks look at the same regions?Computer Vision and Image Understanding 163 (2017), 90–100.Google Scholar
- Dmitry Davidov, Oren Tsur, and Ari Rappoport. 2010. Enhanced Sentiment Learning Using Twitter Hashtags and Smileys. In Proceedings of the 23rd International Conference on Computational Linguistics: Posters(COLING ’10). Association for Computational Linguistics, 241–249.Google ScholarDigital Library
- Kuntal Dey, Ritvik Shrivastava, Saroj Kaushik, and L. Venkata Subramaniam. 2017. EmTaggeR: A Word Embedding Based Novel Method for Hashtag Recommendation on Twitter. In 2017 IEEE International Conference on Data Mining Workshops (ICDMW). 1025–1032.Google Scholar
- Zhuoye Ding, Xipeng Qiu, Qi Zhang, and Xuanjing Huang. 2013. Learning Topical Translation Model for Microblog Hashtag Suggestion.. In IJCAI. 2078–2084.Google Scholar
- Zhuoye Ding, Qi Zhang, and Xuanjing Huang. 2012. Automatic hashtag recommendation for microblogs using topic-specific translation model. Proceedings of COLING 2012: Posters(2012), 265–274.Google Scholar
- Wei Feng and Jianyong Wang. 2014. We can learn your# hashtags: Connecting tweets to explicit topics. In 2014 IEEE 30th International Conference on Data Engineering. IEEE, 856–867.Google ScholarCross Ref
- Yuyun Gong and Qi Zhang. 2016. Hashtag Recommendation Using Attention-based Convolutional Neural Network. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence(IJCAI’16). AAAI Press, 2782–2788.Google Scholar
- Yuyun Gong and Qi Zhang. 2016. Hashtag Recommendation Using Attention-Based Convolutional Neural Network.. In IJCAI. 2782–2788.Google Scholar
- Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware Explainable Recommendation by Modeling Aspects. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management(CIKM ’15). ACM, 1661–1670.Google ScholarDigital Library
- Xiangnan He, Zhenkui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. NAIS: Neural Attentive Item Similarity Model for Recommendation. IEEE Transactions on Knowledge and Data Engineering (2018).Google Scholar
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web(WWW ’17). International World Wide Web Conferences Steering Committee, 173–182.Google ScholarDigital Library
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation 9, 8 (1997), 1735–1780.Google ScholarDigital Library
- Liangjie Hong, Amr Ahmed, Siva Gurumurthy, Alexander J. Smola, and Kostas Tsioutsiouliklis. 2012. Discovering Geographical Topics in the Twitter Stream. In Proceedings of the 21st International Conference on World Wide Web(WWW ’12). ACM, 769–778.Google ScholarDigital Library
- Haoran Huang, Qi Zhang, Yeyun Gong, and Xuanjing Huang. 2016. Hashtag Recommendation Using End-To-End Memory Networks with Hierarchical Attention. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers.Google Scholar
- Haoran Huang, Qi Zhang, Xuanjing Huang, 2017. Mention recommendation for Twitter with end-to-end memory network. In Proc. IJCAI, Vol. 17. 1872–1878.Google ScholarCross Ref
- Amin Javari, HongXiang Qiu, Elham Barzegaran, Mahdi Jalili, and Kevin Chen-Chuan Chang. 2017. Statistical Link Label Modeling for Sign Prediction: Smoothing Sparsity by Joining Local and Global Information. In 2017 IEEE International Conference on Data Mining (ICDM). IEEE, 1039–1044.Google ScholarCross Ref
- Ralf Krestel, Peter Fankhauser, and Wolfgang Nejdl. 2009. Latent Dirichlet Allocation for Tag Recommendation. In Proceedings of the Third ACM Conference on Recommender Systems(RecSys ’09). ACM, 61–68.Google ScholarDigital Library
- Haewoon Kwak, Changhyun Lee, Hosung Park, and Sue Moon. 2010. What is Twitter, a social network or a news media?. In Proceedings of the 19th international conference on World wide web. AcM, 591–600.Google ScholarDigital Library
- Lemao Liu, Masao Utiyama, Andrew M. Finch, and Eiichiro Sumita. 2016. Neural Machine Translation with Supervised Attention.international conference on computational linguistics (2016), 3093–3102.Google Scholar
- Jiasen Lu, Caiming Xiong, Devi Parikh, and Richard Socher. 2017. Knowing when to look: Adaptive attention via a visual sentinel for image captioning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 6. 2.Google ScholarCross Ref
- Tingting Qiao, Jianfeng Dong, and Duanqing Xu. 2018. Exploring human-like attention supervision in visual question answering. In Thirty-Second AAAI Conference on Artificial Intelligence.Google ScholarCross Ref
- Yogesh Singh Rawat and Mohan S Kankanhalli. 2016. ConTagNet: Exploiting user context for image tag recommendation. In Proceedings of the 24th ACM international conference on Multimedia. ACM, 1102–1106.Google ScholarDigital Library
- Tim Rocktäschel, Edward Grefenstette, Karl Moritz Hermann, Tomáš Ko iský, and Phil Blunsom. 2016. Reasoning about Entailment with Neural Attention. international conference on learning representations (2016).Google Scholar
- Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A Neural Attention Model for Abstractive Sentence Summarization. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 379–389.Google ScholarCross Ref
- Petar Veliˇckovi´c, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li‘o, and Yoshua Bengio. 2018. Graph Attention Networks. In Proceedings of ICLR 2018, the 6th International Conference on Learning Representations.Google Scholar
- Yinwei Wei, Zhiyong Cheng, Xuzheng Yu, Zhou Zhao, Lei Zhu, and Liqiang Nie. 2019. Personalized Hashtag Recommendation for Micro-videos. arXiv preprint arXiv:1908.09987(2019).Google Scholar
- Jason Weston, Sumit Chopra, and Keith Adams. 2014. # tagspace: Semantic embeddings from hashtags. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1822–1827.Google ScholarCross Ref
- Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S Yu. 2019. A comprehensive survey on graph neural networks. arXiv preprint arXiv:1901.00596(2019).Google Scholar
- Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, and Jiebo Luo. 2016. Image captioning with semantic attention. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4651–4659.Google ScholarCross Ref
- Eva Zangerle, Wolfgang Gassler, and Gunther Specht. 2011. Recommending#-tags in twitter. In Proceedings of the Workshop on Semantic Adaptive Social Web (SASWeb 2011). CEUR Workshop Proceedings, Vol. 730. 67–78.Google Scholar
- Qi Zhang, Yeyun Gong, Xuyang Sun, and Xuanjing Huang. 2014. Time-aware personalized hashtag recommendation on social media. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. 203–212.Google Scholar
- Yizhou Zhang, Yun Xiong, Xiangnan Kong, Shanshan Li, Jinhong Mi, and Yangyong Zhu. 2018. Deep Collective Classification in Heterogeneous Information Networks. In Proceedings of the 2018 World Wide Web Conference(WWW ’18). International World Wide Web Conferences Steering Committee, 399–408.Google ScholarDigital Library
Index Terms
- Weakly Supervised Attention for Hashtag Recommendation using Graph Data
Index terms have been assigned to the content through auto-classification.
Recommendations
Long-tail Hashtag Recommendation for Micro-videos with Graph Convolutional Network
CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge ManagementHashtags, a user provides to a micro-video, are the ones which can well describe the semantics of the micro-video's content in his/her mind. At the same time, hashtags have been widely used to facilitate various micro-video retrieval scenarios (e.g., ...
Personalized Hashtag Recommendation for Micro-videos
MM '19: Proceedings of the 27th ACM International Conference on MultimediaPersonalized hashtag recommendation methods aim to suggest users hashtags to annotate, categorize, and describe their posts. The hashtags, that a user provides to a post (e.g., a micro-video), are the ones which in her mind can well describe the post ...
Effect of Spam on Hashtag Recommendation for Tweets
WWW '16 Companion: Proceedings of the 25th International Conference Companion on World Wide WebPresence of spam tweets in a dataset may affect the choices of feature selection, algorithm formulation, and system evaluation for many applications. However, most existing studies have not considered the impact of spam tweets. In this paper, we study ...
Comments