skip to main content
10.1145/3289600.3290963acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Linked Variational AutoEncoders for Inferring Substitutable and Supplementary Items

Published:30 January 2019Publication History

ABSTRACT

Recommendation in the modern world is not only about capturing the interaction between users and items, but also about understanding the relationship between items. Besides improving the quality of recommendation, it enables the generation of candidate items that can serve as substitutes and supplements of another item. For example, when recommending Xbox, PS4 could be a logical substitute and the supplements could be items such as game controllers, surround system, and travel case. Therefore, given a network of items, our objective is to learn their content features such that they explain the relationship between items in terms of substitutes and supplements. To achieve this, we propose a generative deep learning model that links two variational autoencoders using a connector neural network to create Linked Variational Autoencoder (LVA). LVA learns the latent features of items by conditioning on the observed relationship between items. Using a rigorous series of experiments, we show that LVA significantly outperforms other representative and state-of-the-art baseline methods in terms of prediction accuracy. We then extend LVA by incorporating collaborative filtering (CF) to create CLVA that captures the implicit relationship between users and items. By comparing CLVA with LVA we show that inducing CF-based features greatly improve the recommendation quality of substitutable and supplementary items on a user level.

References

  1. Gediminas Adomavicius and Alexander Tuzhilin. 2015. Context-aware recommender systems. In Recommender systems handbook . Springer, 191--226.Google ScholarGoogle Scholar
  2. David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research, Vol. 3, Jan (2003), 993--1022. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jesús Bobadilla, Fernando Ortega, Antonio Hernando, and Abraham Gutiérrez. 2013. Recommender systems survey. Knowledge-based systems, Vol. 46 (2013), 109--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jonathan Chang and David M Blei. 2009. Relational topic models for document networks. In International conference on artificial intelligence and statistics. 81--88.Google ScholarGoogle Scholar
  5. David A Cohn and Thomas Hofmann. 2001. The missing link-a probabilistic model of document content and hypertext connectivity. In Advances in neural information processing systems. 430--436. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Michael D Ekstrand, John T Riedl, Joseph A Konstan, et almbox. 2011. Collaborative filtering recommender systems. Foundations and Trends® in Human-Computer Interaction, Vol. 4, 2 (2011), 81--173. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Elena Erosheva, Stephen Fienberg, and John Lafferty. 2004. Mixed-membership models of scientific publications. Proceedings of the National Academy of Sciences, Vol. 101, suppl 1 (2004), 5220--5227.Google ScholarGoogle ScholarCross RefCross Ref
  8. Ruining He, Chen Fang, Zhaowen Wang, and Julian McAuley. 2016a. Vista: a visually, socially, and temporally-aware model for artistic recommendation. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 309--316. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ruining He, Charles Packer, and Julian McAuley. 2016b. Learning compatibility across categories for heterogeneous item recommendation. In Data Mining (ICDM), 2016 IEEE 16th International Conference on. IEEE, 937--942.Google ScholarGoogle ScholarCross RefCross Ref
  10. Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Zhiting Hu, Junjie Yao, Bin Cui, and Eric Xing. 2015. Community level diffusion extraction. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data. ACM, 1555--1569. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Yohan Jo and Alice H Oh. 2011. Aspect and sentiment unification model for online review analysis. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 815--824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).Google ScholarGoogle Scholar
  14. Daphne Koller and Nir Friedman. 2009. Probabilistic graphical models: principles and techniques .MIT press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Xiaopeng Li and James She. 2017. Collaborative variational autoencoder for recommender systems. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 305--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Dawen Liang, Rahul G Krishnan, Matthew D Hoffman, and Tony Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 689--698. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Yan Liu, Alexandru Niculescu-Mizil, and Wojciech Gryc. 2009. Topic-link LDA: joint models of topic and author community. In proceedings of the 26th annual international conference on machine learning. ACM, 665--672. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Julian McAuley and Jure Leskovec. 2013. Hidden factors and hidden topics: understanding rating dimensions with review text. In Proceedings of the 7th ACM conference on Recommender systems. ACM, 165--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Julian McAuley, Rahul Pandey, and Jure Leskovec. 2015. Inferring networks of substitutable and complementary products. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 785--794. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Vineeth Rakesh, Weicong Ding, Aman Ahuja, Nikhil Rao, Yifan Sun, and Chandan K Reddy. 2018. A Sparse Topic Model for Extracting Aspect-Specific Summaries from Online Reviews. In Proceedings of the Tenth ACM International Conference on The Web Conference. ACM, 631--640.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jürgen Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural networks, Vol. 61 (2015), 85--117. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Zhu Sun, Jie Yang, Jie Zhang, and Alessandro Bozzon. 2017. Exploiting both Vertical and Horizontal Dimensions of Feature Hierarchy for Effective Recommendation. In AAAI. 189--195. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ivan Titov and Ryan McDonald. 2008a. A joint model of text and aspect ratings for sentiment summarization. proceedings of ACL-08: HLT (2008), 308--316.Google ScholarGoogle Scholar
  24. Ivan Titov and Ryan McDonald. 2008b. Modeling online reviews with multi-grain topic models. In Proceedings of the 17th international conference on World Wide Web. ACM, 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research, Vol. 11, Dec (2010), 3371--3408. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Chong Wang and David M Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining . ACM, 448--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2017a. Relational Deep Learning: A Deep Latent Variable Model for Link Prediction.. In AAAI . 2688--2694. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015b. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1235--1244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. 2017c. Irgan: A minimax game for unifying generative and discriminative information retrieval models. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 515--524. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Suhang Wang, Jiliang Tang, Yilin Wang, and Huan Liu. 2015a. Exploring Implicit Hierarchical Structures for Recommender Systems.. In IJCAI . 1813--1819. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Suhang Wang, Yilin Wang, Jiliang Tang, Kai Shu, Suhas Ranganath, and Huan Liu. 2017b. What your images reveal: Exploiting visual contents for point-of-interest recommendation. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 391--400. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Zihan Wang, Ziheng Jiang, Zhaochun Ren, Jiliang Tang, and Dawei Yin. 2018. A Path-constrained Framework for Discriminating Substitutable and Complementary Products in E-commerce. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. ACM, 619--627. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Shuai Zhang, Lina Yao, and Aixin Sun. 2017. Deep learning based recommender system: A survey and new perspectives. arXiv preprint arXiv:1707.07435 (2017).Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Jiaqian Zheng, Xiaoyuan Wu, Junyu Niu, and Alvaro Bolivar. 2009. Substitutes or complements: another step forward in recommendations. In Proceedings of the 10th ACM conference on Electronic commerce. ACM, 139--146. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Linked Variational AutoEncoders for Inferring Substitutable and Supplementary Items

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        WSDM '19: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining
        January 2019
        874 pages
        ISBN:9781450359405
        DOI:10.1145/3289600

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 January 2019

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        WSDM '19 Paper Acceptance Rate84of511submissions,16%Overall Acceptance Rate498of2,863submissions,17%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader