skip to main content
10.1145/3377325.3377496acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Navigation-by-preference: a new conversational recommender with preference-based feedback

Published:17 March 2020Publication History

ABSTRACT

We present Navigation-by-Preference, n-by-p, a new conversational recommender that uses what the literature calls preference-based feedback. Given a seed item, the recommender helps the user navigate through item space to find an item that aligns with her long-term preferences (revealed by her user profile) but also satisfies her ephemeral, short-term preferences (revealed by the feedback she gives during the dialog). Different from previous work on preference-based feedback, n-by-p does not assume structured item descriptions (such as sets of attribute-value pairs) but works instead in the case of unstructured item descriptions (such as sets of keywords or tags), thus extending preference-based feedback to new domains where structured item descriptions are not available. Different too is that it can be configured to ignore long-term preferences or to take them into account, to work only on positive feedback or to also use negative feedback, and to take previous rounds of feedback into account or to use just the most recent feedback.

We use an offline experiment with simulated users to compare 60 configurations of n-by-p. We find that a configuration that includes long-term preferences, that uses both positive and negative feedback, and that uses previous rounds of feedback is the one with highest hit-rate. It also obtains the best survey responses and lowest measures of effort in a trial with real users that we conducted with a web-based system. Notable too is that the user trial has a novel protocol for experimenting with short-term preferences.

References

  1. Gediminas Adomavicius, Bamshad Mobasher, Francesco Ricci, and Alexander Tuzhilin. 2011. Context-aware recommender systems. AI Magazine 32, 3 (2011), 67--80.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Xavier Amatriain, Josep M. Pujol, Nava Tintarev, and Nuria Oliver. 2009. Rate it again: Increasing recommendation accuracy by user re-rating. In Procs. of the Third ACM Conference on Recommender SSystems. 173--180.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Derek Bridge, Mehmet H. Göker, Lorraine McGinty, and Barry Smyth. 2005. Case-based recommender systems. Knowledge Engineering Review 20, 3 (2005), 315--320.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Robin Burke. 2000. Knowledge-based recommender systems. In Encyclopedia of Library and Information Systems, vol.60, no.32. Marcel Dekker, 180--200.Google ScholarGoogle Scholar
  5. Robin D. Burke, Kristian J. Hammond, and Benjamin C. Young. 1997. The FindMe approach to assisted browsing. IEEE Expert: Intelligent Systems and Their Applications 12, 4 (1997), 32--40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Li Chen and Pearl Pu. 2012. Critiquing-based recommenders: survey and emerging trends. User Modeling and User-Adapted Interaction 22, 1 (2012), 125--150.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards conversational recommender systems. In Procs. of the Twenty-second ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 815--824.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Cecilia di Sciascio, Peter Brusilovsky, and Eduardo Veas. 2018. A study on user-controllable social exploratory search. In Procs. of the Twenty-third International Conference on Intelligent User Interfaces. 353--364.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Cecilia di Sciascio, Vedran Sabol, and Eduardo E. Veas. 2016. Rank as you go: User-driven exploration of search results. In Procs. of the Twenty-first International Conference on Intelligent User Interfaces. 118--129.Google ScholarGoogle Scholar
  10. Michelle Doyle and Pádraig Cunningham. 2000. A dynamic approach to reducing dialog in on-line decision guides. In Procs. of the Fifth European Workshop on Case-Based Reasoning. 49--60.Google ScholarGoogle ScholarCross RefCross Ref
  11. Yingpeng Du, Hongzhi Liu, Yuanhang Qu, and Zhonghai Wu. 2018. Online personalized next-item recommendation via long short term preference learning. In Procs. of the Pacific Rim International Conference on Artificial Intelligence. 915--927.Google ScholarGoogle ScholarCross RefCross Ref
  12. Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural approaches to conversational AI. In Procs. of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 1371--1374.Google ScholarGoogle Scholar
  13. Mark P. Graus and Martijn C. Willemsen. 2015. Improving the user experience during cold start through choice-based preference elicitation. In Procs. of the Ninth ACM Conference on Recommender Systems. 273--276.Google ScholarGoogle Scholar
  14. Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yinglong Wang, Jun Ma, and Mohan S. Kankanhalli. 2018. Attentive long short-term preference modeling for personalized product search. CoRR abs/1811.10155 (2018).Google ScholarGoogle Scholar
  15. Negar Hariri, Bamshad Mobasher, and Robin Burke. 2014. Context adaptation in interactive recommender systems. In Procs. of the Eighth ACM Conference on Recommender Systems. 41--48.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Anthony Jameson and Barry Smyth. 2007. Recommendation to groups. In The Adaptive Web, Peter Brusilovsky, Alfred Kobsa, and Wolfgang Nejdl (Eds.). Springer-Verlag, 596--627.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Dietmar Jannach, Lukas Lerche, and Michael Jugovac. 2015. Adaptation and evaluation of recommendations for short-term shopping goals. In Procs. of the Ninth ACM Conference on Recommender Systems. 211--218.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Nicolas Jones, Armelle Brun, and Anne Boyer. 2011. Comparisons instead of ratings: Towards more stable preferences. In Procs. of the IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, Vol. 1. 451--456.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Marius Kaminskas and Derek Bridge. 2016. Diversity, serendipity, novelty, and coverage: A survey and empirical analysis of beyond-accuracy objectives in recommender systems. ACM Transactions on Interactive Intelligent Systems 7, 1 (2016), 2:1--2:42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Joseph A. Konstan and John Riedl. 2012. Recommender systems: From algorithms to user experience. User Modeling and User-Adapted Interaction 22, 1--2 (2012), 101--123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Benedikt Loepp, Tim Hussein, and Jüergen Ziegler. 2014. Choice-based preference elicitation for collaborative filtering recommender systems. In Procs. of the SIGCHI Conference on Human Factors in Computing Systems. 3085--3094.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Lorraine Mc Ginty and Barry Smyth. 2002. Comparison-based recommendation. In Procs. of the Sixth European Conference on Case-Based Reasoning. Springer, 575--589.Google ScholarGoogle ScholarCross RefCross Ref
  23. Lorraine Mc Ginty and Barry Smyth. 2003. On the role of diversity in conversational recommender systems. In Procs. of the Fifth International Conference on Case-Based Reasoning. Springer, 276--290.Google ScholarGoogle Scholar
  24. Lorraine Mcginty and Barry Smyth. 2006. Adaptive selection: An analysis of critiquing and preference-based feedback in conversational recommender systems. International Journal of Electronic Commerce 11, 2 (2006), 35--57.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Roberto Pagano, Paolo Cremonesi, Martha Larson, Balázs Hidasi, Domonkos Tikk, Alexandros Karatzoglou, and Massimo Quadrana. 2016. The contextual turn: From context-aware to context-driven recommender systems. In Procs. of the Tenth ACM Conference on Recommender Systems. 249--252.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Pearl Pu and Li Chen. 2008. User-involved preference elicitation for product search and recommender systems. AI Magazine 29, 4 (2008), 93--103.Google ScholarGoogle ScholarCross RefCross Ref
  27. Pearl Huan Z Pu and Pratyush Kumar. 2004. Evaluating example-based search tools. In Procs. of the Fifth ACM Conference on Electronic Commerce. 208--217.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Massimo Quadrana, Paolo Cremonesi, and Dietmar Jannach. 2018. Sequence-aware recommender systems. ACM Comput. Surv. 51, 4 (2018), 66:1--66:36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Massimo Quadrana, Alexandras Karatzoglou, Balázs Hidasi, and Paolo Cremonesi. 2017. Personalizing session-based recommendations with hierarchical recurrent neural networks. In Procs. of the Eleventh ACM Conference on Recommender Systems. 130--137.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Ian Ruthven and Mounia Lalmas. 2003. A survey on the use of relevance feedback for information access systems. Knowl. Eng. Rev. 18, 2 (2003), 95--145.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Sascha Schmitt. 2002. simVar: A similarity-influences question selection criterion or e-sales dialogs. Artificial Intelligence Review 18, 3--4 (2002), 195--221.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Hideo Shimazu. 2002. ExpertClerk: A conversational case-cased reasoning tool for developing salesclerk agents in e-commerce webshops. Artificial Intelligence Review 18, 3--4 (2002), 223--244.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Barry Smyth. 2007. Case-based recommendation. In The Adaptive Web, Peter Brusilovsky, Alfred Kobsa, and Wolfgang Nejdl (Eds.). Springer-Verlag, 342--376.Google ScholarGoogle Scholar
  34. Barry Smyth and Lorraine McGinty. 2003. An analysis of feedback strategies in conversational recommenders. In Procs. of the Fourteenth Irish Artificial Intelligence and Cognitive Science Conference.Google ScholarGoogle Scholar
  35. Barry Smyth and Lorraine McGinty. 2003. The power of suggestion. In Procs. of the International Joint Conference on Artificial Intelligence, Vol. 3. 127--132.Google ScholarGoogle Scholar
  36. Kazunari Sugiyama, Kenji Hatano, and Masatoshi Yoshikawa. 2004. Adaptive web search based on user profile constructed without any effort from users. In Procs. of the Thirteenth International Conference on the World Wide Web. 675--684.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Yueming Sun and Yi Zhang. 2018. Conversational recommender system. In Procs. of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 235--244.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jesse Vig, Shilad Sen, and John Riedl. 2011. Navigating the tag genome. In Procs. of the 16th International Conference on Intelligent User Interfaces. 93--102.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Chao-Yuan Wu, Christopher V. Alvino, Alexander J. Smola, and Justin Basilico. 2016. Using navigation to improve recommendations in real-time. In Procs. of the 10th ACM Conference on Recommender Systems. 341--348.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Navigation-by-preference: a new conversational recommender with preference-based feedback

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      IUI '20: Proceedings of the 25th International Conference on Intelligent User Interfaces
      March 2020
      607 pages
      ISBN:9781450371186
      DOI:10.1145/3377325

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 March 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate746of2,811submissions,27%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader