Skip to main content
SpringerLink
Log in

Evaluating Group Recommender Systems

  • Chapter
  • First Online:
Group Recommender Systems

Part of the book series: Signals and Communication Technology ((SCT))

  • 82 Accesses

Abstract

In the previous chapters, we have learned how to design group recommender systems but did not explicitly discuss how to evaluate them. The evaluation techniques for group recommender systems are often the same or similar to those that are used for single user recommenders. We show how to apply these techniques on the basis of examples and introduce evaluation approaches that are specifically useful in group recommendation scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For an in-depth discussion of evaluation metrics for single user recommenders, we refer to Gunawardana and Shani [24].

  2. 2.

    Predictions are determined using rating data not used as test cases.

  3. 3.

    For a discussion of the handling of symbolic parameter values, we refer to [26].

  4. 4.

    See also Chap. 6.

References

  1. M. Allahbakhsh, B. Benatallah, A. Ignjatovic, H. Motahari-Nezhad, E. Bertino, S. Dustdar, Quality control in crowdsourcing systems: issues and directions. IEEE Int. Comput. 17(12), 76–81 (2013)

    Article  Google Scholar 

  2. L. Baltrunas, T. Makcinskas, F. Ricci, Group recommendations with rank aggregation and collaborative filtering, in 4th ACM Conference on Recommender Systems, Barcelona, 2010, pp. 119–126

    Google Scholar 

  3. R. Burke, Multisided fairness for recommendation, in 2017 Workshop on Fairness, Accountability, and Transparency in Machine Learning (FAT/ML 2017), 2017, pp. 1–5

    Google Scholar 

  4. P. Campos, F. Díez, I. Cantador, Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols. User Model. User Adap. Inter. 24(1–2), 67–119 (2014)

    Article  Google Scholar 

  5. J. Castro, F. Quesada, I. Palomares, L. Martínez, A consensus-driven group recommender system. Intell. Syst. 30(8), 887–906 (2015)

    Article  Google Scholar 

  6. S. Chang, F. Harper, L. He, L. Terveen, CrowdLens: experimenting with crowd-powered recommendation and explanation, in 10th International AAAI Conference on Web and Social Media (ICWSM’16) (AAAI, Menlo Park, 2016), pp. 52–61

    Google Scholar 

  7. T. DePessemier, J. Dhondt, L. Martens, Hybrid group recommendations for a travel service. Multimedia Tools Appl. 76(2), 2787–2811 (2017)

    Article  Google Scholar 

  8. W. Dubitzky, M. Granzow, D. Berrar, Fundamentals of Data Mining in Genomics and Proteomics (Springer, Berlin, 2007)

    Book  MATH  Google Scholar 

  9. A. Felfernig, M. Schubert, C. Zehentner, An efficient diagnosis algorithm for inconsistent constraint sets. Artif. Intell. Eng. Design Anal. Manufact. 26(1), 53–62 (2012)

    Article  Google Scholar 

  10. A. Felfernig, M. Jeran, G. Ninaus, F. Reinfrank, S. Reiterer, M. Stettinger, Basic approaches in recommendation systems, in Recommendation Systems in Software Engineering (Springer, Berlin, 2013), pp. 15–37

    Google Scholar 

  11. A. Felfernig, L. Hotz, C. Bagley, J. Tiihonen, Knowledge-Based Configuration: From Research to Business Cases, 1st edn. (Elsevier/Morgan Kaufmann, Amsterdam/Waltham, 2014)

    Google Scholar 

  12. A. Felfernig, M. Atas, T.N. Trang Tran, M. Stettinger, Towards group-based configuration, in International Workshop on Configuration 2016 (ConfWS’16) (2016), pp. 69–72

    Google Scholar 

  13. M. Ge, C. Delgado-Battenfeld, D. Jannach, Beyond accuracy: evaluating recommender systems by coverage and serendipity, in 4th ACM Conference on Recommender Systems, Barcelona, 2010, pp. 257–260

    Google Scholar 

  14. F. Harper, J. Konstan, The MovieLens Datasets: history and context. ACM Trans. Interactive Intell. Syst. 5(4), 19 (2015)

    Google Scholar 

  15. J. Herlocker, J. Konstan, L. Terveen, J. Riedl, Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst. 22(1), 5–53 (2004)

    Article  Google Scholar 

  16. B. Knijnenburg, M. Willemsen, Evaluating recommender systems with user experiments, in Recommender Systems Handbook, ed. by F. Ricci, L. Rokach, B. Shapira (Springer, Berlin, 2015), pp. 309–352

    Chapter  Google Scholar 

  17. J. Masthoff, A. Gatt, In pursuit of satisfaction and the prevention of embarrassment: affective state in group recommender systems. User Model. User Adap. Inter. 16(3–4), 281–319 (2006)

    Article  Google Scholar 

  18. A. Mislove, B. Viswanath, K. Gummadi, P. Druschel, You are who you know: inferring user profiles in online social networks, in 3rd ACM Conference on Web Search and Data Mining (WSDM’10), New York, 2010, pp. 251–260

    Google Scholar 

  19. D. Parra, S. Sahebi, Recommender systems: sources of knowledge and evaluation metrics, in Advanced Techniques in Web Intelligence-2: Web User Browsing Behaviour and Preference Analysis (Springer, Berlin, 2013), pp. 149–175

    Google Scholar 

  20. L. Quijano-Sanchez, J. Recio-García, B. Díaz-Agudo, G. Jiménez-Díaz, Happy Movie: a group recommender application in Facebook, in 24th International Florida Artificial Intelligence Research Society Conference, Palm Beach, FL, 2011, pp. 419–420

    Google Scholar 

  21. A. Said, D. Tikk, P. Cremonesi, Benchmarking – a methodology for ensuring the relative quality of recommendation systems in software engineering, in Recommender Systems in Software Engineering (Springer, Berlin, 2014), pp. 275–300

    Google Scholar 

  22. H. Schaefer, S. Hors-Fraile, R. Karumur, A. Valdez, A. Said, H. Torkamaan, H. Ulmer, C. Trattner, Towards health (aware) recommender systems, in DH 2017 (2017)

    Google Scholar 

  23. D. Serbos, S. Qi, N. Mamoulis, E. Pitoura, P. Tsaparas, Fairness in package-to-group recommendations, in WWW’17 (ACM, New York, 2017), pp. 371–379

    Google Scholar 

  24. G. Shani, A. Gunawardana, Evaluating recommender systems, in Recommender Systems Handbook, ed. by F. Ricci, L. Rokach, B. Shapira, P. Kantor (Springer, Berlin, 2011), pp. 257–297

    Chapter  Google Scholar 

  25. M. Stettinger, A. Felfernig, G. Leitner, S. Reiterer, Counteracting anchoring effects in group decision making, in 23rd Conference on User Modeling, Adaptation, and Personalization (UMAP’15), Dublin. Lecture Notes in Computer Science, vol. 9146 (2015), pp. 118–130

    Article  Google Scholar 

  26. J. Tiihonen, A. Felfernig, Towards recommending configurable offerings. Int. J. Mass Custom. 3(4), 389–406 (2010)

    Article  Google Scholar 

  27. C. Trattner, D. Elsweiler, Investigating the healthiness of internet-sourced recipes: implications for mean planning and recommender systems, in 26th International Conference on the World Wide Web (2017), pp. 489–498

    Google Scholar 

  28. T. Ulz, M. Schwarz, A. Felfernig, S. Haas, A. Shehadeh, S. Reiterer, M. Stettinger, Human computation for constraint-based recommenders. J. Intell. Inf. Syst. 49(1), 37–57 (2017)

    Article  Google Scholar 

  29. M. Uta, A. Felfernig, V.M. Le, A. Popescu, T.N.T. Tran, D. Helic, Evaluating Recommender Systems in Feature Model Configuration, in 25th ACM International Systems and Software Product Line Conference (SPLC’21) (2021), pp. 58–63

    Google Scholar 

  30. L. Xiao, Z. Min, Z. Yongfeng, G. Zhaoquan, L. Yiqun, M. Shaoping, Fairness-aware group recommendation with Pareto-efficiency, in ACM Conference on Recommender Systems (RecSys’17) (ACM, New York, 2017), pp. 107–115

    Google Scholar 

  31. A. Zapata, V. Menéndez, M. Prieto, C. Romero, Evaluation and selection of group recommendation strategies for collaborative searching of learning objects. Int. J. Hum. Comput. Stud. 76, 22–39 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Bergen, Bergen, Norway

    Christoph Trattner

  2. Department of Applied Information Technology, University of Gothenburg, Göteborg, Sweden

    Alan Said

  3. University of Cagliari, Cagliary, Italy

    Ludovico Boratto

  4. Institute of Software Technology, Graz University of Technology, Graz, Austria

    Alexander Felfernig

Authors
  1. Christoph Trattner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alan Said
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ludovico Boratto
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexander Felfernig
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christoph Trattner .

Editor information

Editors and Affiliations

  1. Graz University of Technology, Klagenfurt, Austria

    Alexander Felfernig

  2. University of Cagliari, Cagliari, Italy

    Ludovico Boratto

  3. Institute for Software Technology, Graz University, Graz, Austria

    Martin Stettinger

  4. Faculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Koper, Slovenia

    Marko Tkalčič

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Trattner, C., Said, A., Boratto, L., Felfernig, A. (2024). Evaluating Group Recommender Systems. In: Felfernig, A., Boratto, L., Stettinger, M., Tkalčič, M. (eds) Group Recommender Systems. Signals and Communication Technology. Springer, Cham. https://doi.org/10.1007/978-3-031-44943-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44943-7_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44942-0

  • Online ISBN: 978-3-031-44943-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation