skip to main content
abstract

Report on the CHIIR 2018 Workshop on Evaluation of Personalisation in Information Retrieval (WEPIR 2018)

Published:31 August 2018Publication History
Skip Abstract Section

Abstract

The Workshop on Evaluation of Personalisation in Information Retrieval (WEPIR 2018) was held in conjunction with the ACM SIGIR Conference on Human Information Interaction & Retrieval (CHIIR 2018) in New Brunswick, USA. The purpose of WEPIR 2018 was to bring together researchers from different backgrounds, interested in advancing the evaluation of personalisation in information retrieval. The workshop focused on developing a common understanding of the challenges, requirements and practical limitations of evaluation of personalisation in information retrieval.

References

  1. M. Agosti, N. Fuhr, E. Toms, and P. Vakkari. Evaluation methodologies in information retrieval. Dagstuhl Seminar 13441, Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Schloss Dagstuhl, Germany, 2014.Google ScholarGoogle Scholar
  2. N. J. Belkin, S. Dumais, N. Kando, and M. Sanderson. Whole-session evaluation of interactive information retrieval systems. NII Shonan Meeting Report 2012-7, National Institute of Informatics, Japan, Tokyo, Japan, 2016.Google ScholarGoogle Scholar
  3. O. Conlan, L. Kelly, K. Koidl, S. Lawless, K. Levacher, and A. Staikopoulos, editors. EvalUMAP2016: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization, Halifax, Canada, 2016.Google ScholarGoogle Scholar
  4. S. Dumais and N. J. Belkin. The TREC interactive tracks: Putting the user into search. In E. M. Voorhees and D. K. Harman, editors, TREC. Experiment and evaluation in information retrieval, pages 123 - 152. MIT Press, Cambridge, MA, 2005.Google ScholarGoogle Scholar
  5. S. Erdelez and I. Jahnke. Personalized systems and illusion of serendipity: A sociotechnical lens. In Proceedings of WEPIR 2018, New Brunswick, USA, 2018.Google ScholarGoogle Scholar
  6. J. Gwizdka. Neuro-physiological data as a source of evaluation metrics for personalized IR. In Proceedings of WEPIR 2018, New Brunswick, USA, 2018.Google ScholarGoogle Scholar
  7. S. Hall, R. Champoux, S. Garver, C. Harriott, and K. Chauncey. Designing the user experience of a co-adaptive data analytics interface in response to user trait. In Proceedings of WEPIR 2018, New Brunswick, USA, 2018.Google ScholarGoogle Scholar
  8. G. J. F. Jones, G. Pasi, A. Angiolillo, and C. Sanvitto. A proposed method for laboratory-based evaluation of personalised information retrieval. In Proceedings of WEPIR 2018, New Brunswick, USA, 2018.Google ScholarGoogle Scholar
  9. E. Kanoulas, B. Carterette, P. D. Clough, and M. Sanderson. Evaluating multi-query sessions. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, pages 1053-1062, Beijing, China, 2011. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. Kumpulainen, H. Huurdeman, and H. Keskustalo. Personalization needs extension towards task stages in collaborative research work tasks. In Proceedings of WEPIR 2018, New Brunswick, USA, 2018.Google ScholarGoogle Scholar
  11. G. Pasi, G. J. F. Jones, S. Marrara, C. Sanvitto, D. Ganguly, and P. Sen. Overview of the CLEF 2017 personalised information retrieval pilot lab (PIR-CLEF 2017). In Proceedings of CLEF 2017, Dublin, Ireland, 2017. Springer.Google ScholarGoogle Scholar
  12. C. Sanvitto, D. Ganguly, G. J. F. Jones, and G. Pasi. A laboratory-based method for the evaluation of personalised search. In Proceedings of The Seventh International Workshop on Evaluating Information Access (EVIA 2016), Tokyo, Japan, 2016.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGIR Forum
    ACM SIGIR Forum  Volume 52, Issue 1
    June 2018
    167 pages
    ISSN:0163-5840
    DOI:10.1145/3274784
    Issue’s Table of Contents

    Copyright © 2018 Authors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 31 August 2018

    Check for updates

    Qualifiers

    • abstract

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader