Sean M. McNee
Dan Cosley
Joseph A. Konstan
John Riedl
ABSTRACT
Collaborative filtering has proven to be valuable for recommending items in many different domains. In this paper, we explore the use of collaborative filtering to recommend research papers, using the citation web between papers to create the ratings matrix. Specifically, we tested the ability of collaborative filtering to recommend citations that would be suitable additional references for a target research paper. We investigated six algorithms for selecting citations, evaluating them through offline experiments against a database of over 186,000 research papers contained in ResearchIndex. We also performed an online experiment with over 120 users to gauge user opinion of the effectiveness of the algorithms and of the utility of such recommendations for common research tasks. We found large differences in the accuracy of the algorithms in the offline experiment, especially when balanced for coverage. In the online experiment, users felt they received quality recommendations, and were enthusiastic about the idea of receiving recommendations in this domain.
- Breese, J., Heckerman, D., and Kadie, C. Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In Proc. UAI 98, Madison, 1998, 43--52. Google Scholar
Digital Library
- Bollacker, K., Lawrence, S., and Giles, C. L. Discovering relevant scientific literature on the web. IEEE Intelligent Systems, 15(2), 42--47, 2000. Google ScholarDigital Library
- Egghe, L., and Rousseau, R. Introduction to Informetrics. Elsevier, Amsterdam, 1990.Google Scholar
- Friedman, N., Gieger, M., and Goldszmidt, M. Bayesian Network Classifiers. Machine Learning, 29, 131--163, 1997. Google ScholarDigital Library
- Garfield, E. Citation Indexing: Its Theory and Application in Science, Technology, and Humanities. Wiley, New York, 1979.Google Scholar
- Goldberg, K., Roeder, T., Gupta, D., and Perkins, K. Eigentaste: A Constant Time Collaborative Filtering Algorithm. Information Retrieval Journal, 4(2), 133--151. 2001. Google ScholarDigital Library
- Herlocker, J., Konstan, J. A., Borchers, A., and Riedl, J. An Algorithmic Framework for Performing Collaborative Filtering. In Proc. SIGIR 99, Berkeley, 1999, 230--237. Google ScholarDigital Library
- Hill, W., Stead, L., Rosenstein, M. and Furnas, G. Recommending and evaluating choices in a virtual community of use. In Proc. CHI 1995, Denver, 1995, 194--201. Google ScholarDigital Library
- Karypis, G. SUGGEST Top-N Recommendation Engine. Available for download from http://www.cs.umn.edu/ karpyis/suggest/.Google Scholar
- Kautz, H., Selman, B., and Shah, M. Referral Web: Combining Social Networks and Collaborative Filtering. Communications of the ACM, 40(3), 63--65, 1997. Google ScholarDigital Library
- Lawrence, S., Bollacker, K., and Giles, C. L. Indexing and Retrieval of Scientific Literature. In Proc. CIKM 99, Kansas City, 1998, 139--146. Google ScholarDigital Library
- Lawrence, S., Giles, C. L., and Bollacker, K. Digital libraries and autonomous citation indexing. IEEE Computer, 32(6), 67--71, 1999. Google ScholarDigital Library
- Newman, M. E. J. Scientific collaboration networks: I. Network construction and fundamental results. Phys. Rev. E 64, 016131, 2001.Google ScholarCross Ref
- Rashid, A. M., Albert, I., Cosley, D., Lam, S. K., McNee, S. M., Konstan, J. A., and Riedl, J. Getting to Know You: Learning New User Preferences in Recommender Systems. In Proc. IUI 02, San Francisco, 2002, 127--134. Google ScholarDigital Library
- Resnick, P., Iacovou, N., Sushak, M., Bergstrom, P., and Riedl, J. GroupLens: An Open Architecture for Collaborative Filtering of Netnews. In Proc. CSCW 94, Chapel Hill, 1994, 175--186. Google ScholarDigital Library
- Sarwar, B., Karypis, G, Konstan, J. A., and Riedl, J. Item-based Collaborative Filtering Recommendation Algorithms. In Proc. WWW 10, Hong Kong, 2001, 285--295. Google ScholarDigital Library
- Scott, J. Social Network Analysis: A Handbook, 2nd Edition. Sage Publications, London, 2000.Google Scholar
- Shardanand, U., and Maes, P. Social Information Filtering: Algorithms for Automating "Word of Mouth". In Proc. CHI 95, Denver, 1995, 210--217. Google ScholarDigital Library
- Terveen, L., Hill, W., Amento, B., McDonald, D., and Creter, J. PHOAKS: A system for sharing recommendations. Communications of the ACM, 40(3), 59--62, 1997. Google ScholarDigital Library
- Woodruff, A., Gossweiler, R., Pitkow, J., Chi, E.H., and Card, S. K. Enhancing a Digital Book with a Reading Recommender. In Proc. CHI 2000, Amsterdam, 2000, 153--160. Google ScholarDigital Library
Index Terms
- On the recommending of citations for research papers
Recommendations
REFEREE: an open framework for practical testing of recommender systems using ResearchIndex
VLDB '02: Proceedings of the 28th international conference on Very Large Data BasesAutomated recommendation (e.g., personalized product recommendation on an ecommerce web site) is an increasingly valuable service associated with many databases--typically online retail catalogs and web logs. Currently, a major obstacle for evaluating ...
A Scalable, Accurate Hybrid Recommender System
WKDD '10: Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data MiningRecommender systems apply machine learning techniques for filtering unseen information and can predict whether a user would like a given resource. There are three main types of recommender systems: collaborative filtering, content-based filtering, and ...
A probabilistic model for recommending to new cold-start non-registered users
Recommender Systems are designed to provide recommendations to registered users. Non-registered users can be regarded as a particular case of the pure new user cold-start problem. Since non-registered users have neither created a profile account nor ...
Comments