Skip to main content
SpringerLink
Log in

A recommender system for the TV on the web: integrating unrated reviews and movie ratings

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

The activity of Social-TV viewers has grown considerably in the last few years—viewers are no longer passive elements. The Web has socially empowered the viewers in many new different ways, for example, viewers can now rate TV programs, comment them, and suggest TV shows to friends through Web sites. Some innovations have been exploring these new activities of viewers but we are still far from realizing the full potential of this new setting. For example, social interactions on the Web, such as comments and ratings in online forums, create valuable feedback about the targeted TV entertainment shows. In this paper, we address this last setting: a media recommendation algorithm that suggests recommendations based on users’ ratings and unrated comments. In contrast to similar approaches that are only ratings-based, we propose the inclusion of sentiment knowledge in recommendations. This approach computes new media recommendations by merging media ratings and comments written by users about specific entertainment shows. This contrasts with existing recommendation methods that explore ratings and metadata but do not analyze what users have to say about particular media programs. In this paper, we argue that text comments are excellent indicators of user satisfaction. Sentiment analysis algorithms offer an analysis of the users’ preferences in which the comments may not be associated with an explicit rating. Thus, this analysis will also have an impact on the popularity of a given media show. Thus, the recommendation algorithm—based on matrix factorization by Singular Value Decomposition—will consider both explicit ratings and the output of sentiment analysis algorithms to compute new recommendations. The implemented recommendation framework can be integrated on a Web TV system where users can view and comment entertainment media from a video-on-demand service. The recommendation framework was evaluated on two datasets from IMDb with 53,112 reviews (50 % unrated) and Amazon entertainment media with 698,210 reviews (26 % unrated). Recommendation results with ratings and the inferred preferences—based on the sentiment analysis algorithms—exhibited an improvement over the ratings only based recommendations. This result illustrates the potential of sentiment analysis of user comments in recommendation systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. http://www.amazon.com.

  2. http://www.netflix.com.

  3. https://github.com/JohnLangford/vowpal_wabbit/wiki.

  4. http://sifter.org/~simon/journal/20061211.html.

  5. http://www.imdb.com.

  6. http://www.cs.cornell.edu/people/pabo/movie-review-data.

  7. http://131.193.40.52/data/.

References

  1. Aciar, S., et al.: Informed recommender: basing recommendations on consumer product reviews. IEEE Intell. Syst. 22(3), 39–47 (2007)

    Article  Google Scholar 

  2. Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)

    Article  Google Scholar 

  3. Baccianella, S., et al.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC’10) (2010)

  4. Baudisch, P.: Recommending TV programs: how far can we get at zero user effort? AAAI Workshop on Recommender Systems (1998)

  5. Bespalov, D., et al.: Sentiment classification based on supervised latent n-gram analysis. Building, 375–382 (2011)

  6. Bollen, J.: Determining the public mood state by analysis of microblogging posts. Alife XII Conf. MIT Press (2010)

  7. Brown, B., Barkhuus, L.: The television will be revolutionized: effects of PVRs and filesharing on television watching. ACM SIGCHI Conference on Human Factors in Computing Systems. ACM (2006)

  8. Das, S., Chen, M.: Yahoo! for Amazon: sentiment parsing from small talk on the Web. EFA 2001 Barcelona Meetings (2001)

  9. Denecke, K.: Are SentiWordNet scores suited for multi-domain sentiment classification? In: Proceedings of ICDIM’2009, 33–38 (2009)

  10. Diakopoulos, N.A., Shamma, D.A.: Characterizing debate performance via aggregated twitter sentiment. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems (2010)

  11. Ding, X., et al.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the International Conference on Web Search and Web Data Mining, pp. 231–240 (2008)

  12. Esuli, A., Sebastiani, F.: Determining the semantic orientation of terms through gloss classification. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management CIKM 05, 617 (2005)

  13. Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of the 5th Conference on Language Resources and Evaluation (LREC’06). Citeseer (2006)

  14. Ferman, A.M., et al.: Multimedia content recommendation engine with automatic inference of user preferences. In: IEEE International Conference on Image Processing (2003)

  15. Harboe, G., et al.: Ambient social TV: drawing people into a shared experience. In: ACM SIGCHI Conference on Human Factors in Computing Systems. ACM (2008)

  16. Haythornthwaite, C.: The strength and the impact of new media. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences (HICSS-34)-Volume 1-Volume 1. IEEE Computer Society (2001)

  17. Heerschop, B., et al.: Polarity analysis of texts using discourse structure. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management CIKM 11, 1061 (2011)

  18. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM (2004)

  19. Jakob, N., et al.: Beyond the stars: exploiting free-text user reviews to improve the accuracy of movie recommendations. In: Proceeding of the 1st International CIKM Workshop on TOPIC-Sentiment Analysis for Mass Opinion (TSA), pp. 57–64 (2009)

  20. Jenkins, H.: Convergence Culture—Where Old and New Collide. NYU Press, New York (2006)

    Google Scholar 

  21. Jindal, N., Liu, B.: Opinion spam and analysis. In: WSDM’08 Proceedings of the International Conference on Web Search and Web Data Mining, pp. 219–230 (2008)

  22. Kim, S.-M., Hovy, E.: Determining the sentiment of opinions. In: Proceedings of the 20th International Conference on Computational Linguistics COLING 04, 1367-es (2004)

  23. Koren, Y.: Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 447–456 (2009)

  24. Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 426–434 (2008)

  25. Koren, Y., et al.: Matrix factorization techniques for recommender systems. IEEE Comput. 42(8), 30–37 (2009)

    Article  MathSciNet  Google Scholar 

  26. Leung, C.W.K., et al.: Integrating collaborative filtering and sentiment analysis: a rating inference approach. In: Proceedings of the ECAI 2006 Workshop on Recommender Systems, pp. 62–66 (2006)

  27. Liu, B.: Sentiment analysis and subjectivity. Handbook of Natural Language Processing. (2010), 978-1420085921

  28. Moshfeghi, Y., et al.: Handling data sparsity in collaborative filtering using emotion and semantic based features. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information—SIGIR’11 (New York, NY, USA, Jul. 2011), 625 (2011)

  29. Ohana, B., Tierney, B.: Sentiment classification of reviews using SentiWordNet. In: 9th. IT & T Conference (2009)

  30. Oliveira, E. et al.: Ifelt: accessing movies through our emotions. In; Proceedings of the 9th International Interactive Conference on Interactive Television—EuroITV’11 (New York, NY, USA, Jun. 2011), 105 (2011)

  31. Pang, B., et al.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-Volume 10, 79–86 (2002)

  32. Pang, B., Lee, L.: A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the Association for Computational Linguistics (ACL) (2004)

  33. Pang, B., Lee, L.: Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. Computer 43(1), 115–124 (2005)

    Google Scholar 

  34. Qu, L., et al.: The bag-of-opinions method for review rating prediction from sparse text patterns. In: COLING’10 Proceedings of the 23rd International Conference on Computational Linguistics, pp. 913–921 (2010)

  35. Sparling, E.I.: Rating: how difficult is it? Methodology 21(3), 149–156 (2011)

    Google Scholar 

  36. Takama, Y., Muto, Y.: Profile generation from TV watching behavior using sentiment analysis. In: Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology—Workshops. IEEE Computer Society (2007)

  37. Takamura, H., et al.: Extracting semantic orientations of words using spin model. In: Proceedings of ACL05 43rd Annual Meeting of the Association for Computational Linguistics, pp. 133–140 (2005)

  38. Turney, P.: Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics (2002)

  39. Turney, P.D., Littman, M.L.: Measuring praise and criticism: inference of semantic orientation from association. ACM Trans. Inf. Syst. 21(4), 37 (2003)

    Article  Google Scholar 

  40. Turney, P.D., Littman, M.L.: Unsupervised learning of semantic orientation from a hundred-billion-word corpus. Information Retrieval. ERB-1094, 11 (2002)

    Google Scholar 

  41. Uchyigit, G., Clark, K.: Personalised multi-modal electronic program guide. In: European Conference on Interactive Television: from Viewers to Actors? (2003)

  42. Vildjiounaite, E., Kyllönen, V.: Unobtrusive dynamic modelling of TV program preferences in a household. Changing Television (2008)

  43. Xu, J., Zhang, L.: The development and prospect of personalized TV program recommendation systems. Multimedia Software Engineering (2002)

  44. Yi, J., et al.: Sentiment analyzer: extracting sentiments about a given topic using natural language processing techniques. In: IEEE International Conference on Data Mining (ICDM), pp. 427–434 (2003)

  45. Yuan, G.X., et al.: Recent advances of large-scale linear classification. Computer 3, 1–15 (2011)

    Google Scholar 

  46. Zaletelj, J., et al.: Real-time viewer feedback in the iTV production. European Conference on Interactive Television and Video. ACM (2009)

  47. Zhang, W., et al.: Augmenting online video recommendations by fusing review sentiment classification. Data Mining Workshops (ICDMW), 2010 IEEE International Conference on, pp. 1143–1150 (2010)

Download references

Acknowledgments

The authors are much appreciated to the authors of [19] who have kindly provided us with their IMDb dataset. This work has been funded by the Portuguese Foundation for Science and Technology under project references UTA-Est/MAI/0010/2009 and PEst-OE/EEI/UI0527/2011, Centro de Informática e Tecnologias da Informação (CITI/FCT/UNL)—2011–2012.

Author information

Authors and Affiliations

  1. Departamento de Informática, Centro de Informática e Tecnologias da Informação, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, 2829-516, Caparica, Portugal

    Filipa Peleja, Pedro Dias, Flávio Martins & João Magalhães

Authors
  1. Filipa Peleja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pedro Dias
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Flávio Martins
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. João Magalhães
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Magalhães.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Peleja, F., Dias, P., Martins, F. et al. A recommender system for the TV on the web: integrating unrated reviews and movie ratings. Multimedia Systems 19, 543–558 (2013). https://doi.org/10.1007/s00530-013-0310-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-013-0310-8

Keywords

Search

Navigation