Naina Yadav
ABSTRACT
A recommendation system is a set of programs that utilize different methodologies for relevant item selection for the user. In recent years deep neural networks have been used heavily for improving recommendation quality in every domain. We describe a model for music recommendation system that uses the BERT (Bidirectional Encoder Representations from Transformers) model. In the past, other deep neural networks have been used for music recommendation, which capture the the unidirectional sequential nature of a user’s data. Unlike other sequential techniques of recommendation, BERT uses bidirectional training of a user’s sequence for better recommendation. BERT uses the encoder part of the Transformer model, which uses an attention mechanism to learn contextual relations between a user’s past interactions. The proposed model relies on a user’s previous interaction to determine the bidirectional encoding for the model, which considers both the left and the right contexts. We evaluated our model with a baseline deep sequential model using two different datasets, and comparative results show that the model outperforms other sequential models.
- Deger Ayata, Yusuf Yaslan, and Mustafa E Kamasak. 2018. Emotion based music recommendation system using wearable physiological sensors. IEEE transactions on consumer electronics 64, 2 (2018), 196–203.Google Scholar
Digital Library
- Thierry Bertin-Mahieux, Daniel P.W. Ellis, Brian Whitman, and Paul Lamere. 2011. The Million Song Dataset. In Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR 2011).Google Scholar
- Erion Çano and Maurizio Morisio. 2017. Hybrid recommender systems: A systematic literature review. Intelligent Data Analysis 21, 6 (2017), 1487–1524.Google ScholarDigital Library
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. A entive collaborative filtering: Multimedia recommendation with item-and component-level a ention. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval.Google ScholarDigital Library
- Rui Cheng and Boyang Tang. 2016. A music recommendation system based on acoustic features and user personalities. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 203–213.Google ScholarDigital Library
- Zhiyong Cheng, Jialie Shen, Lei Zhu, Mohan S Kankanhalli, and Liqiang Nie. 2017. Exploiting Music Play Sequence for Music Recommendation.. In IJCAI, Vol. 17. 3654–3660.Google Scholar
- Khalil Damak and Olfa Nasraoui. 2019. SeER: An Explainable Deep Learning MIDI-based Hybrid Song Recommender System. arXiv preprint arXiv:1907.01640(2019).Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).Google Scholar
- Ferdos Fessahaye, Luis Perez, Tiffany Zhan, Raymond Zhang, Calais Fossier, Robyn Markarian, Carter Chiu, Justin Zhan, Laxmi Gewali, and Paul Oh. 2019. T-recsys: A novel music recommendation system using deep learning. In 2019 IEEE International Conference on Consumer Electronics (ICCE). IEEE, 1–6.Google ScholarCross Ref
- Yuyun Gong and Qi Zhang. 2016. Hashtag recommendation using attention-based convolutional neural network.. In IJCAI. 2782–2788.Google Scholar
- Xiaowen Huang, Shengsheng Qian, Quan Fang, Jitao Sang, and Changsheng Xu. 2018. Csan: Contextual self-attention network for user sequential recommendation. In Proceedings of the 26th ACM international conference on Multimedia. 447–455.Google ScholarDigital Library
- Lei Jin, Dongfeng Yuan, and Haixia Zhang. 2017. Music recommendation based on embedding model with user preference and context. In 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(. IEEE, 688–692.Google ScholarCross Ref
- Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 197–206.Google ScholarCross Ref
- Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.Google ScholarDigital Library
- Tao Li, Minsoo Choi, Kaiming Fu, and Lei Lin. 2019. Music sequence prediction with mixture hidden markov models. In 2019 IEEE International Conference on Big Data (Big Data). IEEE, 6128–6132.Google ScholarCross Ref
- David Zhan Liu and Gurbir Singh. 2016. A recurrent neural network based recommendation system. tech. rep., Stanford University(2016).Google Scholar
- Andriy Mnih and Russ R Salakhutdinov. 2008. Probabilistic matrix factorization. In Advances in neural information processing systems. 1257–1264.Google Scholar
- Michael J Pazzani and Daniel Billsus. 2007. Content-based recommendation systems. In The adaptive web. Springer, 325–341.Google ScholarDigital Library
- Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to recommender systems handbook. In Recommender systems handbook. Springer, 1–35.Google Scholar
- Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton. 2007. Restricted Boltzmann machines for collaborative filtering. In Proceedings of the 24th international conference on Machine learning. 791–798.Google ScholarDigital Library
- Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web. 285–295.Google ScholarDigital Library
- J Ben Schafer, Dan Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. In The adaptive web. Springer, 291–324.Google Scholar
- Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1441–1450.Google ScholarDigital Library
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008.Google Scholar
- Qi Yang, Gaosheng Wu, Yuhua Li, Ruixuan Li, Xiwu Gu, Huicai Deng, and Junzhuang Wu. 2020. AMNN: Attention-Based Multimodal Neural Network Model for Hashtag Recommendation. IEEE Transactions on Computational Social Systems (2020).Google Scholar
- Chang Zhou, Jinze Bai, Junshuai Song, Xiaofei Liu, Zhengchao Zhao, Xiusi Chen, and Jun Gao. 2018. Atrank: An attention-based user behavior modeling framework for recommendation. In Thirty-Second AAAI Conference on Artificial Intelligence.Google ScholarCross Ref
Recommendations
A novel music recommender by discovering preferable perceptual-patterns from music pieces
SAC '10: Proceedings of the 2010 ACM Symposium on Applied ComputingNowadays, advanced information and communication technologies ease the access of music pieces. However, it is still hard for the users to find what she/he prefers from a huge amount of music works. To solve this problem, most music recommenders based on ...
A Web Recommender System for Recommending, Predicting and Personalizing Music Playlists
WISE '09: Proceedings of the 10th International Conference on Web Information Systems EngineeringIn this paper, we present a Web recommender system for recommending, predicting and personalizing music playlists based on a user model. We have developed a hybrid similarity matching method that combines collaborative filtering with ontology-based ...
A music recommendation system based on music and user grouping
Special issue: Intelligent multimedia applicationsIn this paper, we present a music recommendation system, which provides a personalized service of music recommendation. The polyphonic music objects of MIDI format are first analyzed for deriving information for music grouping. For this purpose, the ...
Comments