Xiaoling Gu
ABSTRACT
We demonstrate iGlasses, a novel recommendation system that accepts a frontal face photo as the input and returns the best-fit eyeglasses as the output. As conventional recommendation techniques such as collaborative filtering become inapplicable in the problem, we propose a new recommendation method which exploits the implicit matching rules between human faces and eyeglasses. We first define fine-grained attributes for human faces and frames of glasses respectively. Then, we develop a recommendation framework based on a probabilistic graphical model, which effectively captures the correlation among these fine-grained attributes. Ranking of the frames (glasses) is done by their similarity to the query facial attributes. Finally, we produce a synthesized image for the input face to demonstrate the visual effect when wearing the recommended glasses.
- G. Adomavicius and A. Tuzhilin. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6):734--749, 2005. Google Scholar
Digital Library
- T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models|their training and application. Comput. Vis. Image Underst., 61(1):38--59, 1995. Google ScholarDigital Library
- N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar. Describable visual attributes for face verification and image search. IEEE Trans. Pattern Anal. Mach. Intell., 2011. Google ScholarDigital Library
- T. Mensink, J. J. Verbeek, and G. Csurka. Tree-structured crf models for interactive image labeling. IEEE Trans. Pattern Anal. Mach. Intell., 2013. Google ScholarDigital Library
- C. Rother, V. Kolmogorov, and A. B. 0001. "grabcut": interactive foreground extraction using iterated graph cuts. ACM Trans. Graph., 23(3):309--314, 2004. Google ScholarDigital Library
- P. Viola and M. Jones. Robust real-time face detection. International Journal of Computer Vision, 57(2):137--154, 2004. Google ScholarDigital Library
Index Terms
- iGlasses: A Novel Recommendation System for Best-fit Glasses
Recommendations
Facial Landmark Detection and Tracking for Facial Behavior Analysis
ICMR '16: Proceedings of the 2016 ACM on International Conference on Multimedia RetrievalThe face is the most dominant and distinct communication tool of human beings. Automatic analysis of facial behavior allows machines to understand and interpret a human's states and needs for natural interactions. This research focuses on developing ...
Bayesian Additive Matrix Approximation for Social Recommendation
Social relations between users have been proven to be a good type of auxiliary information to improve the recommendation performance. However, it is a challenging issue to sufficiently exploit the social relations and correctly determine the user ...
Improving Content-based and Hybrid Music Recommendation using Deep Learning
MM '14: Proceedings of the 22nd ACM international conference on MultimediaExisting content-based music recommendation systems typically employ a \textit{two-stage} approach. They first extract traditional audio content features such as Mel-frequency cepstral coefficients and then predict user preferences. However, these ...
Comments