Skip to main content
Log in

Computer vision based eyewear selector

  • Image Processing
  • Published:
Journal of Zhejiang University SCIENCE C Aims and scope Submit manuscript

Abstract

The widespread availability of portable computing power and inexpensive digital cameras are opening up new possibilities for retailers in some markets. One example is in optical shops, where a number of systems exist that facilitate eyeglasses selection. These systems are now more necessary as the market is saturated with an increasingly complex array of lenses, frames, coatings, tints, photochromic and polarizing treatments, etc. Research challenges encompass Computer Vision, Multimedia and Human-Computer Interaction. Cost factors are also of importance for widespread product acceptance. This paper describes a low-cost system that allows the user to visualize different glasses models in live video. The user can also move the glasses to adjust its position on the face. The system, which runs at 9.5 frames/s on general-purpose hardware, has a homeostatic module that keeps image parameters controlled. This is achieved by using a camera with motorized zoom, iris, white balance, etc. This feature can be specially useful in environments with changing illumination and shadows, like in an optical shop. The system also includes a face and eye detection module and a glasses management module.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • ABS, 2007. Smart Look. Available from http://www.smartmirror.com [Accessed on July 30, 2007].

  • Activisu, 2007. Activisu Expert. Available from http://www.activisu.com [Accessed on July 30, 2007].

  • Arkin, R.C., Balch, T., 1997. AuRA: Principles and practice in review. J. Exper. Theor. Artif. Intell., 9(2–3):175–189. [doi:10.1080/095281397147068]

    Google Scholar 

  • Azuma, R.T., 1997. A survey of augmented reality. Presence, 6:355–385.

    Google Scholar 

  • Battocchi, A., Pianesi, F., 2004. Dafex: Un Database di Espressioni Facciali Dinamiche. SLI-GSCPWorkshop Comunicazione Parlata e Manifestazione delle Emozioni, p.1–11.

  • Bouguet, J., 1999. Pyramidal Implementation of the Lucas Kanade Feature Tracker. Technical Report, OpenCV Documents, Intel Corporation, Microprocessor Research Labs.

  • Breazeal, C., 1998. A Motivational System for Regulating Human-Robot Interaction. AAAI/IAAI, p.54–61.

  • Cañamero, D., 1997. Modeling Motivations and Emotions as a Basis for Intelligent Behavior. Proc. 1st Int. Conf. on Autonomous Agents, p.148–155. [doi:10.1145/267658.267688]

  • Carl Zeiss Vision, 2007. Lens Frame Assistant. Available from http://www.zeiss.com [Accessed on July 30, 2007].

  • Castrillón, M., Déniz, O., Hernández, M., Guerra, C., 2007. ENCARA2: real-time detection of multiple faces at different resolutions in video streams. J. Vis. Commun. Image Represent., 18(2):130–140. [doi:10.1016/j.jvcir.2006.11.004]

    Article  Google Scholar 

  • CBC Co., 2007. Camirror. Available from http://www.camirror.com [Accessed on July 30, 2007].

  • CyberImaging, 2007. CyberEyes. Available from http://www.cyber-imaging.com [Accessed on July 30, 2007].

  • Fiala, M., 2004. Artag, an Improved Marker System Based on Artoolkit. Technical Report, ERB-1111, NRC Canada.

  • Gadanho, S.C., Hallam, J., 2001. Robot learning driven by emotions. Adapt. Behav., 9(1):42–64. [doi:10.1177/105971230200900102]

    Article  Google Scholar 

  • GlassyEyes, 2009. Trying Eyeglasses Online. GlassyEyes Blog. Available from http://glassyeyes.blogspot.com [Accessed on Dec. 23, 2009].

  • Jesorsky, O., Kirchberg, K.J., Frischholz, R.W., 2001. Robust face detection using the Hausdorff distance. LNCS, 2091:90–95. [doi:10.1007/3-540-45344-X_14]

    Google Scholar 

  • Just, A., Rodriguez, Y., Marcel, S., 2006. Hand Posture Classification and Recognition Using the Modified Census Transform. Proc. Int. Conf. on Automatic Face and Gesture Recognition, p.351–356. [doi:10.1109/FGR.2006.62]

  • Kölsch, M., Turk, M., 2004. Robust Hand Detection. Proc. Sixth IEEE Int. Conf. on Automatic Face and Gesture Recognition, p.614–619. [doi:10.1109/AFGR.2004.1301601]

  • Kuttler, H., 2003. Seeing Is Believing. Using Virtual Tryons to Boost Premium Lens Sales. Available from http://www.2020mag.com [Accessed on Dec. 23, 2009].

  • Lee, J.S., Jung, Y.Y., Kim, B.S., Ko, S.J., 2001. An advanced video camera system with robust AF, AE and AWB control. IEEE Trans. Consum. Electron., 47(3):694–699. [doi:10.1109/30.964165]

    Article  Google Scholar 

  • Lepetit, V., Vacchetti, L., Thalmann, D., Fua, P., 2003. Fully Automated and Stable Registration for Augmented Reality Applications. Proc. 2nd IEEE and ACM Int. Symp. on Mixed and Augmented Reality, p.93–102. [doi:10.1109/ISMAR.2003.1240692]

  • Li, S., Zhu, L., Zhang, Z., Blake, A., Zhang, H., Shum, H., 2002. Statistical learning of multi-view face detection. LNCS, 2353:67–81. [doi:10.1007/3-540-47979-1_5]

    Google Scholar 

  • Low, K.H., Leow, W.K., Ang, M.H.Jr., 2002. Integrated Planning and Control of Mobile Robot with Self-Organizing Neural Network. Proc. 18th IEEE Int. Conf. on Robotics and Automation, p.3870–3875. [doi:10.1109/ROBOT.2002.1014324]

  • Lyu, M.R., King, I., Wong, T.T., Yau, E., Chan, P.W., 2005. ARCADE: Augmented Reality Computing Arena for Digital Entertainment. Proc. IEEE Aerospace Conf., p.1–9. [doi:10.1109/AERO.2005.1559626]

  • Morgan, E., 2004. Dispensing’s New Wave. Eyecare Business. Available from http://www.eyecarebiz.com [Accessed on Dec. 23, 2009].

  • Nanda, H., Cutler, R., 2001. Practical Calibrations for a Real-Time Digital Omnidirectional Camera. Proc. Computer Vision and Pattern Recognition Conf., p.3578–3596.

  • OfficeMate Software Systems, 2007. iPointVTO. Available from http://www.opticalinnovations.com [Accessed on July 30, 2007].

  • Picard, R., 1997. Affective Computing. MIT Press, Cambridge, MA.

    Google Scholar 

  • Practice, P., 2007. FrameCam. Available from http://www.paperlesspractice.com [Accessed on July 30, 2007].

  • Reimondo, A., 2007. OpenCV Swiki. Available from http://www.alereimondo.no-ip.org/OpenCV/ [Accessed on Dec. 23, 2009].

  • Roberts, K., Threlfall, I., 2006. Modern dispensing tools. Options for customised spectacle wear. Optometry Today, 46(12):26–31.

    Google Scholar 

  • Rodenstock, 2007. ImpressionIST. Available from http://www.rodenstock.com [Accessed on July 30, 2007].

  • Sanchez-Nielsen, E., Anton-Canalis, L., Guerra-Artal, C., 2005. An autonomous and user-independent hand posture recognition system for vision-based interface tasks. LNCS, 4177:113–122. [doi:10.1007/11881216_13]

    Google Scholar 

  • Schneiderman, H., Kanade, T., 2000. A Statistical Method for 3D Object Detection Applied to Faces and Cars. IEEE Conf. on Computer Vision and Pattern Recognition, p.1746–1759.

  • Stenger, B., Thayananthan, A., Torr, P., Cipolla, R., 2004. Hand pose estimation using hierarchical detection. LNCS, 3058:105–116. [doi:10.1007/b97917]

    Google Scholar 

  • Storring, M., Moeslund, T., Liu, Y., Granum, E., 2004. Computer Vision Based Gesture Recognition for an Augmented Reality Interface. 4th IASTED Int. Conf. on Visualization, Imaging, and Image Processing, p.766–771.

  • Swain, M.J., Ballard, D.H., 1991. Color indexing. Int. J. Comput. Vis., 7(1):11–32. [doi:10.1007/BF00130487]

    Article  Google Scholar 

  • Velasquez, J., 1997. Modeling Emotions and Other Motivations in Synthetic Agents. Proc. AAAI Conf., p.10–15.

  • Velasquez, J., 1998. Modeling Emotion-Based Decision Making. In: Canamero, D. (Ed.), Emotional and Intelligent: The Tangled Knot of Cognition. AAAI Press, Springer Netherlands, p.164–169.

    Google Scholar 

  • Viola, P., Jones, M.J., 2004. Robust real-time face detection. Int. J. Comput. Vis., 57(2):137–154. [doi:10.1023/B:VISI.0000013087.49260.fb]

    Article  Google Scholar 

  • Visionix, 2007. 3DiView 3D Virtual Try-on. Available from http://www.visionix.com [Accessed on July 30, 2007].

  • Wagner, S., Alefs, B., Picus, C., 2006. Framework for a Portable Gesture Interface. Proc. 7th Int. Conf. on Automatic Face and Gesture Recognition, p.275–280. [doi:10.1109/FGR.2006.54]

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Oscar Déniz.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Déniz, O., Castrillón, M., Lorenzo, J. et al. Computer vision based eyewear selector. J. Zhejiang Univ. - Sci. C 11, 79–91 (2010). https://doi.org/10.1631/jzus.C0910377

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/jzus.C0910377

Key words

CLC number

Navigation