Skip to main content
SpringerLink
Log in

Smile Detection for User Interfaces

  • Conference paper
Advances in Visual Computing (ISVC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5359))

Included in the following conference series:

Abstract

Perceptual User Interfaces (PUIs) aim at facilitating human-computer interaction with the aid of human-like capacities (computer vision, speech recognition, etc.). In PUIs, the human face is a central element, since it conveys not only identity but also other important information, particularly with respect to the user’s mood or emotional state. This paper describes both a face detector and a smile detector for PUIs. Both are suitable for real-time interaction. The face detector provides eye, mouth and nose locations in frontal or nearly-frontal poses, whereas the smile detector is able to give a smile intensity measure. Experiments confirm that they are competitive with respect to extant detectors. These two detectors are used in an unobtrusive application that allows to interact with an Instant Messaging (IM) client.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hjelmas, E., Low, B.K.: Face detection: A survey. Computer Vision and Image Understanding 83, 236–274 (2001)

    Article  MATH  Google Scholar 

  2. Yang, M.H., Kriegman, D., Ahuja, N.: Detecting faces in images: A survey. Transactions on Pattern Analysis and Machine Intelligence 24, 34–58 (2002)

    Article  Google Scholar 

  3. Castrillón, M., Déniz, O., Hernández, M., Guerra, C.: ENCARA2: Real-time detection of multiple faces at different resolutions in video streams. Journal of Visual Communication and Image Representation, 130–140 (2007)

    Google Scholar 

  4. Viola, P., Jones, M.: Robust real-time face detection. IJCV 57, 151–173 (2004)

    Article  Google Scholar 

  5. Hewitt, R.: Seeing with OpenCV, part 2. Servo, 48–52 (2007)

    Google Scholar 

  6. Reimondo, A.: OpenCV Swiki. Last accessed: January 2008 (2008)

    Google Scholar 

  7. Battocchi, A., Pianesi, F.: Dafex: Un database di espressioni facciali dinamiche. In: SLI-GSCP Workshop Comunicazione Parlata e Manifestazione delle Emozioni (2004)

    Google Scholar 

  8. Entertainment.millionface.com: Smile detection technology in camera. Last accessed: January 2008 (2008)

    Google Scholar 

  9. Swik.net: Sony’s Cyber-shot T200 gets its first review. Last accessed: January 2008 (2008)

    Google Scholar 

  10. Omron Corp.: Omron OKAO vision system. Last accessed: January 2008 (2008)

    Google Scholar 

  11. Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36, 259–275 (2003)

    Article  MATH  Google Scholar 

  12. Pantic, M., Member, S., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 1424–1445 (2000)

    Article  Google Scholar 

  13. Ito, A., Wang, X., Suzuki, M., Makino, S.: Smile and laughter recognition using speech processing and face recognition from conversation video. In: Procs. of the 2005 IEEE Int. Conf. on Cyberworlds, CW 2005 (2005)

    Google Scholar 

  14. Shinohara, Y., Otsu, N.: Facial expression recognition using Fisher weight maps. In: Procs. of the IEEE Int. Conf. on AFGR (2004)

    Google Scholar 

  15. Kowalik, U., Aoki, T., Yasuda, H.: Broaference - a next generation multimedia terminal providing direct feedback on audience’s satisfaction level. In: INTERACT, pp. 974–977 (2005)

    Google Scholar 

  16. Kowalik, U., Aoki, T., Yasuda, H.: Using automatic facial expression classification for contents indexing based on the emotional component. In: EUC, pp. 519–528 (2006)

    Google Scholar 

  17. Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Procs. of the Third IEEE International Conference on Automatic Face and Gesture Recognition (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidad de Castilla-La Mancha, E.T.S.I.I, Campus Universitario, Avda. Camilo Jose Cela s/n, 13071, Spain

    O. Deniz & G. Bueno

  2. Dpto. Informatica y Sistemas,Edificio de Informatica, Universidad de Las Palmas de Gran Canaria, Campus de Tafira, 35017 Las Palmas, Spain

    M. Castrillon, J. Lorenzo & L. Anton

Authors
  1. O. Deniz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Castrillon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Lorenzo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. L. Anton
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. Bueno
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Mitsubishi Electric Research Laboratories, P.O. Box 02139, Cambridge, MA, USA

    Fatih Porikli

  7. Computer and Information Science and Engineering, University of Florida, P.O. Box, FL 32611-6120, Gainsville, USA

    Jörg Peters

  8. IBM T.J. Watson Research Center, 19 Skyline Drive, NY 10532, Hawthorne, USA

    James Klosowski

  9. 128 Memorial Mall, Stewart B001, IN 47907, West Lafayette, USA

    Laura Arns

  10. Denver Museum of Nature and Space, 2001 Colorade Blvd. Denver,, CO 80205, USA

    Yu Ka Chun

  11. Departmen of Computer Science,, NC State University, Campus Box 8206, NC 27695-8206, Raleigh, USA

    Theresa-Marie Rhyne

  12. Los Alamos National Labs, P.O. Box 1663, NM 87545, Los Alamos, USA

    Laura Monroe

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Deniz, O., Castrillon, M., Lorenzo, J., Anton, L., Bueno, G. (2008). Smile Detection for User Interfaces. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, vol 5359. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89646-3_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89646-3_59

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89645-6

  • Online ISBN: 978-3-540-89646-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation