Skip to main content
SpringerLink
Log in

Basic Facial Expressions Analysis on a 3D Model: Based on Action Units and the Nose Tip

  • Conference paper
  • First Online:
Advances of Science and Technology (ICAST 2019)

Included in the following conference series:

  • 847 Accesses

Abstract

Facial expressions play a significant role in conveying emotions with a widespread use across diverse cultures and societies globally. In particular, the expressions anger, sadness, fear, disgust, surprise, happiness and also neutral are considered universal. 2D and 3D avatar models are used to simulate facial expressions and have different applications in many domains. In this work, we consider a 3D model with facial expressions as a platform to analyze the basic set of expressions. We considered direction weighted intensity values of the FACS Action Units (i.e., also referred here as shape keys) relative to the nose tip, serving as a reference point, to generate direction weighted score for each target expression. The scores also give numerical validations for the repeated correlations indicated between a specific set of expressions (i.e., anger vs. sadness, and fear vs. disgust) in other research works that focus on developing techniques for facial expressions recognition and classification. In addition, the normal distribution of these seven expressions was depicted and gave a close to bell-curve shape which is an indication of a common phenomenon in nature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mehrabian, A.: Communication without words. Psychol. Today 2(4), 53–56 (1968)

    Google Scholar 

  2. Ekman, P., Friesen, W.: Pictures of Facial Affect. Consulting Psychologist, Palo Alto (1976)

    Google Scholar 

  3. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  4. Pandzic, I., Forchheimer, R. (eds.): MPEG-4 Facial Animation: the Standard, Implementationand Applications. Wiley, Hoboken (2002)

    Google Scholar 

  5. Adolphs, R.: Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behav. Cognitive Neurosci. Rev. 1(1), 21–62 (2002)

    Article  Google Scholar 

  6. Pantic, M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1424–1445 (2000)

    Article  Google Scholar 

  7. Sariyanidi, E., Gunes, H., Cavallaro, A.: Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(62015), 1113–1133 (2015)

    Article  Google Scholar 

  8. Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Measuring facial expressions by computer image analysis. Psychophysiology 36, 253–263 (1999)

    Article  Google Scholar 

  9. Zhong, L., Liu, Q., Yang, P., Liu, B., Huang, J., Metaxas, D.N.: Learning active facial patches for expression analysis. In: CVPR (2012)

    Google Scholar 

  10. ISO/IEC JTC1/SC29/WG11 MPEG96/N1365: MPEG4 SNHC: Face and body definition and animation parameters (1996)

    Google Scholar 

  11. Hai, T.S., Thai, L.H., Thuy, N.T.: Facial expression classification using artificial neural network and k-nearest neighbor. Int. J. Inf. Technol. Comput. Sci. 7, 27–32 (2015)

    Google Scholar 

  12. Zhang, Z., Lyons, M.J., Schuster, M., Akamatsu, S.: Comparison between geometry-based and gabor-wavelets-based facial expression recognition using multilayer perceptron. In: 3rd Automatic Face & Gesture Recognition. IEEE (1998)

    Google Scholar 

  13. Jaffar, M.A., Al Eisa, E.: Classification of facial expression using transformed features. Int. J. Inf. Electron. Eng. 4(4), 269–273 (2014)

    Google Scholar 

  14. Soyel, H., Demire, H.: Facial expression recognition using 3D facial feature distances. In: Affective Computing, Focus on Emotion Expression, Synthesis and Recognition (2008)

    Google Scholar 

  15. de Bittencourt Zavan, F.H., Nascimento, A.C.P., e Silva, L.P., Bellon, O.R.P., Silva, L.: 3D face alignment in the wild: a landmark-free, nose-based approach. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9914, pp. 581–589. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48881-3_40

    Chapter  Google Scholar 

  16. Scherer, K.R.: What are emotions? And how can they be measured? Soc. Sci. Inf. 44(4), 695–729 (2005)

    Article  Google Scholar 

  17. Takahashi, K.: Remarks on emotion recognition from bio-potential signals. In: Proceedings of the 2nd International Conference on Autonomous Robots and Agents. IEEE (2004)

    Google Scholar 

  18. Matlovic, T., Gaspar, P., Moro, R., Simko, J., Bielikova, M.: Emotions detection using facial expressions recognition and EEG. In: International Workshop on Semantic and Social Media Adaptation and Personalization. IEEE (2016)

    Google Scholar 

  19. Hamedi, M., Salleh, S.-H., Swee, T.T., Kamarulafizam: Surface electromyography-based facial expression recognition in bi-polar configuration. J. Comput. Sci. 7(9), 1407–1415 (2011)

    Google Scholar 

  20. DasGupta, A.: Probability for Statistics and Machine Learning: Fundamentals and Advanced Topics. Texts in Statistics. Springer, New York (2011). https://doi.org/10.1007/978-1-4419-9634-3

    Book  MATH  Google Scholar 

  21. Zhang, F., Zhang, T., Mao, Q., Xu, C.: Joint pose and expression modeling for facial expression recognition. In: CVPR (2018)

    Google Scholar 

  22. Ying, A.C.C., Ujir, H., Hipiny, I.: 3D facial expression intensity measurement analysis. In: Zulikha, J.N.H., Zakaria (eds.) Proceedings of the 6th International Conference of Computing and Informatics, pp. 43–48. School of Computing, Sintok (2017)

    Google Scholar 

  23. Pantic, M., Rothkrantz, L.: An expert system for recognition of facial actions and their intensity. American Association for Artificial Intelligence (2000)

    Google Scholar 

  24. Hussain, N., Ujir, H., Hipiny, I., Minoi, J.-L.: Facial action units recognition for emotional expression. Advanced Science Letters (ICCSE 2017), vol. 24 (2017)

    Google Scholar 

  25. Sun, Y., Reale, M., Yin, L.: Recognizing partial facial action units based on 3D dynamic range data for facial expression recognition. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 1–8 (2008)

    Google Scholar 

  26. https://github.com/hansonrobotics/HEAD/tree/master/src/blender_api. Accessed 11 Nov 2019

  27. Mahmood, S.A., Ghani, R.F., Kerim, A.A.: Nose tip detection using shape index and energy effective for 3D face recognition. Int. J. Mod. Eng. Res. (IJMER) 3(5), 3086–3090 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Addis Ababa University, Addis Ababa, Ethiopia

    Meareg A. Hailemariam

Authors
  1. Meareg A. Hailemariam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Meareg A. Hailemariam .

Editor information

Editors and Affiliations

  1. Bahir Dar University, Bahir Dar, Ethiopia

    Nigus Gabbiye Habtu

  2. Bahir Dar University, Bahir Dar, Ethiopia

    Delele Worku Ayele

  3. Bahir Dar University, Bahir Dar, Ethiopia

    Solomon Workneh Fanta

  4. Bahir Dar University, Bahir Dar, Ethiopia

    Bimrew Tamrat Admasu

  5. Bahir Dar University, Bahir Dar, Ethiopia

    Mekuanint Agegnehu Bitew

Rights and permissions

Reprints and permissions

Copyright information

© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hailemariam, M.A. (2020). Basic Facial Expressions Analysis on a 3D Model: Based on Action Units and the Nose Tip. In: Habtu, N., Ayele, D., Fanta, S., Admasu, B., Bitew, M. (eds) Advances of Science and Technology. ICAST 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 308. Springer, Cham. https://doi.org/10.1007/978-3-030-43690-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-43690-2_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-43689-6

  • Online ISBN: 978-3-030-43690-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation