Skip to main content

Computational Empathy Using Facial Emotion Recognition: An Update

  • Conference paper
  • First Online:
Proceedings of the Future Technologies Conference (FTC) 2023, Volume 4 (FTC 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 816))

Included in the following conference series:

  • 221 Accesses

Abstract

Facial emotion recognition plays a vital role in computational empathy enabling the nature and effectiveness of human-machine interaction. Although facial emotion has received much attention over the last years as the number of applications has increased, it remains a complicated issue due to facial features and ethnic and cultural differences in facial expressions. This short survey reviews the updated deep learning techniques used for facial emotion recognition. It explores and classifies deep learning models and datasets used for facial emotion recognition. The outcome of the reviews indicates that facial emotion recognition limits complexity and accuracy. This paper also points out the research directions for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Foggia, P., Greco, A., Saggese, A., Vento, M.: Multi-task learning on the edge for effective gender, age, ethnicity and emotion recognition. Eng. Appl. Artif. Intell. 118, 105651 (2023)

    Article  Google Scholar 

  2. Kaminska, D., et al.: Two-stage recognition and beyond for compound facial emotion recognition. Electronics 10(22), 2847 (2021)

    Article  Google Scholar 

  3. Khaireddin, Y., Chen, Z.: Facial emotion recognition: state of the art performance on FER2013. arXiv preprint arXiv:2105.03588 (2021)

  4. Khattak, A., Asghar, M.Z., Ali, M., Batool, U.: An efficient deep learning technique for facial emotion recognition. Multim. Tools Appl. 81(2), 1649–1683 (2022)

    Article  Google Scholar 

  5. Liu, S., Gao, P., Li, Y., Weina, F., Ding, W.: Multi-modal fusion network with complementarity and importance for emotion recognition. Inf. Sci. 619, 679–694 (2023)

    Article  Google Scholar 

  6. Mane, S., Shah, G.: Facial recognition, expression recognition, and gender identification. In: Balas, V.E., Sharma, N., Chakrabarti, A. (eds.) Data Management, Analytics and Innovation. AISC, vol. 808, pp. 275–290. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1402-5_21

  7. Mehendale, N.: Facial emotion recognition using convolutional neural networks (FERC). SN Appl. Sci. 2(3), 1–8 (2020). https://doi.org/10.1007/s42452-020-2234-1

    Article  Google Scholar 

  8. Ozdamli, F., Aljarrah, A., Karagozlu, D., Ababneh, M.: Facial recognition system to detect student emotions and cheating in distance learning. Sustainability 14(20), 13230 (2022)

    Article  Google Scholar 

  9. Pranav, E., Kamal, S., Satheesh Chandran, C., Supriya, M.H.: Facial emotion recognition using deep convolutional neural network. In: 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), pp. 317–320. IEEE (2020)

    Google Scholar 

  10. Sharma, P., et al.: Student engagement detection using emotion analysis, eye tracking and head movement with machine learning. In: Reis, A., et al. (eds.) Technology and Innovation in Learning, Teaching and Education: Third International Conference, TECH-EDU 2022, Lisbon, Portugal, 31 August–2 September 2022, Revised Selected Papers, pp. 52–68. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-22918-3_5

  11. Siddiqui, N., Reither, T., Dave, R., Black, D., Bauer, T., Hanson, M.: A robust framework for deep learning approaches to facial emotion recognition and evaluation. In: 2022 Asia Conference on Algorithms, Computing and Machine Learning (CACML), pp. 68–73. IEEE (2022)

    Google Scholar 

  12. Wang, X., Gong, J., Min, H., Yu, G., Ren, F.: LAUN improved StarGAN for facial emotion recognition. IEEE Access 8, 161509–161518 (2020)

    Article  Google Scholar 

  13. Yang, H.-C., et al.: How can research on artificial empathy be enhanced by applying deepfakes? J. Med. Internet Res. 24(3), e29506 (2022)

    Article  MathSciNet  Google Scholar 

  14. Zhou, H., et al.: Exploring emotion features and fusion strategies for audio-video emotion recognition. In: 2019 International Conference on Multimodal Interaction, pp. 562–566 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sudhanshu Semwal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alharbi, K., Semwal, S. (2023). Computational Empathy Using Facial Emotion Recognition: An Update. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2023, Volume 4. FTC 2023. Lecture Notes in Networks and Systems, vol 816. Springer, Cham. https://doi.org/10.1007/978-3-031-47448-4_7

Download citation

Publish with us

Policies and ethics