Skip to main content
SpringerLink
Log in
Book cover

Progresses in Artificial Intelligence and Neural Systems pp 25–32Cite as

Passengers’ Emotions Recognition to Improve Social Acceptance of Autonomous Driving Vehicles

  • Chapter
  • First Online:

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 184))

Abstract

Autonomous driving cars hopefully could improve road safety. However, they pose new challenges, not only on a technological level but also from ethical and social points of view. In particular, social acceptance of those vehicles is a crucial point to obtain a widespread adoption of them. People nowadays are used to owning manually driven vehicles, but in the future, it will be more probable that the autonomous driving cars will not be owned by the end users, but rented like a sort of driverless taxis. Customers can feel uncomfortable while riding an autonomous driving car, while rental agencies will need to differentiate the services offered by their fleets of vehicles. If people are afraid to travel by these vehicles, even if from the technological point of view they are safer with respect to the manually driven ones, customers will not use them, making the safety improvements useless. To prevent the occupants of the vehicle from having bad feelings, the proposed strategy is to adapt the vehicle driving style based on their moods. This requires the usage of a neural network trained by means of facial expressions databases, of which there are many freely available online for research purposes. These resources are very useful, but it is difficult to combine them due to their different structures. To overcome this issue, a tool designed to uniform them, in order to use the same training scripts, and to simplify the application of commonly used postprocessing operations, has been implemented.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Burns L.D.: Sustainable mobility: a vision of our transport future. In: Nature 497(7448), 181–182 (2013)

    Google Scholar 

  2. Trògolo, A.M., Melchior, F., Medrano, L.A.: The role of difficulties in emotion regulation on driving behavior. J. Behav. Health Soc. Issues (2014). https://doi.org/10.5460/jbhsi.v6.1.47607

    Article  Google Scholar 

  3. Hu T, Xie X., Lee, J.: Negative or positive? The effect of emotion and mood on risky driving (2013). https://doi.org/10.1016/j.trf.2012.08.009

  4. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)

    Article  Google Scholar 

  5. DeepMind company website, https://deepmind.com/. Last accessed 10 May 2019

  6. Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)

    Article  Google Scholar 

  7. Ekman, P.: Basic Emotions. In: Dalgleish, T., Power, M.J. (eds.) Handbook of Cognition and Emotion, pp. 45–60. Wiley, New York, NY (1999)

    Google Scholar 

  8. Ekman, P., Cordaro, D.: What is meant by calling emotions basic. Emot. Rev. 3(4), 364–370 (2011)

    Article  Google Scholar 

  9. Cordaro, D.T., Sun, R., Keltner, D., Kamble, S., Huddar, N., McNeil, G.: Universals and cultural variations in 22 emotional expressions across five cultures. Emotion 18(1), 75–93 (2018)

    Article  Google Scholar 

  10. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  11. Ekman, Paul, Friesen, Wallace V., Hager, Joseph C.: Facial Action Coding System: The Manual on CD ROM. A Human Face, Salt Lake City (2002)

    Google Scholar 

  12. Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 300–305 (1998)

    Google Scholar 

  13. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)

    Article  Google Scholar 

  14. Fraedrich, E., Lenz, B.: Societal and individual acceptance of autonomous driving. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_29

  15. Fraedrich, E., Lenz, B.: Taking a drive, hitching a ride: autonomous driving and car usage. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_31

  16. Woisetschläger, D.M.: Consumer perceptions of automated driving technologies: an examination of use cases and branding strategies. In: Autonomous Driving (2016). https://doi.org/10.1007/978-3-662-48847-8_32

  17. Kanade, T., Cohn, J. F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG’00), Grenoble, France, pp. 46–53 (2000)

    Google Scholar 

  18. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade Dataset (CK+): a complete expression dataset for action unit and emotion-specified expression. In: Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB 2010), San Francisco, USA, pp. 94–101 (2010)

    Google Scholar 

  19. Goodfellow, I., Erhan, D., Carrier, P.L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D.H., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L., Xu, B., Chuang, Z., Bengio, Y.: Challenges in representation learning: a report on three machine learning contests. arXiv (2013)

    Google Scholar 

  20. Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets. In: 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205 (1998)

    Google Scholar 

  21. Aifanti, N., Papachristou, C., Delopoulos, A.: The MUG facial expression database. In: Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano, Italy, April 12–14 (2010)

    Google Scholar 

  22. Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D.H.J., Hawk, S.T., van Knippenberg, A.: Presentation and validation of the Radboud faces database. Cogn. Emot. 24(8), 1377–1388 (2010). https://doi.org/10.1080/02699930903485076

    Article  Google Scholar 

  23. Chollet, F., Keras, et al.: https://keras.io (2015). Last accessed 10 May 2019

  24. Scikit-learn: Machine Learning in Python, Pedregosa et al., JMLR 12, pp. 2825–2830 (2011)

    Google Scholar 

  25. Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools 120, 122–125 (2000)

    Google Scholar 

  26. Facial Expression Database Classifier (FEDC), https://github.com/AntonioMarceddu/Facial_Expression_Database_Classifier. Last accessed 10 May 2019

Download references

Author information

Authors and Affiliations

  1. Politecnico di Torino, Turin, Italy

    Jacopo Sini, Antonio Costantino Marceddu & Massimo Violante

  2. General Motors – Global Propulsion Systems, Turin, Italy

    Riccardo Dessì

Authors
  1. Jacopo Sini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Antonio Costantino Marceddu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Massimo Violante
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Riccardo Dessì
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jacopo Sini .

Editor information

Editors and Affiliations

  1. Dipartimento di Psicologia and IIASS, Università della Campania “Luigi Vanvitelli”, Caserta, Italy

    Anna Esposito

  2. Fundació Tecnocampus, Pompeu Fabra University, Mataró, Barcelona, Spain

    Marcos Faundez-Zanuy

  3. Department of Civil, Environmental, Energy, and Material Engineering, University Mediterranea of Reggio Calabria, Reggio Calabria, Italy

    Francesco Carlo Morabito

  4. Laboratorio di Neuronica, Dipartimento Elettronica e Telecomunicazioni , Politecnico di Torino, Torino, Italy

    Eros Pasero

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sini, J., Marceddu, A.C., Violante, M., Dessì, R. (2021). Passengers’ Emotions Recognition to Improve Social Acceptance of Autonomous Driving Vehicles. In: Esposito, A., Faundez-Zanuy, M., Morabito, F., Pasero, E. (eds) Progresses in Artificial Intelligence and Neural Systems. Smart Innovation, Systems and Technologies, vol 184. Springer, Singapore. https://doi.org/10.1007/978-981-15-5093-5_3

Download citation

Publish with us

Policies and ethics

Search

Navigation