Abstract
The paper describes the conceptual model of an emotion-aware car interface able to: map both the driver’s cognitive and emotional states with the vehicle dynamics; adapt the level of automation or support the decision-making process if emotions negatively affecting the driving performance are detected; ensure emotion regulation and provide a unique user experience creating a more engaging atmosphere (e.g. music, LED lighting) in the car cabin. To enable emotion detection, it implements a low-cost emotion recognition able to recognize Ekman’s universal emotions by analyzing the driver’s facial expression from stream video.
A preliminary test was conducted in order to determine the effectiveness of the proposed emotion recognition system in a driving context. Results evidenced that the proposed system is capable to correctly qualify the drivers’ emotion in a driving simulation context.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Stephens, A.N., Groeger, J.A.: Situational specificity of trait influences on drivers’ evaluations and driving behaviour. Transp. Res. Part F: Ttraff. Psychol. Behaviour 12(1), 29–39 (2009)
Walch, M., Lange, K., Baumann, M., Weber, M.: Autonomous driving: investigating the feasibility of car-driver handover assistance. In: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 11–18, September 2015
Bimbraw, K.: Autonomous cars: past, present and future a review of the developments in the last century, the present scenario and the expected future of autonomous vehicle technology. In: 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO), vol. 1, pp. 191–198. IEEE, July 2015
Pêcher, C., Lemercier, C., Cellier, J.M.: Emotions drive attention: effects on driver’s behaviour. Saf. Sci. 47(9), 1254–1259 (2009)
Özkan, T., Lajunen, T., Parker, D., Sümer, N., Summala, H.: Aggressive driving among british, dutch, finnish and turkish drivers. Int. J. Crashworthiness 16(3), 233–238 (2011)
Sârbescu, P.: Aggressive driving in Romania: psychometric properties of the driving anger expression inventory. Transp. Res. Part F Traffic Psychol. Behav. 15(5), 556–564 (2012)
Lisetti, C.L., Nasoz, F.: Affective intelligent car interfaces with emotion recognition. In: Proceedings of 11th International Conference on Human Computer Interaction, Las Vegas, NV, USA, July 2005
Matthews, G.: Towards a transactional ergonomics for driver stress and fatigue. Theor. Issues Ergon. Sci. 3(2), 195–211 (2002)
Jeon, M., Walker, B.N., Yim, J.B.: Effects of specific emotions on subjective judgment, driving performance, and perceived workload. Transp. Res. Part F: Traffic Psychol. Behav. 24, 197–209 (2014)
Jeon, M.: Emotions in driving. In: Emotions and Affect in Human Factors and Human-Computer Interaction, pp. 437–474. Academic Press (2017)
Ceccacci, S., Generosi, A., Giraldi, L., Mengoni, M.: Tool to make shopping experience responsive to customer emotions. Int. J. Autom. Technol. 12(3), 319–326 (2018)
Generosi, A., et al.: MoBeTrack: a toolkit to analyze user experience of mobile apps in the wild. In: 2019 IEEE International Conference on Consumer Electronics (ICCE), pp. 1–2. IEEE, January 2019
Generosi, A., Ceccacci, S., Mengoni, M.: A deep learning-based system to track and analyze customer behavior in retail store. In: 2018 IEEE 8th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), pp. 1–6. IEEE, September 2018
Ekman, P., Friesen, W.V.: Manual for the Facial Action Coding System. Consulting Psychologists Press, Ekman, P., Friesen, W.V.: Manual for the Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1978)
Nasoz, F., Lisetti, C.L., Vasilakos, A.V.: Affectively intelligent and adaptive car interfaces. Inf. Sci. 180(20), 3817–3836 (2010)
Katsis, C.D., Katertsidis, N., Ganiatsas, G., Fotiadis, D.I.: Toward emotion recognition in car-racing drivers: a biosignal processing approach. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 38(3), 502–512 (2008)
Jones, C.M., Jonsson, I.-M.: Performance analysis of acoustic emotion recognition for in-car conversational interfaces. In: Stephanidis, C. (ed.) UAHCI 2007. LNCS, vol. 4555, pp. 411–420. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73281-5_44
Tango, F., Botta, M., Minin, L., Montanari, R.: Non-intrusive detection of driver distraction using machine learning algorithms. In: ECAI, pp. 157–162, August 2010
Benedetto, S., Pedrotti, M., Minin, L., Baccino, T., Re, A., Montanari, R.: Driver workload and eye blink duration. Trans. Res. Part F Traffic Psychol. Behav. 14(3), 199–208 (2011)
Benitez-Quiroz, C.F., Srinivasan, R., Feng, Q., Wang, Y., Martinez, A.M.: EmotioNet challenge: recognition of facial expressions of emotion in the wild (2017)
Talipu, A., Generosi, A., Mengoni, M., Giraldi, L.: Evaluation of deep convolutional neural network architectures for emotion recognition in the wild. In: 2019 IEEE 23rd International Symposium on Consumer Technologies (ISCT), pp. 25–27. IEEE, June 2019
Gullà, F., Cavalieri, L., Ceccacci, S., Germani, M.: A BBN-based method to manage adaptive behavior of a smart user interface. Procedia CIRP 50, 535–540 (2016)
Toledo, T., Lotan, T.: In-vehicle data recorder for evaluation of driving behavior and safety, transportation research record: Journal of the Transportation Research Board, No. 1953, Transportation Research Board of the National Academies, Washington, D.C., 2006, pp. 112–119 (2006)
The Royal Society for the Prevention of Accidents: Road Safety and In-Vehicle Monitoring (Black Box) Technology, Policy Paper, February 2013 (2013)
Macdonald, W.A., Hoffmann, E.R.: Review of relationships between steering wheel reversal rate and driving task demand. Hum. Factors 22(6), 733–739 (1980)
Verster, J.C., Roth, T.: Standard operation procedures for conducting the on-the-road driving test, and measurement of the standard deviation of lateral position (SDLP). Int. J. Gen. Med. 4, 359 (2011)
Van Der Horst, R., Hogema, J.: Time-to-collision and collision avoidance systems. In: Proceedings of the 6th ICTCT Workshop (1993)
Saulino, G., Persaud, B., Bassani, M.: Calibration and application of crash prediction models for safety assessment of roundabouts based on simulated conflicts. In: Proceedings of the 94th Transportation Research Board (TRB) Annual Meeting, Washington, DC, USA, pp. 11–15 (2015)
Henia, W.M.B., Lachiri, Z.: Emotion classification in arousal-valence dimension using discrete affective keywords tagging. In: 2017 International Conference on Engineering & MIS (ICEMIS), pp. 1–6. IEEE, May 2017
Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, no. 9, pp. 904–908. Sage Publications, Los Angeles, October 2006
Bradley, M.M., Lang, P.J.: The International Affective Digitized Sounds (; IADS-2): Affective ratings of sounds and instruction manual. University of Florida, Gainesville, FL, Technical Rep. B-3 (2007)
Siedlecka, E., Denson, T.F.: Experimental methods for inducing basic emotions: a qualitative review. Emot. Rev. 11(1), 87–97 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ceccacci, S. et al. (2020). A Preliminary Investigation Towards the Application of Facial Expression Analysis to Enable an Emotion-Aware Car Interface. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Applications and Practice. HCII 2020. Lecture Notes in Computer Science(), vol 12189. Springer, Cham. https://doi.org/10.1007/978-3-030-49108-6_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-49108-6_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49107-9
Online ISBN: 978-3-030-49108-6
eBook Packages: Computer ScienceComputer Science (R0)