Abstract
Emotion detection provides a promising basis for designing future-oriented human centered design of Human-Machine Interfaces. Affective Computing can facilitate human-machine communication. Such adaptive advanced driver assistance systems (ADAS) which are dependent on the emotional state of the driver can be applied in cars. In contrast to the majority of former studies that only used static recognition methods, we investigated a new dynamic approach for detecting emotions in facial expressions in an artificial setting and in a driving context. By analyzing the changes of an area defined by a number of dots that were arranged on participants’ faces, variables were extracted to classify the participants’ emotions according to the Facial Action Coding System. The results of our novel way to categorize emotions lead to a discussion on additional applications and limitations that frames an attempted approach of emotion detection in cars. Implications for further research and applications are outlined.
Chapter PDF
References
Crancer, A., Dille, J.M., Delay, J.C., Wallace, J.E., Haykins, M.D.: Comparison of the effects of marijuana and alcohol on simulated driving performance. Science 164, 851–854 (1969)
Weiler J.M., Bloomfield J.R., Woodworth G.G., Grant, A.R., Layton, T.A., Brown, T.L., McKenzie, D.R., Baker, T.W., Watson, G.S.: Effects of fexofenadine, diphenhydramine, and alcohol on driving performance. A randomized, placebo-controlled trial in the Iowa driving simulator. Annals of Internal Medicine 132, 354–363 (2000).
dpa Deutsche Presse-Agentur: Weniger Verkehrstote auf Europas Straßen. Frankfurter Rundschau, http://www.fr-online.de/auto/weniger-verkehrstote-auf-europas-strassen/-/1472790/3076970/-/index.html (retrieved June 23, 2009)
Mesken, J., Hagenzieker, M.P., Rothengatter, T., De Waard, D.: Frequency, determinants, and consequences of different drivers’ emotions: An on-the-road study using self-reports (observed) behaviour, and physiology. Transportation Research Part F 10, 458–475 (2007)
Nesbit, S.M., Conger, J.C., Conger, A.J.: A quantitative review of the relationship between anger and aggressive driving. Aggression and Violent Behavior 12(2), 156–176 (2007)
Levelt, P.B.M.: Praktijkstudie naar emoties in het verkeer (Emotions in Traffic). SWOV Report R-2003-08. SWOV, Leidschendam, Netherlands (2003)
Deffenbacher, J.L., Oetting, E.R., Lynch, R.S.: Development of a driving anger scale. Psychological Reports 74, 83–91 (1994)
Oehl, M., Roidl, E., Frehse, B., Suhr, J., Siebert, F.W., Pfister, H.-R., Höger, R.: Das Emotionsspektrum von Autofahrern im Straßenverkehr. In: Petermann, F., Koglin, U. (eds.) (Hrsg.), 47. Kongress der Deutschen Gesellschaft für Psychologie, Abstracts, pp. 371–372. Pabst Science Publishers, Lengerich (2010)
Wells-Parker, E., Ceminsky, J., Hallberg, V., Snow, R.W., Dunaway, G., Guiling, S., Williams, M., Anderson, B.: An exploratory study of the relationship between road rage and crash experience in a representative sample of US drivers. Accident Analysis and Prevention 34, 271–278 (2002)
Mesken, J., Lajunen, T., Summala, H.: Interpersonal violations, speeding violations and their relation to accident involvement in Finland. Ergonomics 45, 469–483 (2002)
Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)
Kirby, M., Sirovich, L.: Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 103–108 (1990)
Sirovich, L., Kirby, M.: Low-dimensional procedure for the characterization of human faces. Journal of the Optical Society of America A 4, 519–524 (1987)
Lin, C.-H., Wu, J.-L.: Automatic Facial Feature Extraction by Genetic Algorithms. IEEE Transactions on Image Processing 8, 834–845 (1999)
Rottenberg, J., Ray, R.D., Gross, J.J.: Emotion Elicitation Using Films. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 9–28. Oxford University Press, Oxford (2007)
Hewig, J., Hagemann, D., Seifert, J., Gollwitzer, M., Naumann, E., Bartussek, D.: A revised film set for the induction of basic emotions. Cognition & Emotion 19/7, 1095–1109 (2005)
Schaefer, A., Nils, F., Sanchez, X., Philippot, P.: Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers. Cognition & Emotion 24/7, 1153–1172 (2010)
Lang, P.J.: Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski, J.B., Johnson, J.H., Williams, T.A. (eds.) Technology in Mental Health Care Delivery Systems, pp. 119–137. Ablex, Norwood (1980)
Bradley, M.M., Lang, P.J.: Measuring Emotion: The Self-Assessment Manikin and the Semantic Differential. Ther. & Exp. Psychiat. 25/1, 49–59 (1994)
Kaiser, S., Wehrle, T.: Automated coding of facial behavior in humancomputer interactions with FACS. Journal of Nonverbal Behavior 16, 67–83 (1992)
Bassili, J.N.: Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37, 2049–2058 (1979)
Cohn, J.F., Ekman, P.: Measuring facial action by manual coding, facial EMG, and automatic facial image analysis. In: Harrigan, J.A., Rosenthal, R., Scherer, K. (eds.) Handbook of Nonverbal Behavior Research Methods in the Affective Sciences, pp. 9–64. Oxford University Press, New York (2005)
Mahalanobis, P.C.: On the generalised distance in statistics. Proceedings of the National Institute of Science of India 12, 49–55 (1936)
Lin, C.-H., Wu, J.-L.: Automatic Facial Feature Extraction by Genetic Algorithms. IEEE Transactions on Image Processing 8, 834–845 (1999)
Agarwal, M., Jain, N., Kumar, M., Agrawal, H.: Face Recognition using Principle Component Analysis, Eigenface and Neural Network. In: Jha, M., Long, C., Mastorakis, N., Bulucea, C.A. (eds.) Sensors, Signals, Visualization, Imaging, Simulation And Materials, pp. 204–208. The World Scientific and Engineering Academy and Society, Wisconsin (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tews, TK., Oehl, M., Siebert, F.W., Höger, R., Faasch, H. (2011). Emotional Human-Machine Interaction: Cues from Facial Expressions. In: Smith, M.J., Salvendy, G. (eds) Human Interface and the Management of Information. Interacting with Information. Human Interface 2011. Lecture Notes in Computer Science, vol 6771. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21793-7_73
Download citation
DOI: https://doi.org/10.1007/978-3-642-21793-7_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21792-0
Online ISBN: 978-3-642-21793-7
eBook Packages: Computer ScienceComputer Science (R0)