Abstract
Automatic emotion recognition is a major topic in the area of human--robot interaction. This paper presents an emotion recognition system based on physiological signals . Emotion induction experiments which induced joy, sadness, anger, and pleasure were conducted on 11 subjects. The subjects’ electrocardiogram (ECG) and respiration (RSP) signals were recorded simultaneously by a physiological monitoring device based on wearable sensors. Compared to the non-wearable physiological monitoring devices often used in other emotion recognition systems, the wearable physiological monitoring device does not restrict the subjects’ movement. From the acquired physiological signals, one hundred and forty-five signal features were extracted. A feature selection method based on genetic algorithm was developed to minimize errors resulting from useless signal features as well as reduce computation complexity. To recognize emotions from the selected physiological signal features, a support vector machine (SVM) method was applied, which achieved a recognition accuracy of 81.82, 63.64, 54.55, and 30.00 % for joy, sadness, anger, and pleasure, respectively. The results showed that it is feasible to recognize emotions from physiological signals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bai L, Ma H, Huang YX (2005) The development of native chinese affective picture system–a pretest in 46 college students. Chin Ment Health J 19(11):719–722
Beck AT, Steer RA, Brown GK (1996) Manual for the beck depression inventory-II. Technical report. Psychological Corporation, San Antonio, Texas
Biehl M, Matsumoto D, Ekman P et al (1997) Matsumoto and Ekman’s Japanese and Caucasian facial expressions of emotion (JACFEE): reliability data and cross-national differences. J Nonverbal Behav 21(1):3–21. doi:10.1023/A:1024902500935
Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on Computational learning theory, pp 144–152
Bradley MM, Lang PJ (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical report, The Center for Research in Psychophysiology, University of Florida, Gainesville, Florida
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297. doi:10.1007/BF00994018
Cover TM, Van Campenhout JM (1977) On the possible orderings in the measurement selection problem. IEEE Trans Syst Man Cybern 7(9):657–661. doi:10.1109/TSMC.1977.4309803
Deb K, Pratap A, Agarwal S et al (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197. doi:10.1109/4235.996017
Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17(2):124. doi:10.1037/h0030377
Gendron M, Barrett LF (2009) Reconstructing the past: a century of ideas about emotion in psychology. Emot Rev 1(4):316–339. doi:10.1177/1754073909338877
Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Networks 13(2):415–425. doi:10.1109/72.991427
Kim J, André E (2008) Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 30(12):2067–2083. doi:10.1109/TPAMI.2008.26
Knerr S, Personnaz L, Dreyfus G (1990) Single-layer learning revisited: a stepwise procedure for building and training a neural network. Neurocomputing. Springer, Heidelberg, pp 41–50. doi:10.1007/978-3-642-76153-9_5
Kučera D, Haviger J (2012) Using mood induction procedures in psychological research. Procedia Soc Behav Sci 69:31–40. doi:10.1016/j.sbspro.2012.11.380
Lisetti CL, Nasoz F (2004) Using noninvasive wearable computers to recognize human emotions from physiological signals. EURASIP J Appl Sig Process 2004(11):1672–1687. doi:10.1155/S1110865704406192
Picard RW, Vyzas E, Healey J (2001) Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175–1191. doi:10.1109/34.954607
Rattanyu K, Ohkura M, Mizukawa M (2010) Emotion monitoring from physiological signals for service robots in the living space. In: 2010 International conference on control automation and systems. Gyeonggi-do, pp 580–583
Rubin DC, Talarico JM (2009) A comparison of dimensional models of emotion: evidence from emotions, prototypical events, autobiographical memories, and words. Memory 17(8):802–808
Schlosberg H (1954) Three dimensions of emotion. Psychol Rev 61(2):81. doi:10.1037/h0054570
van’t Wout M, Chang LJ, Sanfey AG (2010) The influence of emotion regulation on social interactive decision-making. Emotion 10(6):815–821. doi:10.1037/a0020069
Verma GK, Tiwary US (2014) Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals. Neuroimage 102(P1):162–172. doi:10.1016/j.neuroimage.2013.11.007
Zhou CC, Tu CL, Tian J et al (2015) A low power miniaturized monitoring system of six human physiological parameters based on wearable body sensor network. Sens Rev 35(2):210–218. doi:10.1108/SR-08-2014-687
Acknowledgments
This work is supported by National Science and Technology Major Project of the Ministry of Science and Technology of China (No. 2013ZX03005008). And the authors would like to thank Congcong Zhou, Chunlong Tu, Jian Tian, Jingjie Feng, and Yun Gao for their physiological monitoring device and advice.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Zhejiang University Press and Springer Science+Business Media Singapore
About this paper
Cite this paper
He, C., Yao, Yj., Ye, Xs. (2017). An Emotion Recognition System Based on Physiological Signals Obtained by Wearable Sensors. In: Yang, C., Virk, G., Yang, H. (eds) Wearable Sensors and Robots. Lecture Notes in Electrical Engineering, vol 399. Springer, Singapore. https://doi.org/10.1007/978-981-10-2404-7_2
Download citation
DOI: https://doi.org/10.1007/978-981-10-2404-7_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-2403-0
Online ISBN: 978-981-10-2404-7
eBook Packages: EngineeringEngineering (R0)