Abstract
This paper aims at defining a real-time probabilistic model for user’s mood in its dialect with a software agent, which has a long-term goal of counseling the user in the domain of “coping with exam pressure”. We propose a new approach based on Hidden Markov Models (HMMs) to describe the differences in the sequence of emotions expressed due to different moods experienced by users. During real time operation, each user move is passed on to a vocal affect recognizer. The decisions from the recognizer about the kind of emotion expressed are then mapped into code-words to generate a sequence of discrete symbols for HMM models of each mood. We train and test the system using corpora of the temporal sequences of tagged emotional utterances by six male and six female adult Indians in English and Hindi language. Our system achieved an average f-measure rating for all moods of approximately 78.33%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Charniak, E.: Statistical language learning. MIT Press, Cambridge (1993)
Fox, A.: Prosodic Features and Prosodic Structure. Oxford University Press (2000)
Morris, W.N.: Mood: The frame of mind. Springer, New York (1989)
Becker, P.: Structural and Relational Analyses of Emotion and Personality Traits. In: Zeitschrift für Differentielle und Diagnostische Psychologie (2001) (in German)
Asawa, K., Verma, V., Aggrawal, A.: Recognition of Vocal Emotions from Acoustic Profile. In: Proceedings of International Conference on Advances in Computing, Communications and Informatics, Chennai (2012)
Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)
Davidson, R.: Honoring biology in the study of affective style. In: Ekman, P., Davidson, R. (eds.) The Nature of Emotion: Fundamental Questions, pp. 321–328 (1994)
Picard, R.W.: Affective computing: challenges. Int. J. Human- Comput. Stud 59(12), 55–64 (2003)
Batliner, A., Steidl, S., Hacker, C., Noth, E., Niemann, E.: Private emotions vs social interaction: towards new dimensions in research on emotions. In: Carberry, S., De Rosis, F. (eds.) Procs. of the Workshop on Adapting the Interaction Style to Affective Factors (2005)
Levin, E., Pieraccini, R., Eckert, W.: Using Markov decision process for learning dialogue strategies. In: Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing, vol. 1, pp. 201–204 (1998)
Stolcke, A., Coccaro, N., Bates, R., Taylor, P., Van Ess-Dykema, C., Ries, K., Shriberg, E., Jurafsky, D., Martin, R., Meteer, M.: Dialogue act modeling for automatic tagging and recognition of conversational speech. Comput. Linguist 26(3) (2000)
Novielli, N.: HMM modeling of user engagement in advice-giving dialogues. J. Multimodal User Interfaces 3, 131–140 (2010)
Schuller, B., Rigoll, G., Lang, M.: Hidden Markov Model-Based Speech Emotion Recognition. In: ICASSP, vol. 1, pp. 1–4 (2003)
Vlasenko, B., Wendemuth, A.: Tuning Hidden Markov Models for Speech Emotion Recognition. In: 33rd German Annual Conference on Acoustics, Stuttgart, Germany (2007)
Pantic, M., Bartlett, M.S.: Machine Analysis of Facial Expressions. In: Delac, K., Grgic, M. (eds.) Face Recognition, pp. 377–416. I-Tech Education and Publishing, Vienna
Kapoor Ashish Picard R.: Multimodal Affect Recognition in Learning Environments, Singapore (2005)
Kapoor, A., Picard, R.W., Ivanov, Y.: Probabilistic combination of multiple modalities to detect interest. In: ICPR (August 2004)
Elgammal, A., Shet, V., Yacoob, Y., Davis, L.S.: Learning dynamics for exemplar based gesture recognition. In: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, pp. 571–578 (2003)
Vardhan, R., Asawa, K., Goel, S.: Emotion elicitation in a virtual dialog agent of an interactive counseling system. In: National Conference on Advances in Computer Sciences, Communication and Information Technologies, New Delhi (2012)
Jahmm – Hidden Markov Model (HMM): An Implementation of HMM in java, http://www.run.montefiore.ulg.ac.be/~francois/software/jahmm
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Asawa, K., Vardhan, R. (2013). HMM Modeling of User Mood through Recognition of Vocal Emotions. In: Vinh, P.C., Hung, N.M., Tung, N.T., Suzuki, J. (eds) Context-Aware Systems and Applications. ICCASA 2012. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 109. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36642-0_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-36642-0_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36641-3
Online ISBN: 978-3-642-36642-0
eBook Packages: Computer ScienceComputer Science (R0)