Abstract
Laughter is a strong social signal in human-human and human-machine communication. However, very few attempts to model it exist. In this paper we discuss several challenges regarding the generation of laughs. We focus, more particularly, on two aspects a) modeling laughter with different intensities and b) modeling respiration behavior during laughter. Both of these models combine a data-driven approach with high-level animation control. Careful analysis and implementation of the synchronization mechanisms linking visual and respiratory cues has been undertaken. It allows us to reproduce the highly correlated multimodal signals of laughter on a 3D virtual agent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adelsward, V.: Laughter and dialogue: The social significance of laughter in institutional discourse. Nordic Journal of Linguistics 102(12), 107–136 (1989)
Provine, R.: Laughter. American Scientist 84(1), 38–47 (1996)
Huber, T., Ruch, W.: Laughter as a uniform category? a historic analysis of different types of laughter. In: 10th Congress of the Swiss Society of Psychology. University of Zurich, Switzerland (2007)
Huber, T., Drack, P., Ruch, W.: Sulky and angry laughter: The search for distinct facial displays. In: Banninger-Huber, E., Peham, D. (eds.) Current and Future Perspectives in Facial Expression Research: Topics and Methodical Questions, pp. 38–44. Universitat Innsbruck (2009)
Martin, R.: Is laughter the best medicine? humor, laughter, and physical health. Current Directions in Psychological Science 11(6), 216–220 (2002)
Urbain, J., Niewiadomski, R., Bevacqua, E., Dutoit, T., Moinet, A., Pelachaud, C., Picart, B., Tilmanne, J., Wagner, J.: AVLaughterCycle. enabling a virtual agent to join in laughing with a conversational partner using a similarity-driven audiovisual laughter animation. Journal of Multimodal User Interfaces 4(1), 47–58 (2010)
Fukushima, S., Hashimoto, Y., Nozawa, T., Kajimoto, H.: Laugh enhancer using laugh track synchronized with the user’s laugh motion. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems (CHI 2010), pp. 3613–3618 (2010)
Ruch, W., Ekman, P.: The expressive pattern of laughter. In: Kaszniak, A. (ed.) Emotion Qualia, and Consciousness, pp. 426–443. Word Scientific Publisher (2001)
Cosker, D., Edge, J.: Laughing, crying, sneezing and yawning: Automatic voice driven animation of non-speech articulations. In: Proceedings of Computer Animation and Social Agents, CASA (2009)
DiLorenzo, P., Zordan, V., Sanders, B.: Laughing out loud: Control for modeling anatomically inspired laughter using audio. ACM Transactions on Graphics 27(1) (2008)
Melo, C.D., Kenny, P., Gratch, J.: Real-time expression of affect through respiration. Computer Animation and Virtual Worlds 21, 225–234 (2010)
Kider, J., Pollock, K., Safonova, A.: A data-driven appearance model for human fatigue. In: Spencer, S. (ed.) Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2011), pp. 119–128. ACM, New York (2011)
Niewiadomski, R., Urbain, J., Pelachaud, C., Dutoit, T.: Finding out the audio and visual features that influence the perception of laughter intensity and differ in inhalation and exhalation phases. In: Proceedings of 4th International Workshop on Corpora for Research on Emotion, Sentiment & Social Signals, LREC 2012, Istanbul, Turkey (2012)
Urbain, J., Bevacqua, E., Dutoit, T., Moinet, A., Niewiadomski, R., Pelachaud, C., Picart, B., Tilmanne, J., Wagner, J.: The AVLaughterCycle Database. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC 2010), Valletta, Malta, pp. 2996–3001. European Language Resources Association (ELRA) (2010)
Urbain, J., Dutoit, T.: A Phonetic Analysis of Natural Laughter, for Use in Automatic Laughter Processing Systems. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011, Part I. LNCS, vol. 6974, pp. 397–406. Springer, Heidelberg (2011)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Beermann, U., Gander, F., Hiltebrand, D., Wyss, T., Ruch, W.: Laughing at oneself: Trait or state? In: Banninger-Huber, E., Peham, D. (eds.) Current and Future Perspectives in Facial Expression Research: Topics and Methodical Questions, pp. 31–36. Universitat Innsbruck (2009)
Drack, P., Huber, T., Ruch, W.: The apex of happy laughter: A FACS-study with actors. In: Banninger-Huber, E., Peham, D. (eds.) Current and Future Perspectives in Facial Expression Research: Topics and Methodical Questions, pp. 32–37. Universitat Innsbruck (2009)
Darwin, C.: The expression of the emotions in man and animals. John Murray, London (1972)
Bartneck, C., Reichenbach, J.: Subtle emotional expressions of synthetic characters. International Journal Human-Computer Studies 62(2), 179–192 (2005)
Ostermann, J.: Face animation in MPEG-4. In: Pandzic, I.S., Forchheimer, R. (eds.) MPEG-4 Facial Animation - The Standard Implementation and Applications, pp. 17–55. Wiley, Chichester (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Niewiadomski, R., Pelachaud, C. (2012). Towards Multimodal Expression of Laughter. In: Nakano, Y., Neff, M., Paiva, A., Walker, M. (eds) Intelligent Virtual Agents. IVA 2012. Lecture Notes in Computer Science(), vol 7502. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33197-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-33197-8_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33196-1
Online ISBN: 978-3-642-33197-8
eBook Packages: Computer ScienceComputer Science (R0)