Vladislav Maraev
Catherine Pelachaud
ABSTRACT
Gaze and laughter play a crucial role in managing miscommunication and coordinating social interactions. We hypothesise that models of laughter and gaze coordination in human dialogue extend to virtual entities. This paper describes methodology of the future experiment which involves a socially interactive agent (SIA) that incorporates previous theoretical findings.
- Gérard Bailly, Stephan Raidt, and Frédéric Elisei. 2010. Gaze, conversational agents and face-to-face communication. Speech Communication 52 (06 2010), 598–612. https://doi.org/10.1016/j.specom.2010.02.015Google Scholar
Digital Library
- Janet Beavin Bavelas, Linda Coates, and Trudy Johnson. 2002. Listener responses as a collaborative process: The role of gaze. Journal of Communication 52, 3 (2002), 566–580.Google ScholarCross Ref
- Geoffrey W Beattie. 1978. Sequential temporal patterns of speech and gaze in dialogue. Semiotica 23, 1-2 (1978), 29–52.Google ScholarCross Ref
- Yu Ding, Jing Huang, and Catherine Pelachaud. 2017. Audio-driven laughter behavior controller. IEEE Trans. on Affect. Comp. 8, 4 (2017), 546–558.Google ScholarCross Ref
- Gwyneth Doherty-Sneddon and Fiona G Phelps. 2005. Gaze aversion: A response to cognitive or social difficulty?Memory & cognition 33, 4 (2005), 727–733.Google Scholar
- Starkey Duncan. 1972. Some signals and rules for taking speaking turns in conversations.Journal of personality and social psychology 23, 2 (1972), 283.Google Scholar
- Jon Gillick, Wesley Deng, Kimiko Ryokai, and David Bamman. 2021. Robust Laughter Detection in Noisy Environments. In Proc. Interspeech 2021. 2481–2485. https://doi.org/10.21437/Interspeech.2021-353Google ScholarCross Ref
- Jonathan Ginzburg, Ellen Breitholtz, Robin Cooper, Julian Hough, and Ye Tian. 2015. Understanding Laughter. In Proceedings of the 20th Amsterdam Colloquium. 137–146.Google Scholar
- Arthur M Glenberg, Jennifer L Schroeder, and David A Robertson. 1998. Averting the gaze disengages the environment and facilitates remembering. Memory & Cognition 26, 4 (1998), 651–658.Google ScholarCross Ref
- Phillip Glenn. 2003. Laughter in interaction. Cambridge University Press, Cambridge.Google Scholar
- Charles Goodwin. 1980. Restarts, pauses, and the achievement of a state of mutual gaze at turn-beginning. Sociological inquiry 50, 3-4 (1980), 272–302.Google Scholar
- Marjorie Harness Goodwin and Charles Goodwin. 1986. Gesture and coparticipation in the activity of searching for a word. Semiotica 62, 1-2 (1986), 51–76.Google Scholar
- Kevin El Haddad, Sandeep Nallan Chakravarthula, and James Kennedy. 2019. Smile and laugh dynamics in naturalistic dyadic interactions: Intensity levels, sequences and roles. In 2019 International Conference on Multimodal Interaction. 259–263.Google ScholarDigital Library
- Kobin H Kendrick and Judith Holler. 2017. Gaze direction signals response preference in conversation. Research on Language and Social Interaction 50, 1 (2017), 12–32.Google ScholarCross Ref
- Jina Lee and Stacy Marsella. 2006. Nonverbal Behavior Generator for Embodied Conversational Agents. In Intelligent Virtual Agents, 6th International Conference, IVA 2006, Marina Del Rey, CA, USA, August 21-23, 2006, Proceedings(Lecture Notes in Computer Science, Vol. 4133), Jonathan Gratch, Robert Michael Young, Ruth Aylett, Daniel Ballin, and Patrick Olivier (Eds.). Springer, 243–255. https://doi.org/10.1007/11821830_20Google ScholarDigital Library
- Hieu-Thi Luong and Junichi Yamagishi. 2021. LaughNet: synthesizing laughter utterances from waveform silhouettes and a single laughter example. CoRR abs/2110.04946 (2021). arXiv:2110.04946https://arxiv.org/abs/2110.04946Google Scholar
- Maurizio Mancini, Beatrice Biancardi, Florian Pecune, Giovanna Varni, Yu Ding, Catherine Pelachaud, Gualtiero Volpe, and Antonio Camurri. 2017. Implementing and evaluating a laughing virtual character. ACM Trans. on Internet Technology (TOIT) 17, 1 (2017), 1–22.Google ScholarDigital Library
- Chiara Mazzocconi, Vladislav Maraev, Vidya Somashekarappa, and Christine Howes. 2021. Looking for Laughs: Gaze Interaction with Laughter Pragmatics and Coordination. In Proceedings of the 2021 International Conference on Multimodal Interaction (Montréal, QC, Canada) (ICMI ’21). Association for Computing Machinery, New York, NY, USA, 636–644. https://doi.org/10.1145/3462244.3479947Google ScholarDigital Library
- Chiara Mazzocconi, Ye Tian, and Jonathan Ginzburg. 2020. What’s your laughter doing there? A taxonomy of the pragmatic functions of laughter. IEEE Trans. on Affective Computing (2020), 1–1. https://doi.org/10.1109/TAFFC.2020.2994533Google ScholarCross Ref
- Patricia Mirenda, Anne Donnellan, and David Yoder. 1984. Gaze behavior: A new look at an old problem. Journal of Autism and Developmental Disorders 13 (01 1984), 397–409. https://doi.org/10.1007/BF01531588Google ScholarCross Ref
- Tomohiro Nagata and Hiroki Mori. 2020. Defining Laughter Context for Laughter Synthesis with Spontaneous Speech Corpus. IEEE Trans. Affect. Comput. 11, 3 (2020), 553–559. https://doi.org/10.1109/TAFFC.2018.2813381Google ScholarCross Ref
- Radosław Niewiadomski, Elisabetta Bevacqua, Maurizio Mancini, and Catherine Pelachaud. 2009. Greta: an interactive expressive ECA system. In Proc. AAMS 2009. International Foundation for Autonomous Agents and Multiagent Systems, 1399–1400.Google Scholar
- Magalie Ochs, Catherine Pelachaud, and Gary Mckeown. 2017. A User Perception–Based Approach to Create Smiling Embodied Conversational Agents. Trans on Interactive Intelligent Systems 7, 1 (2017).Google Scholar
- Robert R Provine. 2004. Laughing, tickling, and the evolution of speech and self. Current Directions in Psychological Science 13, 6 (2004), 215–218.Google ScholarCross Ref
- Tanya Romaniuk. 2009. The ‘Clinton Cackle’: Hillary Rodham Clinton’s Laughter in News Interviews. Crossroads of Language, Interaction, and Culture 7 (2009), 17–49.Google Scholar
- Federico Rossano. 2013. Gaze in Conversation. In The handbook of conversation analysis, Jack Sidnell and Tanya Stivers (Eds.). John Wiley & Sons, Chapter 15, 308.Google Scholar
- Federico Rossano, Penelope Brown, and Stephen C Levinson. 2009. Gaze, questioning and culture. In Conversation Analysis: Comparative Perspectives. 187–249.Google Scholar
- JP De Ruiter. 2005. If eye-gaze frequency drops, its relationship with turn-taking disappears. In Poster presented at AMLAP.Google Scholar
- Olof Sandgren, Richard Andersson, Joost van de Weijer, Kristina Hansson, and Birgitta Sahlén. 2012. Timing of gazes in child dialogues: A time-course analysis of requests and back channelling in referential communication. International Journal of Language & Communication Disorders 47, 4 (2012), 373–383.Google ScholarCross Ref
- Franklin R Schneier, Thomas L Rodebaugh, Carlos Blanco, Hillary Lewin, and Michael R Liebowitz. 2011. Fear and avoidance of eye contact in social anxiety disorder. Comprehensive psychiatry 52, 1 (2011), 81–87.Google Scholar
- Gordon Stanley and Donald S Martin. 1968. Eye-contact and the recall of material involving competitive and noncompetitive associations. Psychonomic Science 13, 6 (1968), 337–338.Google ScholarCross Ref
- Catherine J. Stevens, Bronwyn Pinchbeck, Trent Lewis, Martin Luerssen, Darius Pfitzner, David M. W. Powers, Arman Abrahamyan, Yvonne Leung, and Guillaume Gibert. 2016. Mimicry and expressiveness of an ECA in human-agent interaction: familiarity breeds content!Computational Cognitive Science 2, 1 (06 2016). https://doi.org/10.1186/s40469-016-0008-2Google ScholarCross Ref
- Obed Torres, Justine Cassell, and Scott Prevost. 1997. Modeling gaze behavior as a function of discourse structure. In First International Workshop on Human-Computer Conversation. Citeseer.Google Scholar
- Kaibin Xu, Junpei Zhong, and Kristiina Jokinen. 2021. It is Time to Laugh: Discovering Specific Contexts for Laughter with Attention Mechanism. In 2021 IEEE 4th International Conference on Information Systems and Computer Aided Education (ICISCAE). 211–215. https://doi.org/10.1109/ICISCAE52414.2021.9590766Google ScholarCross Ref
Index Terms
- Towards investigating gaze and laughter coordination in socially interactive agents
Recommendations
Looking for Laughs: Gaze Interaction with Laughter Pragmatics and Coordination
ICMI '21: Proceedings of the 2021 International Conference on Multimodal InteractionLaughter and gaze have an important role in managing and coordi-nating social interactions. In the current work, using a multimodal corpus of dyadic taste-testing interactions, we explore whether laughs performing different pragmatic functions are ...
Who's next?: Integrating Non-Verbal Turn-Taking Cues for Embodied Conversational Agents
IVA '23: Proceedings of the 23rd ACM International Conference on Intelligent Virtual AgentsTaking turns in a conversation is a delicate interplay of various signals, which we as humans can easily decipher. Embodied conversational agents (ECAs) communicating with humans should leverage this ability for smooth and enjoyable conversations. ...
Laughter entrainment in dyadic interactions: Temporal distribution and form
AbstractIt has been established across a wide range of communicative behaviours that conversational partners tend to become more similar during their interaction. This phenomenon, often called entrainment, has been shown to take place not only ...
Highlights- Laughter entrainment examined across languages: French, German and Mandarin Chinese.
Comments