Eric M. Meisner
ABSTRACT
Humans rely on a finely tuned ability to recognize and adapt to socially relevant patterns in their everyday face-to-face interactions. This allows them to anticipate the actions of others, coordinate their behaviors, and create shared meaning to communicate. Social robots must likewise be able to recognize and perform relevant social patterns, including interactional synchrony, imitation, and particular sequences of behaviors. We use existing empirical work in the social sciences and observations of human interaction to develop nonverbal interactive capabilities for a robot in the context of shadow puppet play, where people interact through shadows of hands cast against a wall. We show how information theoretic quantities can be used to model interaction between humans and to generate interactive controllers for a robot. Finally, we evaluate the resulting model in an embodied human-robot interaction study. We show the benefit of modeling interaction as a joint process rather than modeling individual agents.
- C. L. Breazeal, Designing Sociable Robots. Cambridge, MA: MIT Press, 2002. Google Scholar
Digital Library
- G. R. Semin, "Grounding communication: Synchrony, Social Psychology: Handbook of Basic Principles 2nd Edition, pp. 630--649, 2007.Google Scholar
- K. Dautenhahn, B. Ogden, and T. Quick,"From embodied to socially embedded agents' Implications for interaction-aware robots,"Cognitive Systems Research, vol. 3, pp. 397--428, 2002. Google ScholarDigital Library
- L.W. Barsalou, C. Breazeal, and L. B. Smith, Cognition as coordinated non-cognition,"Cognitive Processing, vol. 8, no. 2, pp. 79--91, June 2007.Google Scholar
- E. R. Smith and G. R. Semin, Socially situated cognition: Cognition in its social context, Advances in Experimental Social Psychology, vol. 36, pp. 53--117, 2004.Google Scholar
- S. Sabanovic, M. P. Michalowski, and L. R. Caporael, Making friends: Building social robots through interdisciplinary collaboration, in Multidisciplinary Collaboration for Socially Assistive Robotics: Papers from the 2007 AAAI Spring Symposium, Technical Report SS-07-07. AAAI, March 2007, pp. 71--77.Google Scholar
- W. S. Condon and L.W. Sander,"Synchrony demonstrated between movements of the neonate and adult speech,"Child Development, vol. 45, no. 2, pp. 456--462, 1974.Google ScholarCross Ref
- D. McNeill, Gesture & Thought. Chicago: Chicago University Press, 2005.Google Scholar
- C. Crick, M. Munz, T. Nad, and B. Scassellati, Robotic drumming: Synchronization in social tasks, in IEEE ROMAN, 2006, pp. 97--102.Google ScholarCross Ref
- M. P. Michalowski, S. Sabanovic, and H. Kozima, A dancing robot for rhythmic social interaction, in Human-Robot Interaction Conference, 2007. Google ScholarDigital Library
- H. Ogawa and T. Watanabe, Interrobot: speech-driven embodied interaction robot," Advanced Robotics, vol. 15, pp. 371--377, 2001.Google Scholar
- H. Clark and S. A. Brennan, Perspectives on socially shared cognition. Academic Press, 1991, ch. Grounding in communication.Google Scholar
- L. Barrett,"Too much monkey business,"in Proc. Grounding Sociality: Neurons, Minds, and Culture, 2007.Google Scholar
- J. K. Burgoon, L. A. Stern, and L. Dillman, Interpersonal Adaptation: Dyadic Interaction Patterns. Cambridge: Cambridge University Press, 1995.Google Scholar
- L. R. Caporael, The evolution of truly social cognition: The core configuration model,"Personality and Social Psychology Review, vol. 1, pp. 276--298, 1997.Google Scholar
- E. Z. Tronick and J. F. Cohn, "Infant-mother face-to-face interaction: age and gender differences in coordination and the occurrence of miscoordination,"Child Development, vol. 60, no. 1, pp. 85--92, 1989.Google ScholarCross Ref
- T. L. Chartrand and J. A. Bargh,"The chameleon effect: The perception-behavior link and social interaction, Journal of Personality and Social Psychology, vol. 76, pp. 893--910, 1999.Google ScholarCross Ref
- P. Andry, P. Gaussier, S. Moga, J. P. Banquet, and J. Nadel,"Learning and communication via imitation: An autonomous robot perspective, IEEE Trans. Systems, Man, and Cybernetics, vol. 31, no. 5, pp. 431--442, 2000. Google ScholarDigital Library
- S. Penny, Embodied cultural agents: at the intersection of robotics, cognitive science, and interactive art, in AAAI Socially Intelligent Agents Symposium, 1997.Google Scholar
- M. Blow, K. Dautenhahn, A. Appleby, C. L. Nehaniv, and D. Lee,"The art of designing robot faces: Dimensions for human-robot interaction, in HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. New York, NY, USA: ACM, 2006, pp. 331--332. Google ScholarDigital Library
- H. Kozima and C. Nakagawa, Social robots for children: Practice in communication-care, in Proc. IEEE Intl. Workshop on Advanced Motion Control, 2006, pp. 768--773.Google ScholarCross Ref
- F. J. Bernieri, J. S. Reznick, and R. Rosenthal, Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions,"Journal of Personality and Social Psychology, vol. 54, no. 2, pp. 243--253, 1988.Google Scholar
- Meisner and Sabanovic,"Shadow puppet interaction site,"May 2008, www.cs.rpi.edu/~meisne/interaction.Google Scholar
- M.-K. Hu,"Visual pattern recognition by moment invariants, Information Theory, IEEE Transactions on, vol. 8, no. 2, pp. 179--187, 1962.Google Scholar
- M. Cuturi and J.-P. Vert, A mutual information kernel for sequences, Proc. IEEE Intl. Joint Conf. on Neural Networks, vol. 3, pp. 1905--1910 vol.3, July 2004.Google ScholarCross Ref
- M. Seeger,"Covariance kernels from bayesian generative models, in NIPS, vol. 14, 2002, pp. 905--912.Google Scholar
- Meisner, www.cs.rpi.edu/~meisne/interaction/wam.html.Google Scholar
Index Terms
- ShadowPlay: a generative model for nonverbal human-robot interaction
Recommendations
Robotic Stand-Up Comedy: State-of-the-Art
Distributed, Ambient and Pervasive Interactions: Understanding HumansAbstractHumanoid and social robots have to perform in socially acceptable ways. They interact with humans and support humans in their needs and their activities. Stand-up comedy is an extreme form of human-human and human-audience interaction. It can be ...
Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions
In human-human interactions, entrainment is a naturally occurring phenomenon that happens when interlocutors mutually adapt their behaviors through the course of an interaction. This mutual behavioral dependency has been at the center of psychological ...
How Robots’ Unintentional Metacommunication Affects Human–Robot Interactions. A Systemic Approach
AbstractIn this paper, we theoretically address the relevance of unintentional and inconsistent interactional elements in human–robot interactions. We argue that elements failing, or poorly succeeding, to reproduce a humanlike interaction create ...
Comments