Skip to main content
SpringerLink
Log in

Personalizing Intelligent Systems and Robots with Human Motion Data

  • Chapter
  • First Online:
Robotics Research

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 114))

  • 4912 Accesses

Abstract

According to Merhabian, more than \(90\,\%\) of human-human communication is non-verbal when expressing affects and attitudes. Further studies have shown that a large proportion of non-verbal communication can be attributed to posture and to gesture. They communicate information about action: intent, meaning, as well as information about internal states such as affects. Emotional understanding is a key for satisfying and successful interaction between two or more humans, it must also be true for human-robot interaction. In this paper we explore the importance of non verbal information and communication, typically motion data, and how it can be used to develop and to personalize intelligent systems and robots. First, we present and discuss our findings on the strong correlation between what humans feel during an unannounced interaction with a humanoid robot and their movements and attitudes. Then, we propose a framework that uses not only the kinematics information of movements but also the dynamics. We use the direct measure of the dynamics when available. If not we propose to compute the dynamics from the kinematics, and use it to understand human motions. Finally, we discuss some developments and concrete applications in the field of health care and HRI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ayusawa, K., Venture, G., Nakamura, Y.: Identifiability and identification of inertial parameters using the underactuated base-link dynamics for legged multibody systems. Int. J. Robot. Res. (2013) (in press)

    Google Scholar 

  2. Baddoura, R., Matuskata, R., Venture, G.: The familiar as a key-concept in regulating the social and affective dimensions of HRI. In: Proceedings of the IEEE/RAS International Conference on Humanoid Robots, pp. 234–241 (2012)

    Google Scholar 

  3. Baddoura, R., Venture, G.: Social versus useful HRI: experiencing the familiar, perceiving the robot as a sociable partner and responding to its actions. Int. J. Soc. Robot. (2013)

    Google Scholar 

  4. Bartneck, C., Kanda, T., Ishiguro, H., Hagita, N.: My robotic doppelganger—a critical look at the uncanny valley theory. In: 18th IEEE International Symposium on Robot and Human Interactive Communication, pp. 269–276 (2009)

    Google Scholar 

  5. Baxter, P., Belpaeme, T., Cañamero, L., Cosi, P., Demiris, Y., Enescu, V., Hiolle, A., Kruijff-Korbayova, I., Looije, R., Nalin, M. et al.: Long-term human-robot interaction with young users. In: IEEE/ACM Human-Robot Interaction Conference (Robots with Children Workshop) (2011)

    Google Scholar 

  6. Bethel, C., Murphy, R.: Affective expression in appearance—constrained robots. In: ACM SIGCHI/SIGART Conference on Human Robotics, Interaction (2006)

    Book  Google Scholar 

  7. Bickmore, T., Vardoulakis, M.: L. and Pfeifer, and D. Schulman. Tinker: a relational agent museum guide. Autonom. Agents Multi-Agent Syst. 27(2), 254–276 (2013)

    Google Scholar 

  8. Biswas, R., Thrun, S., Fujimura, K.: Recognizing activities with multiple cues. Hum. Motion Underst. Model. Capture Anim. Lect. Notes Comput. Sci. 4814, 255–270 (2007)

    Article  Google Scholar 

  9. Breazeal, C., Gray, J., Berin, M.: Mindreading as a foundational skill for socially intelligent robots. Robot. Res. Springer Tracts Adv. Robot. 66, 383–394 (2011)

    Article  Google Scholar 

  10. Broadbent, E., Tamagawa, R., Patience, A., Knock, B., Kerse, N., Day, K., MacDonald, B.: Attitudes towards health-care robots in a retirement village. Australasian J. Ageing 31(2), 115–120 (2012)

    Article  Google Scholar 

  11. Burgard, W., Cremers, A., Fox, D., Hänel, D., Lakemeyer, G., Schulz, D., Steiner, W., Thrun, S.: The museum tour-guide robot rhino. In: Autonome Mobile Systeme 1998. Informatik aktuell, pp. 245–254. Springer, Heidelberg (1999)

    Google Scholar 

  12. Canamero, L.: Playing the emotion game with feelix: What can a lego robot tell us about emotion? Socially intelligent agents: Creating relationships with computers and robots, pp. 69–76 (2002)

    Google Scholar 

  13. Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., McOwan, P.: Detecting engagement in HRI: An exploration of social and task-based context. In: International Conference on Privacy, Security, Risk and Trust and International Conference on Social Computing, pp. 421–428 (2012)

    Google Scholar 

  14. Colome, A., Pardo, D., Alenya, G., Torras, C.: External force estimation during compliant robot manipulation. In: IEEE International Conference on Robotics and Automation, pp. 3535–3540 (2013)

    Google Scholar 

  15. Dautenhahn, K.: Robots we like to live with?!—a developmental perspective on a personalized, life-long robot companion. In IEEE International Workshop on Robot and Human Interactive, Communication (2004)

    Book  Google Scholar 

  16. de Gelder, B.: Towards the neurobiology of emotional body language. Nat. Rev. Neurosci. 7, 242–249 (2006)

    Article  Google Scholar 

  17. Ekman, P., Friesen, W.: Head and body cues in the judgement of emotion—a reformulation. Percept. Motor Skills 24, 711–724 (1967)

    Article  Google Scholar 

  18. Fanaswala, I., Browning, B., Skar, M.: Interactional disparities in english and arabic native speakers with a bi-lingual robot receptionist. In: Proceedings of the International Conference on Human-Robot Interaction (2011)

    Google Scholar 

  19. Fischer, K.: Interpersonal variation in understanding robots as social actors. In: Proceedings of the International Conference on Human-Robot, Interaction, pp. 53–60 (2011)

    Google Scholar 

  20. Forlizzi, J., Di Salvo, C.: Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot Interaction, HRI ’06, pp. 258–265, ACM, New York (2006)

    Google Scholar 

  21. Freud, S.: The Uncanny (das unheimliche, 1919). Penguin Books Limited, UK (1919)

    Google Scholar 

  22. Glas, D.F., Wada, K., Shiomi, M., Kanda, T., Ishiguro, H., Hagita, N., Environment personal service: a robot that greets people individually based on observed behavior patterns. In: International Conference on Human Robot Intercation, pp. 129–130 (2013)

    Google Scholar 

  23. Guizzo, E., Ackerman, E.: The rise of the robot worker. IEEE Spect. 49(10), 34–41 (2012)

    Article  Google Scholar 

  24. Hashimoto, T., Verner, I., Kobayashi, H.: Human-like robot as teacher’s representative in a science lesson: An elementary school experiment. In: Robot Intelligence Technology and Applications 2012. vol. 208 of Advances in Intelligent Systems and Computing, pp. 775–786. Springer, Heidelberg (2013)

    Google Scholar 

  25. Hebb, D.: A Textbook of Psychology (1958)

    Google Scholar 

  26. Jentsch, E.: On the psychology of the uncanny (zur psychologie des unheimlichen). Psychiatrisch-Neurologische Wochenschrift, pp. 195–198 (1906)

    Google Scholar 

  27. Kadone, H., Nakamura, Y.: Segmentation, memorization, recognition and abstraction of humanoid motions based on correlations and associative memory. In: IEEE/RAS Proceedings of the International Conference on Humanoid Robots, pp. 1–6 (2006)

    Google Scholar 

  28. Kawashima, Y., Venture, G., Kawashima, N.: Contact force computation from inverse dynamics: Application to gait analysis. In: Proceedings of the International Conference on Posture and Gait, pp. 332–333 (2012)

    Google Scholar 

  29. Kleinsmith, A., Bianchi-Berthouze, N.: Affective Body Expression Perception and Recognition: A Survey. IEEE Trans. Affect. Comput. 4(1), 15–33 (2013)

    Article  Google Scholar 

  30. Kulic, D., Takano, W., Nakamura, Y.: Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden markov chains. Int. J. Robot. Res. 27, 761 (2008)

    Article  Google Scholar 

  31. Kulic, D., Venture, G., Nakamura, Y.: Detecting changes in motion characteristics during sports training. In: Proceedings of the IEEE International Conference on Engineering in Medicine and Biology, pp. 4011–4014 (2009)

    Google Scholar 

  32. Lee, D., Ott, C., Nakamura, Y., Hirzinger, G.: Physical human robot interaction in imitation learning. In: IEEE International Conference on Robotics and Automation, pp. 3439–3440 (2011)

    Google Scholar 

  33. Lee, E.-J.: Flattery may get computers somewhere, sometimes: The moderating role of output modality, computer gender, and user gender. Int. J. Hum. Comput. Stud. 66, 789–800 (2008)

    Article  Google Scholar 

  34. Lee, M.K., Forlizzi, J., Kiesler, S., Rybski, P., Antanitis, J., Savetsila, S.: Personalization in HRI: A Longitudinal Field Experiment. In: International Conference on Human Robot Intercation, pp. 319–326 (2012)

    Google Scholar 

  35. Lee, N., Shin, H., Sundar, S.S.: Utilitarian vs. hedonic robots, role of parasocial tendency and anthropomorphism in shaping user attitudes. In: Proceedings of the International Conference on Human-Robot Interaction, pp. 183–184 (2011)

    Google Scholar 

  36. Mac Dorman, K., Ishiguro, H.: The uncanny advantage of using androids in cognitive and social science research. Interact. Stud. 7(3), 297–337 (2006)

    Google Scholar 

  37. Mehrabian, A., Ferris, S.R.: Inference of attitudes from nonverbal communication in two channels. J. Consult. Psychol. 31(3), 248 (1967)

    Article  Google Scholar 

  38. Mori, M.: Bukimi no tani (the uncanny valley). Energy, pp. 33–35 (1970)

    Google Scholar 

  39. Moro, F., Tsagarakis, N., Caldwell, D.: Walking in the resonance with the coman robot with trajectories based on human kinematic motion primitives (KMPS). In: Autonomous Robots, pp. 1–17 (2013)

    Google Scholar 

  40. Reeves, B., Nass, C.: The Media Equation. CSLI Publications, Stanford (1996)

    Google Scholar 

  41. Rohrer, B., Fasoli, S., Krebs, H., Hughes, R., Volpe, B., Frontera, W., Stein, J., Hogan, N.: Movement smoothness changes during stroke recovery. J. Neurosci. 22(18), 8297–8304 (2002)

    Google Scholar 

  42. Salvini, P., Laschi, C., Dario, P.: Design for acceptability: Improving robots’ coexistence in human society. Int. J. Soc. Robot. 2, 451–460 (2010)

    Article  Google Scholar 

  43. Shibata, T.: Therapeutic seal robot as biofeedback medical device: Qualitative and quantitative evaluations of robot therapy in dementia care. Proc. IEEE 100(8), 2527–2538 (2012)

    Article  Google Scholar 

  44. E. Takano, T. Chikaraishi, Y. Matsumoto, Y. Nakamura, H. Ishiguro, and K. Sugamoto. Psychological effects on interpersonal communication by bystander android using motions based on human-like needs. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3721–3726 (2009)

    Google Scholar 

  45. Tisseron, S.: De l’animal numerique au robot de compagnie: quel avenir pour l’intersubjectivite? Revue francaise de psychanalyse 75, 149–159 (2011)

    Article  Google Scholar 

  46. Turkle, S.: A nascent robotics culture: New complicities for companionship. AAAI Technical report series (2006)

    Google Scholar 

  47. Venture, G., Ayusawa, K., Nakamura, Y.: Dynamics identification of humanoid systems. In: Proceedings of the CISM-IFToMM Symposium on Robot Design, Dynamics, and Control (ROMANSY), pp. 301–308 (2008)

    Google Scholar 

  48. Wallbott, H.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)

    Article  Google Scholar 

  49. Walters, M., Syrdal, D., Koay, K., Dautenhahn, K., Boekhorst, R.: Human approach distances to a mechanical-looking robot with different robot voice styles. In: Proceedings of the IEEE International Symposium Robot and Human Interactive, Communication, pp. 707–712 (2008)

    Google Scholar 

  50. Weiss, A., Bernhaupt, R., Tscheligi, M., Wollherr, D., Kuhnlenz, K., Buss, M.: A methodological variation for acceptance evaluation of human-robot interaction in public places. In IEEE International Symposium on Robot and Human Interactive, Communication (2008)

    Book  Google Scholar 

  51. Yabuki, T., Venture, G.: Motion recognition from contact force measurement. In: Proceedings of the IEEE International Conference Engineering in Medicine and Biology, pp. 7245–7248 (2013)

    Google Scholar 

  52. Zhang, T., et al.: Individual recognition from gait using feature value method. Cybern. Inform. Tech. 12, 86–95 (2012)

    Google Scholar 

  53. Zhang, T., Venture, G.: Biometrics from gait using feature value method. Artif. Intell. Methodol. Syst. Appl. Lect. Notes Comput. Sci. 7557, 325–333 (2012)

    Article  Google Scholar 

Download references

Acknowledgments

This research is partially supported by the “Women’s Future Development Organization”.

Author information

Authors and Affiliations

  1. Tokyo University of Agriculture and Technology, 2-24-16 Nakacho, Koganei, Tokyo, Japan

    Gentiane Venture

  2. INSERM, Lyon, France

    Ritta Baddoura

  3. Tokyo University of Agriculture and Technology, Tokyo, Japan

    Yuta Kawashima

  4. National Rehabilitation Center for People with Disabilities, Tokorozawa, Japan

    Noritaka Kawashima

  5. Tokyo University of Agriculture and Technology, Tokyo, Japan

    Takumi Yabuki

Authors
  1. Gentiane Venture
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ritta Baddoura
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuta Kawashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Noritaka Kawashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Takumi Yabuki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gentiane Venture .

Editor information

Editors and Affiliations

  1. Creative Informatics, The University of Tokyo, Tokyo, Japan

    Masayuki Inaba

  2. School of Electrical Engineering and Com, Queensland Univ of Technology, Brisbane, Queensland, Australia

    Peter Corke

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Venture, G., Baddoura, R., Kawashima, Y., Kawashima, N., Yabuki, T. (2016). Personalizing Intelligent Systems and Robots with Human Motion Data. In: Inaba, M., Corke, P. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 114. Springer, Cham. https://doi.org/10.1007/978-3-319-28872-7_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28872-7_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28870-3

  • Online ISBN: 978-3-319-28872-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation