Skip to main content
SpringerLink
Log in

Gesture-based mobile training of intercultural behavior

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Cultural heuristics determine acceptable verbal and non-verbal behavior in interpersonal encounters and are often the main reason for problems in intercultural communication. In this article, we present an approach to intercultural training of non-verbal behaviors that makes use of enculturated virtual agents, i.e. interactive systems that take cultural heuristics for interpreting and generating behavior into account. Because current trends in intercultural training highlight the importance of a coaching approach, i.e. the ability to offer training units anytime and anywhere, the system was developed as a mobile solution taking the sensoric capabilities of smart phones into account for the user interaction in form of gesture recognition. After an introduction of the theoretical background on culture and enculturated systems, the system features are discussed in detail followed by an account of the application itself, emphasizing the importance of situated role-plays. Two evaluation studies are presented next that analyze the usability of the approach as well as the more important question of whether training with the system gives better results than traditional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Notes

  1. http://www.ims.uni-stuttgart.de/projekte/nite/BLAG/ (30 March 2011).

References

  1. Argyle, M.: Bodily Communication. Methuen, London (1975)

    Google Scholar 

  2. Aylett, R., Paiva, A., Vannini, N., Enz, S., André, E., Hall, L.: But that was in another country: agents and intercultural empathy. In: Proceedings of 8th International Conferecne on Autonomous Agents and Multiagent Systems (AAMAS), pp. 329–336 (2009)

  3. Bennett, M.J.: A developmental approach to training for intercultural sensitivity. Int. J. Intercult. Relat. 10(2), 179–195 (1986)

    Article  Google Scholar 

  4. Cassell, J., Bickmore, T., Campbell, L., Vilhjalmsson, H., Yan, H.: Designing embodied conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds) Embodied Conversational Agents, pp. 29–63. MIT Press, Cambridge (2000)

    Google Scholar 

  5. Clancey, W.J.: A tutorial on situated learning. In: Proceedings of Computers and Education (1995)

  6. Clayton, P.: Body Language at Work: Read Signs and Make the Right Moves. Hamlyn, London (2003)

    Google Scholar 

  7. Elfenbein, H.A., Ambady, N.A.: When familiarity breeds accuracy: cultural exposure and facial emotion recognition. J. Pers. Social Psychol. 85(2), 276–290 (2003)

    Article  Google Scholar 

  8. Endrass, B., Rehm, M., André, E.: Planning smalltalk behavior with cultural influences for multiagent systems. Comput. Speech Lang. 25(2), 158–174 (2011)

    Article  Google Scholar 

  9. Fowler, S.M., Blohm, J.M.: An analysis of methods for intercultural training. In: Landis, D., Bennett, J.M., Bennett, M.J. (eds) Handbook of Intercultural Training, pp. 37–84. Sage Publications Inc., Thousand Oaks (2004)

    Google Scholar 

  10. Hall, E.T.: The Silent Language. Doubleday, Garden City (1959)

    Google Scholar 

  11. Hall, E.T.: The Hidden Dimension. Doubleday, Garden City (1966)

    Google Scholar 

  12. Hall, E.T.: Beyond Culture. Doubleday, Garden City (1976)

    Google Scholar 

  13. Hassenzahl, M.: The effect of perceived hedonic quality on product appealingness. Int. J. Human Comput. Interact. 13(4), 481–499 (2001)

    Article  Google Scholar 

  14. Hofstede, G.: Cultures and Organisations—Intercultural Cooperation and its Importance for Survival, Software of the Mind. Profile Books, New York (1991)

    Google Scholar 

  15. Hofstede, G.: Cultures Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations. Sage Publications, Thousand Oaks (2001)

    Google Scholar 

  16. Hofstede, G.J., Pedersen, P.B., Hofstede, G.: Exploring Culture: Exercises, Stories, and Synthetic Cultures. Intercultural Press, Yarmouth (2002)

    Google Scholar 

  17. Isbister, K.: Building bridges through the unspoken: embodied agents to facilitate intercultural communication. In: Payr, S., Trappl, R. (eds) Agent Culture: Human-Agent Interaction in a Multicultural World., pp. 233–244. Lawrence Erlbaum Associates, London (2004)

    Google Scholar 

  18. Jan, D., Herrera, D., Martinovski, B., Novick, D., Traum, D. et al.: A computational model of culture-specific conversational behavior. In: Pelachaud, C. (ed.) Intelligent Virtual Agents (IVA’07), pp. 45–56. Springer, Berlin (2007)

    Chapter  Google Scholar 

  19. Johnson, W.L., Friedland, L.E.: Integrating cross-cultural decision making skills into military training. In: Schmorrow, D., Nicholson, D. (eds) Advances in Cross-Cultural Decision Making, CRC Press, Boca Raton (2010)

    Google Scholar 

  20. Kela, J., Korpipaää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L., Marca, S.D.: Accelerometer-based gesture control for a design environment. Pers. Ubiquitous Comput. 10, 285–299 (2006)

    Article  Google Scholar 

  21. Kendon, A.: Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge Univ Press, Cambridge (1991)

    Google Scholar 

  22. Khaled, R., Barr, P., Biddle, R., Fischer, R., Noble, J.: Game design strategies for collectivist persuasion. In: Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, pp. 31–38 (2009)

  23. Kim, J.M., Hill, R.W., Durlach, P.J., Lane, H.C., Forbell, E., Core, M., Marsella, S., Pynadath, D., Hart, J.: BiLAT: A Game-Based Environment for Practicing Negotiation in a Cultural Context. Int. J. Artif. Intell. Educ. 19(3), 289–308 (2009)

    Google Scholar 

  24. Kluckhohn, F., Strodtbeck, F.: Variations in Value Orientations. Row, Peterson, New York (1961)

    Google Scholar 

  25. Losche, H.: Interkulturelle Kommunikation. Sammlung praktischer Spiele und Übungen. Ziel, Augsburg (2005)

    Google Scholar 

  26. Mäntyjärvi, J., Kela, J., Korpipää, P., Kallio, S.: Enabling fast and effortless customisation in accelerometer based gesture interaction. In: Proceedings of MUM’04, pp. 25–31 (2004)

  27. Marcus, A., Hamoodi, S.: The impact of culture on the design of arabic websites. In: IDGD’09 Proceedings of the 3rd International Conference on Internationalization, Design and Global Development, pp. 386–394. Springer, Berlin (2009)

  28. Marcus, A., Krishnamurthi, N.: Cross-cultural analysis of social network services in japan, korea, and the usa. In: IDGD’09 Proceedings of the 3rd International Conference on Internationalization, Design and Global Development, pp. 59–68. Springer, Berlin (2009)

  29. Mascarenhas, S., Dias, J., Prada, R., Paiva, A.: A dimensional model for cultural behavior in virtual agents. Appl. Artif. Intell. 24, 552–574 (2010)

    Article  Google Scholar 

  30. McNeill, D.: Hand and Mind—What Gestures Reveal about Thought. The University of Chicago Press, Chicago (1992)

    Google Scholar 

  31. Pease, A., Pease, B.: The Definitive Book of Body Language: How to Read Others Attitudes by Their Gestures. Orion, Houston (2005)

    Google Scholar 

  32. Rehm, M.: Developing enculturated agents—pitfalls and strategies. In: Blanchard, E.G., Allard, D. (eds) Handbook of Research on Culturally-Aware Information Technology., IGI Global, Hershey (2010)

    Google Scholar 

  33. Rehm, M., Bee, N., André, E.: Wave like an Egyptian—Acceleration based gesture recognition for culture-specific interactions. In: Proceedings of HCI 2008 Culture, Creativity, Interaction, pp. 13–22 (2008)

  34. Rehm, M., Nakano, Y., André, E., Nishida, T. et al.: Culture-specific first meeting encounters between virtual agents. In: Prendinger, H. (eds) Intelligent Virtual Agents., Springer, Berlin (2008)

    Google Scholar 

  35. Rehm, M., Nakano, Y., André, E., Nishida, T.: Editorial for special issue on enculturating human computer interaction. AI Soc. 24(3), 209–211 (2009)

    Article  Google Scholar 

  36. Rehm, M., Nakano, Y., André, E., Nishida, T., Bee, N., Endrass, B., Wissner, M., Lipi, A.A., Huang, H.H.: From Observation to Simulation—Generating Culture Specific Behavior for Interactive Systems. AI Soc. 24, 267–280 (2009)

    Article  Google Scholar 

  37. Sapouna, M., Wolke, D., Vannini, N., Watson, S., Woods, S., Schneider, W., Enz, S., Hall, L., Paiva, A., André, E., Dautenhahn, K., Aylett, R.: Virtual learning intervention to reduce bullying victimization in primary school: a controlled trial. J. Child Psychol. Psychiatr. 51(1), 104–112 (2010)

    Google Scholar 

  38. Schlömer, T., Poppinga, B., Henze, N., Boll, S.: Gesture recognition with a wii controller. In: Proceedings of Tangible and Embedded Interaction (TEI) (2008)

  39. Schwartz, S.H., Sagiv, L.: Identifying culture-specifics in the content and structure of values. J. Cross-Cultural Psychol. 26(1), 92–116 (1995)

    Article  Google Scholar 

  40. Ting-Toomey, S.: Communicating Across Cultures. The Guilford Press, New York (1999)

    Google Scholar 

  41. Urban, M., Bajcsy, P., Kooper, R., Lementec, J.C.: Recognition of arm gestures using multiple orientation sensors: Repeatability assessment. In: IEEE Intelligent Transportation Systems Conference, pp. 553–558 (2004)

  42. Vygotsky, L.S.: Thinking and speech. In: The Collected Works of L. S. Vygotsky, Problems of general psychology, vol. 1, pp. 39–285. Plenum Press, New York (1987)

  43. Warren, R., Diller, D.E., Leung, A., Ferguson, W., Sutton, J.L.: Simulating scenarios for research on culture and cognition using a commercial role-play game. In: Kuhl, M.E., Steiger, N.M., Armstrong, F.B., Joines, J.A. (eds.) Proceedings of the 2005 Winter Simulation Conference (2005)

Download references

Author information

Authors and Affiliations

  1. Department of Media Technology, Aalborg University, Niels Jernes Vej 14, 9220, Aalborg-Ø, Denmark

    Matthias Rehm

  2. Human Centered Multimedia, Augsburg University, Universitätsstr. 6a, 86159, Augsburg, Germany

    Karin Leichtenstern

Authors
  1. Matthias Rehm
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karin Leichtenstern
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthias Rehm.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rehm, M., Leichtenstern, K. Gesture-based mobile training of intercultural behavior. Multimedia Systems 18, 33–51 (2012). https://doi.org/10.1007/s00530-011-0239-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-011-0239-8

Keywords

Search

Navigation