Skip to main content
SpringerLink
Log in

The Immersive Hand: Non-verbal Communication in Virtual Environments

  • Chapter
The Immersive Internet

Abstract

Hardly anything has become a more popular expression of liking in contemporary online communication than the Facebook ‘thumbs up’ logo. And, just as the development of the first emoticons in the mid-1980s had, not coincidentally, been related to a smiling face, the same applies to the present-day Facebook illustration. Both of these popular visuals rely on non-verbal communicative cues — a facial expression and a hand gesture — to convey meaning in online interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Antonijević, S. (2008) ‘From Text to Gesture Online: A Microethnographic Analysis of Non-verbal Communication in the Second Life Virtual Environment’, Information, Communication, and Society, 11, 2, pp. 211–38.

    Google Scholar 

  • Bailenson, N. J., Beall, A., Blascovich, J., Loomis, J., and Turk, M. (2004) ‘Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments’, Presence, 13, 4, pp. 428–41.

    Article  Google Scholar 

  • Baldoni, M., Baroglio, C., Horvath, A., Patti, V., Portis, F., Avilla, M., and Grillo, P. (2008) ‘Folksonomies Meet Ontologies in ARSMETEO: From Social Descriptions of.Artifacts to Emotional Concepts’, in Borgo, S. and Lesmo, L. (eds) Formal Ontologies Meet Industry. Amsterdam: IOS Press, pp. 132–44.

    Google Scholar 

  • Bates, J. (1994) ‘The Role of Emotion in Believable Agents’, Communications of the ACM, 37, 7, pp. 122–5.

    Article  Google Scholar 

  • Becker, B. (2006) ‘Social Robots — Emotional Agents: Some Remarks on Naturalizing Man-machine Interaction’, International Review of Information Ethics, 6, pp. 37–45.

    Google Scholar 

  • Boehner, K., dePaula, R., Dourish, P., and Sengers, P. (2005) ‘Affect: From Information to Interaction’, Proceedings of the 4th Decennial Conference on Critical Computing, pp. 59–68.

    Google Scholar 

  • Bourdieu, P. (1977 [1972]) Outline of a Theory of Practice. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Brown, B. and Bell, M. (2004) ‘Social Interaction in “There”’, in Dykstra-Erickson, E. and Tscheligi, M. (eds) CHI ′04 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria, pp. 1465–8.

    Google Scholar 

  • Crystal, D. (2006) Language and the Internet. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Dass, S. and Chen, M. (2007) ‘Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web’, Management Science, 53, 9, pp. 1375–88.

    Article  Google Scholar 

  • de Souza, C. S. (2005) The Semiotic Engineering of Human-Computer Interaction. Cambridge: MIT Press.

    Google Scholar 

  • Douglas, M. (2003 [1970]) Natural Symbols. New York and London: Routledge.

    Google Scholar 

  • Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J. C., Devillers, L., Abrilian, S., Batliner, A., Amir, N., and Karpouzis, K. (2007) ‘The HUMAINE Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data’, in A. Paiva, R. Prada and R. W. Picard (eds) Affective Computing and Intelligent Interaction. Berlin, Heidelberg, New York: Springer, pp. 488–500.

    Chapter  Google Scholar 

  • Ekman, P. and Friesen, W. V. (1981) ‘The Repertoire of Non-verbal behavior’, in A. Kendon (ed.) Non-Verbal Communication, Interaction, and Gesture: Selections from Semiotica. New York: Moutoun, pp. 46–105.

    Google Scholar 

  • Ekman, P. and Keltner, D. (1997) ‘Universal Facial Expressions of Emotion: An Old Controversy and New Findings’, in Segerstrale, U. and Molnar, P. (eds) Non-verbal Communication: Where Nature Meets Culture. New Jersey: Lawrence Erlbaum Associates, pp. 27–47.

    Google Scholar 

  • Erickson, T and Kellogg, W. (2000) ‘Social Translucence: An Approach to Designing Systems that Mesh with Social Processes’, ACM Transactions on Human Computer Interaction, 7, 1, pp. 59–83.

    Article  Google Scholar 

  • Fabri, M., Moore, D. K., and Hobbs, D. J. (2002) ‘Expressive Agents: Nonverbal Communication in Collaborative Virtual Environments’, Embodied Conversationa1 Agents at AAMAS’ 02, Bologna, Italy.

    Google Scholar 

  • Fabri, M. and Moore, D. (2005) ‘The Use of Emotionally Expressive Avatars in Collaborative Virtual Environments’, Proceeding of Symposium on Empathic Interaction with Synthetic Characters.

    Google Scholar 

  • Gaver, W. (2009) ‘Designing for Emotion’, Philosophical Transactions of the Royal Society, 364, 1535, pp. 3597–604.

    Article  Google Scholar 

  • Gurak, L. and Antonijević, S. (2008) ‘Digital Rhetoric’, in Lunsford, A. and Aune, J. (eds) The Sage Handbook of Rhetoric. London, Thousand Oaks: Sage, pp. 497–508.

    Google Scholar 

  • Guye-Vuilleme, A., Capin, T. K., Pandzic, S., Thalamann, N. M. (1999) ‘Nonverbal Communication Interface for Collaborative Virtual Environments’, The Virtual Reality Journal, 4, pp. 49–59.

    Article  Google Scholar 

  • Haraway, D. (1991) ‘A Cyborg Manifesto Science, Technology, and Socialist-Feminism in the Late Twentieth Century’, in Haraway, D. (ed.) Simians, Cyborgs and Women: The Reinvention of Nature. New York and London: Routledge, pp. 149–81.

    Google Scholar 

  • Healey, J. and Picard, R. W. (2005) ‘Detecting Stress During Real-world Driving Tasks Using Physiological Sensors’, IEEE Trans. on Intelligent Transportation Systems, 6, 2, pp. 156–66.

    Article  Google Scholar 

  • Hiltz, S. R. and Turoff, M. (1978) The Network Nation: Human Communication via Computer. Cambridge and London: MIT Press.

    Google Scholar 

  • Irani, C. L., Hayes, G. R., and Dourish, P. (2008) ‘Situated Practices of Looking: Visual Practice in an Online World’, Proceedings of the 2008 ACM Conference on Computer-supported Cooperative Work, pp. 187–96.

    Google Scholar 

  • Kaliouby, R., Picard, R., and Baron-Cohen, S. (2006) ‘Affective Computing and Autism’, New York Academy of Sciences, 1093, pp. 228–48.

    Article  Google Scholar 

  • Kambil, A. (2008) ‘What Is Your Web 5.0 Strategy?’, Journal of Business Strategy, 29, 6, pp. 56–8.

    Article  Google Scholar 

  • Kendon, A. (1990) Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge, NY: Cambridge University Press.

    Google Scholar 

  • Manovich, L. (2001) The Language of New Media. Cambridge: MIT Press.

    Google Scholar 

  • McCarthy, J. and Wright, P. (2004) Technology as Experience. Cambridge: MIT Press.

    Google Scholar 

  • McLaughlin, M. L., Sukhatme, G., and Hespanha, J. (2001) Touch in Virtual Environments: Haptics and the Design of Interactive Systems. Upper Sidle River: Pearson Education.

    Google Scholar 

  • McNeill, D. (1992) Hand and Mind: What Gestures Reveal about Thought. Chicago and London: University of Chicago Press.

    Google Scholar 

  • Meijden, van der, O. A. J. and Schijven, M. P. (2009) ‘The Value of Haptic Feedback in Conventional and Robot-assisted Minimal Invasive Surgery and Virtual Reality Training: A Cunent Review’, Surgical Endoscopy, 23, 6, pp. 1180–90.

    Article  Google Scholar 

  • Moore, M. M. (1985) ‘Non-verbal Courtship Patterns in Women: Context and Consequences’, Ethology and Sociobiology, 6, pp. 237–45.

    Article  Google Scholar 

  • Picard, R. W (2000) Affective Computing. Cambridge: MIT Press.

    Google Scholar 

  • Picard, R. W. (2010) ‘Emotion Research by the People, for the People’, Emotion Review, 2, 3, pp. 250–4.

    Article  Google Scholar 

  • Rheinberger, H. J. (1997) Toward a History of Epistemic Things. Stanford: Stanford University Press.

    Google Scholar 

  • Riva, G. (2002) ‘The Cognitive Psychology of Computer-mediated Communication’, Cyber Psychology & behavior, 5, 6, pp. 581–98.

    Article  Google Scholar 

  • Rivera, K., Cooke, J. N., and Bauhs, A. J. (1996) ‘The Effects of Emotional Icons on Remote Communication’, Proceedings of the CHI’ 96 Conference Companion on Human Factors in Computing Systems, Vancouver, British Columbia, Canada.

    Google Scholar 

  • Robles De La Tone, G. (2009) ‘Virtual Reality: Touch/Haptics’, in B. Goldstein (ed.) Encyclopedia of Perception, Vol. 2. Thousand Oaks: Sage Publications, pp. 1036–8.

    Google Scholar 

  • Salah, A. A., Gevers, T., Sebe, N., and Vinciarelli, A. (2010) ‘Challenges of Human Behavior Understanding’, Springer Verlag, 6219, pp. 1–12.

    Google Scholar 

  • Salisbury, K., Conti, F., and Barbagli, F. (2004) ‘Haptic Rendering: Introductory Concepts’, IEEE Computer Society, March-April, pp. 24–32.

    Google Scholar 

  • Schroeder, R. (2011) Being There Together: Social Interaction in Shared Virtual Environments. Oxford: Oxford University Press.

    Google Scholar 

  • Sebeok, T A. (2001) Global Semiotics. Bloomington: Indiana University Press.

    Google Scholar 

  • Stone, A. R. (2000 [1992]) ‘Will the Real Body Please Stand Up? Boundary Stories about Virtual Cultures’, in Bell, D. and Kennedy, B. M. (eds) The Cyber cultures Reader. London: Routledge, pp. 504–29.

    Google Scholar 

  • Talamo, A. and Ligorio, M. B. (2000) ‘Identity in the Cyberspace: The Social Construction of Identity Through On-line Virtual Interactions’, 1st Dialogical Self Conference, 23–26 June, Nijmegen, NL.

    Google Scholar 

  • Walther, J. B. and D’Addario, K. P. (2001) ‘The Impacts of Emoticons on Message Interpretation in Computer-Mediated Communication’, Social Science Computer Review, 19, 3, pp. 324–47.

    Article  Google Scholar 

  • Walther, J. B., Loh, T., and Granka, L. (2005) ‘Let Me Count the Ways’, Journal of Language and Social Psychology, 24, 1, pp. 36–65.

    Article  Google Scholar 

  • Ward, R. D. and Marsden, P. H. (2004) ‘Affective Computing: Problems, Reactions and Intentions’, Interacting with Computers, 16, pp. 701–13.

    Google Scholar 

  • Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., and Picard, R. (2009) ‘Affect-aware Tutors: Recognising and Responding to Student Affect’, International Journal of Learning Technology, 4, 3/4, pp. 129–64.

    Article  Google Scholar 

  • Yee, N., Bailenson, J. N., Urbanek, M., Chang, F., and Merget, D. (2007) ‘The Unbearable Likeness of Being Digital: The Persistence of Non-verbal Social Norms in Online Virtual Environments’, CyberPsychology and behavior, 10, 1, pp. 115–21.

    Article  Google Scholar 

Download references

Authors
  1. Smiljana Antonijević
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Stockholm School of Economics, Sweden

    Robin Teigland

  2. Uppsala University, Sweden

    Dominic Power

Copyright information

© 2013 Smiljana Antonijević

About this chapter

Cite this chapter

Antonijević, S. (2013). The Immersive Hand: Non-verbal Communication in Virtual Environments. In: Teigland, R., Power, D. (eds) The Immersive Internet. Palgrave Macmillan, London. https://doi.org/10.1057/9781137283023_8

Download citation

Publish with us

Policies and ethics

Search

Navigation