Skip to main content

Robots or Agents – Neither Helps You More or Less During Second Language Acquisition

Experimental Study on the Effects of Embodiment and Type of Speech Output on Evaluation and Alignment

  • Conference paper
  • First Online:
Intelligent Virtual Agents (IVA 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10011))

Included in the following conference series:

Abstract

When designing an artificial tutor, the question arises: should we opt for a virtual or a physical embodied conversational agent? With this work we contribute to the ongoing debate of whether, when and how virtual agents or robots provide more benefits to the user and conducted an experimental study on linguistic alignment processes in HCI in the context of second language acquisition. In our study (n = 130 non-native speakers) we explored the influence of design characteristics and investigated the influence of embodiment (virtual agent vs. robot vs. speech based interaction) and system voice (text-to-speech vs. pre-recorded speech) on participants’ perception of the system, their motivation, their lexical and syntactical alignment during interaction and their learning effect after the interaction. The variation of system characteristics had no influence on the evaluation of the system or participants’ alignment behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wainer, J., Feil-Seifer, D.J., Shell, D., et al.: Embodiment and human-robot interaction: a task-based perspective. In: 16th IEEE International Conference on Robot and Human Interactive Communication, pp. 872–877. IEEE, Piscataway (2007)

    Google Scholar 

  2. Aylett, R., Kriegel, M., Wallace, I., et al.: Memory and the design of migrating virtual agents. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems, pp. 1311–1312. International Foundation for Autonomous Agents and Multiagent Systems (2013)

    Google Scholar 

  3. Li, J.: The benefit of being physically present: a survey of experimental works comparing copresent robots, telepresent robots and virtual agents. Int. J. Hum. Comput. Stud. 77, 23–37 (2015). doi:10.1016/j.ijhcs.2015.01.001

    Article  Google Scholar 

  4. Branigan, H.P., Pickering, M.J., Pearson, J., et al.: Beliefs about mental states in lexical and syntactic alignment: evidence from human-computer dialogs. In: Proceedings of the 17th CUNY Conference on Human Sentence Processing (2004)

    Google Scholar 

  5. Fasola, J., Mataric, M.: A socially assistive robot exercise coach for the elderly. J. Hum. Robot Interact. 2(2), 3–32 (2013)

    Article  Google Scholar 

  6. Kidd, C.D., Breazeal, C.L.: Effect of a robot on user perceptions. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), pp. 3559–3564. IEEE, Piscataway (2004)

    Google Scholar 

  7. Kiesler, S.B., Powers, A., Fussell, S.R., et al.: Anthropomorphic interactions with a robot and robot-like agent. Soc. Cogn. 26(2), 169–181 (2008). doi:10.1521/soco.2008.26.2.169

    Article  Google Scholar 

  8. Kennedy, J., Baxter, P., Belpaeme, T.: Comparing robot embodiments in a guided discovery learning interaction with children. Int. J. Soc. Robot. 7(2), 293–308 (2015). doi:10.1007/s12369-014-0277-4

    Article  Google Scholar 

  9. Bartneck, C.: Interacting with an embodied emotional character. In: Proceedings of the International Conference on Designing Pleasurable Products and Interfaces, pp. 55–60. ACM Press, New York (2003)

    Google Scholar 

  10. Hoffmann, L., Krämer, N.C.: Investigating the effects of physical and virtual embodiment in task-oriented and conversational contexts. Int. J. Hum. Comput. Stud. 71(7–8), 763–774 (2013). doi:10.1016/j.ijhcs.2013.04.007

    Article  Google Scholar 

  11. Fischer, K., Lohan, K.S., Foth, K.: Levels of embodiment: linguistic analyses of factors influencing HRI. In: Proceedings of the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2012), pp. 463–470 (2012)

    Google Scholar 

  12. Giles, H.: Accent mobility: a model and some data. Anthropol. Linguist. 15, 87–105 (1973)

    Google Scholar 

  13. Reed, B.S.: Speech rhythm across turn transitions in cross-cultural talk-in-interaction. Special Issue Pragmat. Perspect. Parliam. Discourse J. Pragmat. 42(4), 1037–1059 (2010). doi:10.1016/j.pragma.2009.09.002

    Google Scholar 

  14. Brennan, S.E., Clark, H.H.: Conceptual pacts and lexical choice in conversation. J. Exp. Psychol. Learn. Memory Cogn. 22, 1482–1493 (1996)

    Article  Google Scholar 

  15. Branigan, H.P., Pickering, M.J., Cleland, A.A.: Syntactic co-ordination in dialogue. Cognition 75(2), B13–B25 (2000)

    Article  Google Scholar 

  16. Branigan, H.P., Pickering, M.J., Pearson, J., et al.: Linguistic alignment between people and computers. J Pragmat. 42(9), 2355–2368 (2010). doi:10.1016/j.pragma.2009.12.012

    Article  Google Scholar 

  17. Rosenthal-von der Pütten, A.M., Wiering, L., Krämer, N.C., et al.: Great minds think alike. Experimental study on lexical alignment in human-agent interaction. i-com 12(1), 32–38 (2013). doi:10.1524/icom.2013.0005

    Article  Google Scholar 

  18. Kühne, V., Rosenthal-von der Pütten, A.M., Krämer, N.C.: Using linguistic alignment to enhance learning experience with pedagogical agents: the special case of dialect. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 149–158. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  19. Bergmann, K., Branigan, H.P., Kopp, S.: Exploring the alignment space – lexical and gestural alignment with real and virtual humans. Front. ICT 2, 7 (2015). doi:10.3389/fict.2015.00007

    Article  Google Scholar 

  20. Wunderlich, H.: Talking like a machine?! Linguistic alignment of native-speakers and non-native speakers in interaction with a virtual agent. Bachelor thesis, University of Duisburg-Essen (2012)

    Google Scholar 

  21. Costa, A., Pickering, M.J., Sorace, A.: Alignment in second language dialogue. Lang. Cogn. Proc. 23(4), 528–556 (2008). doi:10.1080/01690960801920545

    Article  Google Scholar 

  22. Atkinson, D., Churchill, E., Nishino, T., et al.: Alignment and interaction in a sociocognitive approach to second language acquisition. Mod. Lang. J. 91(2), 169–188 (2007). doi:10.1111/j.1540-4781.2007.00539.x

    Article  Google Scholar 

  23. Bartneck, C., Kulić, D., Croft, E., et al.: measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009). doi:10.1007/s12369-008-0001-3

    Article  Google Scholar 

  24. Nowak, K.L., Biocca, F.: The Effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence Teleop. Virtual 12(5), 481–494 (2003). doi:10.1162/105474603322761289

    Article  Google Scholar 

  25. Reuter, M.: Linguistic alignment with virtual agents. Bachelor thesis, University of Duisburg-Essen (2011)

    Google Scholar 

  26. Baur, R.S., Meder, G.: C-Tests zur Ermittlung der globalen Sprachfähigkeit im Deutschen und einer Muttersprache bei ausländischen Schülern in der Bundesrepublik Deutschland. In: Grotjahn, R. (ed.) Der C-Tes. Theoretische Grundlagen und praktische Anwendungent. Brockmeyer, Bochum (1994)

    Google Scholar 

  27. Wagenmakers, E.J.: A practical solution to the pervasive problems of p values. Psychon. Bull. Rev. 14(5), 779–804 (2007)

    Article  Google Scholar 

Download references

Acknowledgements

The noALIEN (Using linguistic alignment in German language promotion for immigrants on the basis of human-technology interaction) project was funded by the German Federal Ministry of Education and Research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Astrid M. Rosenthal-von der Pütten .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Rosenthal-von der Pütten, A.M., Straßmann, C., Krämer, N.C. (2016). Robots or Agents – Neither Helps You More or Less During Second Language Acquisition. In: Traum, D., Swartout, W., Khooshabeh, P., Kopp, S., Scherer, S., Leuski, A. (eds) Intelligent Virtual Agents. IVA 2016. Lecture Notes in Computer Science(), vol 10011. Springer, Cham. https://doi.org/10.1007/978-3-319-47665-0_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-47665-0_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-47664-3

  • Online ISBN: 978-3-319-47665-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics