Skip to main content

Figurative Language Grounding in Humanoid Robots

  • Conference paper
  • First Online:
  • 2327 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1038))

Abstract

The paper proposes a method for representing idioms (in particular, colour-related idioms) within the framework of Fluid Construction Grammar (FCG). The main purpose of this endeavour is to facilitate (figurative) language grounding in humanoid robots in the near future. There is sufficient evidence in the cognitive robotics literature that figurative language plays (or, will play) an important role in humanoid robots. Idioms pose a real challenge to satisfactory human-robot interaction due to the plethora of linguistic and contextual subtleties. In my approach, the starting point for encoding idioms within FCG was the selection of several colour-related idioms due to the fact that they could be well-integrated in current robotics experiments. Humanoid robots (for instance, the iCub) are frequently subjected to simple colour-related experiments (such as, learning how to lift and manipulate colourful objects, etc.). Introducing much more difficult tasks, such as recognising colour-idioms as abstract, is needed to achieve further robotic development. The paper presents some techniques on the theoretical encoding of idioms, as well as practical guidelines on how to implement custom figurative constructions within FCG.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Also known as: artificial cognitive systems research, Epigenetic Robotics, Autonomous Mental Development (AMD), and Cognitive Developmental Robotics (CDR) (Metta and Cangelosi in [12, p. 613]). In this paper the term cognitive robotics will be used.

  2. 2.

    Some details concerning FCG are discussed in the methodology section.

  3. 3.

    For more information consult Steels in [18] and http://emergent-languages.org/?page_id=17 for multimedia resources.

  4. 4.

    Code and pseudo-code is hereby conventionally marked by typewriter font. Comments are introduced and closed by ***. Lexemes are written in italics.

  5. 5.

    Although SLIME worked flawlessly during the entire experiment, it did crash once due to a faulty interaction with Swank. It was a major problem that could not be solved using the graphical interface.

  6. 6.

    The Babel software can be downloaded for free at: https://www.fcg-net.org/download/ and http://emergent-languages.org/Babel2/.

  7. 7.

    The algorithm is described in detail in Steels [16, pp. 12–13].

  8. 8.

    See Steels in [16, p. 11] for an in-depth discussion of slots.

  9. 9.

    It is advised that the launch file be named .ccl-init.lisp and placed in the root user’s directory.

  10. 10.

    Another package, IRL (Incremental Recruitment Language) is also employed in studies on language grounding in robots. However, FCG is better suited for the purposes of my paper.

  11. 11.

    Meet is a basic operation that can be understood as syntactic concatenation. ==1 denotes the so-called footprints and should be ignored at the stage of simple processing of phrases. They are important in more complex constructions.

References

  1. Cacciari, C., Tabossi, P. (eds.): Idioms: Processing, Structure, and Interpretation. Lawrence Erlbaum Associates, Hillsdale (1993)

    Google Scholar 

  2. Cangelosi, A., Tikhanoff, V., Fontanari, J.F.: Integrating language and cognition: a cognitive robotics approach. IEEE Comput. Intell. Mag. 2, 65–70 (2007)

    Article  Google Scholar 

  3. Cangelosi, A.: Grounding language in action and perception: from cognitive agents to humanoid robots. Phys. Life Rev. 7, 139–151 (2010)

    Article  Google Scholar 

  4. Flasiński, M.: Wstep do sztucznej inteligencji [Introduction to Artificial Intelligence]. Wydawnictwo Naukowe PWN, Warsaw (2011)

    Google Scholar 

  5. Gibbs Jr., R.W.: Embodiment and Cognitive Science. Cambridge University Press, Cambridge (2005)

    Book  Google Scholar 

  6. Giora, R.: On Our Mind: Salience, Context, and Figurative Language. Oxford UP, Oxford (2003)

    Book  Google Scholar 

  7. Glucksberg, S.: Understanding Figurative Language: From Metaphors to Idioms. Oxford UP, Oxford (2001)

    Book  Google Scholar 

  8. Indurkhya, B.: Metaphor and Cognition: An Interactionist Approach. Kluwer, Dordrecht (1992)

    Book  Google Scholar 

  9. Kanda, T., Ishiguro, H.: Human-Robot Interaction in Social Robotics. CRC Press, London (2013)

    Google Scholar 

  10. Kemp, C.C., Fitzpatrick, P., Hirukawa, H., Yokoi, K., Harada, K., Matsumoto, Y.: Humanoids. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 1307–1329. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  11. Marocco, D., Cangelosi, A., Fischer, K., Belpaeme, T.: Grounding action words in the sensorimotor interaction with the world: experiments with a simulated iCub humanoid robot. Front. Neurorobotics 4(7), 7 (2010)

    Google Scholar 

  12. Metta, G., Cangelosi, A.: Cognitive robotics. In: Seel, N.M. (ed.) Encyclopedia of the Sciences of Learning, pp. 613–616. Springer, London (2012)

    Chapter  Google Scholar 

  13. Parisi, D.: Robots with language. Front. Neurorobotics 4(10), 1–8 (2010)

    Google Scholar 

  14. Samani, H. (ed.): Cognitive Robotics. CRC Press, London (2016)

    Google Scholar 

  15. Sinclair, J.: The Cognitive Dictionary of Idioms. Harper Collins, Glasgow (1995)

    Google Scholar 

  16. Steels, L.: Fluid Construction Grammar. A Brief Tutorial (2004). https://www.fcg-net.org/wp-content/uploads/papers/tutorial-2.pdf

  17. Steels, L.: Language Grounding in Robots. Springer, New York (2012)

    Book  Google Scholar 

  18. Steels, L.: The Talking Heads Experiment: Origins of Words and Meanings. Language Sciences Press, Berlin (2015)

    Book  Google Scholar 

  19. Ziemke, T., Zlatev, J., Frank, R.M.: Body, language and mind, vol. 1. Embodiment. Mouton de Gruyter, Berlin (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maja Gwóźdź .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gwóźdź, M. (2020). Figurative Language Grounding in Humanoid Robots. In: Bi, Y., Bhatia, R., Kapoor, S. (eds) Intelligent Systems and Applications. IntelliSys 2019. Advances in Intelligent Systems and Computing, vol 1038. Springer, Cham. https://doi.org/10.1007/978-3-030-29513-4_25

Download citation

Publish with us

Policies and ethics