Skip to main content
SpringerLink
Log in
Book cover

European Conference on Artificial Life

ECAL 1995: Advances in Artificial Life pp 679–690Cite as

Learning and adaptivity: Enhancing reactive behaviour architectures in real-world interaction systems

  • 5. Robotics and Emulation of Animal Behavior
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 929))

Abstract

The success of the behaviour-based approach to designing robot control structures has largely been a result of the bottom-up development of a number of fast, tightly coupled control processes. These are specifically designed for a particular agent-environment situation. The onus is on the designers to provide the agent with a suitable response repertoire using their own knowledge of the proposed agent-environment interaction. A need for learning and adaptivity to be built into robot systems from the lowest levels is identified. An enhancement to basic reactive robot control architectures is proposed that enables processes to learn and subsequently adapt their input-output mapping. This results in both a local and global increase in robustness as well as a simplification of the design process. An implementation of the proposed mechanism is demonstrated in a real-world situated system: the control of an active laser scanning sensor.

Funded by the Engineering and Physical Sciences Research Council and Sira Ltd.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Arkin90: The Impact of Cybernetics on the Design of a Mobile Robot System: A Case Study. Ronald C. Arkin, IEEE Transactions on Systems, Man and Cybernetics, Vol 20, no 6, November/December 1990.

    Google Scholar 

  • Brooks86. A Robust Layered Control System For A Mobile Robot, Rodney A. Brooks, IEEE Journal of robotics and automation. Vol. RA-2, No 1, March 1986.

    Google Scholar 

  • Brooks89: Fast Cheap and Out of Control: A Robot Invasion of the Solar System. Rodney A. Brooks and Anita M. Flynn. Journal of the British Interplanetary Society. Vol 42 1989.

    Google Scholar 

  • Brooks 91: Intelligence without reason. AI memo 1293, Massachusetts Institute of Technology AI laboratory.

    Google Scholar 

  • Clark, Arkin and Ram 92: Learning Momentum: On-Line Performance Enhancement for Reactive Systems. Russell J. Clark, Ronald C. Arkin, Ashwin Ram. Proceedings of 1992 IEEE International Conference on Robotics and Automation. Nice, France.

    Google Scholar 

  • Dorf 92: Modem Control Systems. Richard C. Dorf. Published by Addison-Wesley 1992.

    Google Scholar 

  • Edelman89. The Remembered Present: A Biological Theory of Consciousness. New York: Basic Books.

    Google Scholar 

  • Gat et al 94: Behaviour Control for Robotic Exploration of Planetary Surfaces. Erann Gat, Rajiv Desai, Robert Ivlev, John Loch and David P. Miller. IEEE Transactions on Robotics and Automation, Vol 10, No. 4, August 1994.

    Google Scholar 

  • Gaussier and Zrehen 94: Complex Neural Architectures for Emerging Cognitive Abilities in an Autonomous System. Conference proceedings: From Perception to Action 94. IEEE Computer Society Press 1994.

    Google Scholar 

  • Grossberg69: Some networks that can learn, remember and reproduce any number of complicated space-time patterns. Journal of Mathematics and Mechanics 19:53–91. 1969.

    Google Scholar 

  • Harris94: Advances in Intelligent Control. Edited by C.J. Harris. Published by Taylor and Francis 1994.

    Google Scholar 

  • IAL93: Automatic Inspection Saves Money and Improves Quality. Commercial publication. Image Automation Ltd, Kelvin House, Worsley Bridge Road, Sydenham, London, SE26 5BX., UK.

    Google Scholar 

  • Kaebling93: Learning in Embedded Systems. Leslie Pack Kaebling, Bradford Books MIT Press 1993.

    Google Scholar 

  • Kohonen88: Self-Organisation and Associative Memory. Springer-Verlag 1988.

    Google Scholar 

  • Maes89: How To Do The Right Thing. Pattie Maes, Connection Science, Vol. 1, No 3, 1989.

    Google Scholar 

  • Maes and Brooks 90: Learning to Coordinate Behaviours. Pattie Maes and Rodney A. Brooks. AAAI 1990 Conference Proceedings.

    Google Scholar 

  • Mahadevan and Connell 92: Automatic Programming of Behaviour Based Robots Using Reinforcement Learning. Sridhar Mahadevan and Jonathan Connell, Artificial Intelligence 55, Elsevier Science Publishers 1992.

    Google Scholar 

  • Mataric94: Reward Functions for Accelerated Learning. Maja J. Mataric. MIT Artificial Intelligence Laboratory. 545 Technology Square, Cambridge MA 02139 USA.

    Google Scholar 

  • McFarland85: Animal Behaviour, section 2.3 Animal Learning. David McFarland. Publishers Longman Scientific and Technical. 1985.

    Google Scholar 

  • Nehmzow and Smithers 90: Mapbuilding using Self-Organising Networks in “Really Useful Robots”. Ulrich Nehmzow and Tim Smithers. University of Edinburgh Department of Artificial Intelligence Research Paper No. 489.

    Google Scholar 

  • Pebody94: Acting to Sense: The lowest levels of a Subsumption Architecture. Miles Pebody. Conference proceedings: From Perception to Action 94. IEEE Computer Society Press 1994.

    Google Scholar 

  • Pfeifer93: Studying Emotions: Fungus Eaters. Rolf Pfeifer. Proceedings 2nd European Conference of Artificial Life 1993.

    Google Scholar 

  • Pfeifer and Verschure 93: Categorisation, Representations and the Dynamics of System-Environment Interaction: A case study in autonomous systems. Paul F.M.J. Verschure and Rolf Pfeifer. Proceeding of the Second International Conference on the Simulation of Adaptive Behaviour, Bradford books MIT Press 1993.

    Google Scholar 

  • Smithers94: What the Dynamics of Adaptive Behaviour and Cognition Might Look Like in Agent-Environment Interaction Systems. Tim Smithers. Workshop proceedings: On the Role of Dynamics and Representation in Adaptive Behaviour and Cognition. 9 and 10 December, 1994, Hosted by University of the Basque Country (UPV/EHU) Faculty of Informatics.

    Google Scholar 

  • Steels93: Building Agents Out Of Autonomous Behaviours. Luc Steels in The Artificial Life Route To Artificial Intelligence: Building Situated Embodied Agents. L Steels and R. Brooks (eds) 1993. New Haven: Lawrence Erlbaum Ass.

    Google Scholar 

  • Wasserman89: Neural Computing: Theory and Practice. Philip D. Wasserman. Van Nostrand Reinhold. 1989.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department Of Computer Science, University College London, Gower Street, WC1E 6BT, London, UK

    Miles Pebody

Authors
  1. Miles Pebody
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Federico Morán Alvaro Moreno Juan Julián Merelo Pablo Chacón

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pebody, M. (1995). Learning and adaptivity: Enhancing reactive behaviour architectures in real-world interaction systems. In: Morán, F., Moreno, A., Merelo, J.J., Chacón, P. (eds) Advances in Artificial Life. ECAL 1995. Lecture Notes in Computer Science, vol 929. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-59496-5_335

Download citation

  • DOI: https://doi.org/10.1007/3-540-59496-5_335

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-59496-3

  • Online ISBN: 978-3-540-49286-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation