Abstract
Self-adaptation has been used extensively to control parameters in various forms of evolutionary computation. The concept was first introduced with evolutionary strategies and it is now often used to control genetic algorithms. This paper describes the addition of a self-adaptive mutation rate and learning rate to the XCS classifier system. Self-adaptation has been used before in the strength based learning classifier system ZCS. This self-adaptive ZCS demonstrated clear performance improvements in a dynamic Woods environment and stable adaptation of its reinforcement learning parameters. In this paper experiments with XCS are carried out in Woods 2, a truncated version of the Woods 14 environment and a dynamic Woods environment. Performance of XCS in the dynamic Woods 14 environment is good with little loss of performance when the environment is perturbed. Use of an adaptive mutation rate does not help or improve on this behavior. XCS has already been shown to perform poorly in the Woods 14 environment, and other long rule chain environments. Use of an adaptive mutation rate is shown to increase performance significantly in these long rule chain environments. Attempts to also self-adapt the learning rate in Woods 14-12 fail to achieve satisfactory system performance.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Angeline, P.J., Fogel, D.B., and Fogel, L.J. (1996) A Comparison of Self-Adaption Methods for Finite State Machines in a Dynamic Environment. In Fogel, L.J, Angeline, P.J, and Back, T. (eds.) Evolutionary Programming V, Springer Press, pp 441–449
Bäck, T. (1992) Self-Adaptation in Genetic Algorithms. In F.J. Varela and P. Bourgine (eds.) Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life, MIT Press, pp. 263–271.
Barry, A. (2001) The stability of long action chins in XCS to appear in Special Issue Journal of Soft Computing on LCS (eds.) Bull, L and Lanzi, P.L Springer
Bull, L., Hurst, L. (2000) Self Adaptive Mutation in ZCS controllers. In Cagnoni, S., Poli, R., Smith, G. Corne, D., Oates, M., Hart, E., Lanzi, P-L, Willem, Li, Y., Paecther, B., and Fogarty, T. (eds.) Real-World Applications of Evolutionary Computing: Proceedings of the Fifth IEEE Conference on Evolutionary Computation, Springer Press pp446–451
Bull, L., Hurst, J., and Tomlinson, A. (2000) Self-Adaptive Mutation in Classifier System Controllers. In J.-A. Meyer, A. Berthoz, D. Floreano, H. Roitblatt and S.W. Wilson (eds.) From Animals to Animats 6-The Sixth International Conference on the Simulation of Adaptive Behaviour, MIT Press.
Butz, M.V. and Wilson, S.W. 2001 to appear in (eds.) Lanzi, P.L, Stolzmann, W. and Wilson, S.W., Advances in Learning Classifier Systems. Third International Workshop (IWLCS 2000)
Cliff, D. and Ross, S. (1995) Adding Temporary memory to ZCS, Adaptive Behavior, 3(2): 101–150.
Fogel, D.B. (1992) Evolving Artificial Intelligence. PhD dissertation, University of California.
Frey, P.W and Slate, D.J (1991) Letter Recognition using Holland-style Adaptive Classifiers. Machine Learning 6:161–182
Hartley, A (1999) Accuracy-based fitness allows similar performance to humans in static and dynamic classification Environments. In Banzhurf, W., Daidu, J., Eiben, A., Garzon, M., Honavar, V., and Jakiela, M, Simth, R., (eds.) Proceedings of the Genetic and Evolutionary Computation Conference 1999. Morgan Kauffmann pp. 266–274
Holland, J.H. (1975) Adaptation in Natural and Artificial Systems. University of Michigan Press.
Hurst, J. and Bull, L. (2001) A Self-Adaptive Classifier System. In P.-L. Lanzi, W. Stolzmann and S. Wilson (eds.) Proceedings of the Third International Workshop on Learning Classifier Systems.
Kovacs, T. (2000) Strength or Accuracy? Fitness Calculation in learning classifier systems. In P-L. Lanzi, W. Stolzmann, and S. Wilson (eds.) Learning Classifier Systems: From Foundations to Applications, Springer pp. 143–160
Koza, J.R. (1991) Genetic Programming. MIT Press
Lanzi, P.L. (1997) A Model of the Environment to Avoid Local Learning. Technical Report N.97.46, Dipartimento di Elettronica E Informazione, Politecnio di Milano, Italia
Rechenberg, I (1973) Evolutionsstrategie; Optimierung technischer Systeme nach Prinzipen der biologischen Evolution. Frommann-Holzboog Verlag.
Wilson, S.W. (1994) ZCS: A Zeroth-level Classifier System. Evolutionary Computation 2(1):1–18
Wilson, S.W. (1995) Classifier fitness based on Accuracy. Evolutionary Computation 3(2):149–177
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hurst, J., Bull, L. (2002). A Self-Adaptive XCS. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds) Advances in Learning Classifier Systems. IWLCS 2001. Lecture Notes in Computer Science(), vol 2321. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48104-4_5
Download citation
DOI: https://doi.org/10.1007/3-540-48104-4_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43793-2
Online ISBN: 978-3-540-48104-1
eBook Packages: Springer Book Archive