Abstract
Wilson extended XCS with interval based conditions to XCSR to handle real valued inputs. However, the possible actions must always be determined in advance. Yet domains such as robot control require numerical actions, so that neither XCS nor XCSR with their discrete actions can yield high performance. In the work presented here, genetic programming-based representation is used for the first time to compute continuous action in XCSR. This XCSR version has been examined on a simple one-dimensional but non-linear testbed problem – the “frog” problem – and compared with two continuous action based systems, GCS and XCSFCA. The proposed approach has consistently solved the frog problem and outperformed GCS and XCSFCA.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ahluwalia, M., Bull, L.: A Genetic Programming Based Classifier System. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 11–18 (1999)
Alfaro-Cid, E., Merelo, J.J., de Vega, F.F., Esparcia-Alcázar, A.I., Sharman, K.: Bloat Control Operators and Diversity in Genetic Programming: A Comparative Study. Evolutionary Computation 18(2), 305–332 (2010)
Butz, M.V.: XCSJava 1.0: An Implementation of the XCS Classifier System in Java. Technical Report 2000027, Illinois Genetic Algorithms Laboratory (2000)
Butz, M.V.: Rule-based Evolutionary Online Learning Systems: A Principal Approach to LCS Analysis and Design. Springer (2006)
Butz, M.V., Wilson, S.W.: An Algorithmic Description of XCS. Soft Computing - A Fusion of Foundations, Methodologies and Applications 6(3-4), 144–153 (2002)
Iqbal, M., Browne, W.N., Zhang, M.: Evolving Optimum Populations with XCS Classifier Systems. Soft Computing (2012), http://dx.doi.org/10.1007/s00500-012-0922-5 , doi:10.1007/s00500-012-0922-5
Iqbal, M., Browne, W.N., Zhang, M.: Extracting and Using Building Blocks of Knowledge in Learning Classifier Systems. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 863–870 (2012)
Iqbal, M., Zhang, M., Browne, W.N.: Automatically Defined Functions for Learning Classifier Systems. In: Proceedings of the Genetic and Evolutionary Computation Conference (Companion), pp. 375–382 (2011)
Kinzett, D., Johnston, M., Zhang, M.: Numerical Simplification for Bloat Control and Analysis of Building Blocks in Genetic Programming. Evolutionary Intelligence 2(4), 151–168 (2009)
Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. The MIT Press (1992)
Lanzi, P.L.: XCS with Stack-Based Genetic Programming. In: Proceedings of the Congress on Evolutionary Computation, pp. 1186–1191 (2003)
Luke, S., Panait, L.: A Comparison of Bloat Control Methods for Genetic Programming. Evolutionary Computation 14(3), 309–344 (2006)
Preen, R.J., Bull, L.: Fuzzy Dynamical Genetic Programming in XCSF. In: Proceedings of the Genetic and Evolutionary Computation Conference (Companion), pp. 167–168 (2011)
Tran, T.H., Sanza, C., Duthen, Y., Nguyen, D.T.: XCSF with Computed Continuous Action. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 1861–1869 (2007)
Urbanowicz, R.J., Moore, J.H.: Learning Classifier Systems: A Complete Introduction, Review, and Roadmap. Journal of Artificial Evolution and Applications 2009(1), 1–25 (2009)
Wilson, S.W.: Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2), 149–175 (1995)
Wilson, S.W.: Get Real! XCS with Continuous-Valued Inputs. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 1999. LNCS (LNAI), vol. 1813, pp. 209–219. Springer, Heidelberg (2000)
Wilson, S.W.: Mining Oblique Data with XCS. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2000. LNCS (LNAI), vol. 1996, pp. 158–174. Springer, Heidelberg (2001)
Wilson, S.W.: Classifiers that Approximate Functions. Natural Computing 1, 211–233 (2002)
Wilson, S.W.: Three Architectures for Continuous Action. In: Kovacs, T., Llorà, X., Takadama, K., Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2003. LNCS (LNAI), vol. 4399, pp. 239–257. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Iqbal, M., Browne, W.N., Zhang, M. (2012). XCSR with Computed Continuous Action. In: Thielscher, M., Zhang, D. (eds) AI 2012: Advances in Artificial Intelligence. AI 2012. Lecture Notes in Computer Science(), vol 7691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35101-3_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-35101-3_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35100-6
Online ISBN: 978-3-642-35101-3
eBook Packages: Computer ScienceComputer Science (R0)