Skip to main content
SpringerLink
Log in

Taxonomy of Evolution Strategies

  • Chapter
  • First Online:
Contemporary Evolution Strategies

Part of the book series: Natural Computing Series ((NCS))

Abstract

In order to provide an integrated overview of the various developments in modern evolution strategies, this chapter provides a possible taxonomy and classification of the algorithms. Section 3.1 starts by providing the different development strands of evolution strategies. In Sect. 3.2, characteristics of modern evolution strategies are identified which can be used for defining the corresponding taxonomy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 44.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Samples are tuples of the form \(\left (\mathbf{x},f(\mathbf{x})\right )\).

  2. 2.

    lmm, nlmm, and p-sep-lmm are abbreviations for local meta model, new local meta model, and partially separable local meta model.

  3. 3.

    For example, on a state-of-the-art computer (Intel Core i7-2600 3.4 GHz), Octave requires a few seconds for the eigendecomposition of a 1,000 × 1,000 matrix, and more than 3 min in the case of a 5,000 × 5,000 matrix.

Bibliography

  1. D.V. Arnold, N. Hansen, Active covariance matrix adaptation for the (1+1)-CMA-ES, in Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation (GECCO’10), Portland, ed. by M. Pelikan, J. Branke (ACM, New York, 2010), pp. 385–392

    Google Scholar 

  2. A. Auger, N. Hansen, Performance evaluation of an advanced local search evolutionary algorithm, in Proceedings of the IEEE Congress on Evolutionary Computation (CEC’05), Edinburgh, vol. 2, ed. by B. McKay et al. (IEEE, Piscataway, 2005), pp. 1777–1784

    Google Scholar 

  3. A. Auger, N. Hansen, A restart CMA evolution strategy with increasing population size, in Proceedings of the IEEE Congress on Evolutionary Computation (CEC’05), Edinburgh, vol. 2, ed. by B. McKay et al. (IEEE, Piscataway, 2005), pp. 1769–1776

    Google Scholar 

  4. A. Auger, M. Schoenauer, N. Vanhaecke, LS-CMA-ES: a second-order algorithm for covariance matrix adaptation, in Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN VIII), Birmingham, ed. by X. Yao et al. Volume 3242 of Lecture Notes in Computer Science (Springer, Berlin, 2004), pp. 182–191

    Google Scholar 

  5. A. Auger, D. Brockhoff, N. Hansen, Mirrored sampling in evolution strategies with weighted recombination, in Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference (GECCO’11), Dublin, ed. by N. Krasnogor, P.L. Lanzi (ACM, New York, 2011), pp. 861–868

    Google Scholar 

  6. H.-G. Beyer, B. Sendhoff, Covariance matrix adaptation revisited – the CMSA evolution strategy, in Proceedings of the 10th International Conference on Parallel Problem Solving from Nature (PPSN X), Dortmund, ed. by G. Rudolph et al. Volume 5199 in Lecture Notes in Computer Science (Springer, Berlin, 2008), pp. 123–132

    Google Scholar 

  7. Z. Bouzarkouna, A. Auger, D.-Y. Ding, Investigating the local-meta-model CMA-ES for large population sizes, in Proceedings of the 3rd European Event on Bioinspired Algorithms for Continuous Parameter Optimisation (EvoNUM’10), Istanbul, Turkey, ed. by C. Di Chio et al. Volume 6024 in Lecture Notes in Computer Science (Springer, Berlin, 2010), pp. 402–411

    Google Scholar 

  8. Z. Bouzarkouna, A. Auger, D.-Y. Ding, Local-meta-model CMA-ES for partially separable functions, in Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference (GECCO’11), Dublin, ed. by N. Krasnogor et al. (ACM, New York, 2011), pp. 869–876

    Google Scholar 

  9. D. Brockhoff, A. Auger, N. Hansen, D.V. Arnold, T. Hohm, Mirrored sampling and sequential selection for evolution strategies, in Proceedings of the 11th International Conference on Parallel Problem Solving from Nature (PPSN XI), Kraków, ed. by R. Schaefer et al. Volume 6238 in Lecture Notes in Computer Science. (Springer, Berlin, 2010), pp. 11–21

    Google Scholar 

  10. T. Glasmachers, T. Schaul, Y. Sun, D. Wierstra, J. Schmidhuber, Exponential natural evolution strategies, in Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation (GECCO’10), Portland, ed. by M. Pelikan, J. Branke (ACM, New York, 2010)

    Google Scholar 

  11. N. Hansen, A. Ostermeier, Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation, in Proceedings of the 1996 IEEE International Conference on Evolutionary Computation (ICEC’96), Nagoya, ed. by Y. Davidor et al. (IEEE, Piscataway, 1996), pp. 312–317

    Google Scholar 

  12. N. Hansen, A. Ostermeier, A. Gawelczyk, On the adaptation of arbitrary normal mutation distributions in evolution strategies: the generating set adaptation, in Proceedings of the 6th International Conference on Genetic Algorithms (ICGA 6), Pittsburgh, ed. by L.J. Eshelman (Morgan Kaufmann, San Francisco, 1995), pp. 57–64

    Google Scholar 

  13. T. Hastie, R. Tibshirani, J.H. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction,2nd edn. Springer Series in Statistics (Springer, Berlin, 2009)

    Google Scholar 

  14. C. Igel, T. Suttorp, N. Hansen, A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies, in Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO’06), Seattle, ed. by M. Keijzer et al. (ACM, New York, 2006), pp. 453–460

    Google Scholar 

  15. G.A. Jastrebski, D.V. Arnold, Improving evolution strategies through active covariance matrix adaptation, in Proceedings of the 2006 IEEE Congress on Evolutionary Computation (CEC’06), Vancouver, BC, Canada, ed. by G.G. Yen et al. (IEEE, Piscataway, 2006), pp. 2814–2821

    Google Scholar 

  16. S. Kern, N. Hansen, P. Koumoutsakos, Local meta-models for optimization using evolution strategies, in Proceedings of the 9th International Conference on Parallel Problem Solving from Nature (PPSN IX), Reykjavik, ed. by T.P. Runarsson et al. (Springer, Berlin, 2006), pp. 939–948

    Google Scholar 

  17. R. Li, Mixed-integer evolution strategies for parameter optimization and their applications to medical image analysis. PhD thesis, Leiden Institute of Advanced Computer Science (LIACS), Faculty of Science, Leiden University, 2009

    Google Scholar 

  18. T.M. Mitchell, Machine Learning (McGraw-Hill, New York, 1997)

    MATH  Google Scholar 

  19. A. Ostermeier, A. Gawelczyk, N. Hansen, A derandomized approach to self adaptation of evolution strategies. Evol. Comput. 2(4), 369–380 (1994)

    Article  Google Scholar 

  20. A. Ostermeier, A. Gawelczyk, N. Hansen, Step-size adaptation based on non-local use of selection information, in Proceedings of the 3rd International Conference on Parallel Problem Solving from Nature (PPSN III), Jerusalem, ed. by Y. Davidor et al. Volume 866 of Lecture Notes in Computer Science (Springer, Berlin, 1994), pp. 189–198

    Google Scholar 

  21. I. Rechenberg, Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der biologischen Evolution (Frommann-Holzboog, Stuttgart, 1973)

    Google Scholar 

  22. R. Ros, N. Hansen, A simple modification in CMA-ES achieving linear time and space complexity, in Proceedings of the 10th International Conference on Parallel Problem Solving from Nature (PPSN X), Dortmund, ed. by G. Rudolph et al. Volume 5199 of Lecture Notes in Computer Science (Springer, Berlin, 2008), pp. 296–305

    Google Scholar 

  23. H.-P. Schwefel, Kybernetische Evolution als Strategie der experimentellen Forschung in der Strömungstechnik. Diplomarbeit, Technische Universität Berlin, Hermann Föttinger–Institut für Strömungstechnik, 1964

    Google Scholar 

  24. H.-P. Schwefel, Evolutionsstrategie und numerische Optimierung. Dr.-Ing. Dissertation, Fachbereich Verfahrenstechnik, Technische Universität Berlin, 1975

    Google Scholar 

  25. H.-P. Schwefel, Numerische Optimierung von Computer-Modellen Mittels der Evolutionsstrategie (Birkhäuser, Basel, 1977)

    MATH  Google Scholar 

  26. H.-P. Schwefel, Numerical Optimization of Computer Models (Wiley, Chichester, 1981)

    MATH  Google Scholar 

  27. P.N. Suganthan, N. Hansen, J.J. Liang, K. Deb, Y.P. Chen, A. Auger, S. Tiwari, Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical Report 2005005, Nanyang Technological University, Singapore and KanGAL (Kanpur Genetic Algorithms Laboratory, IIT Kanpur), 2005

    Google Scholar 

  28. Y. Sun, D. Wierstra, T. Schaul, J. Schmidhuber, Efficient natural evolution strategies, in Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation (GECCO’09), Shanghai, ed. by F. Rothlauf et al. (ACM, New York, 2009), pp. 539–546

    Google Scholar 

  29. S. Wessing, M. Preuss, G. Rudolph, When parameter tuning actually is parameter control, in Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation (GECCO’11), Dublin, ed. by N. Krasnogor et al. (ACM, New York, 2011), pp. 821–828

    Google Scholar 

  30. D. Wierstra, T. Schaul, J. Peters, J. Schmidhuber, Natural evolution strategies, in Proceedings of the IEEE Congress on Evolutionary Computation (CEC’08), Hong Kong (IEEE, Piscataway, 2008), pp. 3381–3387

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Leiden University, Leiden, The Netherlands

    Thomas Bäck

  2. divis intelligent solutions GmbH, Dortmund, Germany

    Christophe Foussette & Peter Krause

Authors
  1. Thomas Bäck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christophe Foussette
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Krause
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Bäck, T., Foussette, C., Krause, P. (2013). Taxonomy of Evolution Strategies. In: Contemporary Evolution Strategies. Natural Computing Series. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40137-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40137-4_3

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40136-7

  • Online ISBN: 978-3-642-40137-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation