Skip to main content

Symbiotic Evolution to Avoid Linkage Problem

  • Chapter

Part of the book series: Studies in Computational Intelligence ((SCI,volume 157))

Abstract

In this chapter, we introduce Symbiotic Evolutionary Algorithm (SEA) as a template for search and optimization based on partially specified chromosomes and symbiotic combination operator. We show that in contrast to genetic algorithms with traditional recombination operators, this template will not be bound to linkage problems. We present three implementations of this template: first, as a pure algorithm for search and optimization, second, as an artificial immune system, and third, as an algorithm for classifier rule base evolution, and compare implementation results and feature lists with similar algorithms.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ada, G.L., Nossal, G.: The Clonal Selection Theory. Scientific American 257(2), 50–57 (1987)

    Article  Google Scholar 

  • Bagley, J.D.: The Behaviour of Adaptive Systems Which Employ Genetic and Correlation Algorithms, PhD Dissertation, University of Michigan (1967)

    Google Scholar 

  • Baluja, S.: Population-based incremental learning: A method for integrating genetic search based function optimization and competitive learning, Tech. Rep. No. CMU-CS-94-163. Pittsburgh, PA, Carnegie Mellon University (1994)

    Google Scholar 

  • Battiti, R., Tecchiolli, G.: The Reactive Tabu Search. ORSA journal on computing 6(2), 126–140 (1994)

    MATH  Google Scholar 

  • Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases, Irvine, CA: University of California, Department of Information and Computer Science (1998), http://www.ics.uci.edu/~mlearn

  • Chen, M.Y., Linkens, D.A.: Rule-base self-generation and simplification for data-driven fuzzy models. Fuzzy Sets and Systems 142(2,1), 243–265 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Cordon, O., del Jesus, M.J., Herrera, F.: Genetic learning of fuzzy rule-based classification systems cooperating with fuzzy reasoning methods. International Journal of Intelligent Systems 13(10), 1025–1053 (1998)

    Article  Google Scholar 

  • Coello, C., Cortes, N.: Solving Multiobjective Optimization Problems Using an Artificial Immune System. Genetic Programming and Evolvable Machines 6(2), 163–190 (2005)

    Article  Google Scholar 

  • Cortés, N.C., Coello Coello, C.A.: Multiobjective Optimization Using Ideas from the Clonal Selection Principle. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724. Springer, Heidelberg (2003)

    Google Scholar 

  • Cui, X., Li, M., Fang, T.: Study of population diversity of multiobjective evolutionary algorithm based on immune and entropy principles. In: Proceedings of the Congress on Evolutionary Computation 2001 (CEC 2001), vol. 2, pp. 1316–1321. IEEE Service Center, Piscataway (2001)

    Google Scholar 

  • de la Iglesia, B., Philpott, M.S., Bagnall, A.J., Rayward-Smith, V.J.: Data Mining Rules Using Multi-Objective Evolutionary Algorithms. In: Proceedings of IEEE Congress on Evolutionary Computations, vol. 3, pp. 1552–1559 (2003)

    Google Scholar 

  • de Castro, L.N., Timmis, J.: An Artificial Immune Network for Multimodal Optimisation. In: Proceedings of the Congress on Evolutionary Computation. Part of the 2002 IEEE World Congress on Computational Intelligence, Honolulu, Hawaii, USA, pp. 699–704 (2002)

    Google Scholar 

  • de Castro, L.N., Timmis, J.: Artificial Immune Systems as a Novel Soft Computing Paradigm. Soft Computing 7(8), 526–544 (2003)

    Google Scholar 

  • de Castro, L.N., Von Zuben, F.J.: Artificial Immune Systems: Part I – Basic Theory and Applications, EEC/Unicamp, Campinas, SP, Tech. Rep. – RT DCA 01/99 (1999)

    Google Scholar 

  • de Castro, L.N., Von Zuben, F.J.: Artificial Immune Systems: Part II – A Survey of Applications. Tech. Rep. – RT DCA 02/00 (2000)

    Google Scholar 

  • de Castro, L.N., Von Zuben, F.J.: aiNet: An Artificial Immune Network for Data Analysis. In: Abbas, H., Sarker, R., Newton, C. (eds.) Data Mining: A Heuristic Approach, pp. 231–259. Idea Group Publishing (2002a)

    Google Scholar 

  • de Castro, L.N., Von Zuben, F.J.: Learning and optimization using the clonal selection principle. IEEE Transactions on Evolutionary Computation 6(3), 239–251 (2002b)

    Article  Google Scholar 

  • de Werra, D., Hertz, A.: Tabu Search Techniques: A tutorial and an application to neural networks - OR Spektrum.  11, 131–141 (1989)

    Google Scholar 

  • Deb, K.: Binary and floating point function optimization using messy genetic algorithms (IlliGAL Report No. 91004). Urbana: University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory (1991)

    Google Scholar 

  • Eggermont, J., Kok, J.N., Koster, W.A.: Genetic Programming for Data Classification: Refining the Search Space. In: Proceedings of the Fifteenth Belgium/Netherlands Conference on Artificial Intelligence, pp. 123–130 (2003)

    Google Scholar 

  • Eiben, A.E., Raué, P.E., Ruttkay, Z.: GA-easy and GA-hard Constraint Satisfaction Problems. In: Meyer, M. (ed.) Constraint Processing. LNCS, vol. 923, pp. 267–283. Springer, Heidelberg (1995)

    Google Scholar 

  • Esposito, M., Mazzariello, C., Oliviero, F., Romano, S.P., Sansone, C.: Evaluating Pattern Recognition Techniques in Intrusion Detection Systems. In: Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems (PRIS 2005), Miami, FL USA, May 24-25, 2005, pp. 144–153 (2005)

    Google Scholar 

  • Farmer, J., Packard, N., Perelson, A.: The immune system, adaptation and machinen learning. Physica D archive 2, 187–204 (1986)

    Article  MathSciNet  Google Scholar 

  • Forrest, S., Mitchell, M.: Relative Building-block fitness and the Building-block Hypothesis. In: Whitley, L.D. (ed.) Foundations of Genetic Algorithms 2, pp. 109–126. Morgan Kaufmann, San Mateo (1993a)

    Google Scholar 

  • Forrest, S., Mitchell, M.: What Makes a Problem Hard for a Genetic Algorithm? Some Anomalous Results and Their Explanation. Machine Learning 13(2/3), 285–319 (1993b)

    Article  Google Scholar 

  • Forrest, S., Perelson, A.: Genetic algorithms and the immune system. In: Schwefel, H.-P., Männer, R. (eds.) Parallel Problem Solving from Nature. LNCS, pp. 320–325. Springer, Heidelberg (1991)

    Google Scholar 

  • Forrest, S., Perelson, A., Allen, L., Cherukuri, R.: Self-nonself discrimination in a computer. In: Proceedings of 1994 IEEE Symposium on Research in Security and Privacy, pp. 132–143 (1994)

    Google Scholar 

  • Freitas, A.: A survey of evolutionary algorithms for data mining and knowledge discovery. In: Ghosh, A., Tsutsui, S. (eds.) Advances in Evolutionary Computation. Springer, Heidelberg (2001)

    Google Scholar 

  • Glover, F.: Tabu Search. Part I, ORSA Journal on Computing 1, 190–206 (1989)

    MATH  MathSciNet  Google Scholar 

  • Glover, F.: Tabu Search. Part II, ORSA Journal on Computing 2, 4–32 (1990)

    MATH  Google Scholar 

  • Goldberg, D.E., Korb, B., Deb, K.: Messy Genetic Algorithms: Motivation, analysis, and first results. Computer Systems 3(5), 493–530 (1989)

    MATH  MathSciNet  Google Scholar 

  • Goldberg, D.E., Richardson, J.: Genetic Algorithms With Sharing for Multimodal Function Optimization. In: Procceedings of the Second International Conference on Genetic Algorithms, pp. 41–49 (1987)

    Google Scholar 

  • Gomez, J., Dasgupta, D.: Evolving Fuzzy Classifiers for Intrusion Detection. In: Proceedings of the IEEE Workshop on Information Assurance (2002)

    Google Scholar 

  • Gomez, J., Gonzalez, F., Dasgupta, D. (2002). Complete Expression Trees for Evolving Fuzzy Classifier Systems with Genetic Algorithms. In: Proceedings of the Evolutionary Computation Conference GECCO 2002 (2002)

    Google Scholar 

  • Gopalan, J., Alhajj, R., Barker, J.: Discovering Accurate and Interesting Classification Rules Using Genetic Algorithm. In: Proceedings of the 2006 International Conference on Data Mining, June 26-29, pp. 389–395 (2006)

    Google Scholar 

  • Gundo, K.K., Alatas, B., Karci, A.: Mining Classification Rules by Using Genetic Algorithms with Non-random Initial Population and Uniform Operator. Turkish Journal of Electrical Engineering and Computer Science 12(1)

    Google Scholar 

  • Halavati, R., Shouraki, S.B., Heravi, M.J., Jashmi, B.J.: Symbiotic Evolutionary Algorithm, A General Purpose Optimization Approach. In: Proceedings of IEEE Congress on Evolutionary Computations (CEC 2007), Singapore (2007a)

    Google Scholar 

  • Halavati, R., Shouraki, S.B., Jashmi, B.J., Heravi, M.J.: SEAM+ Evolutionary Optimization Algorithm. In: Proceedings of the 7th International Conference on Intelligent Systems Design and Applications, IEEE Computational Intelligence Society, Rio de Janiro (2007b)

    Google Scholar 

  • Hunt, J., Cooke, D.E.: An adaptive and distributed learning system based on the Immune system. In: Proceedings of IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2494–2499 (1995)

    Google Scholar 

  • Hunt, J.E., Cooke, D.E.: Learning Using an Artificial Immune System. Journal of Network and Computer Applications 19, 189–212 (1996)

    Article  Google Scholar 

  • Harik, G.R.: Learning Gene Linkage to Efficiently Solve Problems of Bounded Difficulty Using Genetic Algorithm, PhD Dissertation, University of Illinois at Urbana-Champaign, Urbana, Illinois (1997)

    Google Scholar 

  • Harik, G.R., Lobo, F.G., Goldberg, D.E.: The compact genetic algorithm. In: Proceedings of the IEEE Conference on Evolutionary Computation, pp. 523–528 (1998)

    Google Scholar 

  • Hasanzade, M.: Fuzzy Intrusion Detection, MS. Dissertation, Computer Engineering Department, Sharif University of Technology, Tehran, Iran (in Persian, 2003)

    Google Scholar 

  • Hasanzade, M., Bagheri, S.B., Lucas, C.: Discovering Fuzzy Classifiers by Genetic Algorithms. In: Proceedings of 4th international ICSC Symposium on Engineering of Intelligent Systems (EIS 2004), Island of Madeira, Portugal (2004)

    Google Scholar 

  • Hodgkin, P.D.: Role of Cross-Reactivity in the Development of Antibody Responses. The Immunologist 6(6), 223–226 (1998)

    Google Scholar 

  • Hofmeyr, A., Forrest, S.: Immunity by Design: An Artificial Immune System. In: Procceedings of GECCO 1999, pp. 1289–1296 (1999)

    Google Scholar 

  • Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)

    Google Scholar 

  • Ishibuchi, H., Nakashima, T., Murata, T.: A hybrid fuzzy genetics-based machine learning algorithm: Hybridization of Michigan approach and Pittsburgh approach. In: Proceedings of IEEE Conference on Fuzzy Systems (1999)

    Google Scholar 

  • Ishibuchi, H., Nakashima, T., Murata, T.: A hybrid fuzzy GBML for designing compact fuzzy rule-based classification systems. In: Proceedings of IEEE Conference on Fuzzy Systems (2000)

    Google Scholar 

  • Ishibuchi, H., Nakashima, T., Murata, T.: Three objective genetics-based machine learning for linguistic rule extraction, Information Sciences, 109–133 (2001)

    Google Scholar 

  • Ishibuchi, H., Yamamoto, T.: Fuzzy rule selection by data mining criteria and genetic algorithms. In: Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2002), New York, July 9-13 2002, pp. 399–406 (2002)

    Google Scholar 

  • Ishibuchi, H., Yamamoto, T.: Fuzzy Rule Selection by Multi-Objective Genetic Local Search Algorithms and Rule Evaluation Measures in Data Mining. Fuzzy Sets and Systems 141(1), 59–88 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Kargupta, H.: SEARCH Polynomial Complexity And The Fast Messy Genetic, PhD Dissertation, University of Illinois at Urbana-Champaign, Urbana, IL (1995)

    Google Scholar 

  • Kurpati, A., Azarm, S.: Immune network simulation with multiobjective genetic algorithms for multidisciplinary design optimization. Engineering Optimization 33, 245–260 (2000)

    Article  Google Scholar 

  • Larrañaga, P., Lozano, J.A.: Estimation of Distribution Algorithms. In: A New Tool for Evolutionary Computation. Kluwer Academic Publishers, Dordrecht (2002)

    Google Scholar 

  • Liu, J.J., Kwok, J.T.: An Extended Genetic Rule Induction Algorithm. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC 2000), La Jolla, CA, USA (July 2000)

    Google Scholar 

  • Lopes, C., Pacheco, M., Vellasco, M., Passos, E.: Rule-Evolver: An Evolutionary Approach For Data Mining. In: Zhong, N., Skowron, A., Ohsuga, S. (eds.) RSFDGrC 1999. LNCS (LNAI), vol. 1711, pp. 458–462. Springer, Heidelberg (1999)

    Google Scholar 

  • Mason, D.: Antigen Cross-Reactivity: Essential in the Function of TCRs. The Immunologist 6(6), 220–222 (1998)

    Google Scholar 

  • Maynard Smith, J., Szathmary, E.: The Major Transitions in Evolution. WH Freeman, Oxford (1995)

    Google Scholar 

  • Mendes, R.R.F., Voznika, F.B., Freitas, A.A., Nievola, J.C.: Discovering Fuzzy Classification Rules with Genetic Programming and Co-Evolution. In: Proceedings of 5th European Conference PKDD 2001. LNCS (LNAI). Springer, Heidelberg (2001)

    Google Scholar 

  • Merezhkovsky, K.S.: The Theory of Two Plasms as the Basis of Symbiogenesis, a New Study or the Origins of Organisms. In: Proceedings of the Studies of the Imperial Kazan University, Publishing Office of the Imperial University (in Russian) (1909)

    Google Scholar 

  • Mill, J., Inoue, A.: Support Vector Classifiers and Network Intrusion Detection. In: Proceedings of IEEE Conference on Fuzzy Systems, vol. 1, pp. 407–410 (2004)

    Google Scholar 

  • MIT Lincoln Labs, KDD CUP 99 DARPA Intrusion Detection Dataset(2007), http://kdd.ics.uci.edu/databases/kddcup99

  • Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, London (1999)

    Google Scholar 

  • Mühlenbein, H., Mahnig, T.: Convergence theory and application of the factorized distribution algorithm. Journal of Computing and Information Technology 7(1), 19–32 (1999)

    Google Scholar 

  • Newman, D.R.: The Use of Linkage Learning in Genetic Algorithms (September 2006), http://www.ecs.soton.ac.uk/~drn05r/ug/irp/

  • Pelikan, M., Goldberg, D.E., Cantu-Paz, E.: BOA: The Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference GECCO 1999, Orlando, FL, vol. I, pp. 525–532. Morgan Kaufmann Publishers, San Francisco (1999)

    Google Scholar 

  • Pelikan, M., Goldberg, D.E.: Hierarchical BOA solves using spin glasses and MAXSAT. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724, pp. 1275–1286. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  • Potter, M.A., De Jong, K.A.: A Cooperative Coevolutionary Approach to Function Optimization. In: Davidor, Y., Schwefel, H.-P., Manner, R. (eds.) Parallel Problem Solving from Nature (PPSN III), pp. 249–257. Springer, Berlin (1994)

    Google Scholar 

  • Riquelme, J.S., Toro, J.C., Aguilar-Ruiz, M.: Evolutionary Learning of Hierarchical Decision Rules. IEEE Transactions on Systems, Man, and Cybernetics 33(2), 324–334 (2003)

    Article  Google Scholar 

  • Rouwhorst, S.E., Engelbrecht, A.P.: Searching the Forest: Using Decision Tree as Building Blocks for Evolutionary Search in Classification. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC 2000), La Jolla, CA, USA, July 2000, pp. 633–638 (2000)

    Google Scholar 

  • Russle, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn., pp. 111–112. Prentice-Hall, Englewood Cliffs (2002)

    Google Scholar 

  • Sastry, K., Goldberg, D.: On Extended Compact Genetic Algorithm (IlliGAL Report No. 2000026). Urbana, IL: University of Illinois at Urbana-Champaign (2000)

    Google Scholar 

  • Seiden, P.E., Celada, F.A.: Model for Simulating Cognate Recognition and Response the Immune System. Journal of Theoretical Biology 158, 329–357 (1992)

    Article  Google Scholar 

  • Smith, D.J., Forrest, S., Hightower, R.R., Perelson, A.: Deriving Shape Space Parameters from Immunological Data. Journal of Theoretical Biology 189, 141–150 (1997)

    Article  Google Scholar 

  • Smith, R.E., Forrest, S., Perelson, A.: Searching for diverse, cooperative populations with genetic algorithms. Technical Report TCGA No. 92002, University of Alabama, Tuscaloosa, AL (1992)

    Google Scholar 

  • Smith, R.E., Forrest, S., Perelson, A.: Population diversity in an immune system model: Implications for genetic search. In: Whitley, L.D. (ed.) Foundations of Genetic Algorithms, vol. 2, pp. 153–165. Morgan Kaufmann Publishers, San Mateo (1993)

    Google Scholar 

  • Sprent, J.: T and B Memory Cells. Cell 76(2), 315–322 (1994)

    Article  Google Scholar 

  • Tan, K.C., Yu, Q., Heng, C.M., Lee, T.H.: Evolutionary computing for knowledge discovery in medical diagnosis. Artificial Intelligence in Medicine 27, 129–154

    Google Scholar 

  • Teng, M., Xiong, F., Wang, R., Wu, Z.: Using genetic algorithm for weighted fuzzy rule-based system. In: Proceedings of Fifth World Congress on Intelligent Control and Automation (2004)

    Google Scholar 

  • Timmis, J.: Artificial Immune Systems: A Novel Data Analysis Technique Inspired by the Immune Network Theory. Ph.D. Dissertation, Department of Computer Science, University of Wales (2000)

    Google Scholar 

  • Timmis, J., Edmonds, C.: A Comment on opt-AiNet: An Immune Network Algorithm for Optimization. In: Deb, K., et al. (eds.) GECCO 2004. LNCS, vol. 3103. Springer, Heidelberg (2004)

    Google Scholar 

  • Timmis, J., Knight, T., de Castro, L.N., Hart, E.: An overview of artificial immune systems. In: Paton, R., Bolouri, H., Holcombe, M., Parish, J.H., Tateson, R. (eds.) Computation in Cells and Tissues: Perspectives and Tools for Thought. Natural Computation Series, pp. 51–86. Springer, Heidelberg (2004)

    Google Scholar 

  • Timmis, J., Neal, M., Hunt, J.: An Artificial Immune System for Data Analysis. Biosystems 55(1), 143–150 (2000)

    Article  Google Scholar 

  • Toosi, A.N., Kahani, M.: A New Approach to Intrusion Detection Based on an Evolutionary Soft Computing Model Using Neuro-Fuzzy Classifiers. Computer Communications 30, 2201–2212 (2007)

    Article  Google Scholar 

  • Tsang, C.H., Kwong, S., Wang, H.: Anomaly intrusion detection using multi-objective genetic fuzzy system and agent-based evolutionary computation framework. In: Proceedings of Fifth IEEE International Conference on Data Mining (2005)

    Google Scholar 

  • Varela, F.J., Coutinho, A.: Second Generation Immune Networks. Immunology Today 12(5), 159–166 (1991)

    Google Scholar 

  • Watson, R.A., Pollack, J.B.: Incremental Commitment in Genetic Algorithms. In: Proceedings of GECCO 1999, pp. 710–717. Morgan Kaufmann, San Francisco (1999)

    Google Scholar 

  • Watson, R.A., Pollack, J.B.: Symbiotic Combination as an Alternative to Sexual Recombination in Genetic Algorithms. In: Proceedings of Parallel Problem Solving from Nature (PPSN VI), pp. 425–436 (2000)

    Google Scholar 

  • Yoo, J., Hajela, P.: Immune network simulations in multicriterion design. Structural Optimization 18, 85–94 (1999)

    Google Scholar 

  • Zimmermann, H.J.: Fuzzy Set Theory and Its Application. Kluwer Academic Publishers, Dordrecht (1996)

    Google Scholar 

  • Zhu, F., Guan, S.U.: Ordered Incremental Training with Genetic Algorithms. International Journal of Intelligent Systems 19(12), 1239–1256 (2004)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ying-ping Chen Meng-Hiot Lim

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Halavati, R., Shouraki, S.B. (2008). Symbiotic Evolution to Avoid Linkage Problem. In: Chen, Yp., Lim, MH. (eds) Linkage in Evolutionary Computation. Studies in Computational Intelligence, vol 157. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85068-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85068-7_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85067-0

  • Online ISBN: 978-3-540-85068-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics