Abstract
In this chapter, we introduce Symbiotic Evolutionary Algorithm (SEA) as a template for search and optimization based on partially specified chromosomes and symbiotic combination operator. We show that in contrast to genetic algorithms with traditional recombination operators, this template will not be bound to linkage problems. We present three implementations of this template: first, as a pure algorithm for search and optimization, second, as an artificial immune system, and third, as an algorithm for classifier rule base evolution, and compare implementation results and feature lists with similar algorithms.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ada, G.L., Nossal, G.: The Clonal Selection Theory. Scientific American 257(2), 50–57 (1987)
Bagley, J.D.: The Behaviour of Adaptive Systems Which Employ Genetic and Correlation Algorithms, PhD Dissertation, University of Michigan (1967)
Baluja, S.: Population-based incremental learning: A method for integrating genetic search based function optimization and competitive learning, Tech. Rep. No. CMU-CS-94-163. Pittsburgh, PA, Carnegie Mellon University (1994)
Battiti, R., Tecchiolli, G.: The Reactive Tabu Search. ORSA journal on computing 6(2), 126–140 (1994)
Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases, Irvine, CA: University of California, Department of Information and Computer Science (1998), http://www.ics.uci.edu/~mlearn
Chen, M.Y., Linkens, D.A.: Rule-base self-generation and simplification for data-driven fuzzy models. Fuzzy Sets and Systems 142(2,1), 243–265 (2004)
Cordon, O., del Jesus, M.J., Herrera, F.: Genetic learning of fuzzy rule-based classification systems cooperating with fuzzy reasoning methods. International Journal of Intelligent Systems 13(10), 1025–1053 (1998)
Coello, C., Cortes, N.: Solving Multiobjective Optimization Problems Using an Artificial Immune System. Genetic Programming and Evolvable Machines 6(2), 163–190 (2005)
Cortés, N.C., Coello Coello, C.A.: Multiobjective Optimization Using Ideas from the Clonal Selection Principle. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724. Springer, Heidelberg (2003)
Cui, X., Li, M., Fang, T.: Study of population diversity of multiobjective evolutionary algorithm based on immune and entropy principles. In: Proceedings of the Congress on Evolutionary Computation 2001 (CEC 2001), vol. 2, pp. 1316–1321. IEEE Service Center, Piscataway (2001)
de la Iglesia, B., Philpott, M.S., Bagnall, A.J., Rayward-Smith, V.J.: Data Mining Rules Using Multi-Objective Evolutionary Algorithms. In: Proceedings of IEEE Congress on Evolutionary Computations, vol. 3, pp. 1552–1559 (2003)
de Castro, L.N., Timmis, J.: An Artificial Immune Network for Multimodal Optimisation. In: Proceedings of the Congress on Evolutionary Computation. Part of the 2002 IEEE World Congress on Computational Intelligence, Honolulu, Hawaii, USA, pp. 699–704 (2002)
de Castro, L.N., Timmis, J.: Artificial Immune Systems as a Novel Soft Computing Paradigm. Soft Computing 7(8), 526–544 (2003)
de Castro, L.N., Von Zuben, F.J.: Artificial Immune Systems: Part I – Basic Theory and Applications, EEC/Unicamp, Campinas, SP, Tech. Rep. – RT DCA 01/99 (1999)
de Castro, L.N., Von Zuben, F.J.: Artificial Immune Systems: Part II – A Survey of Applications. Tech. Rep. – RT DCA 02/00 (2000)
de Castro, L.N., Von Zuben, F.J.: aiNet: An Artificial Immune Network for Data Analysis. In: Abbas, H., Sarker, R., Newton, C. (eds.) Data Mining: A Heuristic Approach, pp. 231–259. Idea Group Publishing (2002a)
de Castro, L.N., Von Zuben, F.J.: Learning and optimization using the clonal selection principle. IEEE Transactions on Evolutionary Computation 6(3), 239–251 (2002b)
de Werra, D., Hertz, A.: Tabu Search Techniques: A tutorial and an application to neural networks - OR Spektrum. 11, 131–141 (1989)
Deb, K.: Binary and floating point function optimization using messy genetic algorithms (IlliGAL Report No. 91004). Urbana: University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory (1991)
Eggermont, J., Kok, J.N., Koster, W.A.: Genetic Programming for Data Classification: Refining the Search Space. In: Proceedings of the Fifteenth Belgium/Netherlands Conference on Artificial Intelligence, pp. 123–130 (2003)
Eiben, A.E., Raué, P.E., Ruttkay, Z.: GA-easy and GA-hard Constraint Satisfaction Problems. In: Meyer, M. (ed.) Constraint Processing. LNCS, vol. 923, pp. 267–283. Springer, Heidelberg (1995)
Esposito, M., Mazzariello, C., Oliviero, F., Romano, S.P., Sansone, C.: Evaluating Pattern Recognition Techniques in Intrusion Detection Systems. In: Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems (PRIS 2005), Miami, FL USA, May 24-25, 2005, pp. 144–153 (2005)
Farmer, J., Packard, N., Perelson, A.: The immune system, adaptation and machinen learning. Physica D archive 2, 187–204 (1986)
Forrest, S., Mitchell, M.: Relative Building-block fitness and the Building-block Hypothesis. In: Whitley, L.D. (ed.) Foundations of Genetic Algorithms 2, pp. 109–126. Morgan Kaufmann, San Mateo (1993a)
Forrest, S., Mitchell, M.: What Makes a Problem Hard for a Genetic Algorithm? Some Anomalous Results and Their Explanation. Machine Learning 13(2/3), 285–319 (1993b)
Forrest, S., Perelson, A.: Genetic algorithms and the immune system. In: Schwefel, H.-P., Männer, R. (eds.) Parallel Problem Solving from Nature. LNCS, pp. 320–325. Springer, Heidelberg (1991)
Forrest, S., Perelson, A., Allen, L., Cherukuri, R.: Self-nonself discrimination in a computer. In: Proceedings of 1994 IEEE Symposium on Research in Security and Privacy, pp. 132–143 (1994)
Freitas, A.: A survey of evolutionary algorithms for data mining and knowledge discovery. In: Ghosh, A., Tsutsui, S. (eds.) Advances in Evolutionary Computation. Springer, Heidelberg (2001)
Glover, F.: Tabu Search. Part I, ORSA Journal on Computing 1, 190–206 (1989)
Glover, F.: Tabu Search. Part II, ORSA Journal on Computing 2, 4–32 (1990)
Goldberg, D.E., Korb, B., Deb, K.: Messy Genetic Algorithms: Motivation, analysis, and first results. Computer Systems 3(5), 493–530 (1989)
Goldberg, D.E., Richardson, J.: Genetic Algorithms With Sharing for Multimodal Function Optimization. In: Procceedings of the Second International Conference on Genetic Algorithms, pp. 41–49 (1987)
Gomez, J., Dasgupta, D.: Evolving Fuzzy Classifiers for Intrusion Detection. In: Proceedings of the IEEE Workshop on Information Assurance (2002)
Gomez, J., Gonzalez, F., Dasgupta, D. (2002). Complete Expression Trees for Evolving Fuzzy Classifier Systems with Genetic Algorithms. In: Proceedings of the Evolutionary Computation Conference GECCO 2002 (2002)
Gopalan, J., Alhajj, R., Barker, J.: Discovering Accurate and Interesting Classification Rules Using Genetic Algorithm. In: Proceedings of the 2006 International Conference on Data Mining, June 26-29, pp. 389–395 (2006)
Gundo, K.K., Alatas, B., Karci, A.: Mining Classification Rules by Using Genetic Algorithms with Non-random Initial Population and Uniform Operator. Turkish Journal of Electrical Engineering and Computer Science 12(1)
Halavati, R., Shouraki, S.B., Heravi, M.J., Jashmi, B.J.: Symbiotic Evolutionary Algorithm, A General Purpose Optimization Approach. In: Proceedings of IEEE Congress on Evolutionary Computations (CEC 2007), Singapore (2007a)
Halavati, R., Shouraki, S.B., Jashmi, B.J., Heravi, M.J.: SEAM+ Evolutionary Optimization Algorithm. In: Proceedings of the 7th International Conference on Intelligent Systems Design and Applications, IEEE Computational Intelligence Society, Rio de Janiro (2007b)
Hunt, J., Cooke, D.E.: An adaptive and distributed learning system based on the Immune system. In: Proceedings of IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2494–2499 (1995)
Hunt, J.E., Cooke, D.E.: Learning Using an Artificial Immune System. Journal of Network and Computer Applications 19, 189–212 (1996)
Harik, G.R.: Learning Gene Linkage to Efficiently Solve Problems of Bounded Difficulty Using Genetic Algorithm, PhD Dissertation, University of Illinois at Urbana-Champaign, Urbana, Illinois (1997)
Harik, G.R., Lobo, F.G., Goldberg, D.E.: The compact genetic algorithm. In: Proceedings of the IEEE Conference on Evolutionary Computation, pp. 523–528 (1998)
Hasanzade, M.: Fuzzy Intrusion Detection, MS. Dissertation, Computer Engineering Department, Sharif University of Technology, Tehran, Iran (in Persian, 2003)
Hasanzade, M., Bagheri, S.B., Lucas, C.: Discovering Fuzzy Classifiers by Genetic Algorithms. In: Proceedings of 4th international ICSC Symposium on Engineering of Intelligent Systems (EIS 2004), Island of Madeira, Portugal (2004)
Hodgkin, P.D.: Role of Cross-Reactivity in the Development of Antibody Responses. The Immunologist 6(6), 223–226 (1998)
Hofmeyr, A., Forrest, S.: Immunity by Design: An Artificial Immune System. In: Procceedings of GECCO 1999, pp. 1289–1296 (1999)
Holland, J.H.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Ishibuchi, H., Nakashima, T., Murata, T.: A hybrid fuzzy genetics-based machine learning algorithm: Hybridization of Michigan approach and Pittsburgh approach. In: Proceedings of IEEE Conference on Fuzzy Systems (1999)
Ishibuchi, H., Nakashima, T., Murata, T.: A hybrid fuzzy GBML for designing compact fuzzy rule-based classification systems. In: Proceedings of IEEE Conference on Fuzzy Systems (2000)
Ishibuchi, H., Nakashima, T., Murata, T.: Three objective genetics-based machine learning for linguistic rule extraction, Information Sciences, 109–133 (2001)
Ishibuchi, H., Yamamoto, T.: Fuzzy rule selection by data mining criteria and genetic algorithms. In: Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2002), New York, July 9-13 2002, pp. 399–406 (2002)
Ishibuchi, H., Yamamoto, T.: Fuzzy Rule Selection by Multi-Objective Genetic Local Search Algorithms and Rule Evaluation Measures in Data Mining. Fuzzy Sets and Systems 141(1), 59–88 (2004)
Kargupta, H.: SEARCH Polynomial Complexity And The Fast Messy Genetic, PhD Dissertation, University of Illinois at Urbana-Champaign, Urbana, IL (1995)
Kurpati, A., Azarm, S.: Immune network simulation with multiobjective genetic algorithms for multidisciplinary design optimization. Engineering Optimization 33, 245–260 (2000)
Larrañaga, P., Lozano, J.A.: Estimation of Distribution Algorithms. In: A New Tool for Evolutionary Computation. Kluwer Academic Publishers, Dordrecht (2002)
Liu, J.J., Kwok, J.T.: An Extended Genetic Rule Induction Algorithm. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC 2000), La Jolla, CA, USA (July 2000)
Lopes, C., Pacheco, M., Vellasco, M., Passos, E.: Rule-Evolver: An Evolutionary Approach For Data Mining. In: Zhong, N., Skowron, A., Ohsuga, S. (eds.) RSFDGrC 1999. LNCS (LNAI), vol. 1711, pp. 458–462. Springer, Heidelberg (1999)
Mason, D.: Antigen Cross-Reactivity: Essential in the Function of TCRs. The Immunologist 6(6), 220–222 (1998)
Maynard Smith, J., Szathmary, E.: The Major Transitions in Evolution. WH Freeman, Oxford (1995)
Mendes, R.R.F., Voznika, F.B., Freitas, A.A., Nievola, J.C.: Discovering Fuzzy Classification Rules with Genetic Programming and Co-Evolution. In: Proceedings of 5th European Conference PKDD 2001. LNCS (LNAI). Springer, Heidelberg (2001)
Merezhkovsky, K.S.: The Theory of Two Plasms as the Basis of Symbiogenesis, a New Study or the Origins of Organisms. In: Proceedings of the Studies of the Imperial Kazan University, Publishing Office of the Imperial University (in Russian) (1909)
Mill, J., Inoue, A.: Support Vector Classifiers and Network Intrusion Detection. In: Proceedings of IEEE Conference on Fuzzy Systems, vol. 1, pp. 407–410 (2004)
MIT Lincoln Labs, KDD CUP 99 DARPA Intrusion Detection Dataset(2007), http://kdd.ics.uci.edu/databases/kddcup99
Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, London (1999)
Mühlenbein, H., Mahnig, T.: Convergence theory and application of the factorized distribution algorithm. Journal of Computing and Information Technology 7(1), 19–32 (1999)
Newman, D.R.: The Use of Linkage Learning in Genetic Algorithms (September 2006), http://www.ecs.soton.ac.uk/~drn05r/ug/irp/
Pelikan, M., Goldberg, D.E., Cantu-Paz, E.: BOA: The Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference GECCO 1999, Orlando, FL, vol. I, pp. 525–532. Morgan Kaufmann Publishers, San Francisco (1999)
Pelikan, M., Goldberg, D.E.: Hierarchical BOA solves using spin glasses and MAXSAT. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724, pp. 1275–1286. Springer, Heidelberg (2003)
Potter, M.A., De Jong, K.A.: A Cooperative Coevolutionary Approach to Function Optimization. In: Davidor, Y., Schwefel, H.-P., Manner, R. (eds.) Parallel Problem Solving from Nature (PPSN III), pp. 249–257. Springer, Berlin (1994)
Riquelme, J.S., Toro, J.C., Aguilar-Ruiz, M.: Evolutionary Learning of Hierarchical Decision Rules. IEEE Transactions on Systems, Man, and Cybernetics 33(2), 324–334 (2003)
Rouwhorst, S.E., Engelbrecht, A.P.: Searching the Forest: Using Decision Tree as Building Blocks for Evolutionary Search in Classification. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC 2000), La Jolla, CA, USA, July 2000, pp. 633–638 (2000)
Russle, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn., pp. 111–112. Prentice-Hall, Englewood Cliffs (2002)
Sastry, K., Goldberg, D.: On Extended Compact Genetic Algorithm (IlliGAL Report No. 2000026). Urbana, IL: University of Illinois at Urbana-Champaign (2000)
Seiden, P.E., Celada, F.A.: Model for Simulating Cognate Recognition and Response the Immune System. Journal of Theoretical Biology 158, 329–357 (1992)
Smith, D.J., Forrest, S., Hightower, R.R., Perelson, A.: Deriving Shape Space Parameters from Immunological Data. Journal of Theoretical Biology 189, 141–150 (1997)
Smith, R.E., Forrest, S., Perelson, A.: Searching for diverse, cooperative populations with genetic algorithms. Technical Report TCGA No. 92002, University of Alabama, Tuscaloosa, AL (1992)
Smith, R.E., Forrest, S., Perelson, A.: Population diversity in an immune system model: Implications for genetic search. In: Whitley, L.D. (ed.) Foundations of Genetic Algorithms, vol. 2, pp. 153–165. Morgan Kaufmann Publishers, San Mateo (1993)
Sprent, J.: T and B Memory Cells. Cell 76(2), 315–322 (1994)
Tan, K.C., Yu, Q., Heng, C.M., Lee, T.H.: Evolutionary computing for knowledge discovery in medical diagnosis. Artificial Intelligence in Medicine 27, 129–154
Teng, M., Xiong, F., Wang, R., Wu, Z.: Using genetic algorithm for weighted fuzzy rule-based system. In: Proceedings of Fifth World Congress on Intelligent Control and Automation (2004)
Timmis, J.: Artificial Immune Systems: A Novel Data Analysis Technique Inspired by the Immune Network Theory. Ph.D. Dissertation, Department of Computer Science, University of Wales (2000)
Timmis, J., Edmonds, C.: A Comment on opt-AiNet: An Immune Network Algorithm for Optimization. In: Deb, K., et al. (eds.) GECCO 2004. LNCS, vol. 3103. Springer, Heidelberg (2004)
Timmis, J., Knight, T., de Castro, L.N., Hart, E.: An overview of artificial immune systems. In: Paton, R., Bolouri, H., Holcombe, M., Parish, J.H., Tateson, R. (eds.) Computation in Cells and Tissues: Perspectives and Tools for Thought. Natural Computation Series, pp. 51–86. Springer, Heidelberg (2004)
Timmis, J., Neal, M., Hunt, J.: An Artificial Immune System for Data Analysis. Biosystems 55(1), 143–150 (2000)
Toosi, A.N., Kahani, M.: A New Approach to Intrusion Detection Based on an Evolutionary Soft Computing Model Using Neuro-Fuzzy Classifiers. Computer Communications 30, 2201–2212 (2007)
Tsang, C.H., Kwong, S., Wang, H.: Anomaly intrusion detection using multi-objective genetic fuzzy system and agent-based evolutionary computation framework. In: Proceedings of Fifth IEEE International Conference on Data Mining (2005)
Varela, F.J., Coutinho, A.: Second Generation Immune Networks. Immunology Today 12(5), 159–166 (1991)
Watson, R.A., Pollack, J.B.: Incremental Commitment in Genetic Algorithms. In: Proceedings of GECCO 1999, pp. 710–717. Morgan Kaufmann, San Francisco (1999)
Watson, R.A., Pollack, J.B.: Symbiotic Combination as an Alternative to Sexual Recombination in Genetic Algorithms. In: Proceedings of Parallel Problem Solving from Nature (PPSN VI), pp. 425–436 (2000)
Yoo, J., Hajela, P.: Immune network simulations in multicriterion design. Structural Optimization 18, 85–94 (1999)
Zimmermann, H.J.: Fuzzy Set Theory and Its Application. Kluwer Academic Publishers, Dordrecht (1996)
Zhu, F., Guan, S.U.: Ordered Incremental Training with Genetic Algorithms. International Journal of Intelligent Systems 19(12), 1239–1256 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Halavati, R., Shouraki, S.B. (2008). Symbiotic Evolution to Avoid Linkage Problem. In: Chen, Yp., Lim, MH. (eds) Linkage in Evolutionary Computation. Studies in Computational Intelligence, vol 157. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85068-7_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-85068-7_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85067-0
Online ISBN: 978-3-540-85068-7
eBook Packages: EngineeringEngineering (R0)