Abstract
In this paper, two mutation-based evolving artificial neural networks, which are based on the Fuzzy ARTMAP (FAM) network and evolutionary programming, are proposed. The networks utilize the knowledge base extracted from a set of data to perform search and adaptation. The performances of the two networks are assessed using benchmark problems, with the results analyzed and discussed. The effects of the network parameters are evaluated through a parametric study. The applicability of the networks is also demonstrated using a real fault detection and diagnosis task in a power generation plant. The experimental results consistently indicate the usefulness of the proposed evolutionary FAM-based networks in yielding good classification performances with parsimonious network structures.
Similar content being viewed by others
References
González J, Rojas I, Ortega J, Pomares H, Fernández FJ, Diaz AF (2003) Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Trans Neural Netw 14: 1478–1495
Muni DP, Pal NR, Das J (2003) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybernet B 36: 106–117
Yao X (1999) Evolving artificial neural networks. Proc IEEE 87: 1423–1447
Yao X, Liu Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8: 694–713
Perez CA, Salinas CA, Estévez PA et al (2003) Genetic design of biologically inspired receptive fields for neural pattern recognition. IEEE Trans Syst Man Cybernet B 33: 258–270
Angeline PJ, Saunders GM, Pollack JB (1994) An evolutionary algorithm hat constructs recurrent neural networks. IEEE Trans Neural Netw 5: 54–64
Buchtala O, Klimek M, Sick B (2005) Evolutionary optimization of radial basis function classifiers for data mining applications. IEEE Trans Syst Man Cybernet B 35: 928–947
Guo L, Huang D-S, Zhao W (2003) Combining genetic optimization with hybrid learning algorithm for radial basis function neural networks. Electron Lett 39: 1600–1601
Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37: 54–115
Carpenter GA, Grossberg S (1988) The art of adaptive pattern recognition by a self-organising neural network. IEEE Comput 21: 77–88
Carpenter GA, Grossberg S, Markuzon N et al (1992) Fuzzy ARTMAP: a neural network architecture for incremental learning of analog multidimensional maps. IEEE Trans Neural Netw 3: 698–713
Fogel LJ, Owens AJ, Walsh MJ (1966) Artificial intelligence through simulated evolution. John Wiley, New York
Tan SC, Rao MVC, Lim CP (2006) On the reduction of complexity in the architecture of fuzzy artmap with dynamic decay adjustment. Neurocomputing 69: 2456–2460
Hettich S, Blake CL, Merz CJ (1998) UCI repository of machine learning databases http://www.ics.uci.edu/~mlearn/MLRepository.html. Department of Information and Computer Science, University of California, Irvine, CA
De Falco I, Iazzetta A, Natale P et al (1998) Evolutionary neural networks for nonlinear dynamics modelling. In: Parallel problem solving from nature 98. Lectures notes in computer science, vol 1498. Springer, Berlin, pp 593–602
Bullinaria JA (2001) Exploring the Baldwin effect in evolving adaptable control systems. In: French RF, Sougné JP (eds) Connectionist models of learning, development and evolution. Springer, London, pp 231–242
Bullinaria JA (2003) Evolving efficient learning algorithms for binary mappings. Neural Netw 16: 793–800
Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10: 1239–1243
Tsai H-H, Yu P-T (2000) On the optimal design of fuzzy neural networks with robust learning for function approximation. IEEE Trans Syst Man Cybernet B 30: 217–223
Castillo-Valdivieso PA, Merelo JJ, Prieto et al (2002) Statistical analysis of the parameters of a neuro-genetic algorithm. IEEE Trans Neural Netw 6: 1239–1243
Palmes PP, Hayasaka T, Usui S (2005) Mutation-based genetic neural network. IEEE Trans Neural Netw 16: 587–600
Jin Y-C, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9: 303–317
Caudell TP (1992) Genetic algorithms as a tool for the analysis of adaptive resonance theory network training sets. In: Whitley LD, Schaffer JD (eds) Proceedings of international workshop on combinations of genetic algorithms and neural networks, COGANN-92. IEEE Computer Society Press, Los Alamitos, pp 184–200
Li M, Tam H-Y (2001) Hybrid evolutionary search method based on clusters. IEEE Trans Pattern Anal Mach Intell 23: 786–799
Kuo RJ, Liao JL, Tu C (2005) Integration of art2 neural network and genetic k-means algorithm for analyzing web browsing paths in electronic commerce. Decis Support Syst 40: 355–374
Palaniappan R, Raveendran P, Omatu S (2002) VEP optimal channel selection using genetic algorithm for neural network classification of alcoholics. IEEE Trans Neural Netw 13: 486–491
Arkadan AA, Sidani PDM, Bouji M (2000) Performance prediction of srm drive systems under normal and fault operating conditions using ga-based ann method. IEEE Trans Magn 36: 1945–1949
Belfore LA II, Arkadan A-RA (1997) Modeling faulted switched reluctance motors using evolutionary neural networks. IEEE Trans Indus Electron 44: 226–233
Tong F, Xu X-M, Tso SK et al (2005) Application of evolutionary neural network in impact acoustics based nondestructive inspection of tile-wall. Int Conf Commun Circu Syst 2:974–978
Marwala T (2007) Bayesian training of neural networks using genetic programming. Pattern Recogn Lett 28: 1452–1458
Ferentinos KP (2005) Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms. Neural Netw 18: 934–950
Wang J-G, Shang L, Chen S et al (2004) Application of fuzzy classification by evolutionary neural network in incipient fault detection of power transformer. Int J Conf Neural Netw 3:2279–2283
Chen Z-Y, He Y-Y, Chu F-L et al (2003) Evolutionary strategy for classification problems and its application in fault diagnostics. Eng Appl Artif Intel 16: 31–38
Carpenter GA, Grossberg S, Reynolds JH (1991) ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Netw 4: 565–588
Carpenter GA, Gjaja MN, Gopal S et al (1997) ART neural networks for remote sensing: vegetation classification from landsat tm and terrain data. IEEE Trans Geosci Remote Sens 35: 308–325
Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, NY
Hancock PJB (1992) Genetic algorithms and permutation problems: a comparison of recombination operators for neural net structure specification. In: Proc COGANN workshop, Baltimore, MD, pp 108–122
Huber K-P, Berthold MR (1995) Building precise classifiers with automatic rule extraction. Proc IEEE Int Conf Neural Netw 3: 1263–1268
Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10: 925–939
Cantú-Paz E, Kamath C (2005) An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Trans Syst Man Cybernet B 35: 915–1217
Smith SF (1980) A learning system based on genetic adaptive algorithms. Ph.D. Thesis, Department of Computer Science, University of Pittsburgh, PA
Baskar S, Subraraj P, Rao MVC (2001) Performance of hybrid real coded genetic algorithms. Int J Comput Eng Sci 2: 583–601
Salcedo-Sanz S (2009) A survey of repair methods used as constraint handling techniques in evolutionary algorithms. Comput Sci Rev 3: 175–192
Paetz J (2004) Reducing the number of neurons in radial basis function networks with dynamic decay adjustment. Neurocomputing 62: 79–91
Efron B (1979) Bootstrap methods: another look at the jackknife. The Annal Stat 7: 1–26
Qin Z, Lawry J (2008) LFOIL: linguistic rule induction in the label semantics framework. Fuzzy Sets Syst 159: 435–448
Tan KC, Yu Q, Heng CM, Lee TH (2003) Evolutionary computing for knowledge discovery in medical diagnosis. Artif Intel Med 27: 129–154
Quinlan JR (1992) C4.5: programs for machine learning. Kaufmann Morgan, San Mateo CA
Frank E, Witten IH (1998) Generating accurate rule sets without global optimization. In: Proceedings of the 15th international conference machine learning (ICML’98), Madison, WI, USA. Kaufmann Morgan, San Francisco, CA, pp 144–151
John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the 11th conference on uncertainty in artificial intelligence, McGill University, Montreal, Quebec, Canada. Kaufmann Morgan, San Mateo CA, pp 338–345
Ramdén T, Krus P, Palmberg J-O (1995) Fault diagnosis of complex fluid power systems using neural networks. In: 4th Scandinavian international Conference on fluid power, 27–29 Sept, Tampere, Finland
Arkov VY, Kulikov GG, Breikin TV et al (1998) Dynamic model identification of gas turbine. In: Proceedings of UKACC international conference on CONTROL’98, pp 1367–1371
TNB (1999) System description and operating procedures, Prai Power Station Stage 3
Tan SC, Lim CP (2004) Application of an adaptive neural network with symbolic rule extraction to fault detection and diagnosis in a power generation plant. IEEE Trans Energy Conver 19: 369–377
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tan, S.C., Lim, C.P. Evolutionary Fuzzy ARTMAP Neural Networks and their Applications to Fault Detection and Diagnosis. Neural Process Lett 31, 219–242 (2010). https://doi.org/10.1007/s11063-010-9135-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-010-9135-z