Skip to main content
Log in

Evolutionary Fuzzy ARTMAP Neural Networks and their Applications to Fault Detection and Diagnosis

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

In this paper, two mutation-based evolving artificial neural networks, which are based on the Fuzzy ARTMAP (FAM) network and evolutionary programming, are proposed. The networks utilize the knowledge base extracted from a set of data to perform search and adaptation. The performances of the two networks are assessed using benchmark problems, with the results analyzed and discussed. The effects of the network parameters are evaluated through a parametric study. The applicability of the networks is also demonstrated using a real fault detection and diagnosis task in a power generation plant. The experimental results consistently indicate the usefulness of the proposed evolutionary FAM-based networks in yielding good classification performances with parsimonious network structures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. González J, Rojas I, Ortega J, Pomares H, Fernández FJ, Diaz AF (2003) Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Trans Neural Netw 14: 1478–1495

    Article  Google Scholar 

  2. Muni DP, Pal NR, Das J (2003) Genetic programming for simultaneous feature selection and classifier design. IEEE Trans Syst Man Cybernet B 36: 106–117

    Article  Google Scholar 

  3. Yao X (1999) Evolving artificial neural networks. Proc IEEE 87: 1423–1447

    Article  Google Scholar 

  4. Yao X, Liu Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8: 694–713

    Article  Google Scholar 

  5. Perez CA, Salinas CA, Estévez PA et al (2003) Genetic design of biologically inspired receptive fields for neural pattern recognition. IEEE Trans Syst Man Cybernet B 33: 258–270

    Article  Google Scholar 

  6. Angeline PJ, Saunders GM, Pollack JB (1994) An evolutionary algorithm hat constructs recurrent neural networks. IEEE Trans Neural Netw 5: 54–64

    Article  Google Scholar 

  7. Buchtala O, Klimek M, Sick B (2005) Evolutionary optimization of radial basis function classifiers for data mining applications. IEEE Trans Syst Man Cybernet B 35: 928–947

    Article  Google Scholar 

  8. Guo L, Huang D-S, Zhao W (2003) Combining genetic optimization with hybrid learning algorithm for radial basis function neural networks. Electron Lett 39: 1600–1601

    Article  Google Scholar 

  9. Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37: 54–115

    Article  Google Scholar 

  10. Carpenter GA, Grossberg S (1988) The art of adaptive pattern recognition by a self-organising neural network. IEEE Comput 21: 77–88

    Google Scholar 

  11. Carpenter GA, Grossberg S, Markuzon N et al (1992) Fuzzy ARTMAP: a neural network architecture for incremental learning of analog multidimensional maps. IEEE Trans Neural Netw 3: 698–713

    Article  Google Scholar 

  12. Fogel LJ, Owens AJ, Walsh MJ (1966) Artificial intelligence through simulated evolution. John Wiley, New York

    MATH  Google Scholar 

  13. Tan SC, Rao MVC, Lim CP (2006) On the reduction of complexity in the architecture of fuzzy artmap with dynamic decay adjustment. Neurocomputing 69: 2456–2460

    Article  Google Scholar 

  14. Hettich S, Blake CL, Merz CJ (1998) UCI repository of machine learning databases http://www.ics.uci.edu/~mlearn/MLRepository.html. Department of Information and Computer Science, University of California, Irvine, CA

  15. De Falco I, Iazzetta A, Natale P et al (1998) Evolutionary neural networks for nonlinear dynamics modelling. In: Parallel problem solving from nature 98. Lectures notes in computer science, vol 1498. Springer, Berlin, pp 593–602

  16. Bullinaria JA (2001) Exploring the Baldwin effect in evolving adaptable control systems. In: French RF, Sougné JP (eds) Connectionist models of learning, development and evolution. Springer, London, pp 231–242

    Google Scholar 

  17. Bullinaria JA (2003) Evolving efficient learning algorithms for binary mappings. Neural Netw 16: 793–800

    Article  Google Scholar 

  18. Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10: 1239–1243

    Article  Google Scholar 

  19. Tsai H-H, Yu P-T (2000) On the optimal design of fuzzy neural networks with robust learning for function approximation. IEEE Trans Syst Man Cybernet B 30: 217–223

    Article  Google Scholar 

  20. Castillo-Valdivieso PA, Merelo JJ, Prieto et al (2002) Statistical analysis of the parameters of a neuro-genetic algorithm. IEEE Trans Neural Netw 6: 1239–1243

    Google Scholar 

  21. Palmes PP, Hayasaka T, Usui S (2005) Mutation-based genetic neural network. IEEE Trans Neural Netw 16: 587–600

    Article  Google Scholar 

  22. Jin Y-C, Branke J (2005) Evolutionary optimization in uncertain environments—a survey. IEEE Trans Evol Comput 9: 303–317

    Article  Google Scholar 

  23. Caudell TP (1992) Genetic algorithms as a tool for the analysis of adaptive resonance theory network training sets. In: Whitley LD, Schaffer JD (eds) Proceedings of international workshop on combinations of genetic algorithms and neural networks, COGANN-92. IEEE Computer Society Press, Los Alamitos, pp 184–200

  24. Li M, Tam H-Y (2001) Hybrid evolutionary search method based on clusters. IEEE Trans Pattern Anal Mach Intell 23: 786–799

    Article  Google Scholar 

  25. Kuo RJ, Liao JL, Tu C (2005) Integration of art2 neural network and genetic k-means algorithm for analyzing web browsing paths in electronic commerce. Decis Support Syst 40: 355–374

    Article  Google Scholar 

  26. Palaniappan R, Raveendran P, Omatu S (2002) VEP optimal channel selection using genetic algorithm for neural network classification of alcoholics. IEEE Trans Neural Netw 13: 486–491

    Article  Google Scholar 

  27. Arkadan AA, Sidani PDM, Bouji M (2000) Performance prediction of srm drive systems under normal and fault operating conditions using ga-based ann method. IEEE Trans Magn 36: 1945–1949

    Article  Google Scholar 

  28. Belfore LA II, Arkadan A-RA (1997) Modeling faulted switched reluctance motors using evolutionary neural networks. IEEE Trans Indus Electron 44: 226–233

    Article  Google Scholar 

  29. Tong F, Xu X-M, Tso SK et al (2005) Application of evolutionary neural network in impact acoustics based nondestructive inspection of tile-wall. Int Conf Commun Circu Syst 2:974–978

    Google Scholar 

  30. Marwala T (2007) Bayesian training of neural networks using genetic programming. Pattern Recogn Lett 28: 1452–1458

    Article  Google Scholar 

  31. Ferentinos KP (2005) Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms. Neural Netw 18: 934–950

    Article  Google Scholar 

  32. Wang J-G, Shang L, Chen S et al (2004) Application of fuzzy classification by evolutionary neural network in incipient fault detection of power transformer. Int J Conf Neural Netw 3:2279–2283

    Google Scholar 

  33. Chen Z-Y, He Y-Y, Chu F-L et al (2003) Evolutionary strategy for classification problems and its application in fault diagnostics. Eng Appl Artif Intel 16: 31–38

    Article  Google Scholar 

  34. Carpenter GA, Grossberg S, Reynolds JH (1991) ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Netw 4: 565–588

    Article  Google Scholar 

  35. Carpenter GA, Gjaja MN, Gopal S et al (1997) ART neural networks for remote sensing: vegetation classification from landsat tm and terrain data. IEEE Trans Geosci Remote Sens 35: 308–325

    Article  Google Scholar 

  36. Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, NY

    MATH  Google Scholar 

  37. Hancock PJB (1992) Genetic algorithms and permutation problems: a comparison of recombination operators for neural net structure specification. In: Proc COGANN workshop, Baltimore, MD, pp 108–122

  38. Huber K-P, Berthold MR (1995) Building precise classifiers with automatic rule extraction. Proc IEEE Int Conf Neural Netw 3: 1263–1268

    Article  Google Scholar 

  39. Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10: 925–939

    Article  Google Scholar 

  40. Cantú-Paz E, Kamath C (2005) An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Trans Syst Man Cybernet B 35: 915–1217

    Article  Google Scholar 

  41. Smith SF (1980) A learning system based on genetic adaptive algorithms. Ph.D. Thesis, Department of Computer Science, University of Pittsburgh, PA

  42. Baskar S, Subraraj P, Rao MVC (2001) Performance of hybrid real coded genetic algorithms. Int J Comput Eng Sci 2: 583–601

    Article  Google Scholar 

  43. Salcedo-Sanz S (2009) A survey of repair methods used as constraint handling techniques in evolutionary algorithms. Comput Sci Rev 3: 175–192

    Article  Google Scholar 

  44. Paetz J (2004) Reducing the number of neurons in radial basis function networks with dynamic decay adjustment. Neurocomputing 62: 79–91

    Article  Google Scholar 

  45. Efron B (1979) Bootstrap methods: another look at the jackknife. The Annal Stat 7: 1–26

    Article  MATH  MathSciNet  Google Scholar 

  46. Qin Z, Lawry J (2008) LFOIL: linguistic rule induction in the label semantics framework. Fuzzy Sets Syst 159: 435–448

    Article  MATH  MathSciNet  Google Scholar 

  47. Tan KC, Yu Q, Heng CM, Lee TH (2003) Evolutionary computing for knowledge discovery in medical diagnosis. Artif Intel Med 27: 129–154

    Article  Google Scholar 

  48. Quinlan JR (1992) C4.5: programs for machine learning. Kaufmann Morgan, San Mateo CA

    Google Scholar 

  49. Frank E, Witten IH (1998) Generating accurate rule sets without global optimization. In: Proceedings of the 15th international conference machine learning (ICML’98), Madison, WI, USA. Kaufmann Morgan, San Francisco, CA, pp 144–151

  50. John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the 11th conference on uncertainty in artificial intelligence, McGill University, Montreal, Quebec, Canada. Kaufmann Morgan, San Mateo CA, pp 338–345

  51. Ramdén T, Krus P, Palmberg J-O (1995) Fault diagnosis of complex fluid power systems using neural networks. In: 4th Scandinavian international Conference on fluid power, 27–29 Sept, Tampere, Finland

  52. Arkov VY, Kulikov GG, Breikin TV et al (1998) Dynamic model identification of gas turbine. In: Proceedings of UKACC international conference on CONTROL’98, pp 1367–1371

  53. TNB (1999) System description and operating procedures, Prai Power Station Stage 3

  54. Tan SC, Lim CP (2004) Application of an adaptive neural network with symbolic rule extraction to fault detection and diagnosis in a power generation plant. IEEE Trans Energy Conver 19: 369–377

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shing Chiang Tan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tan, S.C., Lim, C.P. Evolutionary Fuzzy ARTMAP Neural Networks and their Applications to Fault Detection and Diagnosis. Neural Process Lett 31, 219–242 (2010). https://doi.org/10.1007/s11063-010-9135-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-010-9135-z

Keywords

Navigation