Skip to main content
SpringerLink
Log in
Book cover

International Conference on Artificial Intelligence and Soft Computing

ICAISC 2015: Artificial Intelligence and Soft Computing pp 112–122Cite as

Using Parity-N Problems as a Way to Compare Abilities of Shallow, Very Shallow and Very Deep Architectures

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9119))

Abstract

This paper presents a new concept of a dual neural network which is hybrid of linear and nonlinear network. This approach allows for solving the problem of Parity-3 with only one sigmoid neuron or Parity-7 with 2 sigmoid neurons that is shown in the analytical and experimental manner. The paper describes the architecture of ANN, presents an analytical way of choosing the weights and the number of neurons, and provides the results of network training for different ANN architectures solving the Parity-N problem.

This work was supported by the National Science Centre, Cracow, Poland under Grant No. 2013/11/B/ST6/01337.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mandal, S., Choudhury, J., Bhadra, S., De, D.: Growth Estimation with Artificial Neural Network Considering Weather Parameters Using Factor and Principal Component Analysis. In: Proceedings of the 10th International Conference on Information Technology, Rourkela (2007)

    Google Scholar 

  2. Quan, Y.: Research on weather forecast based on neural networks. In: Proceedings of the 3rd World Congress on Intelligent Control and Automation, Beijing (2000)

    Google Scholar 

  3. Ghate, V.N., Dudu, S.V.: Cascade neural-network-based fault classifier for three-phase induction motor. IEEE Transactions on Industrial Electronics 58(5), 1555–1563 (2011)

    Article  Google Scholar 

  4. Orlowska-Kowalska, T., Dybkowski, M., Szabat, K.: Adaptive sliding-mode neuro-fuzzy control of the two-mass induction motor drive without mechanical sensors. IEEE Transactions on Industrial Electronics 57(2), 553–564 (2010)

    Article  Google Scholar 

  5. Pucci, M., Cirrincione, M.: Neural MPPT control of wind generators with induction machines without speed sensors. IEEE Transactions on Industrial Electronics 58(1), 37–47 (2011)

    Article  Google Scholar 

  6. El-Sousy, F.F.M.: Hybrid H based wavelet-neural-network tracking control for permanent-magnet synchronous motor servo drives. IEEE Transactions on Industrial Electronics 57(9), 3157–3166 (2010)

    Article  Google Scholar 

  7. Xia, C., Guo, C., Shi, T.: A neural-network-identifier and fuzzy-controller-based algorithm for dynamic decoupling control of permanent-magnet spherical motor. IEEE Transactions on Inductrial Electronics 57(8), 2868–2878 (2010)

    Article  Google Scholar 

  8. Le, Q.N., Jeon, J.W.: Neural-network-based low-speed-damping controller for stepper motor with an FPGA. IEEE Transactions on Industrial Electronics 57(9), 3167–3180 (2010)

    Article  Google Scholar 

  9. Juang, C.-F., Chang, Y.-C., Hsiao, C.-M.: Evolving gaits of a hexapod robot by recurrent neural networks with symbiotic species-based particle swarm optimization. IEEE Transactions on Industrial Electronics 58(7), 3110–3119 (2011)

    Article  Google Scholar 

  10. Tsa, C.-C.I., Huang, H.-C., Lin, S.-C.: Adaptive neural network control of a self-balancing two-wheeled scooter. IEEE Transactions on Industrial Electronics 57(4), 1420–1428 (2010)

    Article  Google Scholar 

  11. Charkhgard, M., Farrokhi, M.: State-of-charge estimation for lithium-ion batteries using neural networks and EKF. IEEE Transactions on Industrial Electronics 57(12), 4178–4187 (2010)

    Article  Google Scholar 

  12. Yahyaou, A., Fnaiech, N., Fnaiech, F.: A Suitable Initialization Procedure for Speeding a Neural Network Job-Shop Scheduling. IEEE Transactions on Industrial Electronics 58(3), 1052–1060 (2011)

    Article  Google Scholar 

  13. Machado, V., Neto, A., de Melo, J.D.: A neural network multiagent architecture applied to industrial networks for dynamic allocation of control strategies using standard function blocks. IEEE Transactions on Industrial Electronics 57(5), 1823–1834 (2010)

    Article  Google Scholar 

  14. Lu, C.-H.: Wavelet fuzzy neural networks for identification and predictive control of dynamic systems. IEEE Transactions on Industrial Electronics 58(7), 3046–3058 (2011)

    Article  Google Scholar 

  15. Wilamowski, B.M., Kaynak, O.: Oil well diagnosis by sensing terminal characteristics of the induction motor. IEEE Transactions on Industrial Electronics 47(5), 1100–1107 (2000)

    Article  Google Scholar 

  16. Wilamowski, B.M., Yu, H.: NNT - Neural Networks Trainer (2015), http://www.eng.auburn.edu/~wilambm/nnt/index.htm (accessed February 1, 2015)

  17. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323, 533–536 (1986)

    Article  Google Scholar 

  18. Werbos, P.J.: Back-propagation: Past and future. In: Proceedings of International Conference on Neural Networks, San Diego (1988)

    Google Scholar 

  19. Levenberg, K.: A method for the solution of certain problems in least squares. Quarterly of Applied Mathematics 2, 164–168 (1944)

    MathSciNet  Google Scholar 

  20. Hagan, M.T., Menha, M.B.J.: Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 5(6), 989–993 (1994)

    Article  Google Scholar 

  21. Wilamowski, B.M., Cotton, N.J., Kaynak, O., Dundar, G.: Computing gradient vector and jacobian matrix in arbitrarily connected neural networks. IEEE Transactions on Industrial Electronics 55(10), 3784–3790 (2008)

    Article  Google Scholar 

  22. Wilamowski, B.M., Yu, H.: Improved Computation for Levenberg Marquardt Training. IEEE Transactions on Neural Networks 21(6), 930–937 (2010)

    Article  Google Scholar 

  23. Wilamowski, B.M., Yu, H.: Neural Network Learning Without Backpropagation. IEEE Transactions on Neural Networks 21(11), 1793–1803 (2010)

    Article  Google Scholar 

  24. Phansalkar, V.V., Sastry, P.S.: Analysis of the back-propagation algorithm with momentum. IEEE Transactions on Neural Networks 5(3), 505–506 (1994)

    Article  Google Scholar 

  25. Wilamowski, B.M., Torvik, L.: Modification of gradient computation in the back-propagation algorithm. In: ANNIE 1993 - Artificial Neural Networks in Engineering, St. Louis (1993)

    Google Scholar 

  26. Hunter, D.S., Yu, H., Pukish, M.S., Kolbusz, J., Wilamowski, B.M.: Selection of Proper Neural Network Sizes and Architectures – A Comparative Study. IEEE Transactions on Industrial Informatics 8(2), 228–240 (2012)

    Article  Google Scholar 

  27. Hunter, D.S., Wilamowski, B.M.: Parallel Multi-Layer Neural Network Architecture with Improved Efficiency. In: Proceedings of the 4th International Conference on Human System Interaction, Yokohama (2011)

    Google Scholar 

  28. Trenn, S.: Mulit-layer Perceptrons: Approximation Order and Necessary Number of Hidden Units. IEEE Transactions on Neural Networks 19(5), 836–844 (2008)

    Article  Google Scholar 

  29. Wilamowski, B.M.: Neural Network Architectures and Learning Algorithms. IEEE Industrial Electronics Magazine, 56–63 (December 2009)

    Google Scholar 

  30. Hochreiter, S.: The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions. Int. J. Unc. Fuzz. Knowl. Based Syst. 06, 107 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Information Technology and Management in Rzeszow, Sucharskiego 2, 35-225, Rzeszow, Poland

    Paweł Różycki & Janusz Kolbusz

  2. Auburn University, Auburn, AL, 36849-5201, USA

    Tomasz Bartczak & Bogdan M. Wilamowski

Authors
  1. Paweł Różycki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Janusz Kolbusz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomasz Bartczak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bogdan M. Wilamowski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paweł Różycki .

Editor information

Editors and Affiliations

  1. Częstochowa University of Technology, Częstochowa, Poland

    Leszek Rutkowski

  2. Częstochowa University of Technology, Częstochowa, Poland

    Marcin Korytkowski

  3. Częstochowa University of Technology, Częstochowa, Poland

    Rafal Scherer

  4. AGH University of Science and Technology, Krakow, Poland

    Ryszard Tadeusiewicz

  5. University of California, Berkeley, California, USA

    Lotfi A. Zadeh

  6. University of Louisville, Louisville, Kentucky, USA

    Jacek M. Zurada

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Różycki, P., Kolbusz, J., Bartczak, T., Wilamowski, B.M. (2015). Using Parity-N Problems as a Way to Compare Abilities of Shallow, Very Shallow and Very Deep Architectures. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2015. Lecture Notes in Computer Science(), vol 9119. Springer, Cham. https://doi.org/10.1007/978-3-319-19324-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19324-3_11

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19323-6

  • Online ISBN: 978-3-319-19324-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation