Abstract
Spiking Neural Networks (SNNs) constitute a representative example of neuromorphic computing in which event-driven computation is mapped to neuron spikes reducing power consumption. A challenge that limits the general adoption of SNNs is the need for mature training algorithms compared with other artificial neural networks, such as multi-layer perceptrons or convolutional neural networks. This paper explores the use of evolutionary algorithms as a black-box solution for training SNNs. The selected SNN model relies on the Izhikevich neuron model implemented in hardware. Differently from state-of-the-art, the approach followed in this paper integrates within the same System-on-a-chip (SoC) both the training algorithm and the SNN fabric, enabling continuous network adaptation in-field and, thus, eliminating the barrier between offline (training) and online (inference). A novel encoding approach for the inputs based on receptive fields is also provided to improve network accuracy. Experimental results demonstrate that these techniques perform similarly to other algorithms in the literature without dynamic adaptability for classification and control problems.
This project has been funded by the European Commission under the project A-IQ Ready (GA. 101096658) and by the Knut and Alice Wallenberg Foundation under the Wallenberg AI autonomous systems and software (WASP) program.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Frenkel, C., Lefebvre, M., Legat, J.-D., Bol, D.: A 0.086-mm2 12.7-pj/sop 64k-synapse 256-neuron online-learning digital spiking neuromorphic processor in 28-nm cmos. IEEE Trans. Biomed. Circuits Syst. 13(1), 145–158 (2018)
Lines, A., et al.: Loihi asynchronous neuromorphic research chip. In: 2018 24th IEEE International Symposium on Asynchronous Circuits and Systems (ASYNC), pp. 32–33. IEEE (2018)
Furber, S.B., Galluppi, F., Temple, S., Plana, L.A.: The spinnaker project. Proc. IEEE 102(5), 652–665 (2014)
Li, C., et al.: Efficient and self-adaptive in-situ learning in multilayer memristor neural networks. Nat. Commun. 9(1), 2385 (2018)
Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500 (1952)
Izhikevich, E.M.: Simple model of spiking neurons. IEEE Trans. Neural Networks 14(6), 1569–1572 (2003)
Brette, R., Gerstner, W.: Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. J. Neurophysiol. 94(5), 3637–3642 (2005)
Ponulak, F., Kasinski, A.: Introduction to spiking neural networks: information processing, learning and applications. Acta Neurobiol. Exp. 71(4), 409–433 (2011)
Bohte, S.M., Kok, J.N., La Poutre, H.: Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 1–4, 17–37 (2002)
Xu, Y., Zeng, X., Han, L., Yang, J.: A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks. Neural Netw. 43, 99–113 (2013)
Ponulak, F., Kasiński, A.: Supervised learning in spiking neural networks with resume: sequence learning, classification, and spike shifting. Neural Comput. 22(2), 467–510 (2010)
Sporea, I., Grüning, A.: Supervised learning in multilayer spiking neural networks. Neural Comput. 25(2), 473–509 (2013)
Belatreche, A., Maguire, L.P., McGinnity, M., Wu, Q.X.: An evolutionary strategy for supervised training of biologically plausible neural networks. In: The Sixth International Conference on Computational Intelligence and Natural Computing, pp. 1524–1527 (2003)
Sanchez, F.G., Nunez-Yanez, J.: Energy proportional streaming spiking neural network in a reconfigurable system. Microprocess. Microsyst. 53, 57–67 (2017)
Brockman, G., et al.: Openai gym. arXiv preprint arXiv:1606.01540 (2016)
Asuncion, A., Newman, D.: UCI machine learning repository (2007)
Saranirad, V., McGinnity, T.M., Dora, S., Coyle, D.: DOB-SNN: a new neuron assembly-inspired spiking neural network for pattern classification. In: 2021 International Joint Conference on Neural Networks, pp. 1–6 (2021)
Wade, J.J., McDaid, L.J., Santos, J.A., Sayers, H.M.: Swat: a spiking neural network training algorithm for classification problems. IEEE Trans. Neural Networks 21(11), 1817–1830 (2010)
Bohte, S.M., Kok, J.N., La Poutré, J.A.: Spikeprop: backpropagation for networks of spiking neurons. In: ESANN, vol. 48, pp. 419–424 (2000)
Dora, S., Subramanian, K., Suresh, S., Sundararajan, N.: Development of a self-regulating evolving spiking neural network for classification problem. Neurocomputing 171, 1216–1229 (2016)
Schuman, C.D., Plank, J.S., Disney, A., Reynolds, J.: An evolutionary optimization framework for neural networks and neuromorphic architectures. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 145–154. IEEE (2016)
Vazquez, R.: Izhikevich neuron model and its application in pattern recognition. Aust. J. Intell. Inf. Process. Syst. 11(1), 35–40 (2010)
Vazquez, R.A.: Training spiking neural models using cuckoo search algorithm. In: 2011 IEEE Congress of Evolutionary Computation (CEC), pp. 679–686 (2011)
Custode, L.L., Iacca, G.: Evolutionary learning of interpretable decision trees. IEEE Access (2023)
Xiao, Z.: Reinforcement Learning: Theory and Python Implementation. Springer, Singapor (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Otero, A., Sanllorente, G., de la Torre, E., Nunez-Yanez, J. (2023). Evolutionary FPGA-Based Spiking Neural Networks for Continual Learning. In: Palumbo, F., Keramidas, G., Voros, N., Diniz, P.C. (eds) Applied Reconfigurable Computing. Architectures, Tools, and Applications. ARC 2023. Lecture Notes in Computer Science, vol 14251. Springer, Cham. https://doi.org/10.1007/978-3-031-42921-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-42921-7_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42920-0
Online ISBN: 978-3-031-42921-7
eBook Packages: Computer ScienceComputer Science (R0)