Abstract
Chaos concept has been appealed in the recent optimization methods to achieve a convenient tradeoff between exploration and exploitation. Different chaotic maps have been considered to find out the appropriate one for the system dynamics. However, on particle swarm optimization (PSO), the usage of these maps has not been handled in an extensive manner, and the best fit one has not known yet. In this paper, ten chaotic maps are handled to reveal the best fit one for PSO, and to explore whether chaotic maps are necessary for PSO or not. Thirteen benchmark functions are used to perform a detailed evaluation at the first experiment. Chaotic PSO (CPSO) methods including different maps are tested on global function optimization. Concerning this, Gauss map based CPSO (GM-CPSO) has come to the forefront by achieving promising fitness values in all function evaluations and in comparison with the state-of-the-art methods. To test the efficiency of GM-CPSO on a different task, GM-CPSO is hybridized with neural network (NN) at the second experiment, and the epileptic seizure recognition is handled. Discrete wavelet transform (DWT) based features, GM-CPSO and NN are considered to design an efficient framework and to specify the type of electroencephalography signals. GM-CPSO-NN is compared with hybrid NNs including two state-of-the-art optimization methods so as to examine the efficiency of GM-CPSO. To accurately test the performances, twofold cross validation is realized on 11,500 instances, and four metrics [accuracy, area under ROC curve (AUC), sensitivity, specificity] are consulted for a detailed assessment beside of computational complexity analysis. In experiments, GM-CPSO including the necessary map, has provided remarkable fitness scores over the state-of-the-art optimization methods on optimization of various functions defined in different dimensions. Besides, the proposed framework including GM-CPSO-NN, has achieved remarkable performance by obtaining reliable accuracy (97.24%), AUC (95.67%), sensitivity (93.04%) and specificity (98.29%) scores, and by including less computational complexity than other algorithms. According to the results, GM-CPSO has arisen as the most convenient optimization method to be preferred in the formation of hybrid NNs. In addition to optimization and classification results, it’s seen that the detail sub-bands of DWT comprise necessary information for seizure recognition. Consequently, it’s revealed that GM-CPSO can be preferred on global function optimization for reliable convergence, and its usage can be extended to different disciplines like signal classification, pattern recognition or hybrid system design.
Graphical Abstract
Similar content being viewed by others
References
Xie Z, Jin L, Du X, Xiao X, Li H, Li S (2019) On generalized RMP scheme for redundant robot manipulators aided with dynamic neural networks and nonconvex bound constraints. IEEE Trans Ind Inform 15(9):5172–5181
Dai Z (2014) Extension of modified Polak–Ribiere–Polyak conjugate gradient method to linear equality constraints minimization problems. Abstr Appl Anal 2014:1–9
Zhou W, Wang F (2015) A PRP-based residual method for large-scale monotone nonlinear equations. Appl Math Comput 261:1–7
Dong XL, Han DR, Ghanbari R, Li XL, Dai ZF (2017) Some new three-term Hestenes–Stiefel conjugate gradient methods with affine combination. Optimization 66(5):759–776
Chu HH, Qian WM, Chu YM, Song YQ (2016) Optimal bounds for a Toader-type mean in terms of one-parameter quadratic and contraharmonic means. J Nonlinear Sci Appl 9(5):3424–3432
Liu C, Gong Z, Teo KL, Sun J, Caccetta L (2017) Robust multi-objective optimal switching control arising in 1,3-propanediol microbial fed-batch process. Nonlinear Anal Hybrid 25:1–20
Wei L, Jin L, Yang C, Chen K, Li W (2019) New noise-tolerant neural algorithms for future dynamic nonlinear optimization with estimation on hessian matrix inversion. IEEE T Syst Man Cyb Syst. https://doi.org/10.1109/TSMC.2019.2916892
Yang XS (2014) Nature-inspired optimization algorithms. Elsevier, New York
Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proceedings of 1998 IEEE international conference on evolutionary computation, pp 69–73
Koyuncu H, Ceylan R (2018) A PSO based approach: scout particle swarm algorithm for continuous global optimization problems. J Comput Des Eng 6(2):129–142
Koyuncu H, Ceylan R, Asoglu S, Cebeci H, Koplay M (2019) An extensive study for binary characterisation of adrenal tumours. Med Biol Eng Comput 57(4):849–862
Xu X, Rong H, Trovati M, Liptrott M, Bessis N (2018) CS-PSO: chaotic particle swarm optimization algorithm for solving combinatorial optimization problems. Soft Comput 22(3):783–795
Chen K, Zhou F, Liu A (2018) Chaotic dynamic weight particle swarm optimization for numerical function optimization. Knowl Based Syst 139:23–40
Daneshyari M (2010) Chaotic neural network controlled by particle swarm with decaying chaotic inertia weight for pattern recognition. Neural Comput Appl 19(4):637–645
Zhang M, Li F, Guan W, Wu Y, Xie C, Peng Q, Liu X (2018) A three-dimensional indoor positioning technique based on visible light communication using chaotic particle swarm optimization algorithm. Optik 165:54–73
Wang C, Yu T, Shao G, Nguyen TT, Bui TQ (2019) Shape optimization of structures with cutouts by an efficient approach based on XIGA and chaotic particle swarm optimization. Eur J Mech A Solid. 74:176–187
Wang GG, Guo L, Gandomi AH, Hao GS, Wang H (2014) Chaotic krill herd algorithm. Inf Sci 274:17–34
Saremi S, Mirjalili S, Lewis A (2014) Biogeography-based optimisation with chaos. Neural Comput Appl 25(5):1077–1097
Niu P, Chen K, Ma Y, Li X, Liu A, Li G (2017) Model turbine heat rate by fast learning network with tuning based on ameliorated krill herd algorithm. Knowl Based Syst 118:80–92
Handojoseno AA, Shine JM, Nguyen TN, Tran Y, Lewis SJ, Nguyen HT (2015) Analysis and prediction of the freezing of gait using EEG brain dynamics. IEEE Trans Neural Syst Rehabilit Eng 23(5):887–896
Sushkova OS, Morozov AA, Gabova AV (2016) A method of analysis of EEG wave trains in early stages of Parkinson’s disease. In: 2016 International conference on bioinformatics and systems biology (BSB), pp 1–4
Tahaei MS, Jalili M, Knyazeva MG (2012) Synchronizability of EEG-based functional networks in early Alzheimer’s disease. IEEE Trans Neural Syst Rehabilit Eng 20(5):636–641
Mahmoodian N, Boese A, Friebe M, Haddadnia J (2019) Epileptic seizure detection using cross-bispectrum of electroencephalogram signal. Seizure 66:4–11
Tawfik NS, Youssef SM, Kholief M (2016) A hybrid automated detection of epileptic seizures in EEG records. Comput Electr Eng 53:177–190
Osman AH, Alzahrani AA (2019) New approach for automated epileptic disease diagnosis using an ıntegrated self-organization map and radial basis function neural network algorithm. IEEE Access 7:4741–4747
Gupta A, Singh P, Karlekar M (2018) A novel signal modeling approach for classification of seizure and seizure-free EEG signals. IEEE Trans Neural Syst Rehabilit Eng 26(5):925–935
Al-Sharhan S, Bimba A (2019) Adaptive multi-parent crossover GA for feature optimization in epileptic seizure identification. Appl Soft Comput 75:575–587
Ceylan R, Koyuncu H (2019) A novel rotation forest modality based on hybrid NNs: RF (ScPSO-NN). J King Saud Univ Comput Inf Sci 31(2):235–251
Ceylan R, Koyuncu H (2016) A new breakpoint in hybrid particle swarm-neural network architecture: individual boundary adjustment. Int J Inf Technol Decis Mak 15(6):1313–1343
Feng D, Wenkang S, Liangzhou C, Yong D, Zhenfu Z (2005) Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO). Pattern Recognit Lett 26(5):597–603
Suganthan PN, Hansen N, Liang JJ, Deb K, Chen YP, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. KanGAL report, 2005005
https://archive.ics.uci.edu/ml/datasets/Epileptic+Seizure+Recognition
Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907
Koyuncu H, Ceylan R (2015) Scout particle swarm optimization. In: 6th European conference of the international federation for medical and biological engineering, pp 82–85
Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874
Gandhi T, Panigrahi BK, Anand S (2011) A comparative study of wavelet families for EEG signal classification. Neurocomputing 74(17):3051–3057
Zhou W, Liu Y, Yuan Q, Li X (2013) Epileptic seizure detection using lacunarity and Bayesian linear discriminant analysis in intracranial EEG. IEEE Trans Bio-med Eng 60(12):3375–3381
Acknowledgements
This work is supported by the Coordinatorship of Konya Technical University’s Scientific Research Projects.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Koyuncu, H. GM-CPSO: A New Viewpoint to Chaotic Particle Swarm Optimization via Gauss Map. Neural Process Lett 52, 241–266 (2020). https://doi.org/10.1007/s11063-020-10247-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-020-10247-2