Abstract
In this article, a novel evolutionary algorithm called differential evolution with Lévy flight (DEFL) algorithm was proposed to optimize the Takagi-Sugeno-Kang fuzzy model (TSK fuzzy model) by finding the optimal hyper-parameter combination. DEFL consists of the conventional differential evolution (DE) algorithm as the primary search method and Lévy flight which is adopted to improve the early convergence problem of DE by its more changeable step size. Moreover, an adaptive soft-switch factor is designed to achieve the balance between exploration and exploitation according to the fitness of parent individuals, which can enhance the searching ability of DEFL. To verify the high performance of our proposed DEFL, two simulations are conducted. First, the five test functions: Ackley, Rastrigin, Sphere, Dixon & Price, and Perm are performed to verify the searching ability of DEFL and other three evolutionary algorithms: genetic algorithm (GA), particle swarm optimization (PSO), and DE are adopted for comparison. Then, TSK fuzzy model optimized by DEFL is adopted on eight datasets for classification tasks which are compared with the other nine methods. The first simulation shows that DEFL has the best searching ability compared with other algorithms. The accuracy and ranks of the optimized TSK fuzzy model on eight tasks demonstrate the high performance of the model improved by DEFL.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alibrahim, H., Ludwig, S.A.: Hyperparameter optimization: comparing genetic algorithm against grid search and Bayesian optimization. In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 1551–1559. IEEE (2021)
Askari, S., Montazerin, N., Fazel Zarandi, M.: Modeling energy flow in natural gas networks using time series disaggregation and fuzzy systems tuned by particle swarm optimization. Appl. Soft Comput. 92, 106332 (2020)
Cervantes, J., Yu, W., Salazar, S., Chairez, I.: Takagi-sugeno dynamic neuro-fuzzy controller of uncertain nonlinear systems. IEEE Trans. Fuzzy Syst. 25(6), 1601–1615 (2017)
Chuang, C.C., Su, S.F., Chen, S.S.: Robust tsk fuzzy modeling for function approximation with outliers. IEEE Trans. Fuzzy Syst. 9(6), 810–821 (2001)
Cui, Y., Wu, D., Huang, J.: Optimize tsk fuzzy systems for classification problems: minibatch gradient descent with uniform regularization and batch normalization. IEEE Trans. Fuzzy Syst. 28(12), 3065–3075 (2020)
Feng, X., Muramatsu, H., Katsura, S.: Differential evolutionary algorithm with local search for the adaptive periodic-disturbance observer adjustment. IEEE Trans. Industr. Electron. 68(12), 12504–12512 (2021)
Jiang, Y., Weng, J., Zhang, X., Yang, Z., Hu, W.: A CNN-based born-again tsk fuzzy classifier integrating soft label information and knowledge distillation. IEEE Trans. Fuzzy Syst. 31(6), 1843–1854 (2023)
Kumar, N., Susan, S.: Particle swarm optimization of partitions and fuzzy order for fuzzy time series forecasting of COVID-19. Appl. Soft Comput. 110, 107611 (2021)
Li, S., Gu, Q., Gong, W., Ning, B.: An enhanced adaptive differential evolution algorithm for parameter extraction of photovoltaic models. Energy Convers. Manage. 205, 112443 (2020)
Safari Mamaghani, A., Pedrycz, W.: Genetic-programming-based architecture of fuzzy modeling: towards coping with high-dimensional data. IEEE Trans. Fuzzy Syst. 29(9), 2774–2784 (2021)
Shen, T., Ott, M., Auli, M., Ranzato, M.: Mixture models for diverse machine translation: tricks of the trade. In: Chaudhuri, K., Salakhutdinov, R. (eds.) Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 97, pp. 5719–5728 (2019)
Silva, J.M., Vieira, S.M., Valério, D., Henriques, J.C.: Ga-optimized inverse fuzzy model control of OWC wave power plants. Renewable Energy 204, 556–568 (2023)
Tao, X., Yi, J., Pu, Z., Xiong, T.: Robust adaptive tracking control for hypersonic vehicle based on interval type-2 fuzzy logic system and small-gain approach. IEEE Trans. Cybern. 51(5), 2504–2517 (2021)
Tarkhaneh, O., Shen, H.: An adaptive differential evolution algorithm to optimal multi-level thresholding for MRI brain image segmentation. Expert Syst. Appl. 138, 112820 (2019)
Wang, X., et al.: Dynamic pinning synchronization of fuzzy-dependent-switched coupled memristive neural networks with mismatched dimensions on time scales. IEEE Trans. Fuzzy Syst. 30(3), 779–793 (2022)
Wang, X., et al.: Novel heterogeneous mode-dependent impulsive synchronization for piecewise t-s fuzzy probabilistic coupled delayed neural networks. IEEE Trans. Fuzzy Syst. 30(7), 2142–2156 (2022)
Wu, D., Yuan, Y., Huang, J., Tan, Y.: Optimize tsk fuzzy systems for regression problems: minibatch gradient descent with regularization, droprule, and adabound (MBGD-RDA). IEEE Trans. Fuzzy Syst. 28(5), 1003–1015 (2020)
Xia, K., et al.: Tsk fuzzy system for multi-view data discovery underlying label relaxation and cross-rule & cross-view sparsity regularizations. IEEE Trans. Industr. Inf. 17(5), 3282–3291 (2021)
Xue, G., Wang, J., Yuan, B., Dai, C.: Dg-aletsk: a high-dimensional fuzzy approach with simultaneous feature selection and rule extraction. IEEE Trans. Fuzzy Syst. 1–15 (2023)
Yang, C., Deng, Z., Choi, K.S., Wang, S.: Takagi-sugeno-kang transfer learning fuzzy logic system for the adaptive recognition of epileptic electroencephalogram signals. IEEE Trans. Fuzzy Syst. 24(5), 1079–1094 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Feng, X. et al. (2024). Optimization of Takagi-Sugeno-Kang Fuzzy Model Based on Differential Evolution with Lévy Flight. In: Liu, F., Sadanandan, A.A., Pham, D.N., Mursanto, P., Lukose, D. (eds) PRICAI 2023: Trends in Artificial Intelligence. PRICAI 2023. Lecture Notes in Computer Science(), vol 14327. Springer, Singapore. https://doi.org/10.1007/978-981-99-7025-4_32
Download citation
DOI: https://doi.org/10.1007/978-981-99-7025-4_32
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7024-7
Online ISBN: 978-981-99-7025-4
eBook Packages: Computer ScienceComputer Science (R0)