Figures
Abstract
Parameter estimation for fractional-order chaotic systems is an important issue in fractional-order chaotic control and synchronization and could be essentially formulated as a multidimensional optimization problem. A novel algorithm called quantum parallel particle swarm optimization (QPPSO) is proposed to solve the parameter estimation for fractional-order chaotic systems. The parallel characteristic of quantum computing is used in QPPSO. This characteristic increases the calculation of each generation exponentially. The behavior of particles in quantum space is restrained by the quantum evolution equation, which consists of the current rotation angle, individual optimal quantum rotation angle, and global optimal quantum rotation angle. Numerical simulation based on several typical fractional-order systems and comparisons with some typical existing algorithms show the effectiveness and efficiency of the proposed algorithm.
Citation: Huang Y, Guo F, Li Y, Liu Y (2015) Parameter Estimation of Fractional-Order Chaotic Systems by Using Quantum Parallel Particle Swarm Optimization Algorithm. PLoS ONE 10(1): e0114910. https://doi.org/10.1371/journal.pone.0114910
Academic Editor: Ke Lu, University of Chinese Academy of Sciences, CHINA
Received: July 2, 2014; Accepted: November 2, 2014; Published: January 20, 2015
Copyright: © 2015 Huang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by Central Universities Fundamental Research Funds (12MS117) and the Natural Science Foundation of Fujian Province of China (No.2014J01249). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
As an important concept in nonlinear science, chaos is characterized by unstable dynamic behavior with sensitive dependence on initial conditions and includes infinite unstable periodic motions. The control and synchronization of chaotic systems have gained considerable attention in recent years [1–5]. Furthermore, several researchers have recently directed increasing interest toward the chaotic behavior of fractional-order dynamical systems [6–12]. However, considerable research on the behavior of fractional-order dynamical systems requires the parameters of the fractional-order chaotic system to be determined in advance. Unfortunately, these parameters are usually unknown. In the past decades, numerous methods were proposed to solve the parameter estimation of integer-order chaotic systems. Comparatively, little attention has been devoted to the parameter estimation of fractional-order chaotic systems.
In this study, we preliminarily focus on the parameter estimation problem of fractional-order chaotic systems; those problem can be formulated as a multidimensional optimization problem. To solve this multidimensional optimization problem, a novel algorithm called quantum parallel particle swarm optimization (QPPSO) is proposed. The parallel characteristic of quantum computing is used to improve the ergodicity of QPPSO. Moreover, quantum states are updated by a new quantum evolution equation, which is constituted by the current rotation angle, individual optimal quantum rotation angle, and global optimal quantum rotation angle. The performance of QPPSO in solving the parameter estimation problem of fractional-order chaotic systems is investigated through a comparison with those of other evolutionary optimization algorithms.
The remainder of this paper is organized as follows. A brief review of relevant work on the chaotic behavior of fractional-order dynamical systems and the parameter estimation of chaotic systems is presented in Section 2. Parameter estimation for fractional-order chaotic systems from the viewpoint of optimization is formulated in Section 3. A discussion on QPPSO after a brief introduction of the quantum parallelism character is made in Section 4. Numerical simulation results based on several typical fractional-order chaotic systems and comparisons with a few existing approaches are provided in Section 5. Finally, the conclusions and a brief summary of the results are presented in Section 6.
Literature Review
Considerable research has been done on the chaotic behavior of fractional-order dynamical systems. The chaotic behavior of the fractional-order Lorenz system was studied in [13], in which the authors determined that the system with Σ < 3, where Σ is defined as the sum of the orders of all involved derivatives, can exhibit chaotic behavior. In [14], the chaos and hyperchaos of fractional-order Rössler equations were studied. In this research, the authors showed that chaos can exist in the fractional-order Rössler equation with an order as low as 2.4 and that hyperchaos can exist in the same equation with an order as low as 3.8. In [15], the chaotic behavior of the fractional-order Chen system was examined. The authors determined that chaos exists in the fractional-order Chen system with an order less than 3. In [16], Lu numerically investigated the chaotic behavior of the fractional-order Lü system. A remarkable finding is that the lowest order for this system to exhibit chaos is 0.3; this system is therefore the lowest-order chaotic system among all chaotic systems reported in the literature. More fractional-order systems with chaotic behavior are discussed in detail in [17–19]. However, these studies do not focus much on estimating the parameters of fractional-order chaotic systems.
To date, much work has been made on the parameter estimation of integer-order chaotic systems. Dai et al. [20] used the genetic algorithm (GA) to estimate the parameters of the Lorenz chaotic system. Li et al. [21] utilized a chaotic ant swarm algorithm to identify the parameters of the logistic iteration and Lorenz systems. In [22], differential evolution was used to identify the parameters of the Lorenz system. In [23], the particle swarm optimization (PSO) algorithm was applied to solve the parameter estimation of chaotic systems. Numerical simulation shows that PSO is a feasible approach for the parameter identification of integer-order chaotic systems. Although some progress has been made in the parameter estimation of integer-order chaotic systems, the parameter estimation of fractional-order chaotic systems is more complicated than that of integer-order chaotic systems. Therefore, we put forward QPPSO to solve the complicated problem of parameter estimation of fractional-order chaotic systems. Moreover, QPPSO can also be applied to many other aspects such as 3-d object retrieval and recognition[24], hyperspectral image classification[25,26] and visual-codebook compression[27].
Problem Description
Consider the following n-dimensional fractional-order chaotic system [28]:
(1) where X = (x1, x2, …, xn)T ∈ Rn denotes the n-dimensional state vector of the original system, X0 represents the system initial state, q = (q1, q2, …, qn)T ∈ Rn is a set of fractional order of the original system, and θ = (θ1, θ2, …, θD)T ∈ RD is the value of the original system parameters.
Suppose that the structure of the system is determined in advance, therefore the estimated system can be described as follows:
(2)
where
expresses the n-dimensional state vector of the estimated system,
is the estimated order of the system, and
is a set of estimated parameters.
Essentially, the parameter estimation of the fractional-order chaotic system problem considered here involves searching for the optimal parameters
and
, the performance index shown in Eq. 3 is minimized.
(3)
where M denotes the length of data used for parameter estimation. Xk and
(k = 1, 2, ..., M)denote the state of the original and the estimated systems at time k, respectively.
Evidently, the parameter estimation for the fractional-order chaotic system can be considered asa multi-dimensional continuous optimization problem, where q and θ are the decision variables, and J is the optimization goal. The principle of parameter estimation for fractional-order chaotic systems in the optimization sense is shown in Fig. 1.
The parameter estimation for the fractional-order chaotic system can be considered a multidimensional continuous optimization problem, where q and θ are the decision variables.
Because of the unstable dynamic behavior of fractional-order chaotic systems, accurate parameters are difficult to obtain. Moreover, traditional optimization methods are difficult to derive in global optimal parameters as many local optima in the landscape of J. Therefore, a novel algorithm called QPPSO is proposed to solve the parameter estimation of fractional-order chaotic systems.
QPPSO
Quantum parallelism
Quantum parallelism, which enables quantum computers to simultaneously evaluate a function f(x) for many different values of x, is a fundamental feature of numerous quantum algorithms.
Consider the circuit shown in Fig. 2. The circuit applies Uf to an input that is not in the computational basis. The data register is prepared in the superposition
, which is created with a Hadamard gate acting on
. The state
is then calculated with Uf as follows [29]:
(4)
where
is called the Dirac notation and it is the standard notation for states in quantum mechanics, H is the Hadamard gate, and Uf is the quantum circuit that takes inputs, such as
, to
.
Uf is the quantum circuit that takes inputs, such as
, to
.
In this study, a single f(x) circuit is used to simultaneously evaluate the function for multiple values of x by utilizing the capability of a quantum computer to superposition different states. This procedure can easily be generalized to functions on an arbitrary number of bits by using a general operation known as the Hadamard transform, or sometimes, the Walsh–Hadamard transform. The result of initially conducting the Hadamard transform on m Q-bits in
state is expressed as follows:
(5)
where
is the m times inner product of Hadamard, and
is the m times inner product of
. In Eq. 5, the sum is over all possible values of x, that is, the Hadamard transform produces an equal superposition of all computational basis states. Moreover, the Hadamard transform efficiently performs this process and thus produces a superposition of 2m states by using m gates only.
Quantum parallel particle swarm optimization algorithm
In this section, we introduce the QPPSO optimization algorithm as follows:
Quantum encoding.
The Q-bit is the smallest unit of information, which can be expressed as follows:
(6)
Therefore, the Q-bit can be coded as
, where cosθ or sinθ just represents a probability amplitude. However, in QPPSO, cosθ or sinθ is no longer the probability amplitude but is a certain value. The quantum encoding of QPPSO is shown in Fig. 3.
For an n dimensional space, each basis of this space can be divided into 2m states with m gates only.
In Fig. 3, an arbitrary xj can be expressed as a string of m Q-bits shown as follows:
(7)
where θij = 2π × rand; i = 1, 2, …, m; j = 1, 2, …, n. rand is a random number between zero and one.
Therefore, the tensor product of
with itself can be expressed as follows:
(8)
For an n-dimensional space, each basis in the space has a value range. For simplicity, all the bases are set a value among (aj, bj). The division of the solution space is shown in Fig. 4. In Fig. 4, xjh can be expressed as follows:
(9)
where h = 1, 2, …, 2m. Based on subpopulation parallel computing, the algorithm running rate is exponentially accelerated. Moreover, individuals belong to different subspaces, so premature phenomena can be efficiently prevented.
An arbitrary xj is set a value between (aj, bj), and it is divided into 2m subset by quantum parallelism.
Quantum state update.
In quantum space, the equations in traditional PSO are inapplicable because of the uncertainty relation between the coordinate and the momentum. To restrain the behavior of particles in quantum space, a formula that consists of the current rotation angle, the individual optimal quantum rotation angle, and the global optimal quantum rotation angle is proposed and expressed as follows:
(10)
where k = 1, 2, …, L, L is the population size of QPPSO, c1 and c2 are constants, w is the inertia weight, r1, r2, and uijk(t) are the random numbers between zero and one, and t is the current iteration number.
Structure of QPPSO.
The procedure of the QPPSO algorithm is summarized in the following section, and the flowchart of QPPSO is shown in Fig. 5.
The procedure of the QPPSO algorithm.
- Step 1: Initialize the parameter sets of the algorithm. The population is initialized by quantum encoding in Eq. (7), and the solution space is decomposed by Eq. (9).
- Step 2: The objective values of all particles are evaluated. We set the pbest of each particle and its objective value equal to the current position of the particle and to its objective value, and then set gbest and its objective value equal to the position of the particle and to the objective value of the best initial particle.
- Step 3: The position of every particle is updated by Eq. (10).
- Step 4: The objective values of all particles are evaluated.
- Step 5: The current objective value of each particle is compared with the objective value of its pbest. If the current value is better, then pbest and its objective value are updated with the current position.
- Step 6: The best particle of the current population with the best objective value is determined. If the objective value is better than that of gbest, then gbest and its objective value are updated with the position and objective value of the current best particle.
- Step 7: If the stopping criteria are met, we output gbest and its objective value; otherwise, we go back to Step 3.
Simulation and Comparisons
Typical fractional-order chaotic systems
In this section, numerical simulation and comparisons are conducted on the basis of some typical fractional-order chaotic systems, including the fractional-order Chen system, fractional-order Lorenz system, fractional-order Rössler system, and fractional-order Lü system.
- The fractional-order Chen chaotic system can be expressed as follows:
(11) where a, b, c, q1, q2, and q3 are the unknown constant parameters of the fractional-order chaotic systems that should be estimated. When a = 35, b = 3, c = 28, q1 = 0.93, q2 = 0.9, and q3 = 0.88, this system exhibits a chaotic dynamical behavior.
- The fractional-order Lorenz chaotic system is expressed as follows:
(12)
The system is in a chaotic state when a = 10, b = 28, c = 8/3, q1 = 0.993, q2 = 0.993, and q3 = 0.993. - The fractional-order Rössler chaotic system can be expressed as follows:
(13)
The system is in a chaotic state when a = 0.5, b = 0.2, c = 10, q1 = 0.9, q2 = 0.85, and q3 = 0.95. - The fractional-order Lü chaotic system can be expressed as follows:
(14)
The system is in a chaotic state when a = 36, b = 3, c = 20, q1 = 0.985, q2 = 0.99, and q3 = 0.98.
For the previously discussed systems, we solve all parameters by using the numerical algorithm derived from the G-L definition of fractional derivatives to obtain the state variables x, y, z. Numerical results show that these systems are chaotic, and their chaotic behavior is shown in Fig. 6.
(a) Chaotic behavior of the fractional-order Chen system when a = 35, b = 3, c = 28, q1 = 0.93, q2 = 0.9, and q3 = 0.88; (b) Chaotic behavior of the fractional-order Lorzen system when a = 10, b = 28, c = 8/3, q1 = 0.993, q2 = 0.993, and q3 = 0.993; (c) Chaotic behavior of the fractional-order Rössler system when a = 0.5, b = 0.2, c = 10, q1 = 0.9, q2 = 0.85, and q3 = 0.95; (d) Chaotic behavior of the fractional-order Lü system when a = 36, b = 3, c = 20, q1 = 0.985, q2 = 0.99, and q3 = 0.98.
Simulations on the systems
In our simulation, all previously discussed systems freely evolve from random initial states. After a period of the transient process, a state vector is selected as the initial state X0 for parameter estimation (Fig. 1). The sampling time is h = 0.01, and the total number of states to calculate J is set as 100. We compare our QPPSO with GA and PSO. For a fair comparison, the maximum generation number and the searching range of the parameters are the same in all algorithms. That is, the maximum generation number is set as 1,000, and the population size is set as 80. The searching spaces of the parameters are shown in Table 1. The other settings for the parameters of the algorithms are as follows. For the GA method, the crossover rate is set as 0.9, and the mutation probability is set as Pm = 0.1. For the PSO method, according to Clerc’s stagnation analysis [30], the inertia weight is set as ω = 1/(2 × log(2)), and two acceleration coefficients are set as c1 = c2 = 0.5 + log(2). The probability threshold for random topology is set as Pr = 1 − (1 − 1/s)3, where s is the population size, and Pr is used to determine the proportion of local informants to the entire population. For QPPSO, we also set c1 = c2 = 0.5 + log(2) and the inertia weight ω = 1/(2 × log(2)).
Table 2 shows the mean of the objective function values, the standard deviation, and the best objective value of 50 independent runs. Table 3 shows the estimation values for the parameters of the chaotic systems.
The results shown in the tables indicate that QPPSO has better performance than the GA and PSO methods in the parameter estimation of fractional-order chaotic systems. This conclusion can also be obtained from the convergence curves of the objective function for the different methods displayed in Fig. 7. In this figure, the logarithmic scale is used for the y-axis for convenience in plotting the data.
(a) Convergence graph of the fractional-order Chen system, (b) Convergence graph of the fractional-order Lorzen system, (c) Convergence graph of the fractional-order Rössler system, (d) Convergence graph of the fractional-order Lü system.
For the fractional-order Chen and Lü chaotic systems, the converging speed for QPPSO is slower than those for the GA and PSO methods in the initial period of evolution. However, QPPSO converges more quickly than the GA and PSO methods during the later period of evolution. The estimation values for the parameters in QPPSO are more accurate than those for the parameters in the GA and PSO methods (Table 3).
For the fractional-order Lorenz and Rössler chaotic systems, the converging speed for QPPSO is faster than those for the GA and PSO methods during all periods of evolution. Table 3 also shows that the estimation values for the parameters in QPPSO are more accurate than those for the parameters in the GA and PSO methods.
Fig. 8 shows one typical run of the tuning trajectories of the parameters of fractional-order chaotic systems with respect to the number of generations by the QPPSO method. Less than 500 iterations are needed for the parameters to reach the steady state and converge to the actual parameters. This result shows the effectiveness and feasibility of using QPPSO to estimate the parameters of fractional-order chaotic systems.
(a) Tuning trajectory of the parameters of the fractional-order Chen system, (b) Tuning trajectory of the parameters of the fractional-order Lorzen system, (c) Tuning trajectory of the parameters of the fractional-order Rössler system, (d) Tuning trajectory of the parameters of the fractional-order Lü system.
From the above results, we can conclude that the calculation method of the introduced quantum computing parallel characteristic can improve the ergodicity of the algorithm and then increase the ability of global convergence of the algorithm. Moreover, the quantum states updated by Eq. (10) can make the convergence speed of QPPSO faster than that of PSO because the speed limited equation is no longer suitable in quantum space. The above results also show the effectiveness and efficiency of QPPSO.
Conclusion
This study proposed a new QPPSO algorithm that was applied to solve the unknown parameter estimation of the fractional-order chaotic system. The parallel characteristic of quantum computing is used in QPPSO. This characteristic causes the calculation of each generation to exponentially increase. The behavior of particles in quantum space is restrained by the quantum evolution equation, which consists of the current rotation angle, individual optimal quantum rotation angle, and global optimal quantum rotation angle. Numerical simulation based on several typical fractional-order systems and comparisons with some typical existing algorithms demonstrate the effectiveness and efficiency of the proposed algorithm. Future work should develop QPPSO-based approaches more effective and adaptive than current ones and apply the algorithm to other systems.
Author Contributions
Conceived and designed the experiments: YH. Performed the experiments: FG. Analyzed the data: Y. Li. Wrote the paper: Y. Liu.
References
- 1. Sheikhan M, Shahnazi R, Garoucy S (2013) Synchronization of general chaotic systems using neural controllers with application to secure communication. Neural Computing and Applications 22: 361–373.
- 2. Yassi M, Yassi A, Yaghoobi M (2014) Distinguishing and clustering breast cancer according to hierarchical structures based on chaotic multispecies particle swarm optimization. IEEE. pp. 1–6.
- 3. Gandomi AH, Yun GJ, Yang X-S, Talatahari S (2013) Chaos-enhanced accelerated particle swarm optimization. Communications in Nonlinear Science and Numerical Simulation 18: 327–340.
- 4.
Dong-Feng W, Pu H (2006) Proportional-integral-derivative chaotic system control algorithm based on particle swarm optimization.
- 5. Ho W-H, Chou J-H, Guo C-Y (2010) Parameter identification of chaotic systems using improved differential evolution algorithm. Nonlinear Dynamics 61: 29–41.
- 6. Odibat ZM, Corson N, Aziz-Alaoui M, Bertelle C (2010) Synchronization of chaotic fractional-order systems via linear control. International Journal of Bifurcation and Chaos 20: 81–97.
- 7. Daftardar-Gejji V, Bhalekar S (2010) Chaos in fractional ordered Liu system. Computers & mathematics with applications 59: 1117–1127.
- 8. Bhalekar S, Daftardar-Gejji V (2010) Fractional ordered Liu system with time-delay. Communications in Nonlinear Science and Numerical Simulation 15: 2178–2191.
- 9. Tavazoei MS, Haeri M (2008) Chaotic attractors in incommensurate fractional order systems. Physica D: Nonlinear Phenomena 237: 2628–2637.
- 10. Tavazoei MS, Haeri M (2007) A necessary condition for double scroll attractor existence in fractional-order systems. Physics Letters A 367: 102–113.
- 11. Deng W, Lü J (2006) Design of multidirectional multiscroll chaotic attractors based on fractional differential systems via switching control. Chaos: An Interdisciplinary Journal of Nonlinear Science 16: 043120. pmid:17199398
- 12. Diethelm K, Ford NJ (2002) Analysis of fractional differential equations. Journal of Mathematical Analysis and Applications 265: 229–248.
- 13. Grigorenko I, Grigorenko E (2003) Chaotic dynamics of the fractional Lorenz system. Physical Review Letters 91: 034101. pmid:12906418
- 14. Li C, Chen G (2004) Chaos and hyperchaos in the fractional-order Rössler equations. Physica A: Statistical Mechanics and its Applications 341: 55–61.
- 15. Li C, Chen G (2004) Chaos in the fractional order Chen system and its control. Chaos, Solitons & Fractals 22: 549–554.
- 16. Lu JG (2006) Chaotic dynamics of the fractional-order Lü system and its synchronization. Physics Letters A 354: 305–311.
- 17. Tavazoei MS, Haeri M (2010) Chaos generation via a switching fractional multi-model system. Nonlinear Analysis: Real World Applications 11: 332–340.
- 18.
Caponetto R (2010) Fractional order systems: modeling and control applications: World Scientific.
- 19. Sheu L-J, Chen H-K, Chen J-H, Tam L-M, Chen W-C, et al. (2008) Chaos in the Newton–Leipnik system with fractional order. Chaos, Solitons & Fractals 36: 98–103.
- 20. Dai D, Ma X-K, Li F-C, You Y (2002) An approach of parameter estimation for a chaotic system based on genetic algorithm. Acta Physica Sinica 51: 2459–2462.
- 21. Li L, Yang Y, Peng H, Wang X (2006) Parameters identification of chaotic systems via chaotic ant swarm. Chaos, Solitons & Fractals 28: 1204–1211.
- 22. Peng B, Liu B, Zhang F-Y, Wang L (2009) Differential evolution algorithm-based parameter estimation for chaotic systems. Chaos, Solitons & Fractals 39: 2110–2118.
- 23. He Q, Wang L, Liu B (2007) Parameter estimation for chaotic systems by particle swarm optimization. Chaos, Solitons & Fractals 34: 654–661.
- 24. Gao Y, Wang M, Tao D, Ji R, Dai Q (2012) 3-d object retrieval and recognition with hypergraph analysis. Image Processing, IEEE Transactions on 21: 4290–4303. pmid:22614650
- 25.
Ji R, Gao Y, Hong R, Liu Q, Tao D, et al. (2014) Spectral-spatial constraint hyperspectral image classification.
- 26.
Gao Y, Ji R, Cui P, Dai Q, Hua G (2014) Hyperspectral Image Classification Through Bilayer Graph Based Learning.
- 27. Ji R, Yao H, Liu W, Sun X, Tian Q (2012) Task-dependent visual-codebook compression. Image Processing, IEEE Transactions on 21: 2282–2293. pmid:22128004
- 28. Tang Y, Zhang X, Hua C, Li L, Yang Y (2012) Parameter identification of commensurate fractional-order chaotic system via differential evolution. Physics Letters A 376: 457–464.
- 29.
Nielsen MA, Chuang IL (2010) Quantum computation and quantum information: Cambridge university press.
- 30. Clerc M, Kennedy J (2002) The particle swarm-explosion, stability, and convergence in a multidimensional complex space. Evolutionary Computation, IEEE Transactions on 6: 58–73.