Impulsive control strategy for the Mittag-Leffler synchronization of fractional-order neural networks with mixed bounded and unbounded delays

Abstract: In this paper we apply an impulsive control method to keep the Mittag-Leffler stability properties for a class of Caputo fractional-order cellular neural networks with mixed bounded and unbounded delays. The impulsive controls are realized at fixed moments of time. Our results generalize some known criteria to the fractional-order case and provide a design method of impulsive control law for the impulse free fractional-order neural network model. Examples are presented to demonstrate the effectiveness of our results.

The advantages of fractional-order derivatives have generated much recent interest to the study of fractional neural networks and have resulted in a large amount of papers devoted to the dynamical properties of such networks. See, for example, [16][17][18][19][20][21][22] and the references therein. The numerous applications of fractional-order neural networks to solve optimization, associative memory, pattern recognition and computer vision problems heavily depend on the dynamic behavior of networks; therefore, the qualitative analysis of these dynamic behaviors is an essential step in the workable design of such neural networks. It is worth mentioning that most of the existing studies on delayed fractional-order neural network models considered bounded delays. However, the corresponding investigations on fractional-order delayed neural networks with distributed delays are relatively less. In addition, to the best of our knowledge, unbounded delays are not examined in the existing literature.This interesting open problem is one of the motivations of our study.
The control theory of systems is an important part of their qualitative theory. Among the numerous excellent results on control methods in the literature, we will refer to [23], where a very good comprehensive discussion on several important for neural network models control strategies is given. Recently, the type of control called Impulsive Control, attracts the attention of researchers. This type of control arises naturally in a wide variety of applications and it allows the control action only at some discrete instances which may reduce the amount of information to be transmitted and increase the robustness against the disturbance, see [24][25][26][27][28][29][30][31][32][33]. The impulsive control strategies are also applied to some fractional-order neural networks [34][35][36][37][38]. However, there are still many challenging open questions in this direction. The stability behavior of fractional neural networks with unbounded delays under an impulsive control is not investigated previously, which is the next motivation for the present paper.
On the other side, the concept of Mittag-Leffler stability for fractional-order systems has been introduced in [39]. The importance of the notion lies in the fact that it generalizes the exponential stability concept to the fractional-order case. Since, for integer-order neural network models the exponential convergence is the most desirable behavior, the Mittag-Leffler stability notion of fractional-order systems received a great deal of interest among scientists [35][36][37][39][40][41][42]. However, the concept has not been applied to fractional-order neural networks with unbounded delays, and we plan to fill the gap. The contribution of our paper is in following aspects: 1. Unbounded delays are introduced intro a fractional-order neural network model, and their effects on the qualitative behavior of the solutions are examined.
2. An impulsive control approach is applied to achieve a synchronization between fractional neural networks with mixed bounded and unbounded delays.
3. The concept of global Mittag-Leffler synchronization is adapted to fractional neural network models with mixed delays under impulsive control. The rest of the paper is structured as follows. In Section 2, we introduce our fractional-order neural network model with bounded and unbounded delays. The corresponding impulsive control strategy and the impulsive control system are also developed. The concept of global Mittag-Leffler synchronization is proposed for the fractional-order master and controlled systems. Some basic fractional Lyapunov function method nomenclatures and lemmas are presented. In Section 3, by using the fractional Lyapunov method and designing an appropriate impulsive controller, we obtain two main global Mittag-Leffler synchronization criteria. The synchronization results can be easily applied to the stability analysis of such systems. Our results generalize and complement some existing results on integer-order and fractional-order neural networks. Two examples are given to illustrate the efficiency of the results established in Section 4. The conclusion is given in Section 5.

Preliminaries
In this paper we will use the standard notation R n for the n-dimensional Euclidean space. Let ||x|| = n i=1 |x i | denote the norm of x ∈ R n , R + = [0, ∞), t 0 ∈ R + , and let Γ denotes the Gamma function.
Consider a q, 0 < q < 1. Following [14], the Caputo fractional derivative of order q for a function

Model introduction. Impulsive control
Since distributed and unbounded delays are more realistic, in this research we will consider the following fractional-order neural network with bounded and unbounded delays where i = 1, 2, ..., n, x(t) = (x 1 (t), x 2 (t), ..., x n (t)) T and x i (t) is the state of ith neuron at time t, f j (x j (t)) denotes the activation function of the jth unit at time t, a i j , b i j ,c i j denote the interconnection strength representing the weight coefficient of the neurons, d i (t) is a continuous function that represents the self-feedback connection weight of the ith unit at time t, d i (t) > 0, t ≥ t 0 , the bounded time delays τ j (t) are such that 0 ≤ τ j (t) ≤ τ, I i is the external input on the ith neuron, the delay kernel K j (t, s) = K j (t − s), ( j = 1, 2, ..., n) is of convolution type with an initial condition The main objective in this paper is to control the stability behavior of the fractional-order network (2.1) by adding an impulsive controller to its nodes such that the trajectories of all nodes can be synchronized onto that of system (2.1).
Let the points are such that lim k→∞ t k = ∞, and let the functions P ik are defined on R for any i = 1, 2, ..., n and k = 1, 2, .... Now we consider the corresponding fractional impulsive control system where t k , k = 1, 2, ... are the impulsive control instants and the numbers y i (t k ) = y i (t − k ) and y i (t + k ) are, respectively, the states of the ith unit before and after an impulse input at the moment t k . The functions P ik are the impulsive functions that measure the rate of changes of the states y i (t) at the impulsive moments t k .
The impulsive control model (2.2) generalizes many existing fractional-order neural network systems with bounded and distributed delays [15,36], as well as integer-order neural networks to the fractional-order case. See, for example, [25][26][27][28][29][30][31][32][33] and the references therein. By means of appropriate impulsive functions P ik we can impulsively control the qualitative behavior of the states of type (2.1) fractional models.
The initial conditions associated with system (2.2) are given in the form: where the initial function ϕ ∈ R n is bounded and piecewise continuous on (−∞, 0] with points of discontinuity of the first kind at which it is continuous from the left. The set of all such functions will be denoted by PCB[(−∞, 0], R n ], and the norm of a function ϕ ∈ PCB[(−∞, 0], R n ] is defined as According to the theory of impulsive control systems [15,28,29,[32][33][34][35][36][37], the solution y(t) = y(t; t 0 , ϕ) ∈ R n of the initial value problem (2.2), (2.3) is a piecewise continuous function with points of discontinuity of the first kind t k , k = 1, 2, ..., where it is continuous from the left, i.e. the following relations are valid We introduce some assumptions for the system parameters in (2.2) which will be used in the proofs of our main results. These assumptions also guarantee the existence and uniqueness of the solutions of (2.2): A2.1. There exist constants L i > 0 such that A2.3. The delay kernel K i : R 2 → R + is continuous, and there exist positive numbers κ i such that for all t ≥ t 0 , t t k , k = 1, 2, ... and i = 1, 2, ..., n. A2.4. The functions P ik are continuous on R, i = 1, 2, ..., n, k = 1, 2, .... A2.5. t 0 < t 1 < t 2 < ...t k < t k+1 < ... and t k → ∞ as k → ∞.
Remark 2.1. The assumptions A2.1 and A2.2 are used in the existence and uniqueness results for the solutions of fractional-order neural network models of type (2.1). See, for example, [15][16][17]19]. The consideration of more general activation functions that are discontinuous and satisfy a nonlinear growth property as in [18,21] can motivate the researchers for future results on the topic.
To realize the impulsive control and synchronization between the fractional-order neural network systems (2.1) and (2.2) we will use the following impulsive controller: Define the synchronization error as e(t) = (e 1 (t), e 2 (t), ..., e n (t)) T , Therefore, the error fractional dynamical system is given as: .., n, the impulsive control functions Q ik are continuous on R and Q ik (0) = 0 for all i = 1, 2, ..., n, k = 1, 2, ...,

Mittag-Leffler synchronization concept
Since we will investigate the Mittag-Leffler synchronization opportunities of the impulsive control approach, we will use the standard Mittag-Leffler function [14] given as where q > 0 in our analysis.
In addition, the following definition of global Mittag-Leffler synchronization between fractionalorder systems, which is inspired by the Mittag-Leffler stability definition introduced in [39], will be important.
Definition 2.2. The controlled system (2.2) is said to be globally Mittag-Leffler synchronized onto the system (2.1), if forφ 0 ∈ PCB[(−∞, 0], R n ] there exist constants λ > 0 and d > 0 such that In other words, the global Mittag-Leffler synchronization between fractional-order systems (2.1) and (2.2) is equivalent to a global Mittag-Leffler stability of the zero solution of the error system (2.5).
We note that, for integer-order systems where q = 1, the concept of global Mittag-Leffler synchronization reduces to that of global exponential synchronization, which is a particular type of global asymptotic synchronization. This particular type of synchronization provides the fastest convergent rate and that is why it attracts the high interest. It is also well known, [39] that for fractional-order systems the Mittag-Leffler stability demonstrates a faster convergence speed than the exponential stability near the origin. This is the main motivation of our research.

Lyapunov method nomenclatures. Auxiliary Lemmas
Introduce the following notations: Further on we will apply the Lyapunov approach and to this end we will use piecewise continuous Lyapunov functions V : [t 0 , ∞) × R n → R + . 4. For each k = 1, 2, ... and e ∈ R n the following equalities are valid We will also need the following auxiliary lemma, which is an impulsive generalization of Lemma 2.1 in [42] for systems with unbounded delays. The proof is identical to the proof of (21) in [42] and we omit it. Similar comparison results are proved in [15,36,38] and some of the references therein.

Results
In this section, sufficient conditions for the global Mittag-Leffler synchronization of the controlled system (2.2) onto the system (2.1), which imply global asymptotic stability of the zero equilibrium of error system (2.5) are derived.
Theorem 3.2. Assume that assumptions of Theorem 3.1 hold, and (3.1) is replaced by Then, the neural network system (2.2) is globally Mittag-Leffler synchronized onto the system (2.1) under the impulsive controller (2.4).
Proof. The proof of Theorem 3.2 is similar to those of Theorem 3.1. We will mention just some main points.
For the error system (2.5) we construct a Lyapunov function as: First, for t = t k , k = 1, 2, ..., from condition (3.2), we obtain Secondly, for t ≥ t 0 and t ∈ [t k−1 , t k ), k = 1, 2, ..., we apply again A2.1, A2.3 and the assumptions of Theorem 3.1 to get The rest of the proof repeats the end of the proof of Theorem 3.1 using (3.5) instead of (3.1).
Remark 3.3. Theorems 3.1 and 3.2 offer an impulsive control law with control gains γ ik that can be applied to the Mittag-Leffler synchronization of the fractional neural network model (2.2) into the model (2.1). Since the synchronization is directly related to the stability and stabilization problems of systems, the proposed impulsive control strategy is a power tool for studying the stability dynamics of fractional-order neural networks.
Remark 3.4. Impulsive control approaches are applied to various integer-order neural networks models in the existing literature. See, for example, [26][27][28][29][30][31][32][33] and some of the references therein. Indeed, it is well known that such control strategies have important advantages. In this paper, we generalize the impulsive control approach to the fractional-order case. In fact, the impulsive controllers (2.4) are designed so that to achieve global Mittag-Leffler synchronization between the fractional master system (2.1) and the control fractional system (2.2).
Remark 3.5. In spite of the great possibilities of applications, the theory of the fractional neural networks with distributed delays is still in the initial stage [22]. To the best of our knowledge, there has not been any work so far considering unbounded delays in fractional-order neural network models, which is very important in theories and applications and also is a very challenging problem. Hence, our results extend the existent ones in the literature adding the effect of unbounded delays.
Remark 3.6. A review of the existing results shows that impulsive control strategies have been applied to some fractional-order neural network models [34][35][36][37][38]. With the presented research we complement the existing works by incorporating unbounded delays into the fractional-order neural network model. The results in [36] can be considered as special cases of the proposed results here, when the terms with unbounded delays are removed in (2.1) and (2.2). Hence, as compared to [34][35][36][37][38], the proposed results in this paper are more general. To the best of our knowledge, this is the first paper on fractional-order neural network models with unbounded delays and subject to impulsive control law.
Remark 3.7. The concept of Mittag-Leffler synchronization between fractional-order neural networks is investigated in some papers. See, for example [36,37,40,41]. In this paper, we extended the existing results incorporating unbounded delays and impulsive perturbations into fractional-order neural networks and dealt with an impulsive synchronization analysis for the addressed more general models.

Examples and simulations
In this section, examples are presented to illustrate the main results.
Example 4.1. Consider a two-dimensional Caputo fractional neural network of type (2.1) with mixed delays as follows where n = 2, t 0 = 0, I 1 = 1, (a i j ) 2×2 = a 11 a 12 a 21 a 22 = 0.5 0.6 −0.5 1 , Then, we have that d 1 = d 2 = 3, L 1 = L 2 = 1, and the assumption A2.3 is satisfied, since ∞ 0 e −s ds = 1. We consider the following impulsive control system with an impulsive control rule defined as where the impulsive moments are such that 0 < t 1 < t 2 < ..., and lim k→∞ t k = ∞. Hence, the condition (3.1) of Theorem 3.1 is satisfied for ν 1 = 1.4, ν 2 = 0.97. We also have that the impulsive control gains satisfy condition (3.2), since According to Theorem 3.1, the master system (4.1) and response system (4.2) with impulsive control (4.3) are globally Mittag-Leffler (globally asymptotically) synchronized. Time responses of the state variables of the synchronization error system are given on Figure 1, for t k = 5k, k = 1, 2, .... If we consider again the system (4.2) but with impulsive perturbations of the form the impulsive control rule (3.2) is not satisfied, and there is nothing we can say about the impulsive synchronization between systems (4.1) and (4.2) with impulsive perturbations (4.4), since γ 1k = 3 > 2.
The state variable e 1 (t) of the error system is demonstrated on Figure 2 in the case when t k = 5k, k = 1, 2, .... It is interesting to see that the impulses cannot synchronize both systems in this case.
Therefore, we obtain by Theorem 3.2, that the master system (4.1) and response system (4.6) are globally Mittag-Leffler (globally asymptotically) synchronized. Time responses of the state variables of the synchronization error system are represented on Figure 3, for t k = 5k, k = 1, 2, ....  4.4. We presented two examples to demonstrate the efficiency of both theorems that ensure the global Mittag-Leffler synchronization of fractional-order neural networks by employing different Lyapunov function candidates, and hence using different conditions of type (3.1) and (3.5). For both synchronization criteria we apply a unified impulsive control rule (3.2). However, the established criteria can help to check the synchronization of impulsive fractional-order neural networks with different systems parameters.

Conclusions
In this paper, we have investigated the global Mittag-Leffler synchronization problem between two fractional-order neural networks with bounded and unbounded delays. Applying an impulsive control approach, criteria are obtained by constructing appropriate Lyapunov functions and the fractional Lyapunov approach. The obtained results are new and complement the existing global Mittag-Leffler synchronization results for fractional neural networks under impulsive controls. Examples are demonstrated to illustrate the obtained results. Since, the impulsive control approach is preferable in many real-world applications, our results can be extended to fractional-order models with reaction-diffusion terms. The discrete cases are also a subject to future investigations.