Stability of delay Hopﬁeld neural networks with generalized proportional Riemann-Liouville fractional derivative

: The general delay Hopﬁeld neural network is studied. It is considered the case of time-varying delay, continuously distributed delays, time varying coe ﬃ cients and a special type of a Riemann-Liouville fractional derivative (GPRLFD) with an exponential kernel. The presence of delays and GPRLFD in the model require two special types of initial conditions. The applied GPRLFD also required a special deﬁnition of the equilibrium of the model. A constant equilibrium of the model is deﬁned. We use Razumikhin method and Lyapunov functions to study stability properties of the equilibrium of the model. We apply Lyapunov functions deﬁned by absolute values as well as quadratic Lyapunov functions. We prove some comparison results for Lyapunov function connected deeply with the applied GPRLFD and use them to obtain exponential bounds of the solutions. These bounds are satisﬁed for intervals excluding the initial time. Also, the convergence of any solution of the model to the equilibrium at inﬁnity is proved. An example illustrating the importance of our theoretical results is also included.


Introduction
Stability properties of Hopfield neural networks modeled by various types of derivatives have been studied in the literature.Different behavior of the dynamics of the neurons could be adequately described by the application of various types of derivatives.For example, the fractional derivatives have typical memory properties and they could be successively applied to describe the memory of the dynamics of neurons.We can reffer to [1] for the Caputo fractional derivative, [2] for the conformable fractional derivative, [3] for the ordinary derivatives and time varying delays, [4,5] for the Caputo fractional derivative and delays.The Riemann-Liouville type of fractional derivatives have a singularity at the initial time point and they can model some abnormalities in the behavior of the neurons.In the case when Riemann-Liouville fractional derivative is applied also several results about the study of stability are published (see, for example, [6][7][8][9] for delays, [10] for random impulses).A good review of the neural networks with applied classical fractional derivatives is given in [11].
In the last few decades, many different definitions of fractional integrals and derivatives have been proposed.One of the ways to generalize the classical ones is to use Sonine kernels (see, for example [12]).The general fractional integrals and derivatives of Riemann-Liouville type are introduced and studied by Y. Luchko [13].Recently, in [14,15] an integral and two types of derivatives of Caputo and of Riemann-Liouville type (GPRLFD), respectively, are introduced and they are called generalized proportional fractional integral and derivatives.The main characteristic of these derivatives is the exponential kernel in the corresponding integrals.The main disadvantage of these type of integrals and derivatives is the absence of mutually inversebility.One of their advantage is that as partial cases the classical Caputo and Riemann-Liouville fractional derivatives are obtained (for some applications of these derivatives, see for example, [16][17][18][19][20][21]). In this paper, we will apply GPRLFD to delay differential equations and set up the initial value problem for a model of neural networks with time-variable delays and distributed delays in an appropriate way.
We consider Hopfield neural networks with both-time variable delays and distributed delays, and variable in time coefficients and external inputs.The dynamics of the units is modeled by GPRLFD.The applied fractional derivative leads to some new points in the study of Hopfiled neural network.These new points are connected with the initial conditions and the definition of the equilibrium.In the paper, two types of initial conditions are set up.These initial conditions are connected with the singularity of the applied derivatives at the initial time point which coincides the lower limit of the integral.The physical meaning of these initial conditions is similar to the one of the classical Riemann-Liouville fractional derivative, which is well explained in the books [22][23][24].The equilibrium of the model is defined appropriately and its stability properties are studied.This equilibrium is deeply connected with the applied derivative.
Note, there are basically two different approaches in studying stability properties of any type of differential equations with delays-the Lyapunov-Krasovskii functional approach and Razumikhin method by Lyapunov functions.The application of Lyapunov functions leads to practically easier applications of sufficient conditions.
By employing the Razumikhin method and appropriate Lyapunov functions, we obtain several upper exponential bounds of the solutions.The obtained results are valid on intervals excluding the initial time which is a singular point for the solutions.We prove the convergence of the solutions to the equilibrium at infinity.The applied derivative gives us as a partial case of the classical Riemann-Liouville fractional derivative, so all results in this paper are a generalization of the Hopfield model with the classical fractional derivative.
The innovations of this article can be described as follows: -We propose a generalized Hopfield neural network model with both time-variable delays and distributed delays.The dynamic of the units is described by a special generalization of the Riemann-Liouville fractional derivative.-We set up the appropriate initial conditions to the studied model.
-We define the equilibrium of the studied model.It depends significantly on the delays and the applied type of the derivative.-We use two basic types of Lyapunov functions, the ones defined by absolute values and the ones by squares.-We use modified Razumikhin conditions deeply connected with the presence of the exponential kernel in the applied derivative.-We obtain two types of exponential bounds of the equilibrium of the model.These bounds are valid only for intervals excluding the initial time point which is singular of the applied derivative.-We prove sufficient conditions for approaching any solution of the model to the equilibrium.
The structure of the rest of the paper pursues the following scheme.The basic definitions and results of derivatives are given in Section 2. Also, some additional results necessary to the proofs of the main results are provided.In Section 3, in connection with the main study of the corresponding model, we prove some stability properties of the solutions of delay differential equations with GPRLFD.We apply Lyapunov like functions and the modified Razumikhin method.We use the Lyapynov function defined by absolute values and quadratic Lyapunov function.Exponential bounds of the solutions are obtained on interval , excluding the initial time point.The generalized Riemann-Liouville delay Hopfield neural network model is introduced and the initial value problem is set up in Section 4. In Section 5 the main results are established on the basis of a Lyapunov-type analysis and Razumikhin method.Several sufficient conditions for the exponential stability properties of defined equilibrium are obtained.The convergence of any solution to the equilibrium is studied.In Section 6 some illustrative examples are elaborated.Some concluding comments are stated in the last section.
Similar result is true for the multi-valued functions.
For the scalar functions we have the following result.
Then for any T ∈ (0, A] such that ν(T ) 0 the inequality holds.
Then for any T ∈ (0, A] such that ν(T ) 0 the inequality holds.
Remark 2.3.If ξ = 1 then Definitions 2.1 and 2.2 are reduced to the classical Riemann-Liouville fractional integral (RLFI) and Riemann-Liouville fractional derivative (RLFD (2.9) In connection with the initial conditions of the differential equations with GPRLFD we will use the following result.
Using that for any fixed T ≥ 0 the function q is an increasing function for σ ∈ (− min{T, τ}, 0) we obtain the following result.
Then any solution of (3.1), (3.2) satisfies the inequality for t > T q .
Then, there exists a point T q > 0 such that n i=1 ξ t for t > T q .
The proof follows from Theorem 3.1 by taking the Lyapunov function V(x) = n i=1 x 2 i and using the norm || • || 2 , i.e., a(u) ≡ u 2 .

Model description of neural networks by GPRLFD
We will consider the general model of Hopfield neural network with the GPRLFD and time-varying delays and distributed delays where u i (t), i = 1, 2, . . ., n are the state variables of i-th neuron at time t > 0, a i j (t), b i j (t), c i j (t) represent the strengths of the neuron interconnection at time t (assuming they are time changeable), n is the number of units in the neural network, q ∈ (0, 1), ξ ∈ (0, 1], f j (u), g j (u) and h j (u) are the activation functions of the j-th neuron, κ(t) is the time varying delay and Θ(t) is the length of interval of the distributed delay with 0 ≤ κ(t) ≤ κ, 0 ≤ Θ(t) ≤ Θ and τ = max{κ, Θ}, I i (t) are the external inputs at time t.
The initial time interval is [−τ, 0].The applied GPRLFD leads to a singularity of the solutions at the initial time 0. It requires appropriate definition of the initial conditions.Some authors (see for example [28] for RLFD) used the integral of the type 0 I 1−q t u(t) for t ∈ [−τ, 0] in the initial condition but according to Eq (2.8) the RLFI is defined for t greater than the lower limit, which is 0 in our case.

Equilibrium of the model
We define the equilibrium as a constant vector.We also need to use the equality (obtained by CAS Wolfram Mathematica 13.2) where Γ(a, x) = ∞ x t a−1 e −t dt is the upper incomplete gamma function.It is clear that lim t→0 = 0 for q ∈ (0, 1) and ξ ∈ (0, 1].Definition 4.1.The constant vector V * = (C 1 , C 2 , . . ., C n ) is called an equilibrium of (4.1) if the equalities . ., n and there is no external input, then the model (4.1) has a zero equilibrium.Remark 4.2.In most cases in the literature the Hopfield neural networks are studied with constant coefficients a ik , b ik , c ik and constant external inputs I i .In the case when RLFD or GPRLFD is applied and all coefficients are constants, the only equilibrium is zero.It is not the case when at least one of the coefficients is variable in time.
Let V * be an equilibrium of (4.1).Change the variables ν i (t) = u i (t) − C i , t ≥ 0, in system (4.1).Then applying (4.2) and ( 4.3) we get with initial conditions (3.2) or their equivalent (3.3),where Note the system (4.4) has a zero solution (with zero initial function).

Stability of the model by Lyapunov functions and Razumikhin method
Note that the singularity of the solutions of the differential equations with GPRLFD and RLFD at the initial time requires this point to be excluded and to be obtained some stability properties on an interval without the initial time.It is totally different than the case of Caputo type fractional derivative or derivative with an integer order.Some authors apply RLFD but do not exclude the initial time and fact that for order γ ∈ (0, 1).The expressions t −γ and t γ−1 are not bounded for points enough close to the initial time 0 (see, for example, [6,29,30]).The main concepts of stability for differential equations with RLFD are discussed and studied in [31].
In connection with the applied GPRLFD we need to define the exponential stability of the equilibrium on an interval excluding the initial time 0. Definition 5.1.The constant equilibrium V * of (4.1) is called exponentially stable in time if there exists a point T > 0, a constant λ > 0 and an increasing function Ξ ∈ C(R + , R + ) such that any solution y(t) of (4.1), (3.2) satisfies y(t) − V * ≤ Ξ φ 0 e λ ξ−1 ξ t , t ≥ T.

Lyapunov functions defined by absolute values
Theorem 5.1.Let the assumptions A1-A3 be satisfied and: (1) The fractional order neural networks (4.1) has an equilibrium Then, the equilibrium V * is exponentially stable in time, i.e., there exists a point T q > 0 such that for any solution u Apply Lemma 2.4, assumptions A1-A3 and we get δ k |ν k (s)|ds. ( From inequality (5.1) we obtain From Corollary 3.2 with y(t) ≡ ν(t) the claim of Theorem 5.1 follows.
Remark 5.1.Note the stability of neural network model with RLFD is studied in [6].It is applied Lyapunov functional and the stability of zero equilibrium is studied.In this paper , first we are using a model with more general GPRLFD, a nonzero equilibrium is defined and its stability by Lyapunov functions and Razumikhin condition are applied.The sufficient conditions in [6] are more restrictive.
Remark 5.2.The Hopfield neural network models with ordinary derivative and delays are studied by many authors and different sufficient conditions for various types of stability are obtained (see, for example, [32,33]).When GPRLFD is applied, first, the initial condition has to be defined in a different way, second the equilibrium is defined differently than in the case of ordinary derivative and finally, the special type of stability excluding the initil time point has to be considered.Also, in this paper Razumikhin method combined with Lyapunov functions and the proved inequalities for GPRLFD of the Lyapunov functions is applied.This leads to different types of sufficient conditions.

Quadratic Lyapunov functions
Note that if a function is RL integrable (or generalized proportional RL integrable) it is not necessarily to be squared RL integrable (or squared generalized proportional RL integrable).
Example 5.1.Let ξ = 0.5, q = 0.3 and ν(t) = t 0.8 .Then the integrals 1 0 e −(1−s) (1 − s) −0.3 s −0.8 ds and 1 0 (1 − s) −0.3 s −0.8 ds exist but the corresponding integrals of the squared function u 2 (t) = t −1.6 , i.e., 1 0 e −(1−s) (1 − s) −0.3 s −1.6 ds and 1 0 (1 − s) −0.3 s −1.6 ds, do not exist.It requires in the application of the squared Lyapunov function as well the product u T (t)u(t) for the solution u(t) of the model (4.1) to be assumed that any solution is squared RL integrable (or squared generalized proportional RL integrable) on the whole time interval of consideration.It is a huge restriction about the solutions of the model (for example, see Theorems 3.1, 3.2 [34] where Lyapunov functional V 1 is used without assuming about squared integrability of the solution).Now we will aplly quadratic Lyapunov functions to study the stability properties of the model (4.1), (3.2).Theorem 5.2.Let the assumptions A1-A4 be satisfied and: (1) The fractional neural model (4.1) has an equilibrium V * = (C 1 , C 2 , . . ., C n ).
The activation functions f   hold.

Conclusions
Our aim of the paper is to study Hopfield neural networks with both the variable delay and distributed delay.An important aspect of our study is we consider the general case of variable in time coefficients and external inputs.The dynamic of the units is modeled by the GPRLFD.This derivative is applied to model the behavior with an anomalies at the initial time point.An exponential type of stability is defined and this stability excludes the initial time because of the singularity of the solutions at the initial time.Lyapunov functions and the Razumikhin method are applied.Both types of Lyapunov functions, absolute values and quadratic function, are used.Theoretical results are illustrated with an example.

Use of AI tools declaration
The author declares he has not used Artificial Intelligence (AI) tools in the creation of this article.