On pursuit-evasion differential game problem in a Hilbert space

Abstract: We consider a pursuit-evasion differential game problem in which countably many pursuers chase one evader in the Hilbert space `2 and for a fixed period of time. Dynamic of each of the pursuer is governed by first order differential equations and that of the evader by a second order differential equation. The control function for each of the player satisfies an integral constraint. The distance between the evader and the closest pursuer at the stoppage time of the game is the payoff of the game. The goal of the pursuers is to minimize the distance to the evader and that of the evader is the opposite. We constructed optimal strategies of the players and find value of the game.


Introduction
In the literature, there are many works that are concern with the study of differential game problem in the Hilbert spaces such as R n and 2 (see, for example ). In particular, the space 2 , consists of elements of the form α = (α 1 , α 2 , . . . ), such that ∞ k=1 α 2 k < ∞. The inner product and norm are defined as follows: where , α, β, ∈ 2 .
Among the last category, the problems considered in the papers [1,9,11,18,22] and [24] involve first order differential equations describing the motion of the players. On the other hand, problems involving second order differential equations are contained in [5,7] and [1]. The works [1] and [29] in the first category, are concern with problems in which dynamic equations of the players given as a combination of first and second order differential equations.
In another point of view, the references can be grouped into two. Those works with pursuer's and evader's dynamic equations are given as differential equations of the same order in one group. These works include [5-13, 15, 17, 18] and [22][23][24][25][26][27][28][29][30]. The other group consists of the works [1] and [29] in which pursuer's and evader's dynamic equations are given as differential equations of different orders.
In [7], Ibragimov and Salimi investigated a differential game with infinitely many inertial players with integral constraints on the control functions of the players. Players' motion described by second order differential equations in the Hilbert space 2 . Duration of the game is fixed. Payoff functional is the infimum of the distance between the evader and the pursuers when the game is terminated. The pursuer's goal is to minimize the payoff, and the evader's goal is to maximize it. Under certain condition, the value of the game is found and the optimal strategies of players are constructed. Subsequently, this result was improved and reported in the paper [15]. Ibragimov and Kuchkarov in [8] examined pursuit-evasion differential game of countably many pursuers and one evader. Players move according to first order equations. Control of the pursuers and evader are subject to integral restrictions. The duration of the game is fixed and the payoff functional is the infimum of the distance between the evader and the pursuers when the game is terminated. The pursuer's goal is to minimize the payoff, and the evader's goal is to maximize it. Optimal strategies of the players are constructed, and value of the game is found.
Inertial Pursuit-evasion game with a finite or countable number of pursuers and evader in Hilbert space 2 was studied by Ibragimov et al. in [13]. Dynamic of the players is described by second order differential equations in a Hilbert space. Control of the pursuers and evader are subject to integral restrictions. The period of the game is fixed. They formulated the value of the game and identified explicitly optimal strategies of the players. They assumed that there is no relation between the control resource of any pursuer and that of the evader.
Salimi, M. and Ferrara, M. in [24] studied differential game in which a finite or countable number of pursuers pursue a single evader. Game is described by an infinite system of differential equation of first order in Hilbert space. The control function of the players satisfy the integral constraints. The period of the game is pre-defined. The farness between the evader and the closest pursuer when the game is finished is the payoff function of the game. They introduce the value of the game and identify optimal strategies of the pursuers.
The game of boy and crocodile is studied by Siddiqova et. al. in [29]. The boy(evader) moves according to first order differential equation with its control subject to geometric constraint and is not allowed to leave a closed ball in R n during the game. The pursuer(crocodile) moves according to second order differential equation with integral constraint on its control function. Sufficient conditions for completion of pursuit from all initial positions are obtained.
A game problem in which pursuers move according to first order differential equation and evader moves according to second order differential equation is studied in [1]. Control function of pursuers and evader are subject to integral and geometric constraints respectively. Theorems each of which provides sufficient conditions for completion of pursuit are stated and proved. There are several other pursuit-evasion scenarios involving multiple pursuers and one evader studied in the literature, with dynamic equations not necessarily in the aforementioned groups. For instance; scenarios involving attackers, defenders and one evader are considered in [3,4], scenarios where the multiple pursuers and evader are constrained within a bounded domain are analyzed in [2,19,21,31,32].
In view of the literature presented above and the references therein, there is no study that belongs to the third category and deals with the problem in which dynamic equations of the players are given as combination of first and second order differential equations. That is, problem of finding values of the game and construction of optimal strategies of the players with players having dissimilar laws of motion. Therefore, the need to contribute to the literature in that direction.
In the present paper, we study pursuit-evasion differential game problem in a Hilbert space 2 , in which motion of the pursuers and evader described by first and second order differential equations respectively. Control functions of both the pursuers and evader are subject to integral constraints.

Statement of the problem
In the space 2 , we define a ball with center at a and radius r by B(a, r) = {x ∈ 2 : ||x − a|| ≤ r}, and a sphere with center at a and radius r by S (a, r) = {x ∈ 2 : ||x − a|| = r}. Control function of the i th pursuer P i , is the function u i (·) ∈ 2 , with Borel measurable coordinates u k : [0, θ] → R 1 . In a similar way, we define control function v(·) of the evader E.
Suppose that motion of the players is described by the equations: . . ) are control functions of the i th pursuer P i and evader E respectively. It is required that the control functions u i (·) and v(·) satisfy the inequalities . . } and σ are given positive numbers. The stoppage time of the game is fixed and is denoted by θ. In what follows in the paper, we shall refer to the control of the i th pursuer u i (·) satisfying the inequality (2.2) and that of the evader v(·) satisfying the inequality (2.3) as admissible control of the i th pursuer and admissible control of the evader respectively.
has a unique solution (x i (·), y(·)) with continuous components x i (·), y(·) in 2 , for an arbitrary admis- and U i are admissible strategies of the pursuers P i and v(·) is an admissible control of the evader E.

9)
and u i (·) are admissible control of the pursuers P i and V is an admissible strategy of the evader E.
In the paper [9], it is reported that the game has the value φ if If the pursuer P i and evader E choose their admissible controls u i (t) = (u i1 (t), u i2 (t), . . . ) and v(t) = (v 1 (t), v 2 (t), . . . ) respectively, then by (2.1) their corresponding motion is given by It is clear that x(·) and y(·) belongs to the space of continuous functions in the norm of 2 for 0 ≤ t ≤ θ, where the component x k (t) and y k (t) are absolutely continuous.

Attainability domains
Proposition 2.5. The attainability domain of (a) the pursuers P i from the initial state x i0 at time t 0 = 0 is the ball H P i (x i0 , ρ i √ θ).
(b) the evader E from the initial state y 0 at time t 0 = 0 is the ball H E y 0 , σ θ 3 Proof. For the proof of (a), using (2.11) we have If the pursuer P i uses the control Then we have The prove of (b) is similar, for the evader's control v(t) = 3(θ−t) θ 3 (ȳ − y 0 ), 0 ≤ t ≤ θ.

Auxiliary differential game
In this section, we consider a game with a single pursuer and a single evader by dropping the index i in the game problem (2.1)-(2.3). In view of this, we have the solutions of the dynamic equations of the players (2.1) are given by where y 0 = y 0 + θy 1 .
We define the set The goal of the pursuer P is to ensure the equality x(θ) = y(θ) and that of evader E is the opposite. The problem is to construct a strategy for the pursuer that ensure the equality x(θ) = y(θ) for any admissible control of the evader. Proof. Let the pursuer's strategy be defined by To show the admissibility of the strategy (3.3), we use the fact that y(θ) ∈ Ω, which means that From this inequality we have Therefore, This shows that the strategy (3.3) of the pursuer is admissible.
We now show that the equality x(θ) = y(θ) is achievable, if the pursuer uses the strategy (3.3). Indeed, The proof of lemma (3.1) is complete.

Main result
In this section, we present the main result of the paper. Firstly, we present some important results that are useful in the presentation of the main result.
We define a positive number φ by Proof. To prove this theorem, we first introduce dummy pursuers whose state variables are z i , i ∈ I and motion described by the equationsż The attainability domain of the dummy pursuer z i from the initial state x i0 is the ball Let strategies of the dummy pursuers z i , i ∈ I be defined as follows: For x i0 y 0 , we set where ϑ is the time such that Now, we define the strategy of the real pursuers by In accordance with the payoff of the game, the number φ is the value of the game if the following inequalities hold sup In view of this, we prove the inequalities in (4.5). Firstly, we show that left hand side inequality of (4.5). By definition of φ, we have By lemma (4.1), we have Consequently, the point y(θ) ∈ H E y 0 , σ θ 3 3 1/2 belong to some half space X j , j ∈Ī. If x j0 y 0 and by the lemma (3.1) for strategy (4.2) of pursuers z j then we have the equality z j (θ) = y(θ) holding and For the other case, if x j0 = y 0 ;ρ j = ρ j + φ √ θ ≥ σ θ 3 3 1/2 and the dummy pursuer uses the strategy (4.3) then it is easy to show that z j (θ) = y(θ). This means that for each case, the equality z j (θ) = y(θ) is achieved. Now suppose that the real pursuers uses the strategies (4.4), we show that y(θ) − x j (θ) ≤ φ. Indeed, This proves the left hand inequality in (4.5). Which means that the value φ is guaranteed for the pursuers.
Secondly, we prove the right hand inequality in (4.5). That is, we prove that the value φ is guaranteed for the evader. If φ = 0, then the inequality follows for any admissible control of the evader. Suppose that φ 0 and if be a non zero positive number such that < φ then by definition of φ the ball H E y 0 , σ(θ 3 /3) 1/2 is not contained in the set Therefore, the existence of a pointȳ ∈ S y 0 , σ(θ 3 /3) 1/2 , such that ||ȳ − x i0 || ≥ ρ i √ θ + φ, i ∈ I, is guaranteed by the lemma (4.1). On another note, it is easy to show that Consequently, we have This means that if the evader can be at pointȳ at time θ, then the right hand side of (4.5) is proved. Indeed, evader's control exists that takes it to the pointȳ for the time θ, since the point is contained in the attainability domain of the evader. In particular, let the evader's control be defined by Then we have Therefore, the value φ is guaranteed for the evader. This proves the right hand inequality of (4.5). The proof of the theorem is complete.

Example
Consider the game problem (2.1)-(2.3) and let ρ i = 1; σ = 1 √ 3 ; θ = 9. We also assume the following initial positions of each of the i th pursuer and evader: where the number √ 19 is the i th coordinate of the initial position of the i th pursuer. Observe that ρ i √ θ = 3 and σ θ 3 The goal is to show the value of the game (2.1)-(2.3) is given by φ = 7. To show this, it is sufficient to show that 1. the following inclusion holds for any > 0 : H E (0, 9) ⊂ i∈I H P i (x 0i , 10 + ); 2. the ball H E (0, 9) is not contained in the set i∈I H P i (x 0i , 10).
We consider the first case in which the vector y * has a nonnegative coordinate y * k . Then we have This means that y * ∈ H P k (x 0k , 10 + ). For the second case, since i∈I (y * i ) 2 < ∞, then lim k→∞ y * k = 0. Therefore, for the index k, we have This also means that y * ∈ H P k (x 0k , 10 + ).
To show (2), it is obvious that for any index i, that This means that any vector y * ∈ S E (0, 9) with negatives coordinates does not belong to i∈I H P i (x 0i , 10).
In view of the this and according to theorem 4.1, the game (2.1)-(2.3) has the value

Conclusion
The pursuit-evasion differential game problem of countably many pursuers and one evader has been studied in the Hilbert space 2 . Control functions of the pursuers and the evader are subject to integral constraints. The value of the game is found and optimal strategies of the players are constructed. The problem considered in this work is uncommon in the literature but represent many real problems. It is a representation of pursuit problems involving objects with different dynamics and possibly information about the acceleration of one of the objects is not available. For further research, the evasion problem concerning the problem considered in this paper can be investigated.