Event-triggered distributed optimization of multi-agent systems with time delay

: In this article, the distributed optimization based on multi-agent systems was studied, where the global optimization objective of the optimization problem is a convex combination of local objective functions. In order to avoid continuous communication among neighboring agents, an event-triggering algorithm was proposed. Time delay was also considered in the designed algorithm. The triggering time of each agent was determined by the state measurement error, the state of its neighbors at the latest triggering instant and the exponential decay threshold. Some su ffi cient conditions for optimal consistency were obtained. In addition, Zeno-behavior in triggering time sequence was eliminated. Finally, a numerical simulation was given to prove the e ff ectiveness of the proposed algorithm.


Introduction
Due to its extensive applications, cooperative control of multi-agent systems (MASs) has received increasing attention for the past few years, such as consensus control [1,2], containment control [3], formation control [4] and resource allocation [5,6].Distributed optimization problem (DOP), one of the hot topics of cooperative control, has been widely studied from different aspects.In DOP, each agent has its own local objective function, which is not available to other agents.The objective function is minimized by selecting an optimal action, where the objective function is defined as a convex combination of local objective functions.Optimization theories [7][8][9][10][11] provide the fundamental tools to address DOP.
In the field of DOP, there were some studies [12,13] about distributed consensus-based gradient methods for convex cost functions.Recently, DOP of continuous-time MASs have been widely researched [14][15][16].In [14], the research was mainly based on nonuniform gradient gain and finite time convergence.In [15], the time-varying loss function was studied.A proportional-integral-differential algorithm was introduced in [16].
The majority of current DOP was studied using continuous-time control algorithms.This control strategy is relatively impractical and inefficient as it results in a wastage of energy.In practice, each agent often faces limited resources and, thus, is expected to update its control signals as infrequently as possible.In order to alleviate the communication load in MASs, a discrete-time control method known as event-triggered control has been developed.This control strategy is aperiodic and neighboring agents only need to communicate at specific time instants determined by pre-designed triggering conditions, the effectiveness of which was systematically illustrated in [17][18][19][20][21][22].In [17], the research studied the event-triggered DOP for nonlinear MASs in undirected and connected communication networks.In [18], two event-triggered control protocols were proposed to solve convex DOP under the directed graph.Moreover, in [19], an event-based control protocol was proposed to solve non-convex DOP.An adaptive event-triggered communication was introduced in [20].In [21], the author explored both event-triggered and time-triggered algorithms to solve DOP.In [22], the paper examined the prescribed-time optimization problem of MASs under two control protocols, specifically the continuous-time protocol and its event-triggered control protocol.
All of the above results focused on networks without time delay.In fact, the hardware performance of each agent requires a certain input time delay for effective communication and processing of information.Hence, the analysis and management of time delay is crucial in understanding and improving the performance of MASs, particularly in cases where there are a large number of agents and intricate communication networks.In the works [23][24][25][26], DOP of MASs with time delay have been studied.
Inspired by the previously discussed works, this paper investigates an event-triggered distributed optimization algorithm with time delay under an undirected communication graph.Each agent utilizes its own gradient information as well as delayed information from its neighbors and itself to search for solutions.The connection between the equilibrium point of MASs and optimal solutions are discussed.Compared with the algorithms in [27][28][29], our algorithm does not require continuous communication between agents and it takes into account that there is a delay in the communication between agents.The algorithm proposed here is based on event-triggered transmissions that can alleviate the communication load and decrease the frequency of controller iterates, resulting in saved network resources.Furthermore, the stability property of MASs with time delay is analyzed using the Lyapunov stability theory, and the Zeno-behavior of triggering time sequence is excluded.
The rest of this article is arranged as follows.The basic theories of graph theory and dynamic systems are provided in Section 2. Section 3 presents the main results.In Section 4, a numerical example is given, which illustrates the effectiveness of the proposed algorithm.Concluding remarks are made in Section 5.
Notations: Let R, R n , and R n×n be a set of real numbers, n-dimensional real vectors, and n × n real matrices, respectively.Let I n ∈ R n×n be the identity matrix.
∂x is gradient of the function f i (x).⊗ is the Kronecker product.∥A∥ denotes the induced matrix norm and ∥ • ∥ represents the Euclidean norm for x ∈ R n .λ max (A) is the largest eigenvalue of symmetric matrix A.

Preliminaries
In this section, the concepts related to graph theory will be introduced, and then the distributed optimization problem is presented.

Grapy theory
Let G = {V, E, A} be an undirected and connected graph used to model a network of N agents, where V = {1, 2, ..., N} denotes the set of nodes and E = {(i, j) ∈ V × V} denotes the set of edges.Let A = [a i j ] be the adjacency matrix of graph G, and a i j = a ji = 1 if (i, j) ∈ E and a i j = 0, otherwise.N i = { j ∈ V : (i, j) ∈ E} is the set of neighbors of node i.The degree matrix of graph G is denoted by D = diag{d 1 , d 2 , ..., d N } and d i = j∈N i a i j .Furthermore, the Laplacian matrix L = [l i j ] is defined as L = D − A. If graph G is a connected undirected graph, one can derive that the eigenvalues of matrix

Problem formulation
The following DOP is studied in this paper min where each agent i ∈ V has a local convex function f i : R n → R. Each of the functions f i is private and accessible only to the corresponding agent i.The aim of each agent is to solve the optimization problem in (2.1) cooperatively, and the interaction topology among the agents is expressed by graph Consider the MASs with each agent modeled by first-order dynamics as follows: where x i (t) ∈ R n represents state vector of agent i, and u i (t) ∈ R n is the control input.The primary objective in this article is to design distributed event-triggered optimization algorithms u i (t) for system (2.2), with the aim of driving the position state of N agents toward the optimal solution x * of Eq (2.1).Toward this end, the following definition is proposed.
Definition 1: where x * = arg min x∈R Nn f (x).Thus, x * is considered as the global optimal solution, which minimizes the global objective function.
The following assumptions will be used in this article.Assumption 1: The communication topology graph G is undirected and connected.Assumption 2: Each local cost function f i is twice continuously differentiable and Remark 1: A function f i is said to be twice continuously differentiable and ω i -strongly convex if ∀K ⊂ R n is a convex and compact set and if there is a positive number ω = min i∈V ω i that makes

Main results
This section presents sufficient conditions for DOP (2.1) and excludes Zeno-behavior with the designed event-triggered mechanism for any agent.
To eliminate continuous communication with neighboring agents, the following event-triggered control protocol with time delay is used: where µ, ℘ are positive numbers and v i denotes the auxiliary variable of agent i.The latest triggering instant of agent j is denoted by t j k ′ = arg min l∈N i ,t≥t j l {t −t j l }, and the triggering time sequence is described recursively as follows: and for given constants )∥ represents the error sum of the states of all agents.Remark 2: In algorithm (3.1), the controller design is mainly divided into following three parts: (i) The first part as state feedback for stabilizing system (2.2); (ii) The second part ∇ f i (x i (t)) is gradient direction of the local cost function, which is used to find the optimal solution of the cost function; (iii) The third part v i (t) is the state auxiliary term, which plays an important role in proving the stability of the algorithm.
With the error e i (t), the control protocol (3.1) can be converted into where Definition 2: If there is an infinite numbers of events in a finite period of time, then the eventtriggered time sequence {t i k } exhibits Zeno-behavior.Remark 3: If the event-triggering time sequence exists Zeno-behavior, it implies that there is a positive constant T , such that lim k→∞ t i k = T .Lemma 1 (Barbalat's lemma [30] ): For all t ≥ t 0 , the function y : R + → R is uniformly continuous.If Lemma 2: Suppose Assumptions 1 and 2 hold and N i=1 v i (0) = 0 n , then (x * , −µ∇ f (x * )) is an equilibrium point of system (3.1),where x * is the optimal solution of DOP (2.1).
Proof: By Assumption 1, we have (1 ) be an equilibrium point of system (3.4), then the equilibrium point satisfies By (3.5), we have v * = −µ∇ f (x * ) and then (1 N ⊗ I n ) T ∇ f (x * ) = 0 Nn , which indicates that x * is an optimal solution of DOP (2.1).For simplicity, let us consider the case with n = 1.Notably, the case of n > 1 can also be proven using complicated calculations based on the property of the Kronecker product.
In the following, it will be proven that there is no Zeno-behavior in the triggering time sequence.Calculate the upper righthand Dini derivative of ∥e i (t)∥ for any t ∈ [t i k , t i k+1 ) and one obtains that Invoking (3.15), we can get that (3.21)By (3.17), since V(t) is bounded, one can assume that ∥ x(t)∥ ≤ ρ 1 and ∥v i (t)∥ ≤ ρ 2 .Moreover, combined with Assumption 2, one can assume that ∥∇ f i (x i (t))∥ ≤ ρ 3 , then it holds that The next event will be triggered only if the value of the driving error crosses the zero threshold.It yields that (3.23) If the event-triggering time sequence exhibits Zeno-behavior, we have which is a contradiction, and, thus, Zeno-behavior does not exhibit in the triggering time sequence.

A numerical example
In this section, the effectiveness of the obtained results is illustrated by a simulation example.

Conclusions
This article investigated a distributed optimization problem with the first-order MASs.A distributed event-triggered algorithm that allows the agents of control systems to achieve the optimal trajectory in the case of time delay was designed.The effectiveness of the algorithm was rigorously proved by using

Figure 1 .
Figure 1.Interaction topology for the network.

Figure 6 .
Figure 6.The gradient sum of f i (x) .

Figure 7 .
Figure 7. Triggering condition of agent one.