Moving Horizon Estimation for Uncertain Networked Control Systems with Packet Loss

. This paper studies a moving horizon estimation approach to solve the constrained state estimation problem for uncertain networked systems with random packet loss. The system model error range is known, and the packet loss phenomena are modeled by a binary switching random sequence. Taking the model error, the packet loss, the system constraints, and the network transmission noise into account, a time-varying weight matrix is obtained by solving a least-square problem. Then, a robust moving horizon estimator is designed to estimate the system state by minimizing an optimization problem with an arrival cost function. The proposed estimator ensures that the optimal estimated state can be obtained in the worst case. Furthermore, the asymptotic convergence of the estimator is analyzed and some suﬃcient conditions for convergence are given. Finally, the validity of the proposed approach can be demonstrated by numerical simulations.


Introduction
Most networked control systems (NCSs) implement control strategies based on the state feedback (see, e.g., [1,2]). In practice, the system states are usually not directly measurable. erefore, it is necessary to accurately estimate the states based on the measures before carrying out the performance analysis, control, and optimization of the control system. However, in many control systems, especially in network environments, perfect communication is not always possible. Owing to the limitation of the network bandwidth, the failure of system information in the form of data packets could occur, such as time delay, timing error, packet loss, and quantization distortion (see, e.g., [3][4][5]), which can affect the accuracy of the state estimates. e estimation problem of network systems with packet loss has been widely considered by many researchers [6][7][8].
In [6], the Kalman filter for networked systems with a bounded Markov dropout is studied, and a sufficient condition is obtained for the stability of the peak covariance of the probability transition matrix of the system dynamics and Markov chains. In [7], the problem of optimal H ∞ filtering for network systems with multiple packet loss is studied by modeling the phenomena of packet loss as a Bernoulli distribution and transforming the probability of random packet loss into the stochastic parameters of the system. And then, the H ∞ filtering problem for linear discrete-time systems with time-varying norm-bounded parameter uncertainties is studied in [8], and an estimator is designed to guarantee the estimation error to be quadratic stable. In addition, many other methods have been proposed to solve the problem of packet loss in the process of estimation (see, e.g., [9][10][11]).
In addition, the state estimation usually depends on the accurate system model, and the accuracy of estimation will be reduced when the model has errors. Because the online recursive filter needs continuous judgment of the system condition in the estimation, the result of the minimized certain indefinite quadratic forms will be inaccurate when special conditions occur in the iterative process, and the estimation error will be biased. In order to solve this problem, reference [12] for the linear time-invariant model, through modifying the robust parameters, the filter can test the stability of the algorithm in any length ahead of time. By using the set-valued estimation approach and considering the noise disturbance, an ellipsoid is constructed around the state estimation problem in [13]. Garulli et al. [14] propose that integral quadratic constraints can be used to describe the uncertain model. It can be seen that the accurate model plays an important role in estimating the effect\enleadertwodots.
Moving horizon estimation (MHE) originated from the model predictive control (MPC) is a state estimation strategy based on moving window and limited information. MHE was applied to improve the effectiveness of the estimator because of its constraint handling ability (see, e.g., [15][16][17][18][19][20][21][22][23]). In [16], a new unconstrained estimator is designed for network systems with an uncertain model, and the estimation error is proved to be bounded. Xue et al. [17] proposed a new moving time domain estimator to deal with the packet loss problem and gave the convergence condition of the average estimation error norm to guarantee the performance of the estimator. Based on the linear and nonlinear MHE principle, the authors in references [18][19][20][21] extend MHE to distributed systems and propose a new distributed estimation algorithm. In order to ensure the estimation error in the moving window is stable, the stability of MHE with linear and nonlinear constraints is studied in [22,23].
However, in the classical MHE algorithm, the weight matrix is a fixed value, which cannot meet the stability requirements of the system in the presence of multiple uncertainties. Most of the existing RMHE algorithms, such as in [24], transform the optimization problem into a minmax problem, but the performance of this algorithm is not ideal when solving the state estimation problem with physical constraints. Based on the above analysis, it is assumed that the packet loss phenomena are modeled by a binary switching random sequence, and the system model error range is known. is paper designs a new MHE estimator to solve the problem of state estimation for network systems with packet loss and system uncertainty. e proposed method retains the quadratic optimization part of the MHE problem, and the weight matrix of the optimization objective is set as a time-varying matrix and obtained by solving a least-square function. Compared with the existing methods, this design not only ensures to solve the physical constraint problem effectively, but also improves the robustness of the algorithm. e emphasis of this paper mainly includes the following points: (1) a new robust MHE problem is studied in a unified framework including random packet loss sum, model error, transmission noise, and system constraints. (2) By solving a least-square problem with uncertain parameters, a timevarying weight matrix is obtained. (3) By choosing a random cost function, the optimal estimated state of the system can be obtained by solving a quadratic programming problem. (4) e stability of the estimator is proved. Finally, the validity and rationality of the method are verified by simulation.
Notation. For a column vector x, the notation ‖x‖ 2 Y stands for x T Yx, where Y is a symmetric positive-semidefinite matrix. e notation A + denotes the pseudoinverse of matrix A. e matrix diag s 1 , . . . , s n is a block diagonal with blocks s n .

Problem Statement
Consider the following discrete-time uncertain networked control system with random packet loss where x k ∈ R n denotes the system state, y k ∈ R m denotes the measurement, w k ∈ R n is the system noise, and v k ∈ R m characterizes network transmission noise derived from the communication network. e two noises have the following statistical characteristics: where δ ik is a sign function and matrices Q and R k , respectively, satisfying Q ≥ 0 and R k > 0 reflect the system's confidence in models and measurements. If Q > R k , it means that the influence of the system model on the estimator is greater than measurements, and vice versa. Furthermore, A, B, and C are known matrices of the appropriate dimensions. ΔA k representing the model error is a time-varying uncertain matrix expressed as where M and E are also the known real constant matrices of the appropriate dimensions and Λ k is an arbitrary contraction. Perturbation models of the form (3) are common in optimization problems. It can transform the problem with uncertain parameters into a region minimization problem with known norm range. As shown in (1), the stochastic parameter c k taking values of 0, 1 { } indicates whether the measurement is lost at time k, and the packet loss satisfies the Bernoulli distribution. c k � 1, meaning that packet loss does not happen and the measurement data are received; otherwise, c k � 0 indicates that packet loss happens and the only measurement noise v k is received. erefore, the stochastic parameter c k has the following statistical characteristics: Assume that the estimator knows the value of c k at time k. e assumption is reasonable because the estimator can get the value of c k by comparing the value of y k with y k− 1 . Based on the value of the random parameter c k indicating whether the measurement is lost, the variance R k of the system's confidence in measurements can take different values as follows: 2 Mathematical Problems in Engineering where σ is a scalar parameter and R is the known real constant matrices. As for (5), the variance R k takes the value in two cases. When the measurement is received at time k, let R k � R denote the system's confidence in the measurement; otherwise, R k � σ 2 I. In the calculation process, the parameter σ is considered to be trending toward ∞ when c k � 0 because the measurement is not received at this moment. In other words, the effect of packet loss on the state estimation is greater than the system uncertainty, and the value of R k is much greater than Q. To estimate the system state for the uncertain networked control system (1), a new robust estimator will be designed in the next section.

Description of RMHE.
In order to eliminate the adverse effects of the above uncertainties (2)-(4) on the state estimation and improve the estimation performance, a robust MHE method relying on the full information estimation will be discussed and some conclusions will be obtained.
At first, the optimization problem of the full information estimation can be described as where the objective function is defined by (1)- (5), where x 0|0 is the prior estimated state of system (1), and P 0|0 represents the prior weight matrix. At time t, the measurement information y k t− 1 k�0 is derived, and then the solutions x * 0|t− 1 and w * can be obtained by minimizing the optimization problem (6). In addition, the estimated state at other times can be found by the following equation: However, the full information estimation (6) needs to use all measurements at the previous time for each calculation, so the calculation load will increase continuously. In order to ensure the efficiency and the real-time property of the state estimation, the moving horizon estimation with a fixed window is proposed in the paper, instead of the full moving horizon estimation. Based on the above analysis, the proposed moving horizon state estimation algorithm can be divided into two parts: the full information estimation in the time period 0 ≤ k ≤ t − n − 1 { } and the moving horizon estimation with a fixed window in the time period }. erefore, the optimization problem (6) of full information estimation can be substituted into the following optimization problem of MHE: where s.t. (1)-(5) and n is the length of the fixed window.
In the optimization problem (9), the choice of the arrival cost function J t− n which reflects the effect of the full information estimation in time period 0 ≤ k ≤ t − n − 1 { } is important because of its influence on the estimation performance of MHE (9). For the computational convenience, a usual form of the arrival cost function is adopted as follows: If the random parameter c k and the three weight matrices in (9) and (11) are determined, the optimized variables k�t− n can be obtained by minimizing the optimization problem (9). Similar to (8) Remark 1. To simplify the calculation, the uncertain matrix ΔA k does not appear in (6)- (12), but it will change the form of the arrival cost function by affecting the weight matrix, which will be discussed in the following part.

Solution of Time-Varying Weight Matrix.
It is worth noting that Q, R k , x t− n|t− 1 , and P t− n|t− 1 must be known when calculating (9). In this paper, Q and R k are designed as fixed matrices and x * t− n+1|t− 1 is chosen as the prior estimated state for the next time. In many studies, the weight matrix P t− n|t− 1 is usually also designed as a fixed matrix, but in order to get more accurate estimation, the next step is to design a timevarying weight matrix calculation method. Assume that the priori estimated state x k− 1|k− 1 and the weight matrix P k− 1|k− 1 are given at time k, along with the measurement y k . Using this initial information, we can seek to update the estimated state from x k− 1|k− 1 to x k|k by solving min (1)- (5), where x k− 1|k and w k− 1|k , respectively, represent the optimal estimated state and system disturbance of the time k − 1 at time k, which satisfy Mathematical Problems in Engineering 3 To make the calculation simple, we define then, (13) can be rewritten as According to eorem 1 proposed in [25], the solution of (16) can be expressed as where where By solving (13)- (19), the solution of the optimization problem (12) can be summed up as the following form: where α is an adjustable parameter, which satisfies α > 0.

Remark 2.
In the result of (13), not only the equation of the time-varying weight matrix P k|k can be obtained, but also an equation of a priori estimated state from x k− 1|k− 1 to x k|k can be obtained. But in this paper, we use x * t− n+1|t− 1 to represent the priori estimation of the next time, so in result (21), we only list the equations about P k|k (for more detailed calculations, see [25]).
In conclusion, the algorithm of the RMHE method proposed in this paper can be summarized into the following steps: Step 1. Initialize and determine x 0|0 , P 0|0 , Q, R, and window length n Step 2. When t ≤ n, get the optimal solutions x * 0|t− 1 and w * k | t− 1 t− 1 k�0 by solving (6), and then get the estimated state by solving (8) Step 3. When t > n, get P t− n|t− 1 by solving (21) Step 4. Based on the measurement data y k k�t− n by solving (9), then get the estimated state by solving (12) Step 5. At time t + 1, return to Step 3 In this section, a state estimator is designed to solve the problem of packet loss and model error in NCSs. In the first part, the state estimation problem is transformed into a quadratic programming problem (9) by selecting a random cost function. Moreover, in order to make the result of (9) more accurate, equation (21) of the weight matrix in (9) is obtained by solving a regularized least-square problem with uncertain parameters.
is estimator guarantees that the estimated state is optimal in the worst case and increases its accuracy and practicability.

Estimation Properties for Robust MHE
In order to verify the stability of the RMHE designed in this paper, the following sufficient conditions of the asymptotic convergence are deduced. Before the convergence analysis of the estimator, let e recursive formula of the error covariance P k|k in (21) can be rewritten into the following form: To prove the following theorem, firstly two lemma are introduced as follows. (21) is asymptotically stable for any P 0|0 > 0. Furthermore, as t ⟶ ∞, P k|k approaches a unique positive definite matrix (see, e.g., [26]).

(a) (A, C) is detectable and A is unstable
Furthermore, as t ⟶ ∞, the conclusion is satisfied (see, e.g., [15]). According to Lemma 1, it is easy to analyze the related stability of (22) because its analysis process is the same as the proof of eorem 2 in [26]. Moreover, based on Lemmas 1 and 2, the stability of the RMHE proposed in this paper can be discussed, where the influences of measurement noise, packet loss probability, and network transmission noise are all included in the next proof.
To simplify notation, let x i|t− 1 � x i in this section, and so are the others. Theorem 1. Suppose (A, C) is detectable and A is unstable and (A, Q 1/2 ) is controllable. If the optimization problem (9) is solvable and P t− n can be derived from (21), the expectation of the estimation error will eventually tend to 0 over time.
Proof. According to Lemma 1, the solutions of problem (9) are assumed to be x * t− n and w * k t− 1 k�t− n , then the optimal cost function (25) is bounded In addition, the following formula is satisfied: For the convenience of the later proof, the expectation of both sides of (26) can be written as By defining Mathematical Problems in Engineering then we can get the following formula: Because (A, C) is detectable, ρ T ρ is a positive definite matrix. Let ψ � (1/ �������� ξ min (ρ T ρ) ), then equation (29b) can be further reduced to and it is obvious that by combining (30) and (31), it has To eliminate the random variable c t− n in (32), we take the expectation of both sides of (32) and obtain Because the probability λ is given, (33) can be reduced to then, combining (27) and (34), it has

Mathematical Problems in Engineering
In view of the expectation of v k and w k in (2), (35) can be rewritten as Because (25) is bounded, E(‖e t− 1 ‖) has an upper bound. Furthermore, if the conditions of Lemmas 1 and 2 are satisfied, that is, when t ⟶ ∞, it is easy to get E(‖e t− 1 ‖) ⟶ 0. erefore, it is concluded that the RMHE method designed in this paper is asymptotically stable.
In eorem 1, the norm of the estimation error is affected by many factors such as system matrices, system noise, network transmission noise, random packet loss, and system uncertainty.
at is, it is not only related to the coefficient matrix A, B, and C of the system, but also affected by the matrices Q and R, window length n, and uncertain matrices Λ and λ. en, it is very difficult to qualitatively analyze the convergence of the error norm. In order to better compensate the estimation error, it is necessary to appropriately adjust Q and R based on the influence of packet loss and system uncertainties. Different from other methods, such as H ∞ filtering and Kalman filtering, the proposed RMHE method not only guarantees that the error covariance matrix is bounded, but also guarantees that the expectation of the error norm converges to zero if system noise and network noise trend to zero.

Mathematical Problems in Engineering
Remark 3. In this paper, the P in the estimation algorithm is changeable according to the system coefficient at each time, so in the proof process, when the system satisfies some conditions, we guarantee that P is asymptotically stable according to the theorem in [26]. en, the approach is proved to be asymptotically stable according to the theorem in [15] (for more detailed calculations, see [15,26]).

Verification Simulation
In order to verify the effectiveness of the proposed RMHE, the following unstable state-space model is considered in the simulation analysis: It is assumed that ΔA k � MΛ k N, ‖Λ k ‖ ≤ 1, M � 0.01 0.01 0 0 T , and E � 0.5 0.5 0 0 . e parameters R � diag 1, 1 { } and Q � 20 are given. Set λ � 0.8 and the constraints of the system noise as w k > 0. Since the system uncertainty has a much greater impact on the state estimation than packet loss in this simulation, the choice of Q is taken larger than R. Furthermore, assume that P 0|0 � diag 1, 1, 1, 1 { } and x 0|0 � 0 0 0 0 T . So far, there is no good conclusion about how the fixed window length N can make the estimator performance better. Generally, it is twice the order of the system, so the fixed window length N � 10 is chosen in this paper.      To evaluate the estimation performances of such a proposed estimator, the mean error norm (MEN) is adopted as follows: where x * t|t − x t|t is the estimation error at time t and m is the number of estimated states. e proposed MHE method is compared with the existing RMHE in [24]. In [24], the objective function of MHE is transformed into the min-max problem, and the optimal estimated state in the worst case is obtained by solving the inequality. However, this method is limited in solving the problems with physical constraints, which cannot get good results or require a lot of recalculation. In this paper, the quadratic optimization is retained and the min-max strategy is used to solve the weight matrix, so the constraint problem is solved with robustness. e system state trajectories are given in Figures 1-4, and Figure 5 gives a comparison of the mean error norm over time. We can know from these results that both methods can estimate the state of the system well in the presence of model error and packet loss, but when the system has constraints, the proposed method can get a smaller estimation error. Table 1 gives a comparison of MEN for different packet loss probabilities; Table 2 shows the time taken to calculate the different data.
e results show that the proposed method performs better when the time used is basically the same.

Conclusion
Based on the MHE principle, this paper presents a robust moving horizon estimation approach to solve the constrained state estimation problem for uncertain networked systems with random packet loss. e proposed state estimation can be transformed into a quadratic optimization problem with a fixed window, where the initial state and disturbance of the system are estimated by minimizing the performance index. A new unconstrained estimator is given based on the robust leastsquare principle, which ensures that the optimal weight matrix in the worst case can be obtained. e asymptotically convergent conditions of the estimator are discussed. In the future work, this proposed estimation approach can be expanded to distributed control systems and complex systems.
Data Availability e raw/processed data required to reproduce these findings cannot be shared at this time as the data also form part of an ongoing study.

Conflicts of Interest
e authors declare that they have no conflicts of interest.