Abstract
We derive nonlocal necessary optimality conditions, which efficiently strengthen the classical Pontryagin maximum principle and its modification obtained by B. Kaśkosz and S. Łojasiewicz as well as our previous result of a similar kind named the “feedback minimum principle.” The strengthening of the feedback minimum principle (and, hence, of the Pontryagin principle) is owing to the employment of two types of feedback controls “compatible” with a reference trajectory (i.e., producing this trajectory as a Carath´eodory solution). In each of the versions, the strengthened feedback minimum principle states that the optimality of a reference process implies the optimality of its trajectory in a certain family of variational problems generated by cotrajectories of the original and compatible controls. The basic construction of the feedback minimum principle—a perturbation of a solution to the adjoint system—is employed to prove an exact formula for the increment of the cost functional. We use this formula to obtain sufficient conditions for the strong and global minimum of Pontryagin’s extremals. These conditions are much milder than their known analogs, which require the convexity in the state variable of the functional and of the lower Hamiltonian. Our study is focused on a nonlinear smooth Mayer problem with free terminal states. All assertions are illustrated by examples.
Similar content being viewed by others
References
L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, The Mathematical Theory of Optimal Processes (Fizmatgiz, Moscow, 1961; Wiley, New York, 1962).
V. A. Dykhta, “Variational optimality conditions with feedback descent controls that strengthen the maximum principle,” Izv. Irkut. Gos. Univ., Ser. Mat. 8, 86–103 (2014).
V. A. Dykhta, “Weakly monotone solutions of the Hamilton–Jacobi inequality and optimality conditions with positional controls,” Autom. Remote Control 75 (5), 829–844 (2014).
V. A. Dykhta, “Nonstandard duality and nonlocal necessary optimality conditions in nonconvex optimal control problems,” Autom. Remote Control 75 (11), 1906–1921 (2014).
N. N. Krasovskii, Control of a Dynamical System (Nauka, Moscow, 1985) [in Russian].
A. I. Subbotin, Generalized Solutions of First-Order Partial Differential Equations: The Dynamical Optimization Perspective (Birkhäuser, Boston, 1995; Inst. Komp. Issled., Izhevsk, 2003).
F. Clarke, Yu. S. Ledyaev, and A. I. Subbotin, “Universal feedback control via proximal aiming in problems of control under disturbance and differential games,” Proc. Steklov Inst. Math. 224, 149–168 (1999).
F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth Analysis and Control Theory (Springer, New York, 1998).
F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, “Qualitative properties of trajectories of control systems: A survey,” J. Dynam. Control Systems 1 (1), 1–48 (1995).
J. Warga, “A second-order condition that strengthens Pontryagin’s maximum principle,” J. Differential Equations 28 (2), 284–307 (1978).
B. Káskosz and S. Lojasiewicz, “A maximum principle for generalized control,” Nonlinear Anal. 9 (2), 109–130 (1985).
B. Káskosz, “Extremality, controllability, and abundant subsets of generalized control systems,” J. Optim. Theory Appl. 101 (1), 73–108 (1999).
H. Frankowska and B. Káskosz, “Linearization and boundary trajectories of nonsmooth control systems,” Can. J. Math. 11 (3), 589–609 (1988).
H. J. Sussmann, “A strong version of the Lojasiewicz maximum principle,” in Optimal Control of Differential Equations, Ed. by N. H. Pavel (Marcel Dekker, New York, 1994), Ser. Lecture Notes in Pure and Applied Mathematics, Vol. 160, pp. 293–309.
P. D. Loewen and R. B. Vinter, “Pontryagin-type necessary conditions for differential inclusion problems,” Systems Control Lett. 9 (3), 263–265 (1987).
Z. Artstein, “Pontryagin maximum principle revisited with feedbacks,” Eur. J. Control 17 (1), 46–54 (2011).
F. Clarke, Functional Analysis, Calculus of Variations and Optimal Control (Springer, London, 2013), Ser. Graduate Texts in Mathematics, Vol. 264.
M. S. Nikol’skii, “On the sufficiency of the Pontryagin maximum principle in some optimization problems,” Moscow Univ. Comput. Math. Cybernet., No. 1, 29–37 (2005).
N. V. Antipina and V. A. Dykhta, “Linear Lyapunov–Krotov functions and sufficient conditions for optimality in the form of the maximum principle,” Russian Math. (Iz. VUZ) 46 (12), 9–20 (2002).
V. F. Krotov, Global Methods in Optimal Control Theory (Marcel Dekker, New York, 1996), Ser. Monographs and Textbooks in Pure and Applied Mathematics, Vol. 195.
V. A. Dykhta, “Analysis of sufficient optimality conditions with a set of Lyapunov type functions,” Trudy Inst. Mat. Mekh. UrO RAN 16 (5), 66–75 (2010).
R. Gabasov and F. M. Kirillova, The Maximum Principle in the Theory of Optimal Control (Editorial URSS, Moscow, 2011) [in Russian].
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © V.A. Dykhta, 2015, published in Trudy Instituta Matematiki i Mekhaniki UrO RAN, 2015, Vol. 21, No. 2.
Rights and permissions
About this article
Cite this article
Dykhta, V.A. Positional strengthenings of the maximum principle and sufficient optimality conditions. Proc. Steklov Inst. Math. 293 (Suppl 1), 43–57 (2016). https://doi.org/10.1134/S0081543816050059
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0081543816050059