Skip to main content

Bilevel Optimal Control: Existence Results and Stationarity Conditions

  • Chapter
  • First Online:

Part of the book series: Springer Optimization and Its Applications ((SOIA,volume 161))

Abstract

The mathematical modeling of numerous real-world applications results in hierarchical optimization problems with two decision makers where at least one of them has to solve an optimal control problem of ordinary or partial differential equations. Such models are referred to as bilevel optimal control problems. Here, we first review some different features of bilevel optimal control including important applications, existence results, solution approaches, and optimality conditions. Afterwards, we focus on a specific problem class where parameters appearing in the objective functional of an optimal control problem of partial differential equations have to be reconstructed. After verifying the existence of solutions, necessary optimality conditions are derived by exploiting the optimal value function of the underlying parametric optimal control problem in the context of a relaxation approach.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. R.A. Adams, J.J.F. Fournier, Sobolev Spaces (Elsevier Science, Oxford, 2003)

    Google Scholar 

  2. S. Albrecht, M. Ulbrich, Mathematical programs with complementarity constraints in the context of inverse optimal control for locomotion. Optim. Methods Softw. 32(4), 670–698 (2017)

    Article  Google Scholar 

  3. S. Albrecht, C. Passenberg, M. Sobotka, A. Peer, M. Buss, M. Ulbrich, Optimization Criteria for Human Trajectory Formation in Dynamic Virtual Environments, Haptics: Generating and Perceiving Tangible Sensations, ed. by A.M.L. Kappers, J.B.F. van Erp, W.M. Bergmann Tiest, F.C.T. van der Helm (Springer, Berlin, 2010), pp. 257–262

    Chapter  Google Scholar 

  4. S. Albrecht, M. Leibold, M. Ulbrich, A bilevel optimization approach to obtain optimal cost functions for human arm movements Numer. Algebra Control Optim. 2(1), 105–127 (2012)

    Article  Google Scholar 

  5. B. Bank, J. Guddat, D. Klatte, B. Kummer, K. Tammer, Non-Linear Parametric Optimization (Birkhäuser, Basel, 1983)

    Google Scholar 

  6. V. Barbu, Optimal Control of Variational Inequalities, Research Notes in Mathematics (Pitman Advanced Pub. Program, Boston, 1984)

    Google Scholar 

  7. J.F. Bard, Practical Bilevel Optimization: Algorithms and Applications (Kluwer Academic, Dordrecht, 1998)

    Book  Google Scholar 

  8. F. Benita, P. Mehlitz, bilevel optimal control with final-state-dependent finite-dimensional lower level. SIAM J. Optim. 26(1), 718–752 (2016)

    Google Scholar 

  9. F. Benita, S. Dempe, P. Mehlitz, Bilevel optimal control problems with pure state constraints and finite-dimensional lower level. SIAM J. Optim. 26(1), 564–588 (2016)

    Article  Google Scholar 

  10. J.F. Bonnans, A. Shapiro, Perturbation Analysis of Optimization Problems (Springer, New York, Berlin, Heidelberg, 2000)

    Book  Google Scholar 

  11. D.A. Carlson, Existence of Optimal Controls for a Bi-Level Optimal Control Problem, Advances in Dynamic Games: Theory, Applications, and Numerical Methods, ed. by V. Křivan, G. Zaccour (Springer, Cham, 2013), pp. 71–84

    Chapter  Google Scholar 

  12. H. Cartan, Calcul Différentiel (Hermann, Paris, 1967)

    Google Scholar 

  13. C. Clason, Y. Deng, P. Mehlitz, U. Prüfert, Optimal control problems with control complementarity constraints: existence results, optimality conditions, and a penalty method. Optim. Methods Softw. 35(1), 142–170 (2020). https://doi.org/10.1080/10556788.2019.1604705

    Article  Google Scholar 

  14. S. Dempe, Foundations of Bilevel Programming (Kluwer, Dordrecht, 2002)

    Google Scholar 

  15. S. Dempe, J. Dutta, Is bilevel programming a special case of a mathematical program with complementarity constraints? Math. Program. 131(1), 37–48 (2012)

    Article  Google Scholar 

  16. S. Dempe, V. Kalashnikov, G. Pérez-Valdéz, N. Kalashnykova, Bilevel Programming Problems - Theory, Algorithms and Applications to Energy Networks (Springer, Berlin, 2015)

    Google Scholar 

  17. S. Dempe, F. Harder, P. Mehlitz, G. Wachsmuth, Solving inverse optimal control problems via value functions to global optimality. J. Global Optim. 74(2), 297–325 (2019)

    Article  Google Scholar 

  18. A.V. Fiacco, J. Kyparisis, Convexity and concavity properties of the optimal value function in parametric nonlinear programming. J. Optim. Theory Appl. 48(1), 95–126 (1986)

    Article  Google Scholar 

  19. F. Fisch, J. Lenz, F. Holzapfel, G. Sachs, On the solution of bilevel optimal control problems to increase the fairness in air races. J. Guid. Control Dynam. 35(4), 1292–1298 (2012)

    Article  Google Scholar 

  20. L. Guo, J.J. Ye, Necessary optimality conditions for optimal control problems with equilibrium constraints. SIAM J. Control Optim. 54(5), 2710–2733 (2016)

    Article  Google Scholar 

  21. F. Harder, G. Wachsmuth, Comparison of optimality systems for the optimal control of the obstacle problem. GAMM-Mitteilungen 40(4), 312–338 (2018)

    Article  Google Scholar 

  22. F. Harder, G. Wachsmuth, The limiting normal cone of a complementarity set in Sobolev spaces. Optimization 67(10), 1579–1603 (2018)

    Article  Google Scholar 

  23. F. Harder, G. Wachsmuth, Optimality conditions for a class of inverse optimal control problems with partial differential equations. Optimization 68(2–3), 615–643 (2019)

    Article  Google Scholar 

  24. K. Hatz, Efficient Numerical Methods for Hierarchical Dynamic Optimization with Application to Cerebral Palsy Gait Modeling, Ph.D. thesis, University of Heidelberg, Germany, 2014

    Google Scholar 

  25. K. Hatz, J.P. Schlöder, H.G. Bock, Estimating parameters in optimal control problems. SIAM J. Sci. Comput. 34(3), A1707–A1728 (2012)

    Article  Google Scholar 

  26. R. Herzog, F. Schmidt, Weak lower semi-continuity of the optimal value function and applications to worst-case robust optimal control problems. Optimization 61(6), 685–697 (2012)

    Article  Google Scholar 

  27. M. Hinze, R. Pinnau, M. Ulbrich, S. Ulbrich, Optimization with PDE Constraints (Springer, Berlin, 2009)

    Google Scholar 

  28. G. Holler, K. Kunisch, R.C. Barnard, A bilevel approach for parameter learning in inverse problems. Inverse Probl. 34(11), 1–28 (2018)

    Article  Google Scholar 

  29. L. Hörmander, The Analysis of Linear Partial Differential Operators I (Springer, Berlin, 2003)

    Book  Google Scholar 

  30. J. Jahn, Introduction to the Theory of Nonlinear Optimization (Springer, Berlin, 1996)

    Book  Google Scholar 

  31. D. Jerison, C.E. Kenig, The inhomogeneous Dirichlet problem in Lipschitz domains. J. Funct. Anal. 130(1), 161–219 (1995)

    Article  Google Scholar 

  32. V. Kalashnikov, F. Benita, P. Mehlitz, The natural gas cash-out problem: a bilevel optimal control approach. Math. Probl. Eng. 1–17 (2015). https://doi.org/10.1155/2015/286083

  33. M. Knauer, Fast and save container cranes as bilevel optimal control problems. Math. Comput. Model. Dynam. Syst. 18(4), 465–486 (2012)

    Article  Google Scholar 

  34. M. Knauer, C. Büskens, Hybrid solution methods for bilevel optimal control problems with time dependent coupling, in Recent Advances in Optimization and its Applications in Engineering: The 14th Belgian-French-German Conference on Optimization, ed. by M. Diehl, F. Glineur, E. Jarlebring, W. Michiels (Springer, Berlin, 2010), pp. 237–246

    Chapter  Google Scholar 

  35. F.L. Lewis, D. Vrabie, V.L. Syrmos, Optimal Control (Wiley, Hoboken, 2012)

    Book  Google Scholar 

  36. P. Mehlitz, Bilevel programming problems with simple convex lower level, Optimization 65(6), 1203–1227 (2016)

    Article  Google Scholar 

  37. P. Mehlitz, Contributions to Complementarity and Bilevel Programming in Banach Spaces, Ph.D. thesis, Technische Universität Bergakademie Freiberg, 2017

    Google Scholar 

  38. P. Mehlitz, Necessary optimality conditions for a special class of bilevel programming problems with unique lower level solution. Optimization 66(10), 1533–1562 (2017)

    Article  Google Scholar 

  39. P. Mehlitz, On the sequential normal compactness condition and its restrictiveness in selected function spaces. Set-Valued Var. Anal. 27(3), 763–782 (2019)

    Article  Google Scholar 

  40. P. Mehlitz, G. Wachsmuth, Weak and strong stationarity in generalized bilevel programming and bilevel optimal control. Optimization 65(5), 907–935 (2016)

    Article  Google Scholar 

  41. P. Mehlitz, G. Wachsmuth, The limiting normal cone to pointwise defined sets in Lebesgue spaces. Set-Valued Var. Anal. 26(3), 449–467 (2018)

    Article  Google Scholar 

  42. P. Mehlitz, G. Wachsmuth, The weak sequential closure of decomposable sets in Lebesgue spaces and its application to variational geometry. Set-Valued Var. Anal. 27(1), 265–294 (2019)

    Article  Google Scholar 

  43. F. Mignot, Contrôle dans les inéquations variationelles elliptiques. J. Funct. Anal. 22(2), 130–185 (1976)

    Article  Google Scholar 

  44. K. Mombaur, A. Truong, J.-P. Laumond, From human to humanoid locomotion—an inverse optimal control approach. Auton. Robots 28(3), 369–383 (2010)

    Article  Google Scholar 

  45. K.D. Palagachev, M. Gerdts, Exploitation of the Value Function in a Bilevel Optimal Control Problem, ed. by L. Bociu, J.-A. Désidéri, A Habbal. System Modeling and Optimization (Springer, Cham, 2016), pp. 410–419

    Google Scholar 

  46. K.D. Palagachev, M. Gerdts, Numerical Approaches Towards Bilevel Optimal Control Problems with Scheduling Tasks, ed. by L. Ghezzi, D. Hömberg, C. Landry. Math for the Digital Factory (Springer, Cham, 2017), pp. 205–228

    Google Scholar 

  47. S.M. Robinson, Stability theory for systems of inequalities, part II: differentiable nonlinear systems. SIAM J. Numer. Anal. 13(4), 497–513 (1976)

    Article  Google Scholar 

  48. A. Schiela, D. Wachsmuth, Convergence analysis of smoothing methods for optimal control of stationary variational inequalities with control constraints. ESAIM Math. Model. Numer. Anal. 47(3), 771–787 (2013).

    Article  Google Scholar 

  49. K. Shimizu, Y. Ishizuka, J. F. Bard, Nondifferentiable and Two-Level Mathematical Programming (Kluwer Academic, Dordrecht, 1997)

    Book  Google Scholar 

  50. F. Tröltzsch, Optimal Control of Partial Differential Equations (Vieweg, Wiesbaden, 2009)

    Google Scholar 

  51. J.L. Troutman, Variational Calculus and Optimal Control (Springer, New York, 1996)

    Book  Google Scholar 

  52. H.V. Stackelberg, Marktform und Gleichgewicht (Springer, Berlin, 1934)

    Google Scholar 

  53. G. Wachsmuth, Mathematical programs with complementarity constraints in Banach spaces. J. Optim. Theory Appl. 166(2), 480–507 (2015)

    Article  Google Scholar 

  54. G. Wachsmuth, Strong stationarity for optimization problems with complementarity constraints in absence of polyhedricity. Set-Valued Var. Anal. 25(1), 133–175 (2017)

    Article  Google Scholar 

  55. J.J. Ye, Necessary conditions for bilevel dynamic optimization problems. SIAM J. Control Optim. 33(4), 1208–1223 (1995)

    Article  Google Scholar 

  56. J.J. Ye, Optimal strategies for bilevel dynamic problems. SIAM J. Control Optim. 35(2), 512–531 (1997)

    Article  Google Scholar 

  57. J. Zowe, S. Kurcyusz, Regularity and stability for the mathematical programming problem in Banach spaces. Appl. Math. Optim. 5(1), 49–62 (1979)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patrick Mehlitz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Mehlitz, P., Wachsmuth, G. (2020). Bilevel Optimal Control: Existence Results and Stationarity Conditions. In: Dempe, S., Zemkoho, A. (eds) Bilevel Optimization. Springer Optimization and Its Applications, vol 161. Springer, Cham. https://doi.org/10.1007/978-3-030-52119-6_16

Download citation

Publish with us

Policies and ethics