Skip to main content
SpringerLink
Log in

Gradient Descent Approach to Optimal Mode Scheduling in Hybrid Dynamical Systems

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

This paper concerns the problem of optimally scheduling the sequence of dynamic response functions in nonlinear switched-mode hybrid dynamical systems. The control parameter has a discrete component and a continuous component, namely the sequence of modes and the duration of each mode, while the performance criterion consists of a cost functional on the state trajectory. The problem is naturally cast in the framework of optimal control. This framework has established techniques sufficient to address the continuous part of the parameter, but lacks adequate tools to consider the discrete element. To get around this difficulty, the paper proposes a bilevel hierarchical algorithm. At the lower level, the algorithm considers a fixed mode sequence and minimizes the cost functional with respect to the mode durations; at the upper level, it updates the mode sequence by using a gradient technique that is tailored to the special structure of the discrete variable (mode sequencing). The resulting algorithm is not defined on a single parameter space, but rather on a sequence of Euclidean spaces of increasing dimensions, an unusual setting for which there is no established notion of convergence. The paper suggests first a suitable definition of convergence based on the concepts of optimality functions; then, it proves that the proposed algorithm converges in that sense.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Lincoln, B., Rantzer, A.: Optimizing linear systems switching. In: Proceedings of the 40th IEEE Conference on Decision and Control, Orlando, FL, pp. 2063–2068 (2001)

  2. Rehbinder, H., Sanfirdson, M.: Scheduling of a limited communication channel for optimal control. In: Proceedings of the 39th IEEE Conference on Decision and Control, Sidney, Australia, pp. 1011–1016 (2000)

  3. Walsh, G., Ye, H., Bushnell, L.: Stability analysis of networked control systems. In: Proceedings of the American Control Conference, San Diego, CA, pp. 2876–2880 (1999)

  4. Brockett, R.: Stabilization of motor networks. In: Proceedings of the 34th IEEE Conference on Decision and Control, New Orleans, LA, pp. 1484–1488 (1995)

  5. Egerstedt, M., Wardi, Y.: Multiprocess control using queuing theory. In: Proceedings of the 41st IEEE Conference on Decision and Control, Las Vegas, NV, pp. 1991–1996 (2002)

  6. Hristu-Varsakelis, D.: Feedback control systems as users of shared network: communication sequences that guarantee stability. In: Proceedings of the 40th IEEE Conference on Decision and Control, Orlando, FL, pp. 3631–3631 (2001)

  7. Shaikh, M.S., Caines, P.: On trajectory optimization for hybrid systems: theory and algorithms for fixed schedules. In: Proceedings of the 41st IEEE Conference on Decision and Control, Las Vegas, NV, pp. 1997–1998 (2002)

  8. Shaikh, M.S., Caines, P.E.: On the optimal control of hybrid systems: optimization of trajectories, switching times and location schedules. In: Proceedings of the 6th International Workshop on Hybrid Systems: Computation and Control, Prague, Czech Republic, pp. 466–481 (2003)

  9. Xu, X., Antsaklis, P.: Optimal control of switched autonomous systems. In: Proceedings of the 41st IEEE Conference on Decision and Control, Las Vegas, NV, pp. 4401–4406 (2002)

  10. Xu, X., Antsaklis, P.J.: Optimal control of switched systems via nonlinear optimization based on direct differentiations of value functions. Int. J. Control 75, 1406–1426 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  11. Piccoli, B.: Hybrid systems and optimal control. In: Proceedings of the 37th IEEE Conference on Decision and Control, Tampa, FL, pp. 13–18 (1998)

  12. Sussmann, H.J.: A maximum principle for hybrid optimal control problems. In: Proceedings of the 38th IEEE Conference on Decision and Control, Phoenix, AZ, pp. 425–430 (1999)

  13. Sussmann, H.J.: Set-valued differentials and the hybrid maximum principle. In: Proceedings of the 39th IEEE Conference on Decision and Control, Sydney, Australia, pp. 558–563 (2000)

  14. Alamir, M., Attia, S.A.: On solving optimal control problems for switched nonlinear systems by strong variations algorithms. In: Proceedings of the 6th IFAC Symposium on Nonlinear Control Systems, Stuttgart, Germany, pp. 558–563 (2004)

  15. Attia, S.A., Alamir, M., Canudas De Wit, C.: Sub optimal control of switched nonlinear systems under location and switching constraints. In: Proceedings of the 16th IFAC World Congress, Prague, Czech Republic (2005)

  16. Egerstedt, M., Wardi, Y., Axelsson, H.: Transition-time optimization for switched systems. IEEE Trans. Autom. Control 51, 110–115 (2006)

    Article  MathSciNet  Google Scholar 

  17. Axelsson, H., Wardi, Y., Egerstedt, M.: Transition-time optimization for switched systems. In: Proceedings of the 16th IFAC World Congress, Prague, Czech Republic (2005)

  18. Axelsson, H., Wardi, Y., Egerstedt, M., Verriest, E.I.: A provably convergent algorithm for transition-time optimization in switched systems. In: Proceedings of the 44th IEEE Conference on Decision and Control, Sevilla, Spain, pp. 558–563 (2005)

  19. Polak, E.: Optimization Algorithms and Consistent Approximations. Springer, New York (1997)

    MATH  Google Scholar 

  20. Polak, E., Wardi, Y.: A study of minimizing sequences. SIAM J. Control Optim. 22, 599–609 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  21. Armijo, L.: Minimization of functions having Lipschitz continuous first-partial derivatives. Pac. J. Math. 16, 1–3 (1966)

    MATH  MathSciNet  Google Scholar 

  22. Axelsson, H., Wardi, Y., Egerstedt, M., Verriest, E.I.: Tracking the fluid level in a double tank system: an example of optimal control in a switched-mode system with arbitrary number of switches. Technical Memorandum, Georgia Institute of Technology, School of Electrical and Computer Engineering (April 2007), http://www.ece.gatech.edu/~magnus/Papers/ModeSwitch.pdf

Download references

Author information

Authors and Affiliations

  1. Kencast, Stamford, CT, USA

    H. Axelsson

  2. School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA

    Y. Wardi, M. Egerstedt & E. I. Verriest

Authors
  1. H. Axelsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. Wardi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Egerstedt
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. E. I. Verriest
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Y. Wardi.

Additional information

Communicated by E. Polak.

Research supported in part by the National Science Foundation under Grant #0509064.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Axelsson, H., Wardi, Y., Egerstedt, M. et al. Gradient Descent Approach to Optimal Mode Scheduling in Hybrid Dynamical Systems. J Optim Theory Appl 136, 167–186 (2008). https://doi.org/10.1007/s10957-007-9305-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-007-9305-y

Keywords

Search

Navigation