Skip to main content
Log in

Stabilization of linear stochastic systems with a discount: Modeling and estimation of the long-term effects from the application of optimal control strategies

  • Published:
Mathematical Models and Computer Simulations Aims and scope

Abstract

The paper is devoted to the problem of stabilizing a linear stochastic control system. The quadratic cost functional measures the total loss caused by deviation from the fixed (target) levels and control trajectories, as well as a decision-maker’s time preferences expressed in the discount function. The long-term impacts of the use of decision-making, optimal on average, over an infinite-time horizon are taken as estimates of the deviation of the optimal trajectory from its target in the mean square sense and with the probability of 1.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. C. C. Holt, “Linear decision rules for economic stabilization and growth,” Quart. J. Econ. 76, 20–45 (1962).

    Article  MATH  Google Scholar 

  2. S. J. Turnovsky, Macroeconomic Analysis and Stabilization Policy (Cambridge Univ. Press, Cambridge, MA, 1977).

    MATH  Google Scholar 

  3. E. S. Palamarchuk, “Risk estimation for linear economic systems under negative time preferences,” Ekon. Mat. Metody 49(3), 99–116 (2013).

    MATH  Google Scholar 

  4. J. K. Sengupta, “Optimal stabilization policy with a quadratic criterion function,” Rev. Econ. Studies 37, 127–145 (1970).

    Article  Google Scholar 

  5. T. A. Belkina and E. S. Palamarchuk, “On stochastic optimality for a linear controller with attenuating disturbances,” Autom. Remote Control 74, 628–641 (2013).

    Article  MathSciNet  MATH  Google Scholar 

  6. R. Neck, “Optimal stabilizing and destabilizing ‘stabilization’ policies,” in Cybernetics and Systems’86, Proceedings of the 8th European Meeting on Cybernetics and Systems Research (Springer, Berlin, 1986).

    Google Scholar 

  7. A. H. Gelb, “Optimal control and stabilization policy: an application to the coffee economy,” Rev. Econ. Studies 44, 95–109 (1977).

    Article  MATH  Google Scholar 

  8. T. A. Belkina, Yu. M. Kabanov, and E. L. Presman, “On a stochastic optimality of the feedback control in the LQG-problem,” Theory Probabil. Its Appl. 48, 592–603 (2003).

    Article  MathSciNet  MATH  Google Scholar 

  9. H. Kwakernaak and R. Sivan, Linear Optimal Control Systems (Wiley-Interscience, New York, 1972).

    Google Scholar 

  10. E. S. Palamarchuk, “Asymptotic behavior of the solution to a linear stochastic differential equation and almost sure optimality for a controlled stochastic process,” Comput. Math. Math. Phys. 54, 83–96 (2014).

    Article  MathSciNet  MATH  Google Scholar 

  11. M. H. A. Davis, Linear Estimation and Stochastic Control (Chapman and Hall, London, 1977).

    MATH  Google Scholar 

  12. V. Dragan, T. Morozan, and A.-M. Stoica, Mathematical Methods in Robust Control of Linear Stochastic Systems (Springer, New York, 2006).

    MATH  Google Scholar 

  13. L. V. Adrianova, Introduction to Linear Systems of Differential Equations (American Mathematical Society, Providence, 1995; St.-Peterb. Univ., St.-Petersburg, 1992).

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to E. S. Palamarchuk.

Additional information

Original Russian Text © E.S. Palamarchuk, 2015, published in Matematicheskoe Modelirovanie, 2015, Vol. 27, No. 1, pp. 3–15.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Palamarchuk, E.S. Stabilization of linear stochastic systems with a discount: Modeling and estimation of the long-term effects from the application of optimal control strategies. Math Models Comput Simul 7, 381–388 (2015). https://doi.org/10.1134/S2070048215040080

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S2070048215040080

Keywords

Navigation