Abstract
In this paper ergodic control problems (optimal stopping, impulsive control, and stochastic control for singularly perturbed Feller Markov processes) are studied. As the main result the so-called limit control principle is shown to hold in each case. The results obtained depend on the averaging properties of the perturbed system which follow from the fact that the perturbing process does not depend on either the perturbed process or on the control.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bensoussan A, Blankenship GL (1986) Singular perturbations in stochastic control. In: Bensoussan A, Blankenship GL, Kokotovic P (eds) Singular Perturbations and Asymptotic Analysis in Control Systems. Lecture Notes in Control and Information Sciences, vol 90. Springer-Verlag, Berlin, pp 171–260
Bensoussan A, Blankenship GL, Kokotovic P (eds) (1986) Singular Perturbations and Asymptotic Analysis in Control Systems. Lecture Notes in Control and Information Sciences, vol 90. Springer-Verlag, Berlin
Bielecki T, Stettner L (1988) On some problems arising in asymptotic analysis of Markov processes with singularly perturbed generators. Stochastic Anal Appl 6:129–168
Bismut JM (1976) Theorie probabiliste du controle des diffusions. Mem Amer Math Soc 4, no 167
Cox RM (1984) Stationary and discounted control of diffusion processes. Ph.D. thesis, Columbia University
Ikeda N, Watanabe S (1981) Stochastic Differential Equations and Diffusion Processes. North-Holland, Amsterdam
Kogan YuA (1969) On optimal control of a non-terminating diffusion process with reflection. Theory Probab Appl 14:496–502
Koroluk WS, Turbin AF (1978) Mathematical Foundations of Phase Enlargement of Composite Systems. Naukova Dumka, Kiev (in Russian)
Kurtz T (1973) A limit theorem for perturbed operator semigroups with applications to random evolutions. J Funct Anal 12:55–67
Kushner HJ (1978) Optimality conditions for the average cost per unit time problem with a diffusion model. SIAM J Control Optim 16:330–346
Kushner HJ, Runggaldier W (1987) Nearly optimal feedback controls for stochastic systems with wideband noise disturbances. SIAM J Control Optim 25:298–315
Loeve M (1960) Probability Theory, 2nd edn. Van Nostrand, New York
Robin M (1978) Controle impulsionnel de Processus de Markov. Thesis, University of Paris IX
Robin M (1981) On some impulse control problems with long run average cost. SIAM J Control Optim 19:333–358
Robin M (1988) On some perturbations problems in optimal stopping and impulse control. In: Fleming W, Lions PL (eds). IMA, vol 10. Springer-Verlag, New York, pp 473–500
Roxin E (1962) The existence of optimal controls. Michigan Math J 9:109–119
Stettner Ł (1983) On impulsive control with long run average cost Criterion. Studia Math 76:279–298
Stettner Ł (1986) On the existence of an optimal per unit time control for a degenerate diffusion model. Bull Polish Acad Sci Math 34:749–769
Stettner Ł (to appear) On some stopping and impulsive control problems with a general discount rate criteria. Probab Math Statist
Warga J (1972) Optimal Control of Differential and Functional Equations. Academic Press, New York
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bielecki, T., Stettner, Ł. On ergodic control problems for singularly perturbed Markov processes. Appl Math Optim 20, 131–161 (1989). https://doi.org/10.1007/BF01447652
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01447652