Skip to main content
Log in

Sensitivity analysis and optimization of stochastic Petri nets

  • Published:
Discrete Event Dynamic Systems Aims and scope Submit manuscript

Abstract

In this paper we define the notion of controlled stochastic Petri net (CSPN), which is a stochastic Petri net with controlled parameters and performance indices. Specifically, transition times and/or conflict resolution rules can depend on controlled parameters and transition times can have arbitrary distribution functions. A method for computing statistical estimates of performance indices and their gradients (sensitivities) with respect to controlled parameters is described. This method, which needs only one simulation of a CSPN, is considerably superior to conventional finite differences both in terms of precision and required amount of simulation and is based on likelihood ratio/score function approach, other possibilities based on extensions of infinitesimal perturbation analysis are outlined. These gradient estimates are used in stochastic optimization algorithms to obtain the optimal value of the aggregated performance function of the CSPN. A combined optimization and simulation tool is developed which includes approaches to the gradient estimation mentioned above. The numerical experiments presented in this paper confirm the efficiency of the proposed techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ajmone Marsan, M., Balbo, G., and Conte, G. 1989. A class of generalized stochastic Petri nets for the performance evaluation of multiprocessing systems.ACM Trans. Comput. Systems. 2, pp. 93–122.

    Google Scholar 

  • Archetti, F., and Sciomachen, A. 1988. Representation, analysis and simulation of manufacturing systems by Petri net based models. InDiscrete Events Systems: Models and Applications (P. Varaya and A.B. Kurzhansky, eds.), Lecture Notes in Control and Information Sciences, New York: Springer-Verlag, pp. 162–178.

    Google Scholar 

  • Archetti, F., and Sciomachen, A. 1989. Numerical evaluation of transient behavior and parametric sensitivity in Petri net based models.Proc. Fourth Int. Conf. CAD, CAM, Robotics and Factory of the Future, IIT Delhi, New Delhi, India (Juneja-Pujara-Sagar, eds.), TATA McGraw-Hill, vol. 2, pp. 557–565.

  • Archetti, F., Sciomachen, A., and Speranza, G. 1989. Evaluation of dispatching rules in a robot handling system.Proc. IEEE Int. Conf. Systems Engineering, Wright State University, Dayton, Ohio, pp. 251–256.

  • Banaszak, Z., and Krogh, B.H. 1990. Deadlock avoidance in flexible manufacturing systems with concurrently competing process flows.IEEE J. Robotics and Automat. Special Issue on Manufacturing Systems.

  • Bonazzi, A. 1989. On the solution of stochastic Petri nets. Technical Report N.UNC/OR/TR-89/16, University of North Carolina at Chapel Hill.

  • Cao, X.R. 1985. Convergence of parameter sensitivity estimates in a stochastic experiment.IEEE Trans. Automat. Control. AC-30, pp. 834–843.

    Google Scholar 

  • Cao, X.R. 1987. First order perturbation analysis of a simple multiclass finite source queue.Perform. Eval. 7, pp. 31–41.

    Google Scholar 

  • Cumani, A. 1985. ESPN—A package of evaluation of stochastic Petri nets with phase type distributed transition times.Proc. Int. Workshop Timed Petri Nets, Torino, Italy.

  • Ermoliev, Yu. 1976.Methods of Stochastic Programming. Moscow: Nauka (in Russian).

    Google Scholar 

  • Ermoliev, Yu., and Gaivoronski, A. 1992. Stochastic programming techniques for optimization of discrete event systems.Ann. Oper. Res. 39.

  • Ermoliev, Yu., and Wets, R.J.-B. 1988.Numerical Techniques for Stochastic Optimization. Berlin: Springer-Verlag.

    Google Scholar 

  • Fishman, G.S. 1978.Principles of Discrete Event Simulation. New York: Wiley.

    Google Scholar 

  • Fu, M.C., and Hu, J.Q. 1991. Smoothed perturbation analysis of general discrete event systems,IEEE Trans. Automat. Control.

  • Gaivoronski, A. 1982. Approximation methods of solution of stochastic programming problems. Cybernetics 18(2).

  • Gaivoronski, A. 1988a. Implementation of stochastic quasigradient methods. InNumerical Techniques for Stochastic Optimization (Yu. Ermoliev and R.J.-B. Wets, eds.), Berlin: Springer-Verlag, pp. 313–352.

    Google Scholar 

  • Gaivoronski, A. 1988b. Interactive program SQG-PC for solving stochastic programming problems on IBM PC/XT/AT compatibles. User Guide. WP-88-11, IIASA, Laxenburg.

  • Gaivoronski, A., Shi, L., and Sreenivas, R.S. 1992. Augmented infinitesimal perturbation analysis: an alternate explanation.J. Discrete Event Dynamic Systems.

  • Glasserman, P. 1991.Gradient Estimation via Perturbation Analysis. Boston: Kluwer.

    Google Scholar 

  • Glasserman, P., and Gong, W.B. 1991. Smoothed perturnation analysis of a class of discrete event systems.IEEE Trans. Automat. Control. AC-35, pp. 1218–1230.

    Google Scholar 

  • Glasserman, P., and Yao, D.D. 1991. Applications of some structural properties in stochastic discrete event systems.Proc. 29th Conf. Decision and Control, pp. 1317–1322.

  • Glynn, P.W. 1986. Optimization of stochastic systems.Proc. 1986 Winter Simulation Conf.

  • Glynn, P.W., and Sanders, J.L. 1986. Monte Carlo optimization of stochastic systems: two new approaches.Proc. ASME Computing and Engineering Conf.

  • Gong, W., Cassandras, C.G., and Pan. J. 1991. Perturbation analysis of a multiclass queueing system with admission control. IEEE Trans. Automat. Control. 36(6).

  • Heidelberger, P., Cao, X.-R., Zazanis, M.A., and Suri, R. 1988. Convergence properties of infinitesimal perturbation analysis est imates.Management Sci. 34(11).

  • Ho, Y.C., ed. 1987a.A Selected and Annotated Bibliography on Perturbation Analysis. Lecture Notes in Control and Information Sciences, vol. 103, New York: Springer-Verlag, pp. 162–178.

    Google Scholar 

  • Ho, Y.C. 1987b. Performance evaluation and perturbation analysis of discrete event dynamic systems.IEEE Trans. Automat. Control. AC-32, pp. 563–572.

    Google Scholar 

  • Ho, Y.C., Eyler, M.A., and Chien, T.T. 1979. A gradient technique for general buffer storage design in serial production line.Int. J. Prod. Res. 17, pp. 557–580.

    Google Scholar 

  • Ho, Y.C., Shi, L. Dai, L., and Gong, W. 1991. Optimizing discrete event dynamic systems via the gradient surface method. Manuscript.

  • Ho, Y.C., and Cao, X.R. 1991.Discrete Event Dynamic Systems and Perturbation Analysis. Boston: Kluwer.

    Google Scholar 

  • Ho, Y.C., Sreenivas, R.S., and Vakili, P. 1992. Ordinal optimization of DEDS.J. Discrete Event Dynamic Systems.

  • Holloway, L.E., and Krogh, B.H. 1990. Synthesis of feedback control logic for a class of controlled Petri nets.IEEE Trans. Automat. Control. 35(5).

  • Kamath, M., and Viswanadham, N. 1986. Applications of Petri net based models in the modeling and analysis of flexible manufacturing systems.Proc. IEEE Conf. Robotics and Automation, San Francisco, CA.

  • Kiefer, J., and Wolfowitz, J. 1952. Stochastic estimation of a maximum of a regression function.Ann. Math. Statist. 23, pp. 462–466.

    Google Scholar 

  • Kushner, H., and Clark, D. 1978. Stochastic approximation for constrained and unconstrained systems.Appl. Math. 26, Springer.

  • Leung, Y.T., and Suri, R. 1990. Finite-time behavior of two simulation optimization algorithms.Proc. Winter Simulation Conf.

  • Molloy, M. 1982. Performance analysis using stochastic Petri nets.IEEE. Trans. Comput. C31, pp. 913–917.

    Google Scholar 

  • Narahari, Y., and Viswanadham, N. 1984. Analysis and synthesis of flexible manufacturing systems using Petri nets.Proc. First ORSA TIMS Conf. Flexible Manufacturing Systems, Ann Arbor, pp. 347–358.

  • Peterson, J.L. 1981.Petri Net Theory and the Modeling of Systems. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Pflug, G. 1987. Derivatives of probability measures: concepts and applications to the optimization of stochastic systems. InDiscrete Events Systems: Models and Applications (P. Varaya and A.B. Kurzhansky, eds.), Lecture Notes in Control and Information Sciences, Berlin: Springer-Verlag.

    Google Scholar 

  • Pflug, G. 1988. On the determination of the step-size in stochastic quasigradient methods. InNumerical Techniques for Stochastic Optimization (Yu. Ermoliev and R.J.-B. Wets, eds.), Berlin: Springer-Verlag.

    Google Scholar 

  • Pflug, G. 1990. Optimization of discrete event systems.Conf. Operation Research, Vienna.

  • Rockafellar, R.T., and Wets, R.J. 1982. On the interchange of subdifferentiation and conditional expectation for convex functionals.Stochastic. 7, pp. 173–182.

    Google Scholar 

  • Rubinstein, R.Y. 1986a. The score function approach of sensitivity analysis of computer simulation models.Math. Comput. Simulation. 28, pp. 351–379.

    Google Scholar 

  • Rubinstein, R.Y. 1986b.Monte Carlo Optimization, Simulation and Sensitivity Analysis of Queueing Networks. New York: Wiley.

    Google Scholar 

  • Schassberger, R. 1977. Insensitivity of steady-state distributions of generalized semi-Markov processes. Part 1.Ann. Probab. 5, pp. 87–99.

    Google Scholar 

  • Sciomachen, A. 1989. A software environment for modelling and simulation of manufacturing system.Proc. Fourth Int. Conf. CAD, CAM, Robotics and Factory of the Future, IIT Delhi, New Delhi, India (Juneja-Pujara-Sagar, eds.), TATA McGraw-Hill, vol. 2, pp. 690–702.

  • Sifakis, J. 1980. Deadlocks and livelocks in transition systems.Math. Foundations Comput. Sci. 88.

  • Suri, R. 1987. Infinitesimal perturbation analysis of general discrete event systems.J. Assoc. Comput. Mach. 34, pp. 686–717.

    Google Scholar 

  • Suri, R. 1989. Perturbation analysis: the state of the art and research issues explained via the GI/G/1 queue.Proc. IEEE Int. Conf. vol. 77, pp. 114–137.

    Google Scholar 

  • Whitt, W. 1980. Continuity of generalized semi-Markov process.Math. Oper. Res. 5, pp. 494–501.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Archetti, F., Gaivoronski, A. & Sciomachen, A. Sensitivity analysis and optimization of stochastic Petri nets. Discrete Event Dyn Syst 3, 5–37 (1993). https://doi.org/10.1007/BF01439175

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01439175

Key Words

Navigation