Skip to content
BY 4.0 license Open Access Published by De Gruyter Open Access December 17, 2020

From ODE to Open Markov Chains, via SDE: an application to models for infections in individuals and populations

  • Manuel L. Esquível , Paula Patrício and Gracinda R. Guerreiro

Abstract

We present a methodology to connect an ordinary differential equation (ODE) model of interacting entities at the individual level, to an open Markov chain (OMC) model of a population of such individuals, via a stochastic differential equation (SDE) intermediate model. The ODE model here presented is formulated as a dynamic change between two regimes; one regime is of mean reverting type and the other is of inverse logistic type. For the general purpose of defining an OMC model for a population of individuals, we associate an Ito processes, in the form of SDE to ODE system of equations, by means of the addition of Gaussian noise terms which may be thought to model non essential characteristics of the phenomena with small and undifferentiated influences. The next step consists on discretizing the SDE and using the discretized trajectories computed by simulation to define transitions of a finite valued Markov chain; for that, the state space of the Ito processes is partitioned according to some rule. For the example proposed for illustration, the state space of the ODE system referred – corresponding to a model of a viral infection – is partitioned into six infection classes determined by some of the critical points of the ODE system; we detail the evolution of some infected population in these infection classes.

MSC 2010: 92D30; 92B99; 60J20; 60J70

References

[1] Jose G. Castro, Gabriel Manzi, Luis Espinoza, Michael Campos, and Catherine Boulanger. Concurrent pcp and tb pneumonia in hiv infected patients. Scandinavian Journal of Infectious Diseases, 39(11-12):1054–1058, 2007.10.1080/00365540701472056Search in Google Scholar

[2] A.D.D. Craik and H. Okamoto. A three-dimensional autonomous system with unbounded ‘bending’ solutions. Physica D, 164(3-4):168–186, 2002.10.1016/S0167-2789(02)00372-XSearch in Google Scholar

[3] S. Debroy and M. Martcheva. Immuno-epidemiology and hiv/aids: A modeling prospective. In L.B. Wilson, editor, Mathematical Biology Research Trends, chapter 6, pages 175–192. Nova Science Publishers, New York, 2008.Search in Google Scholar

[4] Susanne Ditlevsen, Kay-Pong Yip, and Niels-Henrik Holstein-Rathlou. Parameter estimation in a stochastic model of the tubuloglomerular feedback mechanism in a rat nephron. Mathematical Biosciences, 194(1):49 – 69, 2005.10.1016/j.mbs.2004.12.007Search in Google Scholar

[5] Sophie Donnet and Adeline Samson. A review on estimation of stochastic differential equations for pharmacokinetic/pharmacodynamic models. Advanced Drug Delivery Reviews, 65(7):929 – 939, 2013. Mathematical modeling of systems pharmacogenomics towards personalized drug delivery.10.1016/j.addr.2013.03.005Search in Google Scholar

[6] A.M. Elaiw. Global properties of a class of hiv models. Nonlinear Analysis: Real World Applications, 11(4):2253 – 2263, 2010.10.1016/j.nonrwa.2009.07.001Search in Google Scholar

[7] Manuel L. Esquível, José M. Fernandes, and Gracinda R. Guerreiro. On the evolution and asymptotic analysis of open Markov populations: application to consumption credit. Stoch. Models, 30(3):365–389, 2014.Search in Google Scholar

[8] M.L. Esquível, G.R. Guerreiro, and J.M. Fernandes. Open Markov chain scheme models. REVSTAT, 15(2):277–297, 2017.Search in Google Scholar

[9] L. Ferrante, S. Bompadre, L. Leone, and M. P. Montanari. A stochastic formulation of the gompertzian growth model for in vitro bactericidal kinetics: Parameter estimation and extinction probability. Biometrical Journal, 47(3):309–318, 2005.Search in Google Scholar

[10] Michael A. Gilchrist and Akira Sasaki. Modeling host–parasite coevolution: A nested approach based on mechanistic models. Journal of Theoretical Biology, 218(3):289 – 308, 2002.Search in Google Scholar

[11] A. F. Gribov, I. K. Volkov, and A. P. Krishchenko. Qualitative analysis of a three-dimensional population evolution model with possible nonequilibrium size preservation. Computational Mathematics and Modeling, 11(2):119–134, Apr 2000.10.1007/BF02359179Search in Google Scholar

[12] Gracinda Rita Guerreiro and Jo ao Tiago Mexia. Stochastic vortices in periodically reclassified populations. Discuss. Math., Probab. Stat., 28(2):209–227, 2008.10.7151/dmps.1101Search in Google Scholar

[13] Gracinda Rita Guerreiro, João Tiago Mexia, and Maria de Fátima Miguens. Statistical approach for open bonus malus. ASTIN Bulletin, 44(1):63–83, 2014.10.1017/asb.2013.26Search in Google Scholar

[14] Barbara Hellriegel. Immunoepidemiology – bridging the gap between immunology and epidemiology. Trends in Parasitology, 17(2):102 – 106, 2001.10.1016/S1471-4922(00)01767-0Search in Google Scholar

[15] Radu Herbei, Rajib Paul, and L. Mark Berliner. Applying diffusion-based Markov chain Monte Carlo. PLOS ONE, 12(3):1–14, 03 2017.10.1371/journal.pone.0173453Search in Google Scholar PubMed PubMed Central

[16] AVM Herz, S Bonhoeffer, RM Anderson, RM May, and MA Nowak. Viral dynamics in vivo: Limitations on estimates of intracellular delay and virus decay. Proceedings of the National Academy of Sciences of the USA, 93(14):7247–7251, JUL 9 1996.10.1073/pnas.93.14.7247Search in Google Scholar PubMed PubMed Central

[17] Thorsten Hüls and Christian Pötzsche. Qualitative analysis of a nonautonomous Beverton-Holt Ricker model. SIAM J. Appl. Dyn. Syst., 13(4):1442–1488, 2014.10.1137/140955434Search in Google Scholar

[18] João Sollari Lopes, Paula Rodrigues, Suani TR Pinho, Roberto FS Andrade, Raquel Duarte, and M. Gabriela M. Gomes. Interpreting measures of tuberculosis transmission: a case study on the portuguese population. BMC Infectious Diseases, 14(1):340, Jun 2014.10.1186/1471-2334-14-340Search in Google Scholar PubMed PubMed Central

[19] Jonathan C. Mattingly, Andrew M. Stuart, and M. V. Tretyakov. Convergence of numerical time-averaging and stationary measures via Poisson equations. SIAM Journal on Numerical Analysis, 48(2):552–577, 2010.10.1137/090770527Search in Google Scholar

[20] Yuliia Mishura, S.V. Posashkova, and Georgiy Shevchenko. Properties of solutions of stochastic differential equations with nonhomogeneous coefficients and non-lipschitz diffusion. Theor. Probability and Math. Statist. (Teoriya Jmovirnostej ta Matematychna Statystyka), 79:117–126, 12 2009.10.1090/S0094-9000-09-00774-1Search in Google Scholar

[21] Yuliia Mishura and Svitlana V. Posashkova. Positivity of solution of nonhomogeneous stochastic differential equation with non-lipschitz diffusion. Theory of Stochastic Processes, 14(3-4):77–88, 2008.Search in Google Scholar

[22] MA Nowak, RM May, RE Phillips, S Rowlandjones, DG Lalloo, S Mcadam, P Klenerman, B Koppe, K Sigmund, CRM Bangham, and AJ Mcmichael. Antigenic Oscillations and Shifting Immunodominance in HIV-1 Infections. Nature, 375(6532):606–611, JUN 15 1995.10.1038/375606a0Search in Google Scholar PubMed

[23] Alan S. Perelson, Avidan U. Neumann, Martin Markowitz, John M. Leonard, and David D. Ho. Hiv-1 dynamics in vivo: Virion clearance rate, infected cell life-span, and viral generation time. Science, 271(5255):1582–1586, 1996.Search in Google Scholar

[24] Lawrence Perko. Differential equations and dynamical systems. 3rd ed. New York, NY: Springer, 3rd ed. edition, 2001.10.1007/978-1-4613-0003-8Search in Google Scholar

[25] Umberto Picchini, Susanne Ditlevsen, and Andrea De Gaetano. Modeling the euglycemic hyperinsulinemic clamp by stochastic differential equations. Journal of Mathematical Biology, 53(5):771–796, Nov 2006.10.1007/s00285-006-0032-zSearch in Google Scholar PubMed

[26] Elizabeth L. Read, Allison A. Tovo-Dwyer, and Arup K. Chakraborty. Stochastic effects are important in intrahost hiv evolution even when viral loads are high. Proceedings of the National Academy of Sciences, 109(48):19727–19732, 2012.10.1073/pnas.1206940109Search in Google Scholar PubMed PubMed Central

[27] Roland R. Regoes, Dominik Wodarz, and Martin A. Nowak. Virus dynamics: the effect of target cell limitation and immune responses on virus evolution. Journal of Theoretical Biology, 191(4):451 – 462, 1998.Search in Google Scholar

[28] Sidney I. Resnick. Adventures in stochastic processes. Boston, MA: Birkhäuser, 1992.Search in Google Scholar

[29] Gareth O. Roberts and Richard L. Tweedie. Exponential convergence of langevin distributions and their discrete approximations. Bernoulli, 2(4):341–363, 12 1996.10.2307/3318418Search in Google Scholar

[30] James R. Schott. Matrix analysis for statistics. 3rd edition. Hoboken, NJ: John Wiley & Sons, 3rd edition edition, 2017.Search in Google Scholar

[31] T. Shardlow and A. M. Stuart. A perturbation theory for ergodic markov chains and application to numerical approximations. SIAM Journal on Numerical Analysis, 37(4):1120–1137, 2000.10.1137/S0036142998337235Search in Google Scholar

[32] Hal L. Smith and Patrick De Leenheer. Virus dynamics: A global analysis. SIAM Journal on Applied Mathematics, 63(4):1313–1327, 2003.Search in Google Scholar

[33] Denis Talay. Second-order discretization schemes of stochastic differential systems for the computation of the invariant law. Stochastics and Stochastic Reports, 29(1):13–36, 1990.10.1080/17442509008833606Search in Google Scholar

[34] Christoffer W. Tornøe, Judith L. Jacobsen, Oluf Pedersen, Torben Hansen, and Henrik Madsen. Grey-box modelling of pharmacokinetic /pharmacodynamic systems. Journal of Pharmacokinetics and Pharmacodynamics, 31(5):401–417, Oct 2004.10.1007/s10928-004-8323-8Search in Google Scholar PubMed

[35] Christoffer Wenzel Tornøe, Judith L. Jacobsen, and Henrik Madsen. Grey-box pharmacokinetic/pharmacodynamic modelling of a euglycaemic clamp study. Journal of Mathematical Biology, 48(6):591–604, Jun 2004.10.1007/s00285-003-0257-zSearch in Google Scholar PubMed

Received: 2020-06-14
Accepted: 2020-11-25
Published Online: 2020-12-17

© 2020 Manuel L. Esquível et al., published by De Gruyter

This work is licensed under the Creative Commons Attribution 4.0 International License.

Downloaded on 28.3.2024 from https://www.degruyter.com/document/doi/10.1515/cmb-2020-0110/html
Scroll to top button