A DETERMINISTIC METHODOLOGY FOR ESTIMATION OF PARAMETERS IN DYNAMIC MARKOV CHAIN MODELS
Abstract
A method for estimating parameters in dynamic stochastic (Markov Chain) models based on Kurtz's limit theory coupled with inverse problem methods developed for deterministic dynamical systems is proposed and illustrated in the context of disease dynamics. This methodology relies on finding an approximate large-population behavior of an appropriate scaled stochastic system. The approach leads to a deterministic approximation obtained as solutions of rate equations (ordinary differential equations) in terms of the large sample size average over sample paths or trajectories (limits of pure jump Markov processes). Using the resulting deterministic model, we select parameter subset combinations that can be estimated using an ordinary-least-squares (OLS) or generalized-least-squares (GLS) inverse problem formulation with a given data set. The selection is based on two criteria of the sensitivity matrix: the degree of sensitivity measured in the form of its condition number and the degree of uncertainty measured in the form of its parameter selection score. We illustrate the ideas with a stochastic model for the transmission of vancomycin-resistant enterococcus (VRE) in hospitals and VRE surveillance data from an oncology unit.
References
-
F. Brauer and C. Castillo-Chavez , Mathematical Models in Population Biology and Epidemiology ,Texts in Applied Mathematics 40 ( Springer-Verlag , New York , 2001 ) . Crossref, Google Scholar -
F. Brauer , Mathematical Epidemiology ( Springer-Verlag , New York , 2008 ) . Crossref, Google Scholar - Inf. Control Hosp. Epidemiol. 27, 271 (2002). Web of Science, Google Scholar
- Castillo-Chavez C., Chow K. C., Wang X., A mathematical model of nosocomial infection and antibiotic resistance: evaluating the efficacy of antimicrobial cycling programs and patient isolation on dual resistance, Mathematical and Theoretical Biology Institute Technical Reports, MTBI-04-05M, Arizonia State University, 2007 . Google Scholar
- J. Theor. Biol. 224, 1 (2003), DOI: 10.1016/S0022-5193(03)00228-5. Crossref, Web of Science, Google Scholar
-
B. Grenfell and A. Dobson , Ecology of Infectious Diseases in Natural Populations ( Cambridge University Press , Cambridge , 1995 ) . Crossref, Google Scholar - Annals Internal Med. 131, 269 (1999). Crossref, Web of Science, Google Scholar
-
H. Andersson and T. Britton , Stochastic Epidemic Models and Their Statisticsal Analysis ,Lec. Notes in Statistics 51 ( Springer-Verlag , New York , 2000 ) . Crossref, Google Scholar - J. Roy. Statist. Soc. B 61, 287 (1999), DOI: 10.1111/1467-9868.00177. Crossref, Google Scholar
- Biometrics 38, 115 (1982), DOI: 10.2307/2530294. Crossref, Web of Science, Google Scholar
- Biostatistics 10, 390 (2009), DOI: 10.1093/biostatistics/kxn045. Crossref, Web of Science, Google Scholar
- Banks H. T., Davidian M., Samuels J. R., Jr, Sutton K. L., An inverse problem statistical methodology summary, Center for Research in ScientiThc Computatione Technical Report, CRSC-TR08-01, 2008, North Carolina State University, in Mathematical Statistical Estimation Approaches in Epidemiology, Chowell G. et al. (eds.), Springer, New York, 2009, pp. 249–302 . Google Scholar
- Inverse Problems 21, 1803 (2005), DOI: 10.1088/0266-5611/21/6/001. Crossref, Web of Science, Google Scholar
- Math. Biosci. Eng. 4, 373 (2007). Web of Science, Google Scholar
-
S. N. Ethier and T. G. Kurtz , Markov Processes: Characterization and Convergence ( J. Wiley and Sons , New York , 1986 ) . Crossref, Google Scholar - J Applied Prob. 7, 49 (1970), DOI: 10.2307/3212147. Crossref, Web of Science, Google Scholar
- J. Inverse and Ill-Posed Problems 15, 545 (2009). Google Scholar
-
M. Davidian and D. M. Giltinan , Nonlinear Models for Repeated Measurement Data ,Monographs on Statistics and Applied Probability 62 ( Chapman and Hall/CRC Press , Boca Raton, FL , 1995 ) . Google Scholar - Ortiz A. R., Banks H. T., Castillo-Chavez C., Chowell G., Torres-Viera C., Wang X., Modeling the transmission of Vancomycin-resistant enterococcus (VRE) in hospitals: a case study, Center for Research in ScientiThc Computation Technical Report, CRSC- TR10-05, February, 2010, North Carolina State University, Raleigh . Google Scholar
- Proc. Natl. Acad. Sci. USA 96, 6908 (1999), DOI: 10.1073/pnas.96.12.6908. Crossref, Web of Science, Google Scholar
- J. Infect. Diseases 179, 883 (1999), DOI: 10.1086/314682. Crossref, Web of Science, Google Scholar
- Proc. Biol. Sci. 264, 1629 (1997), DOI: 10.1098/rspb.1997.0227. Crossref, Web of Science, Google Scholar
- The Lancet Infectious Diseases 1(5), 314 (2001), DOI: 10.1016/S1473-3099(01)00145-1. Crossref, Google Scholar
- J. Hosp. Infec. 43, 131 (1999), DOI: 10.1053/jhin.1998.0647. Crossref, Web of Science, Google Scholar
- J. Infec. Diseases 185, 766 (2002), DOI: 10.1086/339293. Crossref, Web of Science, Google Scholar
- Proc. Natl. Acad. Sci. USA 97, 1938 (2000), DOI: 10.1073/pnas.97.4.1938. Crossref, Web of Science, Google Scholar
- Amer. J. Infec. Control 37, 734 (2009), DOI: 10.1016/j.ajic.2008.09.025. Crossref, Web of Science, Google Scholar
- Proc. Natl. Acad. Sci. USA 102, 13343 (2005), DOI: 10.1073/pnas.0504053102. Crossref, Web of Science, Google Scholar
-
L. Allen , An Introduction to Stochastic Processes with Applications to Biology ( Pearson Education-Prentice Hall , New Jersey , 2003 ) . Google Scholar -
E. Renshaw , Modeling Biological Populations in Space and Time ( Cambridge Studies in Mathematical Biology (No. 11) , Cambridge , 1991 ) . Crossref, Google Scholar - J Comput. Physics 22, 403 (1976), DOI: 10.1016/0021-9991(76)90041-3. Crossref, Web of Science, Google Scholar
-
G. A. F. Seber and C. J. Wild , Nonlinear Regression ( J. Wiley and Sons , New York , 1989 ) . Crossref, Google Scholar - Ortiz A. R., Banks H. T., Castillo-Chavez C., Chowell G., Torres-Viera C., Wang X., A discrete events delay differential system model for transmission of Vancomycin-resistant enterococcus (VRE) in hospitals, in preparation . Google Scholar
-
G. Chowell (eds.) , Mathematical and Statistical Estimation Approaches in Epidemiology ( Springer , New York , 2009 ) . Crossref, Google Scholar - Math. Biosci. 180, 1 (2002), DOI: 10.1016/S0025-5564(02)00122-0. Crossref, Web of Science, Google Scholar