Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series
Abstract
Mathematical models play a central role in epidemiology. For example, models unify heterogeneous data into a single framework, suggest experimental designs, and generate hypotheses. Traditional methods based on deterministic assumptions, such as ordinary differential equations (ODE), have been successful in those scenarios. However, noise caused by random variations rather than true differences is an intrinsic feature of the cellular/molecular/social world. Time series data from patients (in the case of clinical science) or number of infections (in the case of epidemics) can vary due to both intrinsic differences or incidental fluctuations. The use of traditional fitting methods for ODEs applied to noisy problems implies that deviation from some trend can only be due to error or parametric heterogeneity, that is noise can be wrongly classified as parametric heterogeneity. This leads to unstable predictions and potentially misguided policies or research programs. In this paper, we quantify the ability of ODEs under different hypotheses (fixed or random effects) to capture individual differences in the underlying data. We explore a simple (exactly solvable) example displaying an initial exponential growth by comparing state-of-the-art stochastic fitting and traditional least squares approximations. We also provide a potential approach for determining the limitations and risks of traditional fittingmore »
- Authors:
-
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
- Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. de Lisboa, Lisbon (Portugal)
- Univ. Pontificia Comillas, Madrid (Spain); Unic. of Leeds, Leeds (United Kingdom)
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA); National Institutes of Health (NIH)
- OSTI Identifier:
- 1557747
- Report Number(s):
- LA-UR-18-28685; LA-UR-19-30215
Journal ID: ISSN 1664-302X
- Grant/Contract Number:
- 89233218CNA000001; R01-AI087520; R01-AI104373; FIS2013-47949-C2-2-P; FIS2016-78883-C2-2-P
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Frontiers in Microbiology
- Additional Journal Information:
- Journal Volume: 9; Journal ID: ISSN 1664-302X
- Publisher:
- Frontiers Research Foundation
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 59 BASIC BIOLOGICAL SCIENCES; Biological Science; stochastic; deterministic; epidemiology; panel data; random effects; fixed effects
Citation Formats
Romero-Severson, Ethan, Ribeiro, Ruy Miguel, and Castro Ponce, Mario. Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series. United States: N. p., 2018.
Web. doi:10.3389/fmicb.2018.01529.
Romero-Severson, Ethan, Ribeiro, Ruy Miguel, & Castro Ponce, Mario. Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series. United States. https://doi.org/10.3389/fmicb.2018.01529
Romero-Severson, Ethan, Ribeiro, Ruy Miguel, and Castro Ponce, Mario. Thu .
"Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series". United States. https://doi.org/10.3389/fmicb.2018.01529. https://www.osti.gov/servlets/purl/1557747.
@article{osti_1557747,
title = {Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series},
author = {Romero-Severson, Ethan and Ribeiro, Ruy Miguel and Castro Ponce, Mario},
abstractNote = {Mathematical models play a central role in epidemiology. For example, models unify heterogeneous data into a single framework, suggest experimental designs, and generate hypotheses. Traditional methods based on deterministic assumptions, such as ordinary differential equations (ODE), have been successful in those scenarios. However, noise caused by random variations rather than true differences is an intrinsic feature of the cellular/molecular/social world. Time series data from patients (in the case of clinical science) or number of infections (in the case of epidemics) can vary due to both intrinsic differences or incidental fluctuations. The use of traditional fitting methods for ODEs applied to noisy problems implies that deviation from some trend can only be due to error or parametric heterogeneity, that is noise can be wrongly classified as parametric heterogeneity. This leads to unstable predictions and potentially misguided policies or research programs. In this paper, we quantify the ability of ODEs under different hypotheses (fixed or random effects) to capture individual differences in the underlying data. We explore a simple (exactly solvable) example displaying an initial exponential growth by comparing state-of-the-art stochastic fitting and traditional least squares approximations. We also provide a potential approach for determining the limitations and risks of traditional fitting methodologies. Finally, we discuss the implications of our results for the interpretation of data from the 2014-2015 Ebola epidemic in Africa.},
doi = {10.3389/fmicb.2018.01529},
journal = {Frontiers in Microbiology},
number = ,
volume = 9,
place = {United States},
year = {Thu Jul 12 00:00:00 EDT 2018},
month = {Thu Jul 12 00:00:00 EDT 2018}
}
Web of Science
Works referenced in this record:
The basic reproductive number of Ebola and the effects of public health measures: the cases of Congo and Uganda
journal, July 2004
- Chowell, G.; Hengartner, N. W.; Castillo-Chavez, C.
- Journal of Theoretical Biology, Vol. 229, Issue 1
Integrated Mapping of Establishment Risk for Emerging Vector-Borne Infections: A Case Study of Canine Leishmaniasis in Southwest France
journal, August 2011
- Hartemink, Nienke; Vanwambeke, Sophie O.; Heesterbeek, Hans
- PLoS ONE, Vol. 6, Issue 8
An excitable gene regulatory circuit induces transient cellular differentiation
journal, March 2006
- Süel, Gürol M.; Garcia-Ojalvo, Jordi; Liberman, Louisa M.
- Nature, Vol. 440, Issue 7083
Measuring the impact of Ebola control measures in Sierra Leone
journal, October 2015
- Kucharski, Adam J.; Camacho, Anton; Flasche, Stefan
- Proceedings of the National Academy of Sciences, Vol. 112, Issue 46
HIV-1 Dynamics in Vivo: Virion Clearance Rate, Infected Cell Life-Span, and Viral Generation Time
journal, March 1996
- Perelson, A. S.; Neumann, A. U.; Markowitz, M.
- Science, Vol. 271, Issue 5255
The estimation of the basic reproduction number for infectious diseases
journal, March 1993
- Dietz, K.
- Statistical Methods in Medical Research, Vol. 2, Issue 1
Heterogeneity in District-Level Transmission of Ebola Virus Disease during the 2013-2015 Epidemic in West Africa
journal, July 2016
- Krauer, Fabienne; Gsteiger, Sandro; Low, Nicola
- PLOS Neglected Tropical Diseases, Vol. 10, Issue 7
Dynamic Variation in Sexual Contact Rates in a Cohort of HIV-Negative Gay Men
journal, May 2015
- Romero-Severson, E. O.; Volz, E.; Koopman, J. S.
- American Journal of Epidemiology, Vol. 182, Issue 3
Nine challenges for deterministic epidemic models
journal, March 2015
- Roberts, Mick; Andreasen, Viggo; Lloyd, Alun
- Epidemics, Vol. 10
Avoidable errors in the modelling of outbreaks of emerging pathogens, with special reference to Ebola
journal, May 2015
- King, Aaron A.; Domenech de Cellès, Matthieu; Magpantay, Felicia M. G.
- Proceedings of the Royal Society B: Biological Sciences, Vol. 282, Issue 1806
Statistical Inference for Partially Observed Markov Processes via the R Package pomp
journal, January 2016
- King, Aaron A.; Nguyen, Dao; Ionides, Edward L.
- Journal of Statistical Software, Vol. 69, Issue 12
Stochastic models of intracellular transport
journal, January 2013
- Bressloff, Paul C.; Newby, Jay M.
- Reviews of Modern Physics, Vol. 85, Issue 1
Estimation of the Initial Viral Growth Rate and Basic Reproductive Number during Acute HIV-1 Infection
journal, March 2010
- Ribeiro, R. M.; Qin, L.; Chavez, L. L.
- Journal of Virology, Vol. 84, Issue 12
Timing and Order of Transmission Events Is Not Directly Reflected in a Pathogen Phylogeny
journal, May 2014
- Romero-Severson, Ethan; Skar, Helena; Bulla, Ingo
- Molecular Biology and Evolution, Vol. 31, Issue 9
Strong Inference in Mathematical Modeling: A Method for Robust Science in the Twenty-First Century
journal, July 2016
- Ganusov, Vitaly V.
- Frontiers in Microbiology, Vol. 7
Perspectives on the basic reproductive ratio
journal, May 2005
- Heffernan, J. M.; Smith, R. J.; Wahl, L. M.
- Journal of The Royal Society Interface, Vol. 2, Issue 4
Estimating the Reproduction Number of Ebola Virus (EBOV) During the 2014 Outbreak in West Africa
journal, January 2014
- Althaus, Christian L.
- PLoS Currents
An Introduction to Stochastic Processes with Applications to Biology
book, December 2010
- Allen, Linda J. S.
Estimating the Reproduction Number of Ebola Virus (EBOV) During the 2014 Outbreak in West Africa
text, January 2014
- Althaus, Christian L.
- Public Library of Science
Heterogeneity in District-Level Transmission of Ebola Virus Disease during the 2013-2015 Epidemic in West Africa.
text, January 2016
- Low, Nicola; Krauer, Fabienne; Althaus, Christian L.
- Public Library of Science
Avoidable errors in the modeling of outbreaks of emerging pathogens, with special reference to Ebola
text, January 2014
- King, Aaron A.; de Cellès, Matthieu Domenech; Magpantay, Felicia M. G.
- arXiv
The basic reproductive number of Ebola and the effects of public health measures: the cases of Congo and Uganda
journal, July 2004
- Chowell, G.; Hengartner, N. W.; Castillo-Chavez, C.
- Journal of Theoretical Biology, Vol. 229, Issue 1
An excitable gene regulatory circuit induces transient cellular differentiation
journal, March 2006
- Süel, Gürol M.; Garcia-Ojalvo, Jordi; Liberman, Louisa M.
- Nature, Vol. 440, Issue 7083
Impact of bed capacity on spatiotemporal shifts in Ebola transmission
journal, October 2015
- Townsend, Jeffrey P.; Skrip, Laura A.; Galvani, Alison P.
- Proceedings of the National Academy of Sciences, Vol. 112, Issue 46
Timing and Order of Transmission Events Is Not Directly Reflected in a Pathogen Phylogeny
journal, May 2014
- Romero-Severson, Ethan; Skar, Helena; Bulla, Ingo
- Molecular Biology and Evolution, Vol. 31, Issue 9
Practical Solutions for Healthcare Worker Protection During the COVID-19 Pandemic Response in the Ambulatory, Emergency, and Inpatient Settings
journal, August 2020
- Kraus, Anthony; Awoniyi, Oluwafunbi; AlMalki, Yousef
- Journal of Occupational & Environmental Medicine, Vol. 62, Issue 11
HIV-1 Dynamics in Vivo: Virion Clearance Rate, Infected Cell Life-Span, and Viral Generation Time
journal, March 1996
- Perelson, A. S.; Neumann, A. U.; Markowitz, M.
- Science, Vol. 271, Issue 5255
The estimation of the basic reproduction number for infectious diseases
journal, March 1993
- Dietz, K.
- Statistical Methods in Medical Research, Vol. 2, Issue 1
Integrated Mapping of Establishment Risk for Emerging Vector-Borne Infections: A Case Study of Canine Leishmaniasis in Southwest France
journal, August 2011
- Hartemink, Nienke; Vanwambeke, Sophie O.; Heesterbeek, Hans
- PLoS ONE, Vol. 6, Issue 8
Statistical Inference for Partially Observed Markov Processes via the R Package pomp
journal, January 2016
- King, Aaron A.; Nguyen, Dao; Ionides, Edward L.
- Journal of Statistical Software, Vol. 69, Issue 12
Avoidable errors in the modeling of outbreaks of emerging pathogens, with special reference to Ebola
text, January 2014
- King, Aaron A.; de Cellès, Matthieu Domenech; Magpantay, Felicia M. G.
- arXiv
Works referencing / citing this record:
High Contagiousness and Rapid Spread of Severe Acute Respiratory Syndrome Coronavirus 2
journal, July 2020
- Sanche, Steven; Lin, Yen Ting; Xu, Chonggang
- Emerging Infectious Diseases, Vol. 26, Issue 7