DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series

Abstract

Mathematical models play a central role in epidemiology. For example, models unify heterogeneous data into a single framework, suggest experimental designs, and generate hypotheses. Traditional methods based on deterministic assumptions, such as ordinary differential equations (ODE), have been successful in those scenarios. However, noise caused by random variations rather than true differences is an intrinsic feature of the cellular/molecular/social world. Time series data from patients (in the case of clinical science) or number of infections (in the case of epidemics) can vary due to both intrinsic differences or incidental fluctuations. The use of traditional fitting methods for ODEs applied to noisy problems implies that deviation from some trend can only be due to error or parametric heterogeneity, that is noise can be wrongly classified as parametric heterogeneity. This leads to unstable predictions and potentially misguided policies or research programs. In this paper, we quantify the ability of ODEs under different hypotheses (fixed or random effects) to capture individual differences in the underlying data. We explore a simple (exactly solvable) example displaying an initial exponential growth by comparing state-of-the-art stochastic fitting and traditional least squares approximations. We also provide a potential approach for determining the limitations and risks of traditional fittingmore » methodologies. Finally, we discuss the implications of our results for the interpretation of data from the 2014-2015 Ebola epidemic in Africa.« less

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3]
  1. Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
  2. Los Alamos National Lab. (LANL), Los Alamos, NM (United States); Univ. de Lisboa, Lisbon (Portugal)
  3. Univ. Pontificia Comillas, Madrid (Spain); Unic. of Leeds, Leeds (United Kingdom)
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA); National Institutes of Health (NIH)
OSTI Identifier:
1557747
Report Number(s):
LA-UR-18-28685; LA-UR-19-30215
Journal ID: ISSN 1664-302X
Grant/Contract Number:  
89233218CNA000001; R01-AI087520; R01-AI104373; FIS2013-47949-C2-2-P; FIS2016-78883-C2-2-P
Resource Type:
Accepted Manuscript
Journal Name:
Frontiers in Microbiology
Additional Journal Information:
Journal Volume: 9; Journal ID: ISSN 1664-302X
Publisher:
Frontiers Research Foundation
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES; Biological Science; stochastic; deterministic; epidemiology; panel data; random effects; fixed effects

Citation Formats

Romero-Severson, Ethan, Ribeiro, Ruy Miguel, and Castro Ponce, Mario. Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series. United States: N. p., 2018. Web. doi:10.3389/fmicb.2018.01529.
Romero-Severson, Ethan, Ribeiro, Ruy Miguel, & Castro Ponce, Mario. Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series. United States. https://doi.org/10.3389/fmicb.2018.01529
Romero-Severson, Ethan, Ribeiro, Ruy Miguel, and Castro Ponce, Mario. Thu . "Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series". United States. https://doi.org/10.3389/fmicb.2018.01529. https://www.osti.gov/servlets/purl/1557747.
@article{osti_1557747,
title = {Noise Is Not Error: Detecting Parametric Heterogeneity Between Epidemiologic Time Series},
author = {Romero-Severson, Ethan and Ribeiro, Ruy Miguel and Castro Ponce, Mario},
abstractNote = {Mathematical models play a central role in epidemiology. For example, models unify heterogeneous data into a single framework, suggest experimental designs, and generate hypotheses. Traditional methods based on deterministic assumptions, such as ordinary differential equations (ODE), have been successful in those scenarios. However, noise caused by random variations rather than true differences is an intrinsic feature of the cellular/molecular/social world. Time series data from patients (in the case of clinical science) or number of infections (in the case of epidemics) can vary due to both intrinsic differences or incidental fluctuations. The use of traditional fitting methods for ODEs applied to noisy problems implies that deviation from some trend can only be due to error or parametric heterogeneity, that is noise can be wrongly classified as parametric heterogeneity. This leads to unstable predictions and potentially misguided policies or research programs. In this paper, we quantify the ability of ODEs under different hypotheses (fixed or random effects) to capture individual differences in the underlying data. We explore a simple (exactly solvable) example displaying an initial exponential growth by comparing state-of-the-art stochastic fitting and traditional least squares approximations. We also provide a potential approach for determining the limitations and risks of traditional fitting methodologies. Finally, we discuss the implications of our results for the interpretation of data from the 2014-2015 Ebola epidemic in Africa.},
doi = {10.3389/fmicb.2018.01529},
journal = {Frontiers in Microbiology},
number = ,
volume = 9,
place = {United States},
year = {Thu Jul 12 00:00:00 EDT 2018},
month = {Thu Jul 12 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

The basic reproductive number of Ebola and the effects of public health measures: the cases of Congo and Uganda
journal, July 2004

  • Chowell, G.; Hengartner, N. W.; Castillo-Chavez, C.
  • Journal of Theoretical Biology, Vol. 229, Issue 1
  • DOI: 10.1016/j.jtbi.2004.03.006

Integrated Mapping of Establishment Risk for Emerging Vector-Borne Infections: A Case Study of Canine Leishmaniasis in Southwest France
journal, August 2011


An excitable gene regulatory circuit induces transient cellular differentiation
journal, March 2006

  • Süel, Gürol M.; Garcia-Ojalvo, Jordi; Liberman, Louisa M.
  • Nature, Vol. 440, Issue 7083
  • DOI: 10.1038/nature04588

Measuring the impact of Ebola control measures in Sierra Leone
journal, October 2015

  • Kucharski, Adam J.; Camacho, Anton; Flasche, Stefan
  • Proceedings of the National Academy of Sciences, Vol. 112, Issue 46
  • DOI: 10.1073/pnas.1508814112

HIV-1 Dynamics in Vivo: Virion Clearance Rate, Infected Cell Life-Span, and Viral Generation Time
journal, March 1996


The estimation of the basic reproduction number for infectious diseases
journal, March 1993


Heterogeneity in District-Level Transmission of Ebola Virus Disease during the 2013-2015 Epidemic in West Africa
journal, July 2016


Dynamic Variation in Sexual Contact Rates in a Cohort of HIV-Negative Gay Men
journal, May 2015

  • Romero-Severson, E. O.; Volz, E.; Koopman, J. S.
  • American Journal of Epidemiology, Vol. 182, Issue 3
  • DOI: 10.1093/aje/kwv044

Nine challenges for deterministic epidemic models
journal, March 2015


Avoidable errors in the modelling of outbreaks of emerging pathogens, with special reference to Ebola
journal, May 2015

  • King, Aaron A.; Domenech de Cellès, Matthieu; Magpantay, Felicia M. G.
  • Proceedings of the Royal Society B: Biological Sciences, Vol. 282, Issue 1806
  • DOI: 10.1098/rspb.2015.0347

Statistical Inference for Partially Observed Markov Processes via the R Package pomp
journal, January 2016

  • King, Aaron A.; Nguyen, Dao; Ionides, Edward L.
  • Journal of Statistical Software, Vol. 69, Issue 12
  • DOI: 10.18637/jss.v069.i12

Stochastic models of intracellular transport
journal, January 2013


Estimation of the Initial Viral Growth Rate and Basic Reproductive Number during Acute HIV-1 Infection
journal, March 2010

  • Ribeiro, R. M.; Qin, L.; Chavez, L. L.
  • Journal of Virology, Vol. 84, Issue 12
  • DOI: 10.1128/JVI.00127-10

Timing and Order of Transmission Events Is Not Directly Reflected in a Pathogen Phylogeny
journal, May 2014

  • Romero-Severson, Ethan; Skar, Helena; Bulla, Ingo
  • Molecular Biology and Evolution, Vol. 31, Issue 9
  • DOI: 10.1093/molbev/msu179

Perspectives on the basic reproductive ratio
journal, May 2005

  • Heffernan, J. M.; Smith, R. J.; Wahl, L. M.
  • Journal of The Royal Society Interface, Vol. 2, Issue 4
  • DOI: 10.1098/rsif.2005.0042

Heterogeneity in District-Level Transmission of Ebola Virus Disease during the 2013-2015 Epidemic in West Africa.
text, January 2016

  • Low, Nicola; Krauer, Fabienne; Althaus, Christian L.
  • Public Library of Science
  • DOI: 10.7892/boris.85608

Avoidable errors in the modeling of outbreaks of emerging pathogens, with special reference to Ebola
text, January 2014


The basic reproductive number of Ebola and the effects of public health measures: the cases of Congo and Uganda
journal, July 2004

  • Chowell, G.; Hengartner, N. W.; Castillo-Chavez, C.
  • Journal of Theoretical Biology, Vol. 229, Issue 1
  • DOI: 10.1016/j.jtbi.2004.03.006

An excitable gene regulatory circuit induces transient cellular differentiation
journal, March 2006

  • Süel, Gürol M.; Garcia-Ojalvo, Jordi; Liberman, Louisa M.
  • Nature, Vol. 440, Issue 7083
  • DOI: 10.1038/nature04588

Impact of bed capacity on spatiotemporal shifts in Ebola transmission
journal, October 2015

  • Townsend, Jeffrey P.; Skrip, Laura A.; Galvani, Alison P.
  • Proceedings of the National Academy of Sciences, Vol. 112, Issue 46
  • DOI: 10.1073/pnas.1518484112

Timing and Order of Transmission Events Is Not Directly Reflected in a Pathogen Phylogeny
journal, May 2014

  • Romero-Severson, Ethan; Skar, Helena; Bulla, Ingo
  • Molecular Biology and Evolution, Vol. 31, Issue 9
  • DOI: 10.1093/molbev/msu179

Practical Solutions for Healthcare Worker Protection During the COVID-19 Pandemic Response in the Ambulatory, Emergency, and Inpatient Settings
journal, August 2020

  • Kraus, Anthony; Awoniyi, Oluwafunbi; AlMalki, Yousef
  • Journal of Occupational & Environmental Medicine, Vol. 62, Issue 11
  • DOI: 10.1097/jom.0000000000002008

HIV-1 Dynamics in Vivo: Virion Clearance Rate, Infected Cell Life-Span, and Viral Generation Time
journal, March 1996


The estimation of the basic reproduction number for infectious diseases
journal, March 1993


Integrated Mapping of Establishment Risk for Emerging Vector-Borne Infections: A Case Study of Canine Leishmaniasis in Southwest France
journal, August 2011


Statistical Inference for Partially Observed Markov Processes via the R Package pomp
journal, January 2016

  • King, Aaron A.; Nguyen, Dao; Ionides, Edward L.
  • Journal of Statistical Software, Vol. 69, Issue 12
  • DOI: 10.18637/jss.v069.i12

Avoidable errors in the modeling of outbreaks of emerging pathogens, with special reference to Ebola
text, January 2014


Works referencing / citing this record:

High Contagiousness and Rapid Spread of Severe Acute Respiratory Syndrome Coronavirus 2
journal, July 2020

  • Sanche, Steven; Lin, Yen Ting; Xu, Chonggang
  • Emerging Infectious Diseases, Vol. 26, Issue 7
  • DOI: 10.3201/eid2607.200282