DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Addressing delayed case reporting in infectious disease forecast modeling

Abstract

Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always bemore » available. Provided alternatives include excluding recently-reported data and performing sensitivity analysis. This work provides intuition and guidance for handling delay in disease case reporting and may serve as a useful resource to inform practical infectious disease forecasting efforts.« less

Authors:
ORCiD logo; ORCiD logo; ORCiD logo;
Publication Date:
Research Org.:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program; National Institutes of Health/National Institute of General Medical Sciences (NIH/NIGMS)
OSTI Identifier:
1872480
Alternate Identifier(s):
OSTI ID: 1871044; OSTI ID: 1894842
Report Number(s):
LA-UR-21-30640
Journal ID: ISSN 1553-7358; 10.1371/journal.pcbi.1010115
Grant/Contract Number:  
20210761PRD1; 89233218CNA000001; R01GM130668-01
Resource Type:
Published Article
Journal Name:
PLoS Computational Biology (Online)
Additional Journal Information:
Journal Name: PLoS Computational Biology (Online) Journal Volume: 18 Journal Issue: 6; Journal ID: ISSN 1553-7358
Publisher:
Public Library of Science (PLoS)
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES; mathematics; simulation and modeling; infectious diseases; forecasting; influenza

Citation Formats

Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., and Perkins, ed., Alex. Addressing delayed case reporting in infectious disease forecast modeling. United States: N. p., 2022. Web. doi:10.1371/journal.pcbi.1010115.
Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., & Perkins, ed., Alex. Addressing delayed case reporting in infectious disease forecast modeling. United States. https://doi.org/10.1371/journal.pcbi.1010115
Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., and Perkins, ed., Alex. Fri . "Addressing delayed case reporting in infectious disease forecast modeling". United States. https://doi.org/10.1371/journal.pcbi.1010115.
@article{osti_1872480,
title = {Addressing delayed case reporting in infectious disease forecast modeling},
author = {Beesley, Lauren J. and Osthus, Dave and Del Valle, Sara Y. and Perkins, ed., Alex},
abstractNote = {Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always be available. Provided alternatives include excluding recently-reported data and performing sensitivity analysis. This work provides intuition and guidance for handling delay in disease case reporting and may serve as a useful resource to inform practical infectious disease forecasting efforts.},
doi = {10.1371/journal.pcbi.1010115},
journal = {PLoS Computational Biology (Online)},
number = 6,
volume = 18,
place = {United States},
year = {Fri Jun 03 00:00:00 EDT 2022},
month = {Fri Jun 03 00:00:00 EDT 2022}
}

Works referenced in this record:

Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited
journal, February 2019


Measuring underreporting and under-ascertainment in infectious disease datasets: a comparison of methods
journal, February 2014

  • Gibbons, Cheryl L.; Mangen, Marie-Josée J.; Plass, Dietrich
  • BMC Public Health, Vol. 14, Issue 1
  • DOI: 10.1186/1471-2458-14-147

Forecasting the 2013–2014 Influenza Season Using Wikipedia
journal, May 2015


Nowcasting by Bayesian Smoothing: A flexible, generalizable model for real-time epidemic tracking
journal, April 2020


Influenza Forecasting with Google Flu Trends
journal, February 2013


Generalized log-normal chain-ladder
journal, December 2019


Adjustments for reporting delays and the prediction of occurred but not reported events
journal, March 1994


Bayesian nowcasting during the STEC O104:H4 outbreak in Germany, 2011: Bayesian Nowcasting
journal, June 2014

  • Höhle, Michael; an der Heiden, Matthias
  • Biometrics, Vol. 70, Issue 4
  • DOI: 10.1111/biom.12194

A modelling approach for correcting reporting delays in disease surveillance data
journal, July 2019

  • Bastos, Leonardo S.; Economou, Theodoros; Gomes, Marcelo F. C.
  • Statistics in Medicine, Vol. 38, Issue 22
  • DOI: 10.1002/sim.8303

Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions
journal, June 2018


Modeling Reporting Delays and Reporting Corrections in Cancer Registry Data
journal, March 2005

  • Midthune, Douglas N.; Fay, Michael P.; Clegg, Limin X.
  • Journal of the American Statistical Association, Vol. 100, Issue 469
  • DOI: 10.1198/016214504000001899

Near-term forecasts of influenza-like illness
journal, June 2019


Nowcasting the COVID‐19 pandemic in Bavaria
journal, December 2020

  • Günther, Felix; Bender, Andreas; Katz, Katharina
  • Biometrical Journal, Vol. 63, Issue 3
  • DOI: 10.1002/bimj.202000112

Stochastic Claims Reserving in General Insurance
journal, August 2002


Estimating the time-varying reproduction number of SARS-CoV-2 using national and subnational case counts
journal, January 2020


Estimating the prevalence of problem drug use from drug‐related mortality data
journal, June 2020

  • Jones, Hayley E.; Harris, Ross J.; Downing, Beatrice C.
  • Addiction, Vol. 115, Issue 12
  • DOI: 10.1111/add.15111

Evaluating epidemic forecasts in an interval format
journal, February 2021


A pre-registered short-term forecasting study of COVID-19 in Germany and Poland during the second wave
journal, August 2021