Addressing delayed case reporting in infectious disease forecast modeling
Abstract
Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always bemore »
- Authors:
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); USDOE Laboratory Directed Research and Development (LDRD) Program; National Institutes of Health/National Institute of General Medical Sciences (NIH/NIGMS)
- OSTI Identifier:
- 1872480
- Alternate Identifier(s):
- OSTI ID: 1871044; OSTI ID: 1894842
- Report Number(s):
- LA-UR-21-30640
Journal ID: ISSN 1553-7358; 10.1371/journal.pcbi.1010115
- Grant/Contract Number:
- 20210761PRD1; 89233218CNA000001; R01GM130668-01
- Resource Type:
- Published Article
- Journal Name:
- PLoS Computational Biology (Online)
- Additional Journal Information:
- Journal Name: PLoS Computational Biology (Online) Journal Volume: 18 Journal Issue: 6; Journal ID: ISSN 1553-7358
- Publisher:
- Public Library of Science (PLoS)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 59 BASIC BIOLOGICAL SCIENCES; mathematics; simulation and modeling; infectious diseases; forecasting; influenza
Citation Formats
Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., and Perkins, ed., Alex. Addressing delayed case reporting in infectious disease forecast modeling. United States: N. p., 2022.
Web. doi:10.1371/journal.pcbi.1010115.
Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., & Perkins, ed., Alex. Addressing delayed case reporting in infectious disease forecast modeling. United States. https://doi.org/10.1371/journal.pcbi.1010115
Beesley, Lauren J., Osthus, Dave, Del Valle, Sara Y., and Perkins, ed., Alex. Fri .
"Addressing delayed case reporting in infectious disease forecast modeling". United States. https://doi.org/10.1371/journal.pcbi.1010115.
@article{osti_1872480,
title = {Addressing delayed case reporting in infectious disease forecast modeling},
author = {Beesley, Lauren J. and Osthus, Dave and Del Valle, Sara Y. and Perkins, ed., Alex},
abstractNote = {Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always be available. Provided alternatives include excluding recently-reported data and performing sensitivity analysis. This work provides intuition and guidance for handling delay in disease case reporting and may serve as a useful resource to inform practical infectious disease forecasting efforts.},
doi = {10.1371/journal.pcbi.1010115},
journal = {PLoS Computational Biology (Online)},
number = 6,
volume = 18,
place = {United States},
year = {Fri Jun 03 00:00:00 EDT 2022},
month = {Fri Jun 03 00:00:00 EDT 2022}
}
https://doi.org/10.1371/journal.pcbi.1010115
Works referenced in this record:
Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited
journal, February 2019
- Osthus, Dave; Daughton, Ashlynn R.; Priedhorsky, Reid
- PLOS Computational Biology, Vol. 15, Issue 2
Measuring underreporting and under-ascertainment in infectious disease datasets: a comparison of methods
journal, February 2014
- Gibbons, Cheryl L.; Mangen, Marie-Josée J.; Plass, Dietrich
- BMC Public Health, Vol. 14, Issue 1
Forecasting the 2013–2014 Influenza Season Using Wikipedia
journal, May 2015
- Hickmann, Kyle S.; Fairchild, Geoffrey; Priedhorsky, Reid
- PLOS Computational Biology, Vol. 11, Issue 5
Nowcasting by Bayesian Smoothing: A flexible, generalizable model for real-time epidemic tracking
journal, April 2020
- McGough, Sarah F.; Johansson, Michael A.; Lipsitch, Marc
- PLOS Computational Biology, Vol. 16, Issue 4
Influenza Forecasting with Google Flu Trends
journal, February 2013
- Dugas, Andrea Freyer; Jalalpour, Mehdi; Gel, Yulia
- PLoS ONE, Vol. 8, Issue 2
Generalized log-normal chain-ladder
journal, December 2019
- Kuang, D.; Nielsen, B.
- Scandinavian Actuarial Journal, Vol. 2020, Issue 6
Adjustments for reporting delays and the prediction of occurred but not reported events
journal, March 1994
- Lawless, J. F.
- Canadian Journal of Statistics, Vol. 22, Issue 1
Bayesian nowcasting during the STEC O104:H4 outbreak in Germany, 2011: Bayesian Nowcasting
journal, June 2014
- Höhle, Michael; an der Heiden, Matthias
- Biometrics, Vol. 70, Issue 4
A modelling approach for correcting reporting delays in disease surveillance data
journal, July 2019
- Bastos, Leonardo S.; Economou, Theodoros; Gomes, Marcelo F. C.
- Statistics in Medicine, Vol. 38, Issue 22
Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions
journal, June 2018
- Brooks, Logan C.; Farrow, David C.; Hyun, Sangwon
- PLOS Computational Biology, Vol. 14, Issue 6
Modeling Reporting Delays and Reporting Corrections in Cancer Registry Data
journal, March 2005
- Midthune, Douglas N.; Fay, Michael P.; Clegg, Limin X.
- Journal of the American Statistical Association, Vol. 100, Issue 469
Near-term forecasts of influenza-like illness
journal, June 2019
- Kandula, Sasikiran; Shaman, Jeffrey
- Epidemics, Vol. 27
Nowcasting the COVID‐19 pandemic in Bavaria
journal, December 2020
- Günther, Felix; Bender, Andreas; Katz, Katharina
- Biometrical Journal, Vol. 63, Issue 3
Stochastic Claims Reserving in General Insurance
journal, August 2002
- England, P. D.; Verrall, R. J.
- British Actuarial Journal, Vol. 8, Issue 3
Estimating the time-varying reproduction number of SARS-CoV-2 using national and subnational case counts
journal, January 2020
- Abbott, Sam; Hellewell, Joel; Thompson, Robin N.
- Wellcome Open Research, Vol. 5
Estimating the prevalence of problem drug use from drug‐related mortality data
journal, June 2020
- Jones, Hayley E.; Harris, Ross J.; Downing, Beatrice C.
- Addiction, Vol. 115, Issue 12
Evaluating epidemic forecasts in an interval format
journal, February 2021
- Bracher, Johannes; Ray, Evan L.; Gneiting, Tilmann
- PLOS Computational Biology, Vol. 17, Issue 2
A pre-registered short-term forecasting study of COVID-19 in Germany and Poland during the second wave
journal, August 2021
- Bracher, J.; Wolffram, D.; Deuschel, J.
- Nature Communications, Vol. 12, Issue 1