Catchment scale runoff time-series generation and validation using statistical models for the Continental United States
Abstract
We developed statistical models to generate runoff time-series at National Hydrography Dataset Plus Version 2 (NHDPlusV2) catchment scale for the Continental United States (CONUS). The models use Normalized Difference Vegetation Index (NDVI) based Curve Number (CN) to generate initial runoff time-series which then is corrected using statistical models to improve accuracy. We used the North American Land Data Assimilation System 2 (NLDAS-2) catchment scale runoff time-series as the reference data for model training and validation. We used 17 years of 16-day, 250-m resolution NDVI data as a proxy for hydrologic conditions during a representative year to calculate 23 NDVI based-CN (NDVI-CN) values for each of 2.65 million NHDPlusV2 catchments for the Contiguous U.S. To maximize predictive accuracy while avoiding optimistically biased model validation results, we developed a spatio-temporal cross-validation framework for estimating, selecting, and validating the statistical correction models. We found that in many of the physiographic sections comprising CONUS, even simple linear regression models were highly effective at correcting NDVI-CN runoff to achieve Nash-Sutcliffe Efficiency values above 0.5. However, all models showed poor performance in physiographic sections that experience significant snow accumulation.
- Authors:
- Publication Date:
- Research Org.:
- Oak Ridge Institute for Science and Education (ORISE), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1841797
- Alternate Identifier(s):
- OSTI ID: 1981603
- Grant/Contract Number:
- DW8992298301; SC0014664
- Resource Type:
- Published Article
- Journal Name:
- Environmental Modelling and Software
- Additional Journal Information:
- Journal Name: Environmental Modelling and Software Journal Volume: 149 Journal Issue: C; Journal ID: ISSN 1364-8152
- Publisher:
- Elsevier
- Country of Publication:
- United Kingdom
- Language:
- English
- Subject:
- 54 ENVIRONMENTAL SCIENCES; Computer Science; Engineering; Environmental Sciences & Ecology; Water Resources
Citation Formats
Patton, Douglas, Smith, Deron, Muche, Muluken E., Wolfe, Kurt, Parmar, Rajbir, and Johnston, John M. Catchment scale runoff time-series generation and validation using statistical models for the Continental United States. United Kingdom: N. p., 2022.
Web. doi:10.1016/j.envsoft.2022.105321.
Patton, Douglas, Smith, Deron, Muche, Muluken E., Wolfe, Kurt, Parmar, Rajbir, & Johnston, John M. Catchment scale runoff time-series generation and validation using statistical models for the Continental United States. United Kingdom. https://doi.org/10.1016/j.envsoft.2022.105321
Patton, Douglas, Smith, Deron, Muche, Muluken E., Wolfe, Kurt, Parmar, Rajbir, and Johnston, John M. Tue .
"Catchment scale runoff time-series generation and validation using statistical models for the Continental United States". United Kingdom. https://doi.org/10.1016/j.envsoft.2022.105321.
@article{osti_1841797,
title = {Catchment scale runoff time-series generation and validation using statistical models for the Continental United States},
author = {Patton, Douglas and Smith, Deron and Muche, Muluken E. and Wolfe, Kurt and Parmar, Rajbir and Johnston, John M.},
abstractNote = {We developed statistical models to generate runoff time-series at National Hydrography Dataset Plus Version 2 (NHDPlusV2) catchment scale for the Continental United States (CONUS). The models use Normalized Difference Vegetation Index (NDVI) based Curve Number (CN) to generate initial runoff time-series which then is corrected using statistical models to improve accuracy. We used the North American Land Data Assimilation System 2 (NLDAS-2) catchment scale runoff time-series as the reference data for model training and validation. We used 17 years of 16-day, 250-m resolution NDVI data as a proxy for hydrologic conditions during a representative year to calculate 23 NDVI based-CN (NDVI-CN) values for each of 2.65 million NHDPlusV2 catchments for the Contiguous U.S. To maximize predictive accuracy while avoiding optimistically biased model validation results, we developed a spatio-temporal cross-validation framework for estimating, selecting, and validating the statistical correction models. We found that in many of the physiographic sections comprising CONUS, even simple linear regression models were highly effective at correcting NDVI-CN runoff to achieve Nash-Sutcliffe Efficiency values above 0.5. However, all models showed poor performance in physiographic sections that experience significant snow accumulation.},
doi = {10.1016/j.envsoft.2022.105321},
journal = {Environmental Modelling and Software},
number = C,
volume = 149,
place = {United Kingdom},
year = {Tue Mar 01 00:00:00 EST 2022},
month = {Tue Mar 01 00:00:00 EST 2022}
}
https://doi.org/10.1016/j.envsoft.2022.105321
Works referenced in this record:
Wind speed forecast correction models using polynomial neural networks
journal, November 2015
- Zjavka, Ladislav
- Renewable Energy, Vol. 83
Phenology-adjusted dynamic curve number for improved hydrologic modeling
journal, April 2019
- Muche, Muluken E.; Hutchinson, Stacy L.; Hutchinson, J. M. Shawn
- Journal of Environmental Management, Vol. 235
Verification and validation of simulation models
journal, February 2013
- Sargent, R. G.
- Journal of Simulation, Vol. 7, Issue 1
The antecedent soil moisture condition of the curve number procedure
journal, February 2000
- Silveira, L.; Charbonnier, F.; Genta, J. L.
- Hydrological Sciences Journal, Vol. 45, Issue 1
Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap
journal, September 2009
- Kim, Ji-Hyun
- Computational Statistics & Data Analysis, Vol. 53, Issue 11
Curve Number Method: Time to Think Anew?
journal, June 2014
- Hawkins, Richard H.
- Journal of Hydrologic Engineering, Vol. 19, Issue 6
The Stream-Catchment (StreamCat) Dataset: A Database of Watershed Metrics for the Conterminous United States
journal, December 2015
- Hill, Ryan A.; Weber, Marc H.; Leibowitz, Scott G.
- JAWRA Journal of the American Water Resources Association, Vol. 52, Issue 1
Hydrological modelling at multiple sub-daily time steps: Model improvement via flux-matching
journal, August 2019
- Ficchì, Andrea; Perrin, Charles; Andréassian, Vazken
- Journal of Hydrology, Vol. 575
A Statistical View of Some Chemometrics Regression Tools
journal, May 1993
- Frank, lldiko E.; Friedman, Jerome H.
- Technometrics, Vol. 35, Issue 2
CN-China: Revised runoff curve number by using rainfall-runoff events data in China
journal, June 2020
- Lian, Huishu; Yen, Haw; Huang, Jr-Chuan
- Water Research, Vol. 177
The geomorphological unit hydrograph from a historical-critical perspective: GEOMORPHOLOGICAL UNIT HYDROGRAPH
journal, December 2015
- Rigon, Riccardo; Bancheri, Marialaura; Formetta, Giuseppe
- Earth Surface Processes and Landforms, Vol. 41, Issue 1
Rainfall–runoff response and event-based runoff coefficients in a humid area (northwest Spain)
journal, February 2012
- Rodríguez-Blanco, M. L.; Taboada-Castro, M. M.; Taboada-Castro, M. T.
- Hydrological Sciences Journal, Vol. 57, Issue 3
Machine learning based identification of dominant controls on runoff dynamics
journal, March 2020
- Oppel, Henning; Schumann, Andreas H.
- Hydrological Processes, Vol. 34, Issue 11
Automated Data Slicing for Model Validation: A Big Data - AI Integration Approach
journal, December 2020
- Chung, Yeounoh; Kraska, Tim; Polyzotis, Neoklis
- IEEE Transactions on Knowledge and Data Engineering, Vol. 32, Issue 12
Operational testing of hydrological simulation models
journal, March 1986
- KlemeŠ, V.
- Hydrological Sciences Journal, Vol. 31, Issue 1
Technical note: Inherent benchmark or not? Comparing Nash–Sutcliffe and Kling–Gupta efficiency scores
journal, January 2019
- Knoben, Wouter J. M.; Freer, Jim E.; Woods, Ross A.
- Hydrology and Earth System Sciences, Vol. 23, Issue 10
Multifractal characterisation of a simulated surface flow: A case study with Multi-Hydro in Jouy-en-Josas, France
journal, March 2018
- Gires, Auguste; Abbes, Jean-Baptiste; da Silva Rocha Paz, Igor
- Journal of Hydrology, Vol. 558
Applying Machine Learning to Improve Simulations of a Chaotic Dynamical System Using Empirical Error Correction
journal, May 2019
- Watson, Peter A. G.
- Journal of Advances in Modeling Earth Systems, Vol. 11, Issue 5
Regularization and variable selection via the elastic net
journal, April 2005
- Zou, Hui; Hastie, Trevor
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 67, Issue 2
Array programming with NumPy
journal, September 2020
- Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J.
- Nature, Vol. 585, Issue 7825
A gated recurrent unit neural networks based wind speed error correction model for short-term wind power forecasting
journal, November 2019
- Ding, Min; Zhou, Hao; Xie, Hua
- Neurocomputing, Vol. 365
Validation of hydrological models: Conceptual basis, methodological approaches and a proposal for a code of practice
journal, January 2012
- Biondi, Daniela; Freni, Gabriele; Iacobellis, Vito
- Physics and Chemistry of the Earth, Parts A/B/C, Vol. 42-44
Discussion and Closure: SCS Runoff Equation Revisited for Variable-Source Runoff Areas
journal, October 1996
- Hawkins, Richard H.; Steenhuis, Tammo S.; Frankenberger, Jane Rossing
- Journal of Irrigation and Drainage Engineering, Vol. 122, Issue 5
Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling
journal, October 2009
- Gupta, Hoshin V.; Kling, Harald; Yilmaz, Koray K.
- Journal of Hydrology, Vol. 377, Issue 1-2
Establishing the credibility of simulations
journal, March 1980
- Schruben, Lee W.
- SIMULATION, Vol. 34, Issue 3
GCN250, new global gridded curve numbers for hydrologic modeling and design
journal, August 2019
- Jaafar, Hadi H.; Ahmad, Farah A.; El Beyrouthy, Naji
- Scientific Data, Vol. 6, Issue 1
A note on the validity of cross-validation for evaluating autoregressive time series prediction
journal, April 2018
- Bergmeir, Christoph; Hyndman, Rob J.; Koo, Bonsoo
- Computational Statistics & Data Analysis, Vol. 120
Learning Interactions via Hierarchical Group-Lasso Regularization
journal, July 2015
- Lim, Michael; Hastie, Trevor
- Journal of Computational and Graphical Statistics, Vol. 24, Issue 3
The Global Land Data Assimilation System
journal, March 2004
- Rodell, M.; Houser, P. R.; Jambor, U.
- Bulletin of the American Meteorological Society, Vol. 85, Issue 3
Curve Number Hydrology in Water Quality Modeling: Uses, Abuses, and Future Directions
journal, April 2005
- Garen, David C.; Moore, Daniel S.
- Journal of the American Water Resources Association, Vol. 41, Issue 2
Assessing Model Fit by Cross-Validation
journal, January 2003
- Hawkins, Douglas M.; Basak, Subhash C.; Mills, Denise
- Journal of Chemical Information and Computer Sciences, Vol. 43, Issue 2
Cross-Validation of Regression Models
journal, September 1984
- Picard, Richard R.; Cook, R. Dennis
- Journal of the American Statistical Association, Vol. 79, Issue 387
Estimation of prediction error by using K-fold cross-validation
journal, October 2009
- Fushiki, Tadayoshi
- Statistics and Computing, Vol. 21, Issue 2
The Effects of Rainfall Intensities and Duration on SCS-CN Model Parameters under Simulated Rainfall
journal, June 2020
- Wang, Xiaoxian; Bi, Huaxing
- Water, Vol. 12, Issue 6