Perturbed Input Ensemble Modeling With the Space Weather Modeling Framework
Abstract
Abstract To assess the effect of uncertainties in solar wind driving on the predictions from the operational configuration of the Space Weather Modeling Framework, we have developed a nonparametric method for generating multiple possible realizations of the solar wind just upstream of the bow shock, based on observations near the first Lagrangian point. We have applied this method to the solar wind inputs at the upstream boundary of Space Weather Modeling Framework and have simulated the geomagnetic storm of 5 April 2010. We ran a 40‐member ensemble for this event and have used this ensemble to quantify the uncertainty in the predicted Sym‐H index and ground magnetic disturbances due to the uncertainty in the upstream boundary conditions. Both the ensemble mean and the unperturbed simulation tend to underpredict the magnitude of Sym‐H in the quiet interval before the storm and overpredict in the storm itself, consistent with previous work. The ensemble mean is a more accurate predictor of Sym‐H, improving the mean absolute error by nearly 2 nT for this interval and displaying a smaller bias. We also examine the uncertainty in predicted maxima in ground magnetic disturbances. The confidence intervals are typically narrow during periods where the predicted d Bmore »
- Authors:
-
[1];
[2];
[1]
- Space Science and Applications Los Alamos National Laboratory Los Alamos NM USA
- Climate and Space Sciences and Engineering Department University of Michigan Ann Arbor MI USA, Department of Physics University of Texas at Arlington Arlington TX USA
- Publication Date:
- Research Org.:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Org.:
- USDOE; LANL Laboratory Directed Research and Development (LDRD) Program
- OSTI Identifier:
- 1469713
- Alternate Identifier(s):
- OSTI ID: 1467346; OSTI ID: 1469714
- Report Number(s):
- LA-UR-18-25975
Journal ID: ISSN 1542-7390
- Grant/Contract Number:
- AC52-06NA25396
- Resource Type:
- Published Article
- Journal Name:
- Space Weather (Online)
- Additional Journal Information:
- Journal Name: Space Weather (Online) Journal Volume: 16 Journal Issue: 9; Journal ID: ISSN 1542-7390
- Publisher:
- American Geophysical Union (AGU)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; 58 GEOSCIENCES; Heliospheric and Magnetospheric Physics
Citation Formats
Morley, S. K., Welling, D. T., and Woodroffe, J. R. Perturbed Input Ensemble Modeling With the Space Weather Modeling Framework. United States: N. p., 2018.
Web. doi:10.1029/2018SW002000.
Morley, S. K., Welling, D. T., & Woodroffe, J. R. Perturbed Input Ensemble Modeling With the Space Weather Modeling Framework. United States. https://doi.org/10.1029/2018SW002000
Morley, S. K., Welling, D. T., and Woodroffe, J. R. Wed .
"Perturbed Input Ensemble Modeling With the Space Weather Modeling Framework". United States. https://doi.org/10.1029/2018SW002000.
@article{osti_1469713,
title = {Perturbed Input Ensemble Modeling With the Space Weather Modeling Framework},
author = {Morley, S. K. and Welling, D. T. and Woodroffe, J. R.},
abstractNote = {Abstract To assess the effect of uncertainties in solar wind driving on the predictions from the operational configuration of the Space Weather Modeling Framework, we have developed a nonparametric method for generating multiple possible realizations of the solar wind just upstream of the bow shock, based on observations near the first Lagrangian point. We have applied this method to the solar wind inputs at the upstream boundary of Space Weather Modeling Framework and have simulated the geomagnetic storm of 5 April 2010. We ran a 40‐member ensemble for this event and have used this ensemble to quantify the uncertainty in the predicted Sym‐H index and ground magnetic disturbances due to the uncertainty in the upstream boundary conditions. Both the ensemble mean and the unperturbed simulation tend to underpredict the magnitude of Sym‐H in the quiet interval before the storm and overpredict in the storm itself, consistent with previous work. The ensemble mean is a more accurate predictor of Sym‐H, improving the mean absolute error by nearly 2 nT for this interval and displaying a smaller bias. We also examine the uncertainty in predicted maxima in ground magnetic disturbances. The confidence intervals are typically narrow during periods where the predicted d B H /d t is low. The confidence intervals are often much wider where the median prediction is for enhanced d B H /d t . The ensemble also allows us to identify intervals of activity that cannot be explained by uncertainty in the solar wind driver, driving further model improvements. This work demonstrates the feasibility and importance of ensemble modeling for space weather applications.},
doi = {10.1029/2018SW002000},
journal = {Space Weather (Online)},
number = 9,
volume = 16,
place = {United States},
year = {Wed Sep 12 00:00:00 EDT 2018},
month = {Wed Sep 12 00:00:00 EDT 2018}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1029/2018SW002000
https://doi.org/10.1029/2018SW002000
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 29 works
Citation information provided by
Web of Science
Web of Science
Figures / Tables:
Table 1: Contingency table of the comparison between predictions and observations. The letters a-d represent the number of cases in each category.
All figures and tables
(12 total)
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Adaptive numerical algorithms in space weather modeling
journal, February 2012
- Tóth, Gábor; van der Holst, Bart; Sokolov, Igor V.
- Journal of Computational Physics, Vol. 231, Issue 3
Forecasting the Dst index during corotating interaction region events using synthesized solar wind parameters : COROTATING INTERACTION REGION SYNTHETIC SIGNAL
journal, March 2012
- Andriyas, T.; Spencer, E.; Raj, A.
- Journal of Geophysical Research: Space Physics, Vol. 117, Issue A3
The moving blocks bootstrap versus parametric time series models
journal, June 1996
- Vogel, Richard M.; Shallcross, Amy L.
- Water Resources Research, Vol. 32, Issue 6
A description of the solar wind-magnetosphere coupling based on nonlinear filters
journal, March 1995
- Vassiliadis, D.; Klimas, A. J.; Baker, D. N.
- Journal of Geophysical Research: Space Physics, Vol. 100, Issue A3
Advances in Space Weather Ensemble Forecasting: SPACE WEATHER ENSEMBLE FORECASTING
journal, February 2016
- Knipp, Delores J.
- Space Weather, Vol. 14, Issue 2
Magnetic flux transfer in the 5 April 2010 Galaxy 15 substorm: an unprecedented observation
journal, January 2011
- Connors, M.; Russell, C. T.; Angelopoulos, V.
- Annales Geophysicae, Vol. 29, Issue 3
On the association between northward turnings of the interplanetary magnetic field and substorm onsets: ON THE TRIGGERING OF SUBSTORMS
journal, April 2007
- Morley, S. K.; Freeman, M. P.
- Geophysical Research Letters, Vol. 34, Issue 8
What is the best method to calculate the solar wind propagation delay?
journal, January 2008
- Mailyan, B.; Munteanu, C.; Haaland, S.
- Annales Geophysicae, Vol. 26, Issue 8
The bootstrap method in space physics: Error estimation for the minimum variance analysis
journal, February 1995
- Kawano, H.; Higuchi, T.
- Geophysical Research Letters, Vol. 22, Issue 3
Inner magnetospheric modeling with the Rice Convection Model
journal, January 2003
- Toffoletto, Frank; Sazykin, Stanislav; Spiro, Robert
- Space Science Reviews, Vol. 107, Issue 1/2, p. 175-196
Magnetic storm ring current injection modeled with the Rice Convection Model and a self-consistent magnetic field: RING CURRENT INJECTION SIMULATION
journal, November 2004
- Lemon, C.; Wolf, R. A.; Hill, T. W.
- Geophysical Research Letters, Vol. 31, Issue 21
The Impact of El Niño on an Ensemble of Extended-Range Forecasts
journal, September 1987
- Owen, J. A.; Palmer, T. N.
- Monthly Weather Review, Vol. 115, Issue 9
Derivation, Meaning, and Use of Geomagnetic Indices
book, January 1980
- Mayaud, P. N.
- Geophysical Monograph Series
The Earth’s Magnetosphere: A Systems Science Overview and Assessment
journal, July 2018
- Borovsky, Joseph E.; Valdivia, Juan Alejandro
- Surveys in Geophysics, Vol. 39, Issue 5
The effects of dynamic ionospheric outflow on the ring current: OUTFLOW AND RING CURRENT
journal, February 2011
- Welling, D. T.; Jordanova, V. K.; Zaharia, S. G.
- Journal of Geophysical Research: Space Physics, Vol. 116, Issue A2
A new global average model of the coupled thermosphere and ionosphere: GLOBAL AVERAGE THERMOSPHERE IONOSPHERE
journal, August 2005
- Smithtro, C. G.; Sojka, J. J.
- Journal of Geophysical Research: Space Physics, Vol. 110, Issue A8
A Solution-Adaptive Upwind Scheme for Ideal Magnetohydrodynamics
journal, September 1999
- Powell, Kenneth G.; Roe, Philip L.; Linde, Timur J.
- Journal of Computational Physics, Vol. 154, Issue 2
Deterministic Nonperiodic Flow
journal, March 1963
- Lorenz, Edward N.
- Journal of the Atmospheric Sciences, Vol. 20, Issue 2
A new functional form to study the solar wind control of the magnetopause size and shape
journal, May 1997
- Shue, J. -H.; Chao, J. K.; Fu, H. C.
- Journal of Geophysical Research: Space Physics, Vol. 102, Issue A5
Ensemble forecasting of major solar flares: First results: ENSEMBLE FORECASTING
journal, October 2015
- Guerra, J. A.; Pulkkinen, A.; Uritsky, V. M.
- Space Weather, Vol. 13, Issue 10
Effects of Uncertainties in Electric Field Boundary Conditions for Ring Current Simulations
journal, January 2018
- Chen, Margaret W.; O'Brien, T. Paul; Lemon, Colby L.
- Journal of Geophysical Research: Space Physics, Vol. 123, Issue 1
Ensemble Modeling of the 23 July 2012 Coronal Mass Ejection: ENSEMBLE MODELING OF 23 JULY 2012 CME
journal, October 2015
- Cash, M. D.; Biesecker, D. A.; Pizzo, V.
- Space Weather, Vol. 13, Issue 10
The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability
journal, August 2015
- Kay, J. E.; Deser, C.; Phillips, A.
- Bulletin of the American Meteorological Society, Vol. 96, Issue 8
More accurate, calibrated bootstrap confidence intervals for estimating the correlation between two time series
journal, February 2014
- Ólafsdóttir, K. B.; Mudelsee, M.
- Mathematical Geosciences, Vol. 46, Issue 4
Multimodel Ensembling in Seasonal Climate Forecasting at IRI
journal, December 2003
- Barnston, Anthony G.; Mason, Simon J.; Goddard, Lisa
- Bulletin of the American Meteorological Society, Vol. 84, Issue 12
Dynamic linear models for forecasting of radiation belt electrons and limitations on physical interpretation of predictive models: OSTHUS ET AL.
journal, June 2014
- Osthus, D.; Caragea, P. C.; Higdon, D.
- Space Weather, Vol. 12, Issue 6
Measures of Model Performance Based On the Log Accuracy Ratio
journal, January 2018
- Morley, S. K.; Brito, T. V.; Welling, D. T.
- Space Weather, Vol. 16, Issue 1
The Role of Initial Uncertainties in Predicion
journal, April 1969
- Epstein, Edward S.
- Journal of Applied Meteorology, Vol. 8, Issue 2
Bootstrapping correlated data
journal, October 1985
- Solow, Andrew R.
- Journal of the International Association for Mathematical Geology, Vol. 17, Issue 7
Quantification of modelling uncertainties in a large ensemble of climate change simulations
journal, August 2004
- Murphy, James M.; Sexton, David M. H.; Barnett, David N.
- Nature, Vol. 430, Issue 7001
Introduction to Monte Carlo Methods
book, January 1998
- Mackay, D. J. C.
- Learning in Graphical Models
Space Weather Modeling Framework: A new tool for the space science community
journal, January 2005
- Tóth, Gábor; Sokolov, Igor V.; Gombosi, Tamas I.
- Journal of Geophysical Research, Vol. 110, Issue A12
The Jackknife and the Bootstrap for General Stationary Observations
journal, September 1989
- Kunsch, Hans R.
- The Annals of Statistics, Vol. 17, Issue 3
Validation of an operational product to determine L1 to Earth propagation time delays: SOLAR WIND PROPAGATION VALIDATION STUDY
journal, February 2016
- Cash, M. D.; Witters Hicks, S.; Biesecker, D. A.
- Space Weather, Vol. 14, Issue 2
Heliospheric coordinate systems
journal, February 2002
- Fränz, M.; Harper, D.
- Planetary and Space Science, Vol. 50, Issue 2
Community-wide validation of geospace model ground magnetic field perturbation predictions to support model transition to operations: GEOSPACE MODEL TRANSITION
journal, June 2013
- Pulkkinen, A.; Rastätter, L.; Kuznetsova, M.
- Space Weather, Vol. 11, Issue 6
Bootstrap Methods: Another Look at the Jackknife
journal, January 1979
- Efron, B.
- The Annals of Statistics, Vol. 7, Issue 1
Ionospheric control of the magnetospheric configuration: Thermospheric neutral winds
journal, January 2003
- Ridley, A. J.
- Journal of Geophysical Research, Vol. 108, Issue A8
Uncertainty in weather and climate prediction
journal, December 2011
- Slingo, Julia; Palmer, Tim
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 369, Issue 1956
Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy
journal, February 1986
- Efron, B.; Tibshirani, R.
- Statistical Science, Vol. 1, Issue 1
Geotail mission to explore Earth's magnetotail
journal, January 1992
- Nishida, A.; Acuna, M. H.; Fairfield, D. H.
- Eos, Transactions American Geophysical Union, Vol. 73, Issue 40
The Importance of Ensemble Techniques for Operational Space Weather Forecasting
journal, July 2018
- Murray, Sophie A.
- Space Weather, Vol. 16, Issue 7
Minimum variance analysis-based propagation of the solar wind observations: Application to real-time global magnetohydrodynamic simulations: SW PROPAGATION
journal, December 2009
- Pulkkinen, A.; Rastätter, L.
- Space Weather, Vol. 7, Issue 12
SWMF Global Magnetosphere Simulations of January 2005: Geomagnetic Indices and Cross-Polar Cap Potential: SWMF JANUARY 2005: INDICES AND CPCP
journal, December 2017
- Haiducek, John D.; Welling, Daniel T.; Ganushkina, Natalia Y.
- Space Weather, Vol. 15, Issue 12
High-resolution global storm index: Dst versus SYM-H
journal, January 2006
- Wanliss, James A.; Showalter, Kristin M.
- Journal of Geophysical Research, Vol. 111, Issue A2
On the application of ensemble modeling techniques to improve ambient solar wind models: ENSEMBLE MODELING OF THE SOLAR WIND
journal, February 2013
- Riley, Pete; Linker, Jon A.; Mikić, Zoran
- Journal of Geophysical Research: Space Physics, Vol. 118, Issue 2
Rapid evolution of magnetic decreases (MDs) and discontinuities in the solar wind: ACE and Cluster
journal, January 2005
- Tsurutani, Bruce T.
- Geophysical Research Letters, Vol. 32, Issue 10
Use of the “Odds Ratio” for Diagnosing Forecast Skill
journal, April 2000
- Stephenson, David B.
- Weather and Forecasting, Vol. 15, Issue 2
Looking for evidence of mixing in the solar wind from 0.31 to 0.98 AU: MIXING IN THE SOLAR WIND
journal, June 2012
- Borovsky, Joseph E.
- Journal of Geophysical Research: Space Physics, Vol. 117, Issue A6
Ionospheric control of the magnetosphere: conductance
journal, January 2004
- Ridley, A. J.; Gombosi, T. I.; DeZeeuw, D. L.
- Annales Geophysicae, Vol. 22, Issue 2
Exploring predictive performance: A reanalysis of the geospace model transition challenge: GEOSPACE CHALLENGE REANALYSIS
journal, January 2017
- Welling, D. T.; Anderson, B. J.; Crowley, G.
- Space Weather, Vol. 15, Issue 1
Local variations of interplanetary magnetic field at Earth's bow shock
journal, November 1999
- Kessel, R. L.; Quintana, E.; Peredo, M.
- Journal of Geophysical Research: Space Physics, Vol. 104, Issue A11
Validation of SWMF magnetic field and plasma: SWMF VALIDATION
journal, March 2010
- Welling, D. T.; Ridley, A. J.
- Space Weather, Vol. 8, Issue 3
Solar wind spatial scales in and comparisons of hourly Wind and ACE plasma and magnetic field data
journal, January 2005
- King, J. H.
- Journal of Geophysical Research, Vol. 110, Issue A2
An adaptive MHD method for global space weather simulations
journal, January 2000
- De Zeeuw, D. L.; Gombosi, T. I.; Groth, C. P. T.
- IEEE Transactions on Plasma Science, Vol. 28, Issue 6
Flux tube texture of the solar wind: Strands of the magnetic carpet at 1 AU?: FLUX TUBE TEXTURE OF SOLAR WIND
journal, August 2008
- Borovsky, Joseph E.
- Journal of Geophysical Research: Space Physics, Vol. 113, Issue A8
Why Kp is such a good measure of magnetospheric convection
journal, November 2004
- Thomsen, M. F.
- Space Weather, Vol. 2, Issue 11
Figures / Tables found in this record:
Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.