DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Balancing aggregation and smoothing errors in inverse models

Abstract

Inverse models use observations of a system (observation vector) to quantify the variables driving that system (state vector) by statistical optimization. When the observation vector is large, such as with satellite data, selecting a suitable dimension for the state vector is a challenge. A state vector that is too large cannot be effectively constrained by the observations, leading to smoothing error. However, reducing the dimension of the state vector leads to aggregation error as prior relationships between state vector elements are imposed rather than optimized. Here we present a method for quantifying aggregation and smoothing errors as a function of state vector dimension, so that a suitable dimension can be selected by minimizing the combined error. Reducing the state vector within the aggregation error constraints can have the added advantage of enabling analytical solution to the inverse problem with full error characterization. We compare three methods for reducing the dimension of the state vector from its native resolution: (1) merging adjacent elements (grid coarsening), (2) clustering with principal component analysis (PCA), and (3) applying a Gaussian mixture model (GMM) with Gaussian pdfs as state vector elements on which the native-resolution state vector elements are projected using radial basis functions (RBFs).more » The GMM method leads to somewhat lower aggregation error than the other methods, but more importantly it retains resolution of major local features in the state vector while smoothing weak and broad features.« less

Authors:
;
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1198593
Grant/Contract Number:  
Computational Science Gradaute Fellowship (CSGF)
Resource Type:
Published Article
Journal Name:
Atmospheric Chemistry and Physics (Online)
Additional Journal Information:
Journal Name: Atmospheric Chemistry and Physics (Online) Journal Volume: 15 Journal Issue: 12; Journal ID: ISSN 1680-7324
Publisher:
Copernicus Publications, EGU
Country of Publication:
Germany
Language:
English

Citation Formats

Turner, A. J., and Jacob, D. J. Balancing aggregation and smoothing errors in inverse models. Germany: N. p., 2015. Web. doi:10.5194/acp-15-7039-2015.
Turner, A. J., & Jacob, D. J. Balancing aggregation and smoothing errors in inverse models. Germany. https://doi.org/10.5194/acp-15-7039-2015
Turner, A. J., and Jacob, D. J. Tue . "Balancing aggregation and smoothing errors in inverse models". Germany. https://doi.org/10.5194/acp-15-7039-2015.
@article{osti_1198593,
title = {Balancing aggregation and smoothing errors in inverse models},
author = {Turner, A. J. and Jacob, D. J.},
abstractNote = {Inverse models use observations of a system (observation vector) to quantify the variables driving that system (state vector) by statistical optimization. When the observation vector is large, such as with satellite data, selecting a suitable dimension for the state vector is a challenge. A state vector that is too large cannot be effectively constrained by the observations, leading to smoothing error. However, reducing the dimension of the state vector leads to aggregation error as prior relationships between state vector elements are imposed rather than optimized. Here we present a method for quantifying aggregation and smoothing errors as a function of state vector dimension, so that a suitable dimension can be selected by minimizing the combined error. Reducing the state vector within the aggregation error constraints can have the added advantage of enabling analytical solution to the inverse problem with full error characterization. We compare three methods for reducing the dimension of the state vector from its native resolution: (1) merging adjacent elements (grid coarsening), (2) clustering with principal component analysis (PCA), and (3) applying a Gaussian mixture model (GMM) with Gaussian pdfs as state vector elements on which the native-resolution state vector elements are projected using radial basis functions (RBFs). The GMM method leads to somewhat lower aggregation error than the other methods, but more importantly it retains resolution of major local features in the state vector while smoothing weak and broad features.},
doi = {10.5194/acp-15-7039-2015},
journal = {Atmospheric Chemistry and Physics (Online)},
number = 12,
volume = 15,
place = {Germany},
year = {Tue Jun 30 00:00:00 EDT 2015},
month = {Tue Jun 30 00:00:00 EDT 2015}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.5194/acp-15-7039-2015

Citation Metrics:
Cited by: 39 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Potential of the International Monitoring System radionuclide network for inverse modelling
journal, July 2012


Inverse Methods for Atmospheric Sounding: Theory and Practice
book, July 2000

  • Rodgers, Clive D.
  • Series on Atmospheric, Oceanic and Planetary Physics, Vol. 2
  • DOI: 10.1142/3171

Mapping of North American methane emissions with high spatial resolution by inversion of SCIAMACHY satellite data: NORTH AMERICA METHANE EMISSION INVERSION
journal, June 2014

  • Wecht, Kevin J.; Jacob, Daniel J.; Frankenberg, Christian
  • Journal of Geophysical Research: Atmospheres, Vol. 119, Issue 12
  • DOI: 10.1002/2014JD021551

Correlative Learning: A Basis for Brain and Adaptive Systems
book, March 2007


Toward Optimal Choices of Control Space Representation for Geophysical Data Assimilation
journal, July 2009


Regional Changes in Carbon Dioxide Fluxes of Land and Oceans Since 1980
journal, November 2000


On aggregation errors in atmospheric transport inversions
journal, March 2001

  • Kaminski, Thomas; Rayner, Peter J.; Heimann, Martin
  • Journal of Geophysical Research: Atmospheres, Vol. 106, Issue D5
  • DOI: 10.1029/2000JD900581

A geostatistical approach to surface flux estimation of atmospheric trace gases
journal, January 2004

  • Michalak, Anna M.; Bruhwiler, Lori; Tans, Pieter P.
  • Journal of Geophysical Research, Vol. 109, Issue D14
  • DOI: 10.1029/2003JD004422

Inverse Modeling of Atmospheric Carbon Dioxide Fluxes
journal, October 2001


Global monthly averaged CO2 fluxes recovered using a geostatistical inverse modeling approach: 2. Results including auxiliary environmental data
journal, January 2008

  • Gourdji, Sharon M.; Mueller, Kim L.; Schaefer, Kevin
  • Journal of Geophysical Research, Vol. 113, Issue D21
  • DOI: 10.1029/2007JD009733

Development of the adjoint of GEOS-Chem
journal, January 2007

  • Henze, D. K.; Hakami, A.; Seinfeld, J. H.
  • Atmospheric Chemistry and Physics, Vol. 7, Issue 9
  • DOI: 10.5194/acp-7-2413-2007

Smoothing error pitfalls
journal, January 2014


Regional sources of nitrous oxide over the United States: Seasonal variation and spatial distribution: UNITED STATES NITROUS OXIDE SOURCES
journal, March 2012

  • Miller, S. M.; Kort, E. A.; Hirsch, A. I.
  • Journal of Geophysical Research: Atmospheres, Vol. 117, Issue D6
  • DOI: 10.1029/2011JD016951

Contribution of the Orbiting Carbon Observatory to the estimation of CO 2 sources and sinks: Theoretical study in a variational data assimilation framework
journal, January 2007

  • Chevallier, Frédéric; Bréon, François-Marie; Rayner, Peter J.
  • Journal of Geophysical Research, Vol. 112, Issue D9
  • DOI: 10.1029/2006JD007375

Bayesian design of control space for optimal assimilation of observations. Part I: Consistent multiscale formalism
journal, May 2011

  • Bocquet, M.; Wu, L.; Chevallier, F.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 658
  • DOI: 10.1002/qj.837

Diagnosis of observation, background and analysis-error statistics in observation space
journal, October 2005

  • Desroziers, G.; Berre, L.; Chapnik, B.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 131, Issue 613
  • DOI: 10.1256/qj.05.108

Maximum likelihood estimation of covariance parameters for Bayesian atmospheric trace gas surface flux inversions
journal, January 2005

  • Michalak, Anna M.; Hirsch, Adam; Bruhwiler, Lori
  • Journal of Geophysical Research, Vol. 110, Issue D24
  • DOI: 10.1029/2005JD005970

Optimal representation of source-sink fluxes for mesoscale carbon dioxide inversion with synthetic data: FLUX REPRESENTATION FOR CO
journal, November 2011

  • Wu, Lin; Bocquet, Marc; Lauvaux, Thomas
  • Journal of Geophysical Research: Atmospheres, Vol. 116, Issue D21
  • DOI: 10.1029/2011JD016198

Seeing the forest through the trees: Recovering large-scale carbon flux biases in the midst of small-scale variability
journal, January 2009

  • Schuh, A. E.; Denning, A. S.; Uliasz, M.
  • Journal of Geophysical Research, Vol. 114, Issue G3
  • DOI: 10.1029/2008JG000842

Improved analysis-error covariance matrix for high-dimensional variational inversions: application to source estimation using a 3D atmospheric transport model: Improved Analysis-Error Covariance Estimates
journal, January 2015

  • Bousserez, N.; Henze, D. K.; Perkins, A.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 141, Issue 690
  • DOI: 10.1002/qj.2495

A strategy for operational implementation of 4D-Var, using an incremental approach
journal, July 1994

  • Courtier, P.; Thépaut, J. -N.; Hollingsworth, A.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 120, Issue 519
  • DOI: 10.1002/qj.49712051912

Bayesian design of control space for optimal assimilation of observations. Part II: Asymptotic solutions
journal, May 2011

  • Bocquet, M.; Wu, L.
  • Quarterly Journal of the Royal Meteorological Society, Vol. 137, Issue 658
  • DOI: 10.1002/qj.841

Methane observations from the Greenhouse Gases Observing SATellite: Comparison to ground-based TCCON data and model calculations: GOSAT CH
journal, August 2011

  • Parker, Robert; Boesch, Hartmut; Cogan, Austin
  • Geophysical Research Letters, Vol. 38, Issue 15
  • DOI: 10.1029/2011GL047871

Estimating global and North American methane emissions with high spatial resolution using GOSAT satellite data
journal, January 2015

  • Turner, A. J.; Jacob, D. J.; Wecht, K. J.
  • Atmospheric Chemistry and Physics, Vol. 15, Issue 12
  • DOI: 10.5194/acp-15-7049-2015