Title: Estimating basis functions in massive fields under the spatial mixed effects model

Journal Article · · Statistical Analysis and Data Mining
DOI: https://doi.org/10.1002/sam.11537 · OSTI ID:1811549
ORCiD logo [1]; ORCiD logo [2]
  1. National Security Directorate, Pacific Northwest National Laboratory Richland Washington USA, Department of Statistics North Carolina State University Raleigh North Carolina USA
  2. Department of Statistics Iowa State University Ames Iowa

Abstract Spatial prediction is commonly achieved under the assumption of a Gaussian random field by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets, fixed rank kriging using the expectation–maximization algorithm for estimation has been proposed as an alternative to the usual but computationally prohibitive kriging method. The method reduces computation cost of estimation by redefining the spatial process as a linear combination of basis functions and spatial random effects. A disadvantage of this method is that it imposes constraints on the relationship between the observed locations and the knots. We develop an alternative method that utilizes the spatial mixed effects model, but allows for additional flexibility by estimating the range of the spatial dependence between the observations and the knots via an alternating expectation conditional maximization algorithm. Experiments show that our methodology improves estimation without sacrificing prediction accuracy while also minimizing the additional computational burden of extra parameter estimation. The methodology is applied to a temperature dataset archived by the United States National Climate Data Center, with improved results over previous methodology.

Sponsoring Organization:
USDOE
OSTI ID:
1811549
Journal Information:
Statistical Analysis and Data Mining, Journal Name: Statistical Analysis and Data Mining Journal Issue: 5 Vol. 14; ISSN 1932-1864
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United States
Language:
English

References (36)

Statistics for Spatial Data book September 1993
Using temporal variability to improve spatial mapping with application to satellite data journal June 2010
Model-based clustering of regression time series data via APECM-an AECM algorithm sung to an even faster beat journal November 2011
Interpolation of Spatial Data book January 1999
Dynamic multi-resolution spatial models journal January 2007
Reduced Basis Kriging for Big Spatial Fields journal May 2018
A Case Study Competition Among Methods for Analyzing Large Spatial Data journal December 2018
The California current system—hypotheses and facts journal January 1979
Improving the performance of predictive process modeling for large datasets journal June 2009
Estimation of parameterized spatio-temporal dynamic models journal February 2007
Limitations on low rank approximations for covariance matrices of spatial data journal May 2014
A process-convolution approach to modelling temperatures in the North Atlantic Ocean journal January 1998
Approximating likelihoods for large spatial data sets journal May 2004
A Parallel EM Algorithm for Model-Based Clustering Applied to the Exploration of Large Spatio-Temporal Data journal November 2013
A Multi-Resolution Approximation for Massive Spatial Datasets journal January 2017
A Multiresolution Gaussian Process Model for the Analysis of Large Spatial Datasets journal April 2015
Sequential minimax search for a maximum journal March 1953
Notes on Continuous Stochastic Phenomena journal January 1950
Spectral methods for nonstationary spatial processes journal March 2002
The EM Algorithm-an Old Folk-song Sung to a Fast New Tune journal August 1997
Fixed rank kriging for very large spatial data sets: Fixed Rank Kriging journal January 2008
Gaussian predictive process models for large spatial data sets journal September 2008
An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach: Link between Gaussian Fields and Gaussian Markov Random Fields journal August 2011
Spatio-temporal smoothing and EM estimation for massive remote-sensing data sets: SPATIO-TEMPORAL SMOOTHING & EM ESTIMATION FOR MASSIVE DATA SETS journal May 2011
On Deriving the Inverse of a Sum of Matrices journal January 1981
Space-Filling Location Selection journal September 2014
Interpolation of geophysical data using continuous global surfaces journal November 2002
Smooth fitting of geophysical data using continuous global surfaces journal November 2002
Multiresolution models for nonstationary spatial covariance functions journal December 2002
Infilling Sparse Records of Spatial Fields journal December 2003
Covariance Tapering for Likelihood-Based Estimation in Large Spatial Data Sets journal December 2008
Fast, Resolution-Consistent Spatial Prediction of Global Processes From Satellite Data journal March 2002
Covariance Tapering for Interpolation of Large Spatial Datasets journal September 2006
A comparison of spatial predictors when datasets could be very large journal January 2016
On Information and Sufficiency journal March 1951
The Generalised Product Moment Distribution in Samples from a Normal Multivariate Population journal July 1928