Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

Challenging problems of quality assurance and quality control (QA/QC) of meteorological time series data

Journal Article · · Stochastic Environmental Research and Risk Assessment
; ; ; ; ;

Abstract

Representativeness and quality of collected meteorological data impact accuracy and precision of climate, hydrological, and biogeochemical analyses and predictions. We developed a comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework, consisting of three major phases: Phase I—Preliminary data exploration, i.e., processing of raw datasets, with the challenging problems of time formatting and combining datasets of different lengths and different time intervals; Phase II—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme data; and Phase III—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The paper includes two use cases based on the time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado), and the Barro Colorado Island (BCI, Panama) meteorological station. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.

Sponsoring Organization:
USDOE
OSTI ID:
1829520
Alternate ID(s):
OSTI ID: 1893876
Journal Information:
Stochastic Environmental Research and Risk Assessment, Journal Name: Stochastic Environmental Research and Risk Assessment Journal Issue: 4 Vol. 36; ISSN 1436-3240
Publisher:
Springer Science + Business MediaCopyright Statement
Country of Publication:
Germany
Language:
English

References (16)

The Oklahoma City Micronet journal August 2011
Applied Predictive Modeling book January 2013
Identification of Outliers book January 1980
Data quality checking for single station meteorological databases☆ journal June 1994
Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median journal July 2013
The Influence Curve and its Role in Robust Estimation journal June 1974
A combination of Wilcoxon's and Ansari-Bradley's statistics journal January 1971
Outlier detection using k-nearest neighbour graph conference January 2004
Time Series Outlier Detection Based on Sliding Window Prediction journal January 2014
A Quality Control Program for Surface Mesometeorological Data journal September 1987
Quality Control and Flux Sampling Problems for Tower and Aircraft Data journal June 1997
Quality Assurance Procedures in the Oklahoma Mesonetwork journal April 2000
Trends in Indices of Daily Temperature and Precipitation Extremes in Europe, 1946–99 journal November 2003
The Impact of Unique Meteorological Phenomena Detected by the Oklahoma Mesonet and ARS Micronet on Automated Quality Control journal October 2001
The East River, Colorado, Watershed: A Mountainous Community Testbed for Improving Predictive Understanding of Multiscale Hydrological–Biogeochemical Dynamics journal January 2018
Sequential Imputation of Missing Spatio-Temporal Precipitation Data Using Random Forests journal August 2020

Similar Records

Quality Assurance and Quality Control (QA/QC) of Meteorological Time Series Data for Billy Barr, East River, Colorado USA
Dataset · Thu Dec 31 23:00:00 EST 2020 · OSTI ID:1823516
QA/QC-ed BCI meteorological drivers
Dataset · Sun Dec 31 23:00:00 EST 2017 · OSTI ID:1423307

Related Subjects