skip to main content

SciTech ConnectSciTech Connect

Title: ARM Data Integrator

The Atmospheric Radiation Measurement (ARM) Data Integrator (ADI) streamlines the development of scientific algorithms and analysis of time-series NetCDF data, and improves the content and consistency of the output data products produced by these algorithms. The framework automates the process of retrieving and preparing data for analysis, and allows users to design output data products through a graphical interface. It also provides a modular, flexible software development architecture that scientists can use to generate C, Python, and IDL source code templates that embed the pre and post processing logic allowing the scientist to focus on only their science. The input data, preprocessing, and output data specifications of algorithms are defined through a graphical interface and stored in a database. ADI implements workflow for data integration and supports user access to data through a library of software modules. Data preprocess capabilities supported include automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog and allows developers to use existing data product to build new datamore » products. Views of the output data products include an overlay of how the design meets ARM archive’s data standards providing the user with a visual cue indicating where their output violates an archive standard. The ADI libraries access the information provided through the GUI via a Postgres database. The ADI framework and its supporting components can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.« less
Publication Date:
OSTI Identifier:
Report Number(s):
ADI; 002957WKSTN00
DOE Contract Number:
Software Revision:
Software Package Number:
Software Package Contents:
Open Source software package available from Pacific Northwest National Laboratory at the following URL:
Software CPU:
Open Source:
Source Code Available:
Related Software:
postgres database
Research Org:
Pacific Northwest National Laboratory
Sponsoring Org:
United States Department of Energy
Contributing Orgs:
Matt Macduff, PNNL Krista Gaustad, PNNL Brian Ermold, PNNL Tim Shippert, PNNL Todd Halter, PNNL Sherman Beus, PNNL
Country of Publication:
United States

To initiate an order for this software, request consultation services, or receive further information, fill out the request form below. You may also reach us by email at: .

ESTSC staff will begin to process an order for scientific and technical software once the payment and signed site license agreement are received. If the forms are not in order, ESTSC will contact you. No further action will be taken until all required information and/or payment is received. Orders are processed within three to five business days.

Software Request