ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure

Velliquette, Terri; Welch, Jessica; Crow, Michael; Devarakonda, Ranjeet; Heinz, Susan; Crystal-Ornelas, Robert

doi:10.15485/1734841

Title: ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure

Dataset
Other Related Research

Abstract

The ESS-DIVE reporting format for Comma-separated Values (CSV) file structure is based on a combination of existing guidelines and recommendations including some found within the Earth Science Community with valuable input from the Environmental Systems Science (ESS) Community. The CSV reporting format is designed to promote interoperability and machine-readability of CSV data files while also facilitating the collection of some file-level metadata content. Tabular data in the form of rows and columns should be archived in its simplest form, and we recommend submitting these tabular data following the ESS-DIVE reporting format for generic comma-separated values (CSV) text format files. In general, the CSV file format is more likely accessible by future systems when compared to a proprietary format and CSV files are preferred because this format is easier to exchange between different programs increasing the interoperability of a data file. By defining the reporting format and providing guidelines for how to structure CSV files and some field content within, this can increase the machine-readability of the data file for extracting, compiling, and comparing the data across files and systems.Data package files are in .csv, .png, and .md. Open the .csv with e.g. Microsoft Excel, LibreOffice, or Google Sheets. Open themore »« less

Authors:

;

Oak Ridge National Laboratory
Information International Associates

Publication Date:: Thu Dec 31 23:00:00 EST 2020

Research Org.:: Environmental System Science Data Infrastructure for a Virtual Ecosystem; Environmental Systems Science Data Infrastructure for a Virtual Ecosystem

Sponsoring Org.:: U.S. DOE > Office of Science > Biological and Environmental Research (BER)

Subject:: 54 ENVIRONMENTAL SCIENCES; FAIR data; Reporting Format; community data standard; data guidelines

OSTI Identifier:: 1734841

DOI:: https://doi.org/10.15485/1734841

Citation Formats


                    Velliquette, Terri, Welch, Jessica, Crow, Michael, Devarakonda, Ranjeet, Heinz, Susan, and Crystal-Ornelas, Robert. ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure.  United States: N. p., 2020. 
        Web.  doi:10.15485/1734841.

Copy to clipboard


                    Velliquette, Terri, Welch, Jessica, Crow, Michael, Devarakonda, Ranjeet, Heinz, Susan, & Crystal-Ornelas, Robert. ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure.  United States.  doi:https://doi.org/10.15485/1734841

Copy to clipboard


                    Velliquette, Terri, Welch, Jessica, Crow, Michael, Devarakonda, Ranjeet, Heinz, Susan, and Crystal-Ornelas, Robert. 2020.  
"ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure".  United States.  doi:https://doi.org/10.15485/1734841.  https://www.osti.gov/servlets/purl/1734841. Pub date:Thu Dec 31 23:00:00 EST 2020

Copy to clipboard


                    
@article{osti_1734841,

  title        = {ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure},

  author       = {Velliquette, Terri and Welch, Jessica and Crow, Michael and Devarakonda, Ranjeet and Heinz, Susan and Crystal-Ornelas, Robert},

  abstractNote = {The ESS-DIVE reporting format for Comma-separated Values (CSV) file structure is based on a combination of existing guidelines and recommendations including some found within the Earth Science Community with valuable input from the Environmental Systems Science (ESS) Community. The CSV reporting format is designed to promote interoperability and machine-readability of CSV data files while also facilitating the collection of some file-level metadata content. Tabular data in the form of rows and columns should be archived in its simplest form, and we recommend submitting these tabular data following the ESS-DIVE reporting format for generic comma-separated values (CSV) text format files. In general, the CSV file format is more likely accessible by future systems when compared to a proprietary format and CSV files are preferred because this format is easier to exchange between different programs increasing the interoperability of a data file. By defining the reporting format and providing guidelines for how to structure CSV files and some field content within, this can increase the machine-readability of the data file for extracting, compiling, and comparing the data across files and systems.Data package files are in .csv, .png, and .md. Open the .csv with e.g. Microsoft Excel, LibreOffice, or Google Sheets. Open the .md files by downloading and using a text editor (e.g., notepad or TextEdit). Open the .png in e.g. a web browser, photo viewer/editor, or Google Drive.},

  doi          = {10.15485/1734841},

  journal      = {},

  number       = ,

  volume       = ,

  place        = {United States},

  year         = {Thu Dec 31 23:00:00 EST 2020},

  month        = {Thu Dec 31 23:00:00 EST 2020}

}

Copy to clipboard

Dataset:

View Dataset

DOI: https://doi.org/10.15485/1734841

Save / Share:

Export Metadata

Save to My Library

Similar records in DOE Data Explorer and OSTI.GOV collections:

ESS-DIVE Reporting Format for File-level Metadata

Dataset Velliquette, Terri ; Welch, Jessica ; Crow, Michael ; ...

The ESS-DIVE reporting format for file-level metadata (FLMD) provides granular information at the data file level to describe the contents, scope, and structure of the data file to enable comparison of data files within a data package. The FLMD are fully consistent with and augment the metadata collected at the data package level. We developed the FLMD template based on a review of a small number of existing FLMD in use at other agencies and repositories with valuable input from the Environmental Systems Science (ESS) Community. Also included is a template for a CSV Data Dictionary where users can providemore »« less
ESS-DIVE Reporting Format for Location Metadata

Dataset Crystal-Ornelas, Robert ; O'Ryan, Dylan ; Christianson, Danielle ; ...

The ESS-DIVE location metadata reporting format provides instructions and templates for reporting a minimum set of metadata for discrete point locations in geographic space represented by x, y, and z coordinates. This format was created based on a need for earth and environmental science researchers to more consistently provide metadata about locations where they conduct studies. To create the format, we incorporated elements from ESS-DIVE’s community reporting formats as well as 12 additional data standards or other data resources (e.g., databases, data systems, or repositories). In the template, we ask researchers to indicate unique locations using Location IDs and indicatemore »« less
ESS-DIVE Reporting Format for Amplicon Abundance Table

Dataset Weisenhorn, Pamela ; Beilsmith, Kathleen

While standardized sequencing data is available in public repositories and efforts such as MIxS for common sample collection and processing metadata are well established, the lack of common bioinformatic processing metadata has hindered the ability to do large-scale metaanalyses and the potential for data re-use by non-experts such as ecosystem, watershed, or earth system modelers. To address this need for Department of Energy researchers, we have developed an amplicon reporting format which captures both sample preparation and bioinformatic processing metadata and stores processed amplicon data as a paired abundance table and sequencing file to maximize the potential for re-use ofmore »« less
ESS-DIVE Reporting Format for Dataset Package Metadata

Dataset Agarwal, Deb ; Cholia, Shreyas ; Hendrix, Valerie C. ; ...

ESS-DIVE’s (Environmental Systems Science Data Infrastructure for a Virtual Ecosystem) dataset metadata reporting format is intended to compile information about a dataset (e.g., title, description, funding sources) that can enable reuse of data submitted to the ESS-DIVE data repository. The files contained in this dataset include instructions (dataset_metadata_guide.md and README.md) that can be used to understand the types of metadata ESS-DIVE collects. The data dictionary (dd.csv) follows ESS-DIVE’s file-level metadata reporting format and includes brief descriptions about each element of the dataset metadata reporting format. This dataset also includes a terminology crosswalk (dataset_metadata_crosswalk.csv) that shows how ESS-DIVE’s metadata reporting formatmore »« less
ESS-DIVE Reporting Format for Hydrologic Monitoring Data and Metadata

Dataset Goldman, Amy E ; Ren, Huiying ; Torgeson, Joshua ; ...

The ESS-DIVE Reporting Format (RF) for Hydrologic Monitoring Data and Metadata was designed for water level, temperature, electrical conductivity, specific conductance, dissolved oxygen, and pH measured in situ using sensors deployed in water bodies. It can also be applied to a broader suite of variables beyond its original scope. The RF is intended to provide clear and easy guidance to data generators aiming to upload consistent findable, accessible, interoperable, and reusable (FAIR) datasets. The RF includes instructions (pdf), a term guide (csv), templates (csv and xlsx), and a list of recommended vocabulary (csv) to equip the data generator with allmore »« less

Similar Records