A RESTful API for accessing microbial community data for MG-RAST

Wilke, Andreas; Bischof, Jared; Harrison, Travis; Brettin, Tom; D'Souza, Mark; Gerlach, Wolfgang; Matthews, Hunter; Paczian, Tobias; Wilkening, Jared; Glass, Elizabeth M.; Desai, Narayan; Meyer, Folker; Gardner, Paul P.

doi:10.1371/journal.pcbi.1004008

A RESTful API for accessing microbial community data for MG-RAST

Journal Article · Thu Jan 08 00:00:00 EST 2015 · PLoS Computational Biology (Online)

DOI:https://doi.org/10.1371/journal.pcbi.1004008· OSTI ID:1212400

Wilke, Andreas ^[1]; Bischof, Jared ^[1]; Harrison, Travis ^[1]; Brettin, Tom ^[2]; D'Souza, Mark ^[1]; Gerlach, Wolfgang ^[1]; Matthews, Hunter ^[1]; Paczian, Tobias ^[1]; Wilkening, Jared ^[1]; Glass, Elizabeth M. ^[1]; Desai, Narayan ^[1]; Meyer, Folker ^[1]; Gardner, Paul P. ^[3]

Argonne National Lab. (ANL), Lement, IL (United States). Mathematics and Computer Science Division; Univ. of Chicago, Chicago, IL (United States). Computation Institute.
Argonne National Lab. (ANL), Lement, IL (United States). Mathematics and Computer Science Division.
Univ. of Canterbury (New Zealand)

Metagenomic sequencing has produced significant amounts of data in recent years. For example, as of summer 2013, MGRAST has been used to annotate over 110,000 data sets totaling over 43 Terabases. With metagenomic sequencing finding even wider adoption in the scientific community, the existing web-based analysis tools and infrastructure in MG-RAST provide limited capability for data retrieval and analysis, such as comparative analysis between multiple data sets. Moreover, although the system provides many analysis tools, it is not comprehensive. By opening MG-RAST up via a web services API (application programmers interface) we have greatly expanded access to MG-RAST data, as well as provided a mechanism for the use of third-party analysis tools with MG-RAST data. This RESTful API makes all data and data objects created by the MG-RAST pipeline accessible as JSON objects. As part of the DOE Systems Biology Knowledgebase project (KBase, http:// kbase.us) we have implemented a web services API for MG-RAST. This API complements the existing MG-RAST web interface and constitutes the basis of KBase’s microbial community capabilities. In addition, the API exposes a comprehensive collection of data to programmers. This API, which uses a RESTful (Representational State Transfer) implementation, is compatible with most programming environments and should be easy to use for end users and third parties. It provides comprehensive access to sequence data, quality control results, annotations, and many other data types. Where feasible, we have used standards to expose data and metadata. Code examples are provided in a number of languages both to show the versatility of the API and to provide a starting point for users. We present an API that exposes the data in MG-RAST for consumption by our users, greatly enhancing the utility of the MG-RAST service.

View Accepted Manuscript (DOE)

Research Organization:: Argonne National Lab. (ANL), Argonne, IL (United States); Argonne National Laboratory (ANL), Argonne, IL (United States)

Sponsoring Organization:: USDOE Office of Science (SC); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21); USDOE Office of Science (SC), Biological and Environmental Research (BER) (SC-23)

Grant/Contract Number:: AC02-06CH11357

OSTI ID:: 1212400

Alternate ID(s):: OSTI ID: 1395022

Journal Information:: PLoS Computational Biology (Online), Journal Name: PLoS Computational Biology (Online) Journal Issue: 1 Vol. 11; ISSN 1553-7358

Publisher:: Public Library of ScienceCopyright Statement

Country of Publication:: United States

Language:: English

References (15)

Accurate determination of microbial diversity from 454 pyrosequencing data Quince, Christopher; Lanzén, Anders; Curtis, Thomas P. Nature Methods, Vol. 6, Issue 9 https://doi.org/10.1038/nmeth.1361	journal	August 2009
The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome McDonald, Daniel; Clemente, Jose C.; Kuczynski, Justin GigaScience, Vol. 1, Issue 1 https://doi.org/10.1186/2047-217x-1-7	journal	July 2012
A Platform-Independent Method for Detecting Errors in Metagenomic Sequencing Data: DRISEE Keegan, Kevin P.; Trimble, William L.; Wilkening, Jared PLoS Computational Biology, Vol. 8, Issue 6 https://doi.org/10.1371/journal.pcbi.1002541	journal	June 2012
Identifying Protein Domains with the Pfam Database Finn, Robert; Griffiths-Jones, Sam; Bateman, Alex Current Protocols in Bioinformatics, Vol. 1, Issue 1 https://doi.org/10.1002/0471250953.bi0205s01	journal	March 2003
Identifying Protein Domains with the Pfam Database Coggill, Penny; Finn, Robert D.; Bateman, Alex Current Protocols in Bioinformatics, Vol. 23, Issue 1 https://doi.org/10.1002/0471250953.bi0205s23	journal	September 2008
Minimum information about a marker gene sequence (MIMARKS) and minimum information about any (x) sequence (MIxS) specifications Yilmaz, Pelin; Kottmann, Renzo; Field, Dawn Nature Biotechnology, Vol. 29, Issue 5 https://doi.org/10.1038/nbt.1823	journal	May 2011
The 'rare biosphere': a reality check Reeder, Jens; Knight, Rob Nature Methods, Vol. 6, Issue 9 https://doi.org/10.1038/nmeth0909-636	journal	September 2009
InterPro in 2011: new developments in the family and domain prediction database Hunter, S.; Jones, P.; Mitchell, A. Nucleic Acids Research, Vol. 40, Issue D1 https://doi.org/10.1093/nar/gkr948	journal	November 2011
InterPro in 2011: new developments in the family and domain prediction database Hunter, S.; Jones, P.; Mitchell, A. Nucleic Acids Research, Vol. 40, Issue 10 https://doi.org/10.1093/nar/gks456	journal	May 2012
The PhyloFacts FAT-CAT web server: ortholog identification and function prediction using fast approximate tree classification Afrasiabi, Cyrus; Samad, Bushra; Dineen, David Nucleic Acids Research, Vol. 41, Issue W1 https://doi.org/10.1093/nar/gkt399	journal	May 2013
Using clouds for metagenomics: A case study Wilkening, Jared; Wilke, Andreas; Desai, Narayan 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289187	conference	August 2009
Accessing the SEED Genome Databases via Web Services API: Tools for Programmers Disz, Terry; Akhter, Sajia; Cuevas, Daniel BMC Bioinformatics, Vol. 11, Issue 1 https://doi.org/10.1186/1471-2105-11-319	journal	January 2010
The M5nr: a novel non-redundant database containing protein sequences and annotations from multiple sources and associated tools Wilke, Andreas; Harrison, Travis; Wilkening, Jared BMC Bioinformatics, Vol. 13, Issue 1 https://doi.org/10.1186/1471-2105-13-141	journal	January 2012
The metagenomics RAST server – a public resource for the automatic phylogenetic and functional analysis of metagenomes Meyer, F.; Paarmann, D.; D'Souza, M. BMC Bioinformatics, Vol. 9, Issue 1 https://doi.org/10.1186/1471-2105-9-386	journal	September 2008
The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome McDonald, Daniel; Clemente, Jose C.; Kuczynski, Justin GigaScience, Vol. 1, Issue 1 https://doi.org/10.1186/2047-217X-1-7	journal	July 2012

Cited By (24)

Web Resources for Metagenomics Studies Dudhagara, Pravin; Bhavsar, Sunil; Bhagat, Chintan Genomics, Proteomics & Bioinformatics, Vol. 13, Issue 5 https://doi.org/10.1016/j.gpb.2015.10.003	journal	October 2015
GeneHunt for rapid domain-specific annotation of glycoside hydrolases Nguyen, S. N.; Flores, A.; Talamantes, D. Scientific Reports, Vol. 9, Issue 1 https://doi.org/10.1038/s41598-019-46290-w	journal	July 2019
Comparative metagenomics reveals taxonomically idiosyncratic yet functionally congruent communities in periodontitis Dabdoub, Shareef M.; Ganesan, Sukirth M.; Kumar, Purnima S. Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep38993	journal	December 2016
Complete Genome Sequence of Escherichia coli Phage vB_EcoS Sa179lw, Isolated from Surface Water in a Produce-Growing Area in Northern California Liao, Yen-Te; Liu, Fang; Sun, Xincheng Genome Announcements, Vol. 6, Issue 27 https://doi.org/10.1128/genomea.00337-18	journal	July 2018
Genomics of the Uncultivated, Periodontitis-Associated Bacterium Tannerella sp. BU045 (Oral Taxon 808) Beall, Clifford J.; Campbell, Alisha G.; Griffen, Ann L. mSystems, Vol. 3, Issue 3 https://doi.org/10.1128/msystems.00018-18	journal	June 2018
SAMSA: a comprehensive metatranscriptome analysis pipeline Westreich, Samuel T.; Korf, Ian; Mills, David A. BMC Bioinformatics, Vol. 17, Issue 1 https://doi.org/10.1186/s12859-016-1270-8	journal	September 2016
Variable habitat conditions drive species covariation in the human microbiota Fisher, Charles K.; Mora, Thierry; Walczak, Aleksandra M. PLOS Computational Biology, Vol. 13, Issue 4 https://doi.org/10.1371/journal.pcbi.1005435	journal	April 2017
Microscale Biosignatures and Abiotic Mineral Authigenesis in Little Hot Creek, California Kraus, Emily A.; Beeler, Scott R.; Mors, R. Agustin Frontiers in Microbiology, Vol. 9 https://doi.org/10.3389/fmicb.2018.00997	journal	May 2018
Insights into Red Sea Brine Pool Specialized Metabolism Gene Clusters Encoding Potential Metabolites for Biotechnological Applications and Extremophile Survival Ziko, Laila; Adel, Mustafa; Malash, Mohamed N. Marine Drugs, Vol. 17, Issue 5 https://doi.org/10.3390/md17050273	journal	May 2019
Towards Solving The Metagenomics Reproducibility Crisis With Cwl And Ro Meyer, Folker Zenodo, 1 File (4.6 MB) https://doi.org/10.5281/zenodo.1484479	other	October 2018
Towards Solving The Metagenomics Reproducibility Crisis With Cwl And Ro Meyer, Folker Zenodo, 1 File (4.6 MB) https://doi.org/10.5281/zenodo.1484480	other	October 2018
IgA-about the unexpected. Macpherson, Andrew; Ganal-Vonarburg, Stephanie Rockefeller University Press https://doi.org/10.7892/boris.122381	text	January 2018
A novel and wide substrate specific polyhydroxyalkanoate (PHA) synthase from unculturable bacteria found in mangrove soil Foong, Choon Pin; Lakshmanan, Manoj; Abe, Hideki Journal of Polymer Research, Vol. 25, Issue 1 https://doi.org/10.1007/s10965-017-1403-4	journal	December 2017
IgA regulates the composition and metabolic function of gut microbiota by promoting symbiosis between bacteria Nakajima, Akira; Vogelzang, Alexis; Maruya, Mikako Journal of Experimental Medicine, Vol. 215, Issue 8 https://doi.org/10.1084/jem.20180427	journal	July 2018
MG-RAST version 4—lessons learned from a decade of low-budget ultra-high-throughput metagenome analysis Meyer, Folker; Bagchi, Saurabh; Chaterji, Somali Briefings in Bioinformatics, Vol. 20, Issue 4 https://doi.org/10.1093/bib/bbx105	journal	September 2017
Functional sequencing read annotation for high precision microbiome analysis Zhu, Chengsheng; Miller, Maximilian; Marpaka, Srinayani Nucleic Acids Research, Vol. 46, Issue 4 https://doi.org/10.1093/nar/gkx1209	journal	November 2017
SAMSA: A comprehensive metatranscriptome analysis pipeline Westreich, Samuel T.; Korf, Ian; Mills, David A. BMC Bioinformatics https://doi.org/10.1101/046201	journal	March 2016
The diversity of antibiotic resistance and virulence genes are correlated in human gut and environmental microbiomes Escudeiro, Pedro; Pothier, Joël; Dionisio, Francisco mSphere https://doi.org/10.1101/298190	journal	January 2019
Exploring bacterial pathogen community dynamics in freshwater beach sediments: A tale of two lakes VanMensel, Danielle; Chaganti, Subba Rao; Droppo, Ian G. Environmental Microbiology, Vol. 22, Issue 2 https://doi.org/10.1111/1462-2920.14860	journal	November 2019
Metagenomic evidence for the presence of phototrophic Gemmatimonadetes bacteria in diverse environments: Phototrophic Gemmatimonadetes in diverse environments Zeng, Yonghui; Baumbach, Jan; Barbosa, Eudes Guilherme Vieira Environmental Microbiology Reports, Vol. 8, Issue 1 https://doi.org/10.1111/1758-2229.12363	journal	January 2016
Ancient plant DNA in lake sediments Parducci, Laura; Bennett, Keith D.; Ficetola, Gentile Francesco New Phytologist, Vol. 214, Issue 3 https://doi.org/10.1111/nph.14470	journal	April 2017
What Is the Role of Archaea in Plants? New Insights from the Vegetation of Alpine Bogs Taffner, Julian; Erlacher, Armin; Bragina, Anastasia mSphere, Vol. 3, Issue 3 https://doi.org/10.1128/msphere.00122-18	journal	May 2018
Antibiotic Resistance Gene Diversity and Virulence Gene Diversity Are Correlated in Human Gut and Environmental Microbiomes Escudeiro, Pedro; Pothier, Joël; Dionisio, Francisco mSphere, Vol. 4, Issue 3 https://doi.org/10.1128/msphere.00135-19	journal	May 2019
Taxon-Function Decoupling as an Adaptive Signature of Lake Microbial Metacommunities Under a Chronic Polymetallic Pollution Gradient Cheaib, Bachar; Le Boulch, Malo; Mercier, Pierre-Luc Frontiers in Microbiology, Vol. 9 https://doi.org/10.3389/fmicb.2018.00869	journal	May 2018

Similar Records

Accessing the SEED Genome Databases via Web Services API: Tools for Programmers

Journal Article · Sun Jun 13 20:00:00 EDT 2010 · BMC Bioinformatics · OSTI ID:1626269

The MG-RAST API explorer: an on-ramp for RESTful query composition

Journal Article · Thu Nov 07 19:00:00 EST 2019 · BMC Bioinformatics · OSTI ID:1609142

Related Subjects

59 BASIC BIOLOGICAL SCIENCES
96 KNOWLEDGE MANAGEMENT AND PRESERVATION
DNA sequence analysis
database searching
information retrieval
metagenomics
proteases
quality control
sequence databases
web-based applications

A RESTful API for accessing microbial community data for MG-RAST

Citation Formats

References (15)

Cited By (24)

Similar Records

Related Subjects