Comparative evaluation of atom mapping algorithms for balanced metabolic reactions: application to Recon 3D
Abstract
The mechanism of each chemical reaction in a metabolic network can be represented as a set of atom mappings, each of which relates an atom in a substrate metabolite to an atom of the same element in a product metabolite. Genome-scale metabolic network reconstructions typically represent biochemistry at the level of reaction stoichiometry. However, a more detailed representation at the underlying level of atom mappings opens the possibility for a broader range of biological, biomedical and biotechnological applications than with stoichiometry alone. Complete manual acquisition of atom mapping data for a genome-scale metabolic network is a laborious process. However, many algorithms exist to predict atom mappings. How do their predictions compare to each other and to manually curated atom mappings? For more than four thousand metabolic reactions in the latest human metabolic reconstruction, Recon 3D, we compared the atom mappings predicted by six atom mapping algorithms. We also compared these predictions to those obtained by manual curation of atom mappings for over five hundred reactions distributed among all top level Enzyme Commission number classes. Five of the evaluated algorithms had similarly high prediction accuracy of over 91% when compared to manually curated atom mapped reactions. On average, the accuracy ofmore »
- Authors:
-
- University of Luxembourg, Belvaux (Luxembourg). Luxembourg Centre for Systems Biomedicine
- Publication Date:
- Research Org.:
- University of Luxembourg, Belvaux (Luxembourg)
- Sponsoring Org.:
- USDOE Office of Science (SC), High Energy Physics (HEP); USDOE Office of Science (SC), Biological and Environmental Research (BER)
- OSTI Identifier:
- 1424907
- Grant/Contract Number:
- SC0010429
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Cheminformatics
- Additional Journal Information:
- Journal Volume: 9; Journal Issue: 1; Journal ID: ISSN 1758-2946
- Publisher:
- Chemistry Central Ltd.
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; 97 MATHEMATICS AND COMPUTING; Atom mapping; Metabolic network reconstruction; Automation; RDT; DREAM; AutoMapper; CLCA; MWED; ICMAP; Recon 3D
Citation Formats
Preciat Gonzalez, German A., El Assal, Lemmer R. P., Noronha, Alberto, Thiele, Ines, Haraldsdóttir, Hulda S., and Fleming, Ronan M. T. Comparative evaluation of atom mapping algorithms for balanced metabolic reactions: application to Recon 3D. United States: N. p., 2017.
Web. doi:10.1186/s13321-017-0223-1.
Preciat Gonzalez, German A., El Assal, Lemmer R. P., Noronha, Alberto, Thiele, Ines, Haraldsdóttir, Hulda S., & Fleming, Ronan M. T. Comparative evaluation of atom mapping algorithms for balanced metabolic reactions: application to Recon 3D. United States. https://doi.org/10.1186/s13321-017-0223-1
Preciat Gonzalez, German A., El Assal, Lemmer R. P., Noronha, Alberto, Thiele, Ines, Haraldsdóttir, Hulda S., and Fleming, Ronan M. T. Wed .
"Comparative evaluation of atom mapping algorithms for balanced metabolic reactions: application to Recon 3D". United States. https://doi.org/10.1186/s13321-017-0223-1. https://www.osti.gov/servlets/purl/1424907.
@article{osti_1424907,
title = {Comparative evaluation of atom mapping algorithms for balanced metabolic reactions: application to Recon 3D},
author = {Preciat Gonzalez, German A. and El Assal, Lemmer R. P. and Noronha, Alberto and Thiele, Ines and Haraldsdóttir, Hulda S. and Fleming, Ronan M. T.},
abstractNote = {The mechanism of each chemical reaction in a metabolic network can be represented as a set of atom mappings, each of which relates an atom in a substrate metabolite to an atom of the same element in a product metabolite. Genome-scale metabolic network reconstructions typically represent biochemistry at the level of reaction stoichiometry. However, a more detailed representation at the underlying level of atom mappings opens the possibility for a broader range of biological, biomedical and biotechnological applications than with stoichiometry alone. Complete manual acquisition of atom mapping data for a genome-scale metabolic network is a laborious process. However, many algorithms exist to predict atom mappings. How do their predictions compare to each other and to manually curated atom mappings? For more than four thousand metabolic reactions in the latest human metabolic reconstruction, Recon 3D, we compared the atom mappings predicted by six atom mapping algorithms. We also compared these predictions to those obtained by manual curation of atom mappings for over five hundred reactions distributed among all top level Enzyme Commission number classes. Five of the evaluated algorithms had similarly high prediction accuracy of over 91% when compared to manually curated atom mapped reactions. On average, the accuracy of the prediction was highest for reactions catalysed by oxidoreductases and lowest for reactions catalysed by ligases. In addition to prediction accuracy, the algorithms were evaluated on their accessibility, their advanced features, such as the ability to identify equivalent atoms, and their ability to map hydrogen atoms. In addition to prediction accuracy, we found that software accessibility and advanced features were fundamental to the selection of an atom mapping algorithm in practice.},
doi = {10.1186/s13321-017-0223-1},
journal = {Journal of Cheminformatics},
number = 1,
volume = 9,
place = {United States},
year = {Wed Jun 14 00:00:00 EDT 2017},
month = {Wed Jun 14 00:00:00 EDT 2017}
}
Web of Science
Works referenced in this record:
LMSD: LIPID MAPS structure database
journal, January 2007
- Sud, M.; Fahy, E.; Cotter, D.
- Nucleic Acids Research, Vol. 35, Issue Database
CLCA: Maximum Common Molecular Substructure Queries within the MetRxn Database
journal, December 2014
- Kumar, Akhil; Maranas, Costas D.
- Journal of Chemical Information and Modeling, Vol. 54, Issue 12
Automatic reaction mapping and reaction center detection
journal, March 2013
- Chen, William Lingran; Chen, David Z.; Taylor, Keith T.
- Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 3, Issue 6
A community-driven global reconstruction of human metabolism
journal, March 2013
- Thiele, Ines; Swainston, Neil; Fleming, Ronan M. T.
- Nature Biotechnology, Vol. 31, Issue 5
Computational Assignment of the EC Numbers for Genomic-Scale Analysis of Enzymatic Reactions
journal, December 2004
- Kotera, Masaaki; Okuno, Yasushi; Hattori, Masahiro
- Journal of the American Chemical Society, Vol. 126, Issue 50
Algorithm for Reaction Classification
journal, October 2013
- Kraut, Hans; Eiblmaier, Josef; Grethe, Guenter
- Journal of Chemical Information and Modeling, Vol. 53, Issue 11
KEGG: Kyoto Encyclopedia of Genes and Genomes
journal, January 2000
- Kanehisa, Minoru; Goto, Susumu
- Nucleic Acids Research, Vol. 28, Issue 1, p. 27-30
Identification of Conserved Moieties in Metabolic Networks by Graph Theoretical Analysis of Atom Transition Networks
journal, November 2016
- Haraldsdóttir, Hulda S.; Fleming, Ronan M. T.
- PLOS Computational Biology, Vol. 12, Issue 11
The Pathway Tools software
journal, July 2002
- Karp, P. D.; Paley, S.; Romero, P.
- Bioinformatics, Vol. 18, Issue Suppl 1
Stereochemically Consistent Reaction Mapping and Identification of Multiple Reaction Mechanisms through Integer Linear Optimization
journal, December 2011
- First, Eric L.; Gounaris, Chrysanthos E.; Floudas, Christodoulos A.
- Journal of Chemical Information and Modeling, Vol. 52, Issue 1
HMDB: the Human Metabolome Database
journal, January 2007
- Wishart, D. S.; Tzur, D.; Knox, C.
- Nucleic Acids Research, Vol. 35, Issue Database
Quantitative prediction of cellular metabolism with constraint-based models: the COBRA Toolbox v2.0
journal, August 2011
- Schellenberger, Jan; Que, Richard; Fleming, Ronan M. T.
- Nature Protocols, Vol. 6, Issue 9
Refining carbon flux paths using atomic trace data
journal, November 2013
- Pey, Jon; Planes, Francisco J.; Beasley, John E.
- Bioinformatics, Vol. 30, Issue 7
ChemSpider - building a foundation for the semantic web by hosting a crowd sourced databasing platform for chemistry
journal, May 2010
- Williams, Anthony J.; Tkachenko, Valery; Golotvin, Sergey
- Journal of Cheminformatics, Vol. 2, Issue S1
13C Metabolic Flux Analysis
journal, July 2001
- Wiechert, Wolfgang
- Metabolic Engineering, Vol. 3, Issue 3
EC-BLAST: a tool to automatically search and compare enzyme reactions
journal, January 2014
- Rahman, Syed Asad; Cuesta, Sergio Martinez; Furnham, Nicholas
- Nature Methods, Vol. 11, Issue 2
Comparative evaluation of open source software for mapping between metabolite identifiers in metabolic network reconstructions: application to Recon 2
journal, January 2014
- Haraldsdóttir, Hulda S.; Thiele, Ines; Fleming, Ronan MT
- Journal of Cheminformatics, Vol. 6, Issue 1
Open Babel: An open chemical toolbox
journal, October 2011
- O'Boyle, Noel M.; Banck, Michael; James, Craig A.
- Journal of Cheminformatics, Vol. 3, Issue 1
The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of pathway/genome databases
journal, November 2011
- Caspi, R.; Altman, T.; Dreher, K.
- Nucleic Acids Research, Vol. 40, Issue D1
Generation of genome-scale metabolic reconstructions for 773 members of the human gut microbiota
journal, November 2016
- Magnúsdóttir, Stefanía; Heinken, Almut; Kutt, Laura
- Nature Biotechnology, Vol. 35, Issue 1
Reaction Decoder Tool (RDT): extracting features from chemical reactions
journal, February 2016
- Rahman, Syed Asad; Torrance, Gilliean; Baldacci, Lorenzo
- Bioinformatics, Vol. 32, Issue 13
Description of several chemical structure file formats used by computer programs developed at Molecular Design Limited
journal, May 1992
- Dalby, Arthur; Nourse, James G.; Hounshell, W. Douglas
- Journal of Chemical Information and Modeling, Vol. 32, Issue 3
PubChem Substance and Compound databases
journal, September 2015
- Kim, Sunghwan; Thiessen, Paul A.; Bolton, Evan E.
- Nucleic Acids Research, Vol. 44, Issue D1
Accurate Atom-Mapping Computation for Biochemical Reactions
journal, October 2012
- Latendresse, Mario; Malerich, Jeremiah P.; Travers, Mike
- Journal of Chemical Information and Modeling, Vol. 52, Issue 11
The ChEBI reference database and ontology for biologically relevant chemistry: enhancements for 2013
journal, November 2012
- Hastings, Janna; de Matos, Paula; Dekker, Adriano
- Nucleic Acids Research, Vol. 41, Issue D1
MetRxn: a knowledgebase of metabolites and reactions spanning metabolic models and databases
journal, January 2012
- Kumar, Akhil; Suthers, Patrick F.; Maranas, Costas D.
- BMC Bioinformatics, Vol. 13, Issue 1
A protocol for generating a high-quality genome-scale metabolic reconstruction
journal, January 2010
- Thiele, Ines; Palsson, Bernhard Ø
- Nature Protocols, Vol. 5, Issue 1
The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of pathway/genome databases
journal, October 2009
- Caspi, Ron; Altman, Tomer; Dale, Joseph M.
- Nucleic Acids Research, Vol. 38, Issue suppl_1
HMDB: The human metabolome database
text, January 2007
- Chi, Sawhney, Summit; Greiner, Russ; Querengesser, Lori; Shrivastava, Savita; Vogel, Hans J. ; Arndt, David; Macinnis, Glen D. ; Natalie, Zhang; Gavin E. ; Ying, Duggan; Tang, Peter; Amegbey, Godwin; Jewell, Kevin; Wagner, James; Clements; Tzur, Dan; Bamforth, Fiona; Young, Nelson; Miniaci, Jessica; Nikolai, Lisa; Eisner, Roman; Coutouly, Marie-Aude; Clive, Derrick; Li, Liang; Marrie, Tom; Block, David; Hau, David D. ; Cheng, Dean; Melisa, Gebremedhin; Stothard, Paul; Forsythe, Ian; Weljie, Alim M. ; Dowlatabadi, Reza; Wishart, David S. ; Sykes, Brian D. ; Fung, Chris; Knox, Craig; Jeroncic, Kevin; Mulu, Guo; Lewis, Mike; Guo, An
- University of Alberta Libraries
SYSTEMS BIOLOGY: Measurement and modeling approaches bring a big-picture view of biology and may improve drug discovery and development
journal, February 2005
- Henry, Celia M.
- Chemical & Engineering News Archive, Vol. 83, Issue 7
Automatic reaction mapping and reaction center detection
journal, March 2013
- Chen, William Lingran; Chen, David Z.; Taylor, Keith T.
- Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 3, Issue 6
13C Metabolic Flux Analysis
journal, July 2001
- Wiechert, Wolfgang
- Metabolic Engineering, Vol. 3, Issue 3
Description of several chemical structure file formats used by computer programs developed at Molecular Design Limited
journal, May 1992
- Dalby, Arthur; Nourse, James G.; Hounshell, W. Douglas
- Journal of Chemical Information and Modeling, Vol. 32, Issue 3
Stereochemically Consistent Reaction Mapping and Identification of Multiple Reaction Mechanisms through Integer Linear Optimization
journal, December 2011
- First, Eric L.; Gounaris, Chrysanthos E.; Floudas, Christodoulos A.
- Journal of Chemical Information and Modeling, Vol. 52, Issue 1
Algorithm for Reaction Classification
journal, October 2013
- Kraut, Hans; Eiblmaier, Josef; Grethe, Guenter
- Journal of Chemical Information and Modeling, Vol. 53, Issue 11
Computational Assignment of the EC Numbers for Genomic-Scale Analysis of Enzymatic Reactions
journal, December 2004
- Kotera, Masaaki; Okuno, Yasushi; Hattori, Masahiro
- Journal of the American Chemical Society, Vol. 126, Issue 50
A community-driven global reconstruction of human metabolism
journal, March 2013
- Thiele, Ines; Swainston, Neil; Fleming, Ronan M. T.
- Nature Biotechnology, Vol. 31, Issue 5
Generation of genome-scale metabolic reconstructions for 773 members of the human gut microbiota
journal, November 2016
- Magnúsdóttir, Stefanía; Heinken, Almut; Kutt, Laura
- Nature Biotechnology, Vol. 35, Issue 1
EC-BLAST: a tool to automatically search and compare enzyme reactions
journal, January 2014
- Rahman, Syed Asad; Cuesta, Sergio Martinez; Furnham, Nicholas
- Nature Methods, Vol. 11, Issue 2
A protocol for generating a high-quality genome-scale metabolic reconstruction
journal, January 2010
- Thiele, Ines; Palsson, Bernhard Ø
- Nature Protocols, Vol. 5, Issue 1
Quantitative prediction of cellular metabolism with constraint-based models: the COBRA Toolbox v2.0
journal, August 2011
- Schellenberger, Jan; Que, Richard; Fleming, Ronan M. T.
- Nature Protocols, Vol. 6, Issue 9
New globally distributed bacterial phyla within the FCB superphylum
journal, December 2022
- Gong, Xianzhe; del Río, Álvaro Rodríguez; Xu, Le
- Nature Communications, Vol. 13, Issue 1
Red versus green leaves: transcriptomic comparison of foliar senescence between two Prunus cerasifera genotypes
journal, February 2020
- Vangelisti, Alberto; Guidi, Lucia; Cavallini, Andrea
- Scientific Reports, Vol. 10, Issue 1
Refining carbon flux paths using atomic trace data
journal, November 2013
- Pey, Jon; Planes, Francisco J.; Beasley, John E.
- Bioinformatics, Vol. 30, Issue 7
Reaction Decoder Tool (RDT): extracting features from chemical reactions
journal, February 2016
- Rahman, Syed Asad; Torrance, Gilliean; Baldacci, Lorenzo
- Bioinformatics, Vol. 32, Issue 13
HMDB: the Human Metabolome Database
journal, January 2007
- Wishart, D. S.; Tzur, D.; Knox, C.
- Nucleic Acids Research, Vol. 35, Issue Database
The ChEBI reference database and ontology for biologically relevant chemistry: enhancements for 2013
journal, November 2012
- Hastings, Janna; de Matos, Paula; Dekker, Adriano
- Nucleic Acids Research, Vol. 41, Issue D1
PubChem Substance and Compound databases
journal, September 2015
- Kim, Sunghwan; Thiessen, Paul A.; Bolton, Evan E.
- Nucleic Acids Research, Vol. 44, Issue D1
MetRxn: a knowledgebase of metabolites and reactions spanning metabolic models and databases
journal, January 2012
- Kumar, Akhil; Suthers, Patrick F.; Maranas, Costas D.
- BMC Bioinformatics, Vol. 13, Issue 1
Comparative evaluation of open source software for mapping between metabolite identifiers in metabolic network reconstructions: application to Recon 2
journal, January 2014
- Haraldsdóttir, Hulda S.; Thiele, Ines; Fleming, Ronan MT
- Journal of Cheminformatics, Vol. 6, Issue 1
Identification of Conserved Moieties in Metabolic Networks by Graph Theoretical Analysis of Atom Transition Networks
journal, November 2016
- Haraldsdóttir, Hulda S.; Fleming, Ronan M. T.
- PLOS Computational Biology, Vol. 12, Issue 11
Works referencing / citing this record:
Recon3D enables a three-dimensional view of gene variation in human metabolism
journal, February 2018
- Brunk, Elizabeth; Sahoo, Swagatika; Zielinski, Daniel C.
- Nature Biotechnology, Vol. 36, Issue 3
Automatic mapping of atoms across both simple and complex chemical reactions
journal, March 2019
- Jaworski, Wojciech; Szymkuć, Sara; Mikulak-Klucznik, Barbara
- Nature Communications, Vol. 10, Issue 1
Creation and analysis of biochemical constraint-based models using the COBRA Toolbox v.3.0
journal, February 2019
- Heirendt, Laurent; Arreckx, Sylvain; Pfau, Thomas
- Nature Protocols, Vol. 14, Issue 3
Reactant pairs and reaction organization patterns produced by a new rule-based approach
journal, August 2018
- Vazquez-Hernandez, Carlos; Loza, Antonio; Gutierrez-Rios, Rosa-Maria
- BMC Research Notes, Vol. 11, Issue 1
Inferring Biochemical Reactions and Metabolite Structures to Understand Metabolic Pathway Drift
journal, February 2020
- Belcour, Arnaud; Girard, Jean; Aite, Méziane
- iScience, Vol. 23, Issue 2
Automatic mapping of atoms across both simple and complex chemical reactions
journal, March 2019
- Jaworski, Wojciech; Szymkuć, Sara; Mikulak-Klucznik, Barbara
- Nature Communications, Vol. 10, Issue 1