DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Disentangling direct from indirect relationships in association networks

Journal Article · · Proceedings of the National Academy of Sciences of the United States of America

Networks are vital tools for understanding and modeling interactions in complex systems in science and engineering, and direct and indirect interactions are pervasive in all types of networks. However, quantitatively disentangling direct and indirect relationships in networks remains a formidable task. Here, we present a framework, called iDIRECT (Inference of Direct and Indirect Relationships with Effective Copula-based Transitivity), for quantitatively inferring direct dependencies in association networks. Using copula-based transitivity, iDIRECT eliminates/ameliorates several challenging mathematical problems, including ill-conditioning, self-looping, and interaction strength overflow. With simulation data as benchmark examples, iDIRECT showed high prediction accuracies. Application of iDIRECT to reconstruct gene regulatory networks in Escherichia coli also revealed considerably higher prediction power than the best-performing approaches in the DREAM5 (Dialogue on Reverse Engineering Assessment and Methods project, #5) Network Inference Challenge. In addition, applying iDIRECT to highly diverse grassland soil microbial communities in response to climate warming showed that the iDIRECT-processed networks were significantly different from the original networks, with considerably fewer nodes, links, and connectivity, but higher relative modularity. Further analysis revealed that the iDIRECT-processed network was more complex under warming than the control and more robust to both random and target species removal (P < 0.001). As a general approach, iDIRECT has great advantages for network inference, and it should be widely applicable to infer direct relationships in association networks across diverse disciplines in science and engineering.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Biological and Environmental Research (BER)
Grant/Contract Number:
AC02-05CH11231; SC0010715; SC0014079; SC0016247
OSTI ID:
1844610
Journal Information:
Proceedings of the National Academy of Sciences of the United States of America, Journal Name: Proceedings of the National Academy of Sciences of the United States of America Journal Issue: 2 Vol. 119; ISSN 0027-8424
Publisher:
National Academy of SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (62)

Connected Components in Random Graphs with Given Expected Degree Sequences journal November 2002
Microarray analysis of RpoS-mediated gene expression in Escherichia coli K-12 journal November 2004
Causality, cointegration, and control journal June 1988
Indirect effects in community ecology: Their definition, study and importance journal July 1991
A matrix partial correlation test used in investigations of reciprocity and other social interaction patterns at group level journal April 1990
A bivariate causality between stock prices and exchange rates: evidence from recent Asianflu☆ journal September 2000
Computational inference of gene regulatory networks: Approaches, limitations and opportunities journal January 2017
Gene regulatory network inference: Data integration in dynamic models—A review journal April 2009
Disentangling Interactions in the Microbiome: A Network Perspective journal March 2017
Hierarchical structure and the prediction of missing links in networks journal May 2008
Indirect effects drive coevolution in mutualistic networks journal October 2017
Network link prediction by global silencing of indirect correlations journal July 2013
Network deconvolution as a general method to distinguish direct dependencies in networks journal July 2013
Network cleanup journal August 2013
Wisdom of crowds for robust gene network inference journal July 2012
Classes of complex networks defined by role-to-role connectivity profiles journal December 2006
Network biology: understanding the cell's functional organization journal February 2004
Biological robustness journal November 2004
Advantages and limitations of current network inference methods journal August 2010
Climate warming leads to divergent succession of grassland microbial communities journal August 2018
Climate warming enhances microbial network complexity and stability journal February 2021
Climate warming accelerates temporal scaling of grassland soil microbial biodiversity journal March 2019
Inferring sparse networks for noisy transient processes journal February 2016
Network structure and biodiversity loss in food webs: robustness increases with connectance journal July 2002
The modularity of pollination networks journal December 2007
Revealing strengths and weaknesses of methods for gene network inference journal March 2010
Discriminating direct and indirect connectivities in biological networks journal September 2015
Part mutual information for quantifying direct associations in networks journal April 2016
Breakdown of interdependent directed networks journal January 2016
Using Bayesian Networks to Analyze Expression Data journal August 2000
Discovery of meaningful associations in genomic data using partial correlation coefficients journal July 2004
Inferring gene regulatory networks from gene expression data by path consistency algorithm based on conditional mutual information journal November 2011
Inferring gene regulatory networks by ANOVA journal March 2012
A field guide for the compositional analysis of any-omics data journal September 2019
Adaptation in bacterial flagellar and motility systems: from regulon members to ‘foraging’-like behavior in E. coli journal June 2007
RegulonDB version 9.0: high-level integration of gene regulation, coexpression, motif clustering and beyond journal November 2015
Transcription profile of Escherichia coli : genomic SELEX search for regulatory targets of transcription factors journal February 2016
The EcoCyc database: reflecting new knowledge about Escherichia coli K-12 journal November 2016
A sigma factor toolbox for orthogonal gene expression in Escherichia coli journal January 2018
RegulonDB v 10.5: tackling challenges to unify classic and high throughput knowledge of gene regulation in E. coli K-12 journal November 2018
Finding community structure in networks using the eigenvectors of matrices journal September 2006
Specificity and Stability in Topology of Protein Networks journal May 2002
Biological Networks: The Tinkerer as an Engineer journal September 2003
Network analytics in the age of big data journal July 2016
Effects of network modularity on the spread of perturbation impact in experimental metapopulations journal July 2017
The importance of being modular journal July 2017
Genome-Wide Analysis of the General Stress Response Network in Escherichia coli:  S-Dependent Genes, Promoters, and Sigma Factor Selectivity journal February 2005
Phylogenetic Molecular Ecological Network of Soil Microbial Communities in Response to Elevated CO2 journal July 2011
Functional Molecular Ecological Networks journal October 2010
BolA Is a Transcriptional Switch That Turns Off Motility and Turns On Biofilm Development journal February 2015
Inverse Problem Theory and Methods for Model Parameter Estimation book January 2005
Molecular ecological network analyses journal January 2012
RegPrecise 3.0 – A resource for genome-scale exploration of transcriptional regulation in bacteria journal January 2013
Eigengene networks for studying the relationships between co-expression modules journal November 2007
Dialogue on Reverse-Engineering Assessment and Methods: The DREAM of High-Throughput Pathway Inference journal October 2007
Linkage Rules for Plant–Pollinator Networks: Trait Complementarity or Exploitation Barriers? journal January 2007
Geometric Interpretation of Gene Coexpression Network Analysis journal August 2008
Sparse and Compositionally Robust Inference of Microbial Ecological Networks journal May 2015
Comprehensive Mapping of the Escherichia coli Flagellar Regulatory Network journal October 2014
The whole set of the constitutive promoters recognized by four minor sigma subunits of Escherichia coli RNA polymerase journal June 2017
On the Interpretation of χ 2 from Contingency Tables, and the Calculation of P journal January 1922
Deciphering microbial interactions and detecting keystone species with co-occurrence networks journal May 2014