DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: PlasmoData.jl — A Julia framework for modeling and analyzing complex data as graphs

Journal Article · · Computers and Chemical Engineering
 [1];  [2]
  1. Univ. of Wisconsin, Madison, WI (United States)
  2. Univ. of Wisconsin, Madison, WI (United States); Argonne National Laboratory (ANL), Argonne, IL (United States)

Datasets encountered in scientific and engineering applications appear in complex formats (e.g., images, multivariate time series, molecules, video, text strings, networks). Graph theory provides a unifying framework to model such datasets and enables the use of powerful tools that can help analyze, visualize, and extract value from data. In this work, we present PlasmoData.jl, an open-source, Julia framework that uses concepts of graph theory to facilitate the modeling and analysis of complex datasets. The core of our framework is a general data modeling abstraction, which we call a DataGraph. We show how the abstraction and software implementation can be used to represent diverse data objects as graphs and to enable the use of tools from topology, graph theory, and machine learning (e.g., graph neural networks) to conduct a variety of tasks. We illustrate the versatility of the framework by using real datasets: (i) an image classification problem using topological data analysis to extract features from the graph model to train machine learning models; (ii) a disease outbreak problem where we model multivariate time series as graphs to detect abnormal events; and (iii) a technology pathway analysis problem where we highlight how we can use graphs to navigate connectivity. Further, our discussion also highlights how PlasmoData.jl leverages native Julia capabilities to enable compact syntax, scalable computations, and interfaces with diverse packages. Overall, we show that the DataGraph abstraction and PlasmoData.jl Julia package are able to model data within graphs and enable useful analysis.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF)
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
2407242
Journal Information:
Computers and Chemical Engineering, Journal Name: Computers and Chemical Engineering Vol. 185; ISSN 0098-1354
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (61)

Seeing the Unseen: The Role of Liquid Crystals in Gas‐Sensing Technologies journal April 2020
Modularity measures: Concepts, computation, and applications to manufacturing systems journal March 2020
Redox-Triggered Orientational Responses of Liquid Crystals to Chlorine Gas journal July 2018
Lake networks and connectivity metrics for the conterminous U.S. (LAGOS‐US NETWORKS v1) journal August 2021
Minimum Cycle Bases for Network Graphs journal May 2004
DeCODe: a community-based algorithm for generating high-quality decompositions of optimization problems journal June 2019
A survey on network node ranking algorithms: Representative methods, extensions, and applications journal October 2020
A graph-based modeling abstraction for optimization: concepts and implementation in Plasmo.jl journal August 2022
Link probability, node degree and coverage in three-dimensional networks journal February 2016
Economic properties of multi-product supply chains journal February 2021
The Euler characteristic: A general topological descriptor for complex data journal November 2021
A graph-based modeling framework for tracing hydrological pollutant transport in surface waters journal November 2023
Cycle bases in graphs characterization, algorithms, complexity, and applications journal November 2009
Graph theory—Recent developments of its application in geomorphology journal August 2015
Cycle graph analysis for 3D roof structure modelling: Concepts and performance journal July 2014
Community detection in networks: A multidisciplinary review journal April 2018
GraphVar: A user-friendly toolbox for comprehensive graph analyses of functional brain connectivity journal April 2015
Decomposition of integrated scheduling and dynamic optimization problems using community detection journal June 2020
Complex network measures of brain connectivity: Uses and interpretations journal September 2010
Community detection in graphs journal February 2010
Higra: Hierarchical Graph Analysis journal July 2019
Fast diameter and radius BFS-based computation in (weakly connected) real-world graphs journal June 2015
Social Network Analysis book January 1994
Outlook: How I Learned to Love Machine Learning (A Personal Perspective on Machine Learning in Process Systems Engineering) journal June 2023
Graph-Based Optimization for Technology Pathway Analysis: A Case Study in the Decarbonization of University Campuses journal January 2024
Predicting Critical Micelle Concentrations for Surfactants Using Graph Convolutional Neural Networks journal September 2021
Scalable Extraction of Information from Spatiotemporal Patterns of Chemoresponsive Liquid Crystals Using Topological Descriptors journal August 2023
Ordering Transitions of Liquid Crystals Triggered by Metal Oxide-catalyzed Reactions of Sulfur Oxide Species journal September 2022
Uncovering the overlapping community structure of complex networks in nature and society journal June 2005
Topological data analysis of contagion maps for examining spreading processes on networks journal July 2015
Complex brain networks: graph theoretical analysis of structural and functional systems journal February 2009
A new hyperspectral image classification method based on spatial-spectral features journal January 2022
MoleculeNet: a benchmark for molecular machine learning journal January 2018
Capturing molecular interactions in graph neural networks: a case study in multi-component phase equilibrium journal January 2023
Chemical and biological sensing using liquid crystals journal June 2013
QNet: A Tool for Querying Protein Interaction Networks journal September 2008
Combinatorial homotopy. I journal January 1949
Topology and data journal January 2009
On a routing problem journal January 1958
Graph-based methods for analysing networks in cell biology journal May 2006
Beyond the tree of texts: Building an empirical model of scribal variation through graph analysis of texts and stemmata journal June 2013
Finding and evaluating community structure in networks journal February 2004
Near linear time algorithm to detect community structures in large-scale networks journal September 2007
A methodology for choosing data representations journal May 1991
Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval journal April 2000
Electrical Networks and Algebraic Graph Theory: Models, Properties, and Applications journal May 2018
An Algorithm for Path Connections and Its Applications journal September 1961
Deep Learning for Hyperspectral Image Classification: An Overview journal September 2019
Methods for Visual Understanding of Hierarchical System Structures journal January 1981
Embedded Data Representations journal January 2017
Principles for Measurement of Chemical Exposure Based on Recognition-Driven Anchoring Transitions in Liquid Crystals journal August 2001
The Why, How, and When of Representations for Complex Systems journal January 2021
Algorithm 97: Shortest path journal June 1962
Topological Data Analysis journal March 2018
Cluster analysis of networks generated through homology: automatic identification of important protein communities involved in cancer metastasis journal January 2006
Using graph theory to analyze biological networks journal April 2011
Revisiting the use of graph centrality models in biological pathway analysis journal June 2020
BRAPH: A graph theory software for the analysis of brain connectivity journal August 2017
Image Segmentation using Euler Graphs journal September 2010
A Gentle Introduction to Graph Neural Networks journal August 2021
An Introduction to Topological Data Analysis: Fundamental and Practical Aspects for Data Scientists journal September 2021

Similar Records

A Julia Framework for Graph-Structured Nonlinear Optimization
Journal Article · 2022 · Industrial and Engineering Chemistry Research · OSTI ID:1892497

Quantum-assisted associative adversarial network: applying quantum annealing in deep learning
Journal Article · 2021 · Quantum Machine Intelligence · OSTI ID:1786745

Topological structure of complex predictions
Journal Article · 2023 · Nature Machine Intelligence · OSTI ID:2216985