A Scalable Graph Analytics Framework for Programming with Big Data in R (pbdR)
Many disciplines such as biology, economics, engineering, physics, and the social sciences represent their data as graphs to capture patterns, trends, and associations. There are are many commercially available graph libraries in different programming languages to analyze these complex graphs. But there is no distributed graph library package in R - the popular statistical programming language to analyze graphs that bigger than a single machine's memory. Many domain experts prefer R over the numerous other alternatives. Towards this, we present a distributed graph analytics framework for R called programming with big graph using R (pBGR.) Our proposed framework leverages the Programming with Big Data in R (pbdR) ecosystem that provides scalable R packages for distributed computing in data science. We present an early prototype implementation of this framework using the distributed-memory parallel graph library CombBLAS and evaluate the framework's performance on leadership class computing platforms. Our experimental results demonstrate that the proposed framework is capable of performing large-scale parallel graph mining through the easyto-use R language. This enhanced graph processing capability coupled with other statistical tools already available in R, should be valuable to many domain experts.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1649576
- Resource Relation:
- Conference: IEEE Big Data 2019 - Sixth International Workshop on High Performance Big Graph Data Management, Analysis, and Mining (BigGraphs 2019) - Los Angeles, California, United States of America - 12/9/2019 6:00:00 PM-12/12/2019 6:00:00 PM
- Country of Publication:
- United States
- Language:
- English
Similar Records
Programming with BIG data in R: Scaling analytics from one to thousands of nodes
Developing Mango Graph Studio and its Applications for Bioinformatics and Systems Biology (SBIR Phase I Grant Final Technical Report)