skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

This content will become publicly available on May 31, 2021

Title: Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model

Abstract

Recently, there has been substantial interest in the study of various random networks as mathematical models of complex systems. As real-life complex systems grow larger, the ability to generate progressively large random networks becomes all the more important. This motivates the need for efficient parallel algorithms for generating such networks. Naïve parallelization of sequential algorithms for generating random networks is inefficient due to inherent dependencies among the edges and the possibility of creating duplicate (parallel) edges. In this article, we present message passing interface-based distributed memory parallel algorithms for generating random scale-free networks using the preferential-attachment model. Our algorithms are experimentally verified to scale very well to a large number of processing elements (PEs), providing near-linear speedups. The algorithms have been exercised with regard to scale and speed to generate scale-free networks with one trillion edges in 6 minutes using 1,000 PEs.

Authors:
 [1];  [2];  [1];  [3]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Texas A & M Univ. at Kingsville, TX (United States)
  3. Univ. of Virginia, Charlottesville, VA (United States)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1631261
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Accepted Manuscript
Journal Name:
ACM Transactions on Parallel Computing
Additional Journal Information:
Journal Volume: 7; Journal Issue: 2; Journal ID: ISSN 2329-4949
Publisher:
Association for Computing Machinery
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Alam, Maksudul, Khan, Maleq, Perumalla, Kalyan S., and Marathe, Madhav. Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model. United States: N. p., 2020. Web. doi:10.1145/3391446.
Alam, Maksudul, Khan, Maleq, Perumalla, Kalyan S., & Marathe, Madhav. Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model. United States. doi:https://doi.org/10.1145/3391446
Alam, Maksudul, Khan, Maleq, Perumalla, Kalyan S., and Marathe, Madhav. Sun . "Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model". United States. doi:https://doi.org/10.1145/3391446.
@article{osti_1631261,
title = {Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model},
author = {Alam, Maksudul and Khan, Maleq and Perumalla, Kalyan S. and Marathe, Madhav},
abstractNote = {Recently, there has been substantial interest in the study of various random networks as mathematical models of complex systems. As real-life complex systems grow larger, the ability to generate progressively large random networks becomes all the more important. This motivates the need for efficient parallel algorithms for generating such networks. Naïve parallelization of sequential algorithms for generating random networks is inefficient due to inherent dependencies among the edges and the possibility of creating duplicate (parallel) edges. In this article, we present message passing interface-based distributed memory parallel algorithms for generating random scale-free networks using the preferential-attachment model. Our algorithms are experimentally verified to scale very well to a large number of processing elements (PEs), providing near-linear speedups. The algorithms have been exercised with regard to scale and speed to generate scale-free networks with one trillion edges in 6 minutes using 1,000 PEs.},
doi = {10.1145/3391446},
journal = {ACM Transactions on Parallel Computing},
number = 2,
volume = 7,
place = {United States},
year = {2020},
month = {5}
}

Journal Article:
Free Publicly Available Full Text
This content will become publicly available on May 31, 2021
Publisher's Version of Record

Save / Share:

Works referenced in this record:

Community structure in social and biological networks
journal, June 2002

  • Girvan, M.; Newman, M. E. J.
  • Proceedings of the National Academy of Sciences, Vol. 99, Issue 12
  • DOI: 10.1073/pnas.122653799

Evaluating North American electric grid reliability using the Barabási–Albert network model
journal, September 2005

  • Chassin, David P.; Posse, Christian
  • Physica A: Statistical Mechanics and its Applications, Vol. 355, Issue 2-4
  • DOI: 10.1016/j.physa.2005.02.051

An introduction to exponential random graph (p*) models for social networks
journal, May 2007


Error and attack tolerance of complex networks
journal, July 2000

  • Albert, Réka; Jeong, Hawoong; Barabási, Albert-László
  • Nature, Vol. 406, Issue 6794
  • DOI: 10.1038/35019019

What is Twitter, a social network or a news media?
conference, January 2010

  • Kwak, Haewoon; Lee, Changhyun; Park, Hosung
  • Proceedings of the 19th international conference on World wide web - WWW '10
  • DOI: 10.1145/1772690.1772751

Planetary-scale views on a large instant-messaging network
conference, January 2008

  • Leskovec, Jure; Horvitz, Eric
  • Proceeding of the 17th international conference on World Wide Web - WWW '08
  • DOI: 10.1145/1367497.1367620

Communication-Free Massively Distributed Graph Generation
conference, May 2018

  • Funke, Daniel; Lamm, Sebastian; Sanders, Peter
  • 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
  • DOI: 10.1109/IPDPS.2018.00043

Stochastic models for the Web graph
conference, January 2000

  • Kumar, R.; Raghavan, P.; Rajagopalan, S.
  • Proceedings 41st Annual Symposium on Foundations of Computer Science
  • DOI: 10.1109/SFCS.2000.892065

Fast random graph generation
conference, January 2011

  • Nobari, Sadegh; Lu, Xuesong; Karras, Panagiotis
  • Proceedings of the 14th International Conference on Extending Database Technology - EDBT/ICDT '11
  • DOI: 10.1145/1951365.1951406

Collective dynamics of ‘small-world’ networks
journal, June 1998

  • Watts, Duncan J.; Strogatz, Steven H.
  • Nature, Vol. 393, Issue 6684
  • DOI: 10.1038/30918

Power laws and the AS-level internet topology
journal, August 2003

  • Siganos, G.; Faloutsos, M.; Faloutsos, P.
  • IEEE/ACM Transactions on Networking, Vol. 11, Issue 4
  • DOI: 10.1109/TNET.2003.815300

Epidemic Spreading in Scale-Free Networks
journal, April 2001


Highly optimized tolerance: A mechanism for power laws in designed systems
journal, August 1999


Network biology: understanding the cell's functional organization
journal, February 2004

  • Barabási, Albert-László; Oltvai, Zoltán N.
  • Nature Reviews Genetics, Vol. 5, Issue 2
  • DOI: 10.1038/nrg1272

Emergence of Scaling in Random Networks
journal, October 1999


Parallel dynamics and computational complexity of network growth models
journal, February 2005


Understanding scientific collaboration: Homophily, transitivity, and preferential attachment: JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY
journal, September 2017

  • Zhang, Chenwei; Bu, Yi; Ding, Ying
  • Journal of the Association for Information Science and Technology, Vol. 69, Issue 1
  • DOI: 10.1002/asi.23916

Markov Graphs
journal, September 1986


Scalable generation of scale-free graphs
journal, July 2016


Principles of statistical mechanics of uncorrelated random networks
journal, September 2003


Efficient generation of large random networks
journal, March 2005


A high-level and scalable approach for generating scale-free graphs using active objects
conference, January 2016

  • Azadbakht, Keyvan; Bezirgiannis, Nikolaos; de Boer, Frank S.
  • Proceedings of the 31st Annual ACM Symposium on Applied Computing - SAC '16
  • DOI: 10.1145/2851613.2851722

Generating Massive Scale-Free Networks under Resource Constraints
conference, January 2016

  • Meyer, Ulrich; Penschuck, Manuel
  • 2016 Proceedings of the Eighteenth Workshop on Algorithm Engineering and Experiments (ALENEX)
  • DOI: 10.1137/1.9781611974317.4

Design, Generation, and Validation of Extreme Scale Power-Law Graphs
conference, May 2018

  • Kepner, Jeremy; Samsi, Siddharth; Arcand, William
  • 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
  • DOI: 10.1109/IPDPSW.2018.00055

R-MAT: A Recursive Model for Graph Mining
conference, December 2013

  • Chakrabarti, Deepayan; Zhan, Yiping; Faloutsos, Christos
  • Proceedings of the 2004 SIAM International Conference on Data Mining
  • DOI: 10.1137/1.9781611972740.43