DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Community detection and unveiling of hierarchy in networks: a density-based clustering approach

Abstract

Abstract The unveiling of communities within a network or graph, and the hierarchization of its members that results is of utmost importance in areas ranging from social to biochemical networks, from electronic circuits to cybersecurity. We present a statistical mechanics approach that uses a normalized Gaussian function which captures the impact of a node within its neighborhood and leads to a density-ranking of nodes by considering the distance between nodes as punishment. A hill-climbing procedure is applied to determine the density attractors and identify the unique parent (leader) of each member as well as the group leader. This organization of the nodes results in a tree-like network with multiple clusters, the community tree. The method is tested using synthetic networks generated by the LFR benchmarking algorithm for network sizes between 500 and 30,000 nodes and mixing parameter between 0.1 and 0.9 . Our results show a reasonable agreement with the LFR results for low to medium values of the mixing parameter and indicate a very mild dependence on the size of the network.

Authors:
ORCiD logo; ; ;
Publication Date:
Sponsoring Org.:
USDOE Advanced Research Projects Agency - Energy (ARPA-E)
OSTI Identifier:
1619421
Grant/Contract Number:  
NA 0002686; 2017-2007
Resource Type:
Published Article
Journal Name:
Applied Network Science
Additional Journal Information:
Journal Name: Applied Network Science Journal Volume: 4 Journal Issue: 1; Journal ID: ISSN 2364-8228
Publisher:
Springer Science + Business Media
Country of Publication:
Switzerland
Language:
English

Citation Formats

Felfli, Zineb, George, Roy, Shujaee, Khalil, and Kerwat, Mohamed. Community detection and unveiling of hierarchy in networks: a density-based clustering approach. Switzerland: N. p., 2019. Web. doi:10.1007/s41109-019-0216-2.
Felfli, Zineb, George, Roy, Shujaee, Khalil, & Kerwat, Mohamed. Community detection and unveiling of hierarchy in networks: a density-based clustering approach. Switzerland. https://doi.org/10.1007/s41109-019-0216-2
Felfli, Zineb, George, Roy, Shujaee, Khalil, and Kerwat, Mohamed. Tue . "Community detection and unveiling of hierarchy in networks: a density-based clustering approach". Switzerland. https://doi.org/10.1007/s41109-019-0216-2.
@article{osti_1619421,
title = {Community detection and unveiling of hierarchy in networks: a density-based clustering approach},
author = {Felfli, Zineb and George, Roy and Shujaee, Khalil and Kerwat, Mohamed},
abstractNote = {Abstract The unveiling of communities within a network or graph, and the hierarchization of its members that results is of utmost importance in areas ranging from social to biochemical networks, from electronic circuits to cybersecurity. We present a statistical mechanics approach that uses a normalized Gaussian function which captures the impact of a node within its neighborhood and leads to a density-ranking of nodes by considering the distance between nodes as punishment. A hill-climbing procedure is applied to determine the density attractors and identify the unique parent (leader) of each member as well as the group leader. This organization of the nodes results in a tree-like network with multiple clusters, the community tree. The method is tested using synthetic networks generated by the LFR benchmarking algorithm for network sizes between 500 and 30,000 nodes and mixing parameter between 0.1 and 0.9 . Our results show a reasonable agreement with the LFR results for low to medium values of the mixing parameter and indicate a very mild dependence on the size of the network.},
doi = {10.1007/s41109-019-0216-2},
journal = {Applied Network Science},
number = 1,
volume = 4,
place = {Switzerland},
year = {Tue Oct 22 00:00:00 EDT 2019},
month = {Tue Oct 22 00:00:00 EDT 2019}
}

Works referenced in this record:

Likelihood-based model selection for stochastic block models
journal, April 2017

  • Wang, Y. X. Rachel; Bickel, Peter J.
  • The Annals of Statistics, Vol. 45, Issue 2
  • DOI: 10.1214/16-AOS1457

Emergence of Scaling in Random Networks
journal, October 1999


Community structure in social and biological networks
journal, June 2002

  • Girvan, M.; Newman, M. E. J.
  • Proceedings of the National Academy of Sciences, Vol. 99, Issue 12
  • DOI: 10.1073/pnas.122653799

An Efficient Heuristic Procedure for Partitioning Graphs
journal, February 1970


Cyclic flows, Markov process and stochastic traffic assignment
journal, October 1996


Bayesian model selection of stochastic block models
conference, August 2016

  • Yan, Xiaoran
  • 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM)
  • DOI: 10.1109/ASONAM.2016.7752253

Randomized Shortest-Path Problems: Two Related Models
journal, August 2009


A bag-of-paths framework for network data analysis
journal, June 2017


A family of dissimilarity measures between nodes generalizing both the shortest-path and the commute-time distances
conference, January 2008

  • Yen, Luh; Saerens, Marco; Mantrach, Amin
  • Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD 08
  • DOI: 10.1145/1401890.1401984

Developments in the theory of randomized shortest paths with a comparison of graph node distances
journal, January 2014

  • Kivimäki, Ilkka; Shimbo, Masashi; Saerens, Marco
  • Physica A: Statistical Mechanics and its Applications, Vol. 393
  • DOI: 10.1016/j.physa.2013.09.016

A mixture model for random graphs
journal, December 2007


Algebraic connectivity of graphs [Algebraic connectivity of graphs]
journal, January 1973


Detecting community structure in networks
journal, March 2004


Towards realistic artificial benchmark for community detection algorithms evaluation
journal, January 2013

  • Orman, Günce Keziban; Labatut, Vincent; Cherifi, Hocine
  • International Journal of Web Based Communities, Vol. 9, Issue 3
  • DOI: 10.1504/IJWBC.2013.054908

Partitioning Sparse Matrices with Eigenvectors of Graphs
journal, July 1990

  • Pothen, Alex; Simon, Horst D.; Liou, Kang-Pu
  • SIAM Journal on Matrix Analysis and Applications, Vol. 11, Issue 3
  • DOI: 10.1137/0611030

The many facets of community detection in complex networks
journal, February 2017

  • Schaub, Michael T.; Delvenne, Jean-Charles; Rosvall, Martin
  • Applied Network Science, Vol. 2, Issue 1
  • DOI: 10.1007/s41109-017-0023-6

Benchmark graphs for testing community detection algorithms
journal, October 2008


Finding and evaluating community structure in networks
journal, February 2004


Bayesian Approach to Network Modularity
journal, June 2008


Spectral redemption in clustering sparse networks
journal, November 2013

  • Krzakala, F.; Moore, C.; Mossel, E.
  • Proceedings of the National Academy of Sciences, Vol. 110, Issue 52
  • DOI: 10.1073/pnas.1312486110