Community detection and unveiling of hierarchy in networks: a density-based clustering approach
Abstract
Abstract The unveiling of communities within a network or graph, and the hierarchization of its members that results is of utmost importance in areas ranging from social to biochemical networks, from electronic circuits to cybersecurity. We present a statistical mechanics approach that uses a normalized Gaussian function which captures the impact of a node within its neighborhood and leads to a density-ranking of nodes by considering the distance between nodes as punishment. A hill-climbing procedure is applied to determine the density attractors and identify the unique parent (leader) of each member as well as the group leader. This organization of the nodes results in a tree-like network with multiple clusters, the community tree. The method is tested using synthetic networks generated by the LFR benchmarking algorithm for network sizes between 500 and 30,000 nodes and mixing parameter between 0.1 and 0.9 . Our results show a reasonable agreement with the LFR results for low to medium values of the mixing parameter and indicate a very mild dependence on the size of the network.
- Authors:
- Publication Date:
- Sponsoring Org.:
- USDOE Advanced Research Projects Agency - Energy (ARPA-E)
- OSTI Identifier:
- 1619421
- Grant/Contract Number:
- NA 0002686; 2017-2007
- Resource Type:
- Published Article
- Journal Name:
- Applied Network Science
- Additional Journal Information:
- Journal Name: Applied Network Science Journal Volume: 4 Journal Issue: 1; Journal ID: ISSN 2364-8228
- Publisher:
- Springer Science + Business Media
- Country of Publication:
- Switzerland
- Language:
- English
Citation Formats
Felfli, Zineb, George, Roy, Shujaee, Khalil, and Kerwat, Mohamed. Community detection and unveiling of hierarchy in networks: a density-based clustering approach. Switzerland: N. p., 2019.
Web. doi:10.1007/s41109-019-0216-2.
Felfli, Zineb, George, Roy, Shujaee, Khalil, & Kerwat, Mohamed. Community detection and unveiling of hierarchy in networks: a density-based clustering approach. Switzerland. https://doi.org/10.1007/s41109-019-0216-2
Felfli, Zineb, George, Roy, Shujaee, Khalil, and Kerwat, Mohamed. Tue .
"Community detection and unveiling of hierarchy in networks: a density-based clustering approach". Switzerland. https://doi.org/10.1007/s41109-019-0216-2.
@article{osti_1619421,
title = {Community detection and unveiling of hierarchy in networks: a density-based clustering approach},
author = {Felfli, Zineb and George, Roy and Shujaee, Khalil and Kerwat, Mohamed},
abstractNote = {Abstract The unveiling of communities within a network or graph, and the hierarchization of its members that results is of utmost importance in areas ranging from social to biochemical networks, from electronic circuits to cybersecurity. We present a statistical mechanics approach that uses a normalized Gaussian function which captures the impact of a node within its neighborhood and leads to a density-ranking of nodes by considering the distance between nodes as punishment. A hill-climbing procedure is applied to determine the density attractors and identify the unique parent (leader) of each member as well as the group leader. This organization of the nodes results in a tree-like network with multiple clusters, the community tree. The method is tested using synthetic networks generated by the LFR benchmarking algorithm for network sizes between 500 and 30,000 nodes and mixing parameter between 0.1 and 0.9 . Our results show a reasonable agreement with the LFR results for low to medium values of the mixing parameter and indicate a very mild dependence on the size of the network.},
doi = {10.1007/s41109-019-0216-2},
journal = {Applied Network Science},
number = 1,
volume = 4,
place = {Switzerland},
year = {Tue Oct 22 00:00:00 EDT 2019},
month = {Tue Oct 22 00:00:00 EDT 2019}
}
https://doi.org/10.1007/s41109-019-0216-2
Works referenced in this record:
Likelihood-based model selection for stochastic block models
journal, April 2017
- Wang, Y. X. Rachel; Bickel, Peter J.
- The Annals of Statistics, Vol. 45, Issue 2
Emergence of Scaling in Random Networks
journal, October 1999
- Barabási, Albert-László; Albert, Réka
- Science, Vol. 286, Issue 5439
Community structure in social and biological networks
journal, June 2002
- Girvan, M.; Newman, M. E. J.
- Proceedings of the National Academy of Sciences, Vol. 99, Issue 12
An Efficient Heuristic Procedure for Partitioning Graphs
journal, February 1970
- Kernighan, B. W.; Lin, S.
- Bell System Technical Journal, Vol. 49, Issue 2
Cyclic flows, Markov process and stochastic traffic assignment
journal, October 1996
- Akamatsu, Takashi
- Transportation Research Part B: Methodological, Vol. 30, Issue 5
Bayesian model selection of stochastic block models
conference, August 2016
- Yan, Xiaoran
- 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM)
Randomized Shortest-Path Problems: Two Related Models
journal, August 2009
- Saerens, Marco; Achbany, Youssef; Fouss, François
- Neural Computation, Vol. 21, Issue 8
A bag-of-paths framework for network data analysis
journal, June 2017
- Françoisse, Kevin; Kivimäki, Ilkka; Mantrach, Amin
- Neural Networks, Vol. 90
A family of dissimilarity measures between nodes generalizing both the shortest-path and the commute-time distances
conference, January 2008
- Yen, Luh; Saerens, Marco; Mantrach, Amin
- Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD 08
Developments in the theory of randomized shortest paths with a comparison of graph node distances
journal, January 2014
- Kivimäki, Ilkka; Shimbo, Masashi; Saerens, Marco
- Physica A: Statistical Mechanics and its Applications, Vol. 393
A mixture model for random graphs
journal, December 2007
- Daudin, J. -J.; Picard, F.; Robin, S.
- Statistics and Computing, Vol. 18, Issue 2
Algebraic connectivity of graphs [Algebraic connectivity of graphs]
journal, January 1973
- Fiedler, Miroslav
- Czechoslovak Mathematical Journal, Vol. 23, Issue 2
Detecting community structure in networks
journal, March 2004
- Newman, M. E. J.
- The European Physical Journal B - Condensed Matter, Vol. 38, Issue 2
Towards realistic artificial benchmark for community detection algorithms evaluation
journal, January 2013
- Orman, Günce Keziban; Labatut, Vincent; Cherifi, Hocine
- International Journal of Web Based Communities, Vol. 9, Issue 3
Partitioning Sparse Matrices with Eigenvectors of Graphs
journal, July 1990
- Pothen, Alex; Simon, Horst D.; Liou, Kang-Pu
- SIAM Journal on Matrix Analysis and Applications, Vol. 11, Issue 3
The many facets of community detection in complex networks
journal, February 2017
- Schaub, Michael T.; Delvenne, Jean-Charles; Rosvall, Martin
- Applied Network Science, Vol. 2, Issue 1
Benchmark graphs for testing community detection algorithms
journal, October 2008
- Lancichinetti, Andrea; Fortunato, Santo; Radicchi, Filippo
- Physical Review E, Vol. 78, Issue 4
Finding and evaluating community structure in networks
journal, February 2004
- Newman, M. E. J.; Girvan, M.
- Physical Review E, Vol. 69, Issue 2
Bayesian Approach to Network Modularity
journal, June 2008
- Hofman, Jake M.; Wiggins, Chris H.
- Physical Review Letters, Vol. 100, Issue 25
Spectral redemption in clustering sparse networks
journal, November 2013
- Krzakala, F.; Moore, C.; Mossel, E.
- Proceedings of the National Academy of Sciences, Vol. 110, Issue 52