Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Sattar, Naw Safrin; Buluc, Aydin; Ibrahim, Khaled Z.; Arifuzzaman, Shaikh

doi:10.1007/s41109-023-00592-1

Title: Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Journal Article · 17 September 2023 · Applied Network Science

DOI: https://doi.org/10.1007/s41109-023-00592-1 · OSTI ID:2000797

Sattar, Naw Safrin; Buluc, Aydin; Ibrahim, Khaled Z.; Arifuzzaman, Shaikh

Abstract Dynamic (temporal) graphs are a convenient mathematical abstraction for many practical complex systems including social contacts, business transactions, and computer communications. Community discovery is an extensively used graph analysis kernel with rich literature for static graphs. However, community discovery in a dynamic setting is challenging for two specific reasons. Firstly, the notion of temporal community lacks a widely accepted formalization, and only limited work exists on understanding how communities emerge over time. Secondly, the added temporal dimension along with the sheer size of modern graph data necessitates new scalable algorithms. In this paper, we investigate how communities evolve over time based on several graph metrics under a temporal formalization. We compare six different algorithmic approaches for dynamic community detection for their quality and runtime. We identify that a vertex-centric (local) optimization method works as efficiently as the classical modularity-based methods. To its advantage, such local computation allows for the efficient design of parallel algorithms without incurring a significant parallel overhead. Based on this insight, we design a shared-memory parallel algorithm DyComPar , which demonstrates between 4 and 18 fold speed-up on a multi-core machine with 20 threads, for several real-world and synthetic graphs from different domains.

View Journal Article

Cite

Export

Save

Sponsoring Organization:: USDOE

OSTI ID:: 2000797

Alternate ID(s):: OSTI ID: 2283820

Journal Information:: Applied Network Science, Journal Name: Applied Network Science Journal Issue: 1 Vol. 8; ISSN 2364-8228

Publisher:: Springer Science + Business MediaCopyright Statement

Country of Publication:: Switzerland

Language:: English

References (43)

A Parallel Community Detection Algorithm Based on Incremental Clustering in Dynamic Network Zhang, Cuiyun; Zhang, Yunlei; Wu, Bin 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) https://doi.org/10.1109/ASONAM.2018.8508730	conference	August 2018
Network Structure and Community Evolution Online: Behavioral and Emotional Changes in Response to COVID-19 Fang, Fan; Wang, Tong; Tan, Suoyi Frontiers in Public Health, Vol. 9 https://doi.org/10.3389/fpubh.2021.813234	journal	January 2022
Overcoming MPI Communication Overhead for Distributed Community Detection Sattar, Naw Safrin; Arifuzzaman, Shaikh Communications in Computer and Information Science https://doi.org/10.1007/978-981-13-7729-7_6	book	January 2019
Defining and evaluating network communities based on ground-truth Yang, Jaewon; Leskovec, Jure Knowledge and Information Systems, Vol. 42, Issue 1 https://doi.org/10.1007/s10115-013-0693-z	journal	October 2013
Robust dynamic community detection with applications to human brain functional networks Martinet, L. -E.; Kramer, M. A.; Viles, W. Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-16285-7	journal	June 2020
Metrics for Community Analysis Chakraborty, Tanmoy; Dalmia, Ayushi; Mukherjee, Animesh ACM Computing Surveys, Vol. 50, Issue 4 https://doi.org/10.1145/3091106	journal	August 2017
Fast unfolding of communities in large networks Blondel, Vincent D.; Guillaume, Jean-Loup; Lambiotte, Renaud Journal of Statistical Mechanics: Theory and Experiment, Vol. 2008, Issue 10 https://doi.org/10.1088/1742-5468/2008/10/P10008	journal	October 2008
Sequential detection of temporal communities by estrangement confinement Kawadia, Vikas; Sreenivasan, Sameet Scientific Reports, Vol. 2, Issue 1 https://doi.org/10.1038/srep00794	journal	November 2012
SONIC: streaming overlapping community detection Sarıyüce, Ahmet Erdem; Gedik, Buğra; Jacques-Silva, Gabriela Data Mining and Knowledge Discovery, Vol. 30, Issue 4 https://doi.org/10.1007/s10618-015-0440-z	journal	November 2015
Community Detection using Semi-supervised Learning with Graph Convolutional Network on GPUs Sattar, Naw Safrin; Arifuzzaman, Shaikh 2020 IEEE International Conference on Big Data (Big Data) https://doi.org/10.1109/BigData50022.2020.9378123	conference	December 2020
Parallel and distributed paradigms for community detection in social networks: A methodological review Naik, Debadatta; Ramesh, Dharavath; Gandomi, Amir H. Expert Systems with Applications, Vol. 187 https://doi.org/10.1016/j.eswa.2021.115956	journal	January 2022
Detecting the evolving community structure in dynamic social networks Liu, Fanzhen; Wu, Jia; Xue, Shan World Wide Web, Vol. 23, Issue 2 https://doi.org/10.1007/s11280-019-00710-z	journal	October 2019
From communities to protein complexes: A local community detection algorithm on PPI networks Dilmaghani, Saharnaz; Brust, Matthias R.; Ribeiro, Carlos H. C. PLOS ONE, Vol. 17, Issue 1 https://doi.org/10.1371/journal.pone.0260484	journal	January 2022
Shared-Memory Scalable k-Core Maintenance on Dynamic Graphs and Hypergraphs Gabert, Kasimir; Pinar, Ali; Catalyurek, Umit V. 2021 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW52791.2021.00158	conference	June 2021
Dynamic Community Evolution Analysis Framework for Large-Scale Complex Networks Based on Strong and Weak Events Qiao, Shaojie; Han, Nan; Gao, Yunjun IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 51, Issue 10 https://doi.org/10.1109/TSMC.2019.2960085	journal	October 2021
Community structure in social and biological networks Girvan, M.; Newman, M. E. J. Proceedings of the National Academy of Sciences, Vol. 99, Issue 12 https://doi.org/10.1073/pnas.122653799	journal	June 2002
A Parallel Algorithm Template for Updating Single-Source Shortest Paths in Large-Scale Dynamic Networks Khanda, Arindam; Srinivasan, Sriram; Bhowmick, Sanjukta IEEE Transactions on Parallel and Distributed Systems, Vol. 33, Issue 4 https://doi.org/10.1109/TPDS.2021.3084096	journal	April 2022
DISTINGER: A distributed graph data structure for massive dynamic graph processing Feng, Guoyao; Meng, Xiao; Ammar, Khaled 2015 IEEE International Conference on Big Data (Big Data) https://doi.org/10.1109/BigData.2015.7363954	conference	October 2015
cuSTINGER: Supporting dynamic graph algorithms for GPUs Green, Oded; Bader, David A. 2016 IEEE High Performance Extreme Computing Conference (HPEC) https://doi.org/10.1109/HPEC.2016.7761622	conference	September 2016
DyPerm: Maximizing Permanence for Dynamic Community Detection Agarwal, Prerna; Verma, Richa; Agarwal, Ayush Advances in Knowledge Discovery and Data Mining https://doi.org/10.1007/978-3-319-93034-3_35	book	January 2018
Exploring the transition behavior of nodes in temporal networks based on dynamic community detection Li, Tianpeng; Wang, Wenjun; Wu, Xunxun Future Generation Computer Systems, Vol. 107 https://doi.org/10.1016/j.future.2020.02.006	journal	June 2020
Modelling Temporal Networks with Markov Chains, Community Structures and Change Points Peixoto, Tiago P.; Rosvall, Martin Computational Social Sciences https://doi.org/10.1007/978-3-030-23495-9_4	book	January 2019
Parallel Network Analysis and Communities Detection (PANC) Pipeline for the Analysis and Visualization of COVID-19 Data Agapito, Giuseppe; Milano, Marianna; Cannataro, Mario Parallel Processing Letters, Vol. 32, Issue 01n02 https://doi.org/10.1142/S0129626421420020	journal	September 2021
Scalable static and dynamic community detection using Grappolo Halappanavar, Mahantesh; Lu, Hao; Kalyanaraman, Ananth 2017 IEEE High-Performance Extreme Computing Conference (HPEC), 2017 IEEE High Performance Extreme Computing Conference (HPEC) https://doi.org/10.1109/HPEC.2017.8091047	conference	September 2017
On the permanence of vertices in network communities Chakraborty, Tanmoy; Srinivasan, Sriram; Ganguly, Niloy Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining https://doi.org/10.1145/2623330.2623707	conference	August 2014
On analyzing user preference dynamics with temporal social networks Pereira, Fabíola S. F.; Gama, João; de Amo, Sandra Machine Learning, Vol. 107, Issue 11 https://doi.org/10.1007/s10994-018-5740-2	journal	July 2018
Computer science fields as ground-truth communities Chakrabort, Tanmoy; Sikdar, Sandipan; Tammana, Vihar Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining https://doi.org/10.1145/2492517.2492536	conference	August 2013
Multiplex community detection in complex networks using an evolutionary approach Karimi, Fatemeh; Lotfi, Shahriar; Izadkhah, Habib Expert Systems with Applications, Vol. 146 https://doi.org/10.1016/j.eswa.2020.113184	journal	May 2020
Evolutionary community structure discovery in dynamic weighted networks Guo, Chonghui; Wang, Jiajia; Zhang, Zhen Physica A: Statistical Mechanics and its Applications, Vol. 413 https://doi.org/10.1016/j.physa.2014.07.004	journal	November 2014
Community Structure in Time-Dependent, Multiscale, and Multiplex Networks Mucha, P. J.; Richardson, T.; Macon, K. Science, Vol. 328, Issue 5980 https://doi.org/10.1126/science.1184819	journal	May 2010
Influence maximization in social networks using effective community detection Kazemzadeh, Farzaneh; Safaei, Ali Asghar; Mirzarezaee, Mitra Physica A: Statistical Mechanics and its Applications, Vol. 598 https://doi.org/10.1016/j.physa.2022.127314	journal	July 2022
The Network Data Repository with Interactive Graph Analytics and Visualization Rossi, Ryan; Ahmed, Nesreen Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 29, Issue 1 https://doi.org/10.1609/aaai.v29i1.9277	journal	March 2015
Packed Compressed Sparse Row: A Dynamic Graph Representation Wheatman, Brian; Xu, Helen 2018 IEEE High Performance extreme Computing Conference (HPEC) https://doi.org/10.1109/HPEC.2018.8547566	conference	September 2018
Community mining on dynamic weighted directed graphs Duan, Dongsheng; Li, Yuhua; Jin, Yanan Proceedings of the 1st ACM international workshop on Complex networks meet information & knowledge management https://doi.org/10.1145/1651274.1651278	conference	November 2009
Benchmark graphs for testing community detection algorithms Lancichinetti, Andrea; Fortunato, Santo; Radicchi, Filippo Physical Review E, Vol. 78, Issue 4 https://doi.org/10.1103/PhysRevE.78.046110	journal	October 2008
High-Resolution Measurements of Face-to-Face Contact Patterns in a Primary School Stehlé, Juliette; Voirin, Nicolas; Barrat, Alain PLoS ONE, Vol. 6, Issue 8 https://doi.org/10.1371/journal.pone.0023176	journal	August 2011
Parallelizing Louvain Algorithm: Distributed Memory Challenges Sattar, Naw Safrin; Arifuzzaman, Shaikh 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech) https://doi.org/10.1109/DASC/PiCom/DataCom/CyberSciTec.2018.00122	conference	August 2018
An Efficient Data Structure for Dynamic Graph on GPUs Zou, Lei; Zhang, Fan; Lin, Yinnian IEEE Transactions on Knowledge and Data Engineering https://doi.org/10.1109/TKDE.2023.3235941	journal	January 2023
Terrace: A Hierarchical Graph Container for Skewed Dynamic Graphs Pandey, Prashant; Wheatman, Brian; Xu, Helen Proceedings of the 2021 International Conference on Management of Data https://doi.org/10.1145/3448016.3457313	conference	June 2021
Community detection algorithms: A comparative analysis Lancichinetti, Andrea; Fortunato, Santo Physical Review E, Vol. 80, Issue 5 https://doi.org/10.1103/PhysRevE.80.056117	journal	November 2009
Scalable distributed Louvain algorithm for community detection in large graphs Sattar, Naw Safrin; Arifuzzaman, Shaikh The Journal of Supercomputing, Vol. 78, Issue 7 https://doi.org/10.1007/s11227-021-04224-2	journal	January 2022
ElGA Gabert, Kasimir; Sancak, Kaan; Özkaya, M. Yusuf Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3458817.3480857	conference	November 2021
Finding and evaluating community structure in networks Newman, M. E. J.; Girvan, M. Physical Review E, Vol. 69, Issue 2 https://doi.org/10.1103/PhysRevE.69.026113	journal	February 2004

Similar Records

Data Locality Enhancement of Dynamic Simulations for Exascale Computing (Final Report)

Technical Report · 2019 · OSTI ID:1576175

Shen, Xipeng

SIGNATURES OF ILLICIT NUCLEAR PROCUREMENT NETWORKS: AN OVERVIEW OF PRELIMINARY APPROACHES AND RESULTS

Conference · 2014 · OSTI ID:1203928

Webster, Jennifer B.; Erikson, Luke E.; Gastelum, Zoe N.; +4 more

Scaling Irregular Applications through Data Aggregation and Software Multithreading

Conference · 2014 · OSTI ID:1156997

Morari, Alessandro; Tumeo, Antonino; Chavarría-Miranda, Daniel; +2 more

Title: Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Citation Formats

References (43)

Similar Records

Related Subjects