Efficient and Reliable Overlay Networks for Decentralized Federated Learning

Hua, Yifan; Miller, Kevin; Bertozzi, Andrea L.; Qian, Chen; Wang, Bao

doi:10.1137/21m1465081

Efficient and Reliable Overlay Networks for Decentralized Federated Learning

Journal Article · 01 August 2022 · SIAM Journal of Applied Mathematics

DOI:https://doi.org/10.1137/21m1465081· OSTI ID:1980778

Hua, Yifan ^[1]; ; Bertozzi, Andrea L.; Qian, Chen;

OSTI

Not provided.

Research Organization:: Purdue Univ., West Lafayette, IN (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: SC0021142;

OSTI ID:: 1980778

Journal Information:: SIAM Journal of Applied Mathematics, Journal Name: SIAM Journal of Applied Mathematics Journal Issue: 4 Vol. 82; ISSN 0036-1399

Publisher:: Society for Industrial and Applied Mathematics (SIAM)

Country of Publication:: United States

Language:: English

References (33)

Constructing Error-Correcting Codes from Expander Graphs Spielman, Daniel A. Emerging Applications of Number Theory https://doi.org/10.1007/978-1-4612-1544-8_25	book	January 1999
A Distributed Trust Framework for Privacy-Preserving Machine Learning Abramson, Will; Hall, Adam James; Papadopoulos, Pavlos Trust, Privacy and Security in Digital Business https://doi.org/10.1007/978-3-030-58986-8_14	book	January 2020
FedSel: Federated SGD Under Local Differential Privacy with Top-k Dimension Selection Liu, Ruixuan; Cao, Yang; Yoshikawa, Masatoshi Database Systems for Advanced Applications https://doi.org/10.1007/978-3-030-59410-7_33	book	January 2020
Eigenvalues and expanders Alon, Noga Combinatorica, Vol. 6, Issue 2 https://doi.org/10.1007/BF02579166	journal	June 1986
Laplacians and the Cheeger Inequality for Directed Graphs Chung, Fan Annals of Combinatorics, Vol. 9, Issue 1 https://doi.org/10.1007/s00026-005-0237-z	journal	April 2005
Explicit Expanders of Every Degree and Size Alon, Noga Combinatorica, Vol. 41, Issue 4 https://doi.org/10.1007/s00493-020-4429-x	journal	February 2021
Online social networks: A survey of a global phenomenon Heidemann, Julia; Klier, Mathias; Probst, Florian Computer Networks, Vol. 56, Issue 18 https://doi.org/10.1016/j.comnet.2012.08.009	journal	December 2012
The Chromatic Number of Graph Powers Alon, Noga; Mohar, Bojan Combinatorics, Probability and Computing, Vol. 11, Issue 1 https://doi.org/10.1017/S0963548301004965	journal	January 2002
An Elementary Construction of Constant-Degree Expanders Alon, Noga; Schwartz, Oded; Shapira, Asaf Combinatorics, Probability and Computing, Vol. 17, Issue 3 https://doi.org/10.1017/S0963548307008851	journal	May 2008
Expander graphs and their applications Hoory, Shlomo; Linial, Nathan; Wigderson, Avi Bulletin of the American Mathematical Society, Vol. 43, Issue 04 https://doi.org/10.1090/S0273-0979-06-01126-8	journal	August 2006
Expander graphs in pure and applied mathematics Lubotzky, Alexander Bulletin of the American Mathematical Society, Vol. 49, Issue 1 https://doi.org/10.1090/S0273-0979-2011-01359-3	journal	January 2012
Expander codes Sipser, M.; Spielman, D. A. IEEE Transactions on Information Theory, Vol. 42, Issue 6 https://doi.org/10.1109/18.556667	journal	January 1996
Expander graph and communication-efficient decentralized optimization Chow, Yat-Tin; Shi, Wei; Wu, Tianyu 2016 50th Asilomar Conference on Signals, Systems and Computers https://doi.org/10.1109/ACSSC.2016.7869675	conference	November 2016
Distributed stochastic optimization and learning Shamir, Ohad; Srebro, Nathan 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton) https://doi.org/10.1109/ALLERTON.2014.7028543	conference	September 2014
Federated Learning with Bayesian Differential Privacy Triastcyn, Aleksei; Faltings, Boi 2019 IEEE International Conference on Big Data (Big Data) https://doi.org/10.1109/BigData47090.2019.9005465	conference	December 2019
A survey and comparison of peer-to-peer overlay network schemes No authors listed IEEE Communications Surveys & Tutorials, Vol. 7, Issue 2 https://doi.org/10.1109/COMST.2005.1610546	journal	January 2005
A Local Switch Markov Chain on Given Degree Graphs with Application in Connectivity of Peer-to-Peer Networks Feder, Tomas; Guetz, Adam; Mihail, Milena 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06) https://doi.org/10.1109/FOCS.2006.5	conference	January 2006
String Figure: A Scalable and Elastic Memory Network Architecture Ogleari, Matheus; Yu, Ye; Qian, Chen 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA) https://doi.org/10.1109/HPCA.2019.00016	conference	February 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Wang, Jianyu; Sahu, Anit Kumar; Yang, Zhouyi 2019 Sixth Indian Control Conference (ICC) https://doi.org/10.1109/ICC47138.2019.9123209	conference	December 2019
Space Shuffle: A Scalable, Flexible, and High-Bandwidth Data Center Network Yu, Ye; Qian, Chen 2014 IEEE 22nd International Conference on Network Protocols https://doi.org/10.1109/ICNP.2014.23	conference	October 2014
Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control Liu, Dongzhu; Simeone, Osvaldo IEEE Journal on Selected Areas in Communications, Vol. 39, Issue 1 https://doi.org/10.1109/JSAC.2020.3036948	journal	January 2021
Push-SAGA: A Decentralized Stochastic Algorithm With Variance Reduction Over Directed Graphs Qureshi, Muhammad I.; Xin, Ran; Kar, Soummya IEEE Control Systems Letters, Vol. 6 https://doi.org/10.1109/LCSYS.2021.3090652	journal	January 2022
Fast distributed coordinate descent for non-strongly convex losses Fercoq, Olivier; Qu, Zheng; Richtarik, Peter 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP) https://doi.org/10.1109/MLSP.2014.6958862	conference	September 2014
Exploiting Unintended Feature Leakage in Collaborative Learning Melis, Luca; Song, Congzheng; De Cristofaro, Emiliano 2019 IEEE Symposium on Security and Privacy (SP) https://doi.org/10.1109/SP.2019.00029	conference	May 2019
Distributed Subgradient Methods for Multi-Agent Optimization Nedic, Angelia; Ozdaglar, Asuman IEEE Transactions on Automatic Control, Vol. 54, Issue 1 https://doi.org/10.1109/TAC.2008.2009515	journal	January 2009
Federated Learning With Differential Privacy: Algorithms and Performance Analysis Wei, Kang; Li, Jun; Ding, Ming IEEE Transactions on Information Forensics and Security, Vol. 15 https://doi.org/10.1109/TIFS.2020.2988575	journal	January 2020
A Scalable and Resilient Layer-2 Network With Ethernet Compatibility Qian, Chen; Lam, Simon S. IEEE/ACM Transactions on Networking, Vol. 24, Issue 1 https://doi.org/10.1109/TNET.2014.2361773	journal	February 2016
Fastest Mixing Markov Chain on a Graph Boyd, Stephen; Diaconis, Persi; Xiao, Lin SIAM Review, Vol. 46, Issue 4 https://doi.org/10.1137/S0036144503423264	journal	January 2004
Geographic routing in d -dimensional spaces with guaranteed delivery and low stretch Lam, Simon S.; Qian, Chen Proceedings of the ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems https://doi.org/10.1145/1993744.1993770	conference	June 2011
A Hybrid Approach to Privacy-Preserving Federated Learning Truex, Stacey; Baracaldo, Nathalie; Anwar, Ali Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security https://doi.org/10.1145/3338501.3357370	conference	November 2019
HybridAlpha Xu, Runhua; Baracaldo, Nathalie; Zhou, Yi Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security https://doi.org/10.1145/3338501.3357371	conference	November 2019
LDP-Fed Truex, Stacey; Liu, Ling; Chow, Ka-Ho Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking https://doi.org/10.1145/3378679.3394533	conference	April 2020
Algebraic connectivity of graphs [Algebraic connectivity of graphs] Fiedler, Miroslav Czechoslovak Mathematical Journal, Vol. 23, Issue 2 https://doi.org/10.21136/CMJ.1973.101168	journal	January 1973

Similar Records

Decentralized and efficient control of transboundary pollution in federal systems

Journal Article · 1996 · Journal of Environmental Economics and Management · OSTI ID:518401

FEDERATED LEARNING ON STOCHASTIC NEURAL NETWORKS

Journal Article · 2025 · Journal of Machine Learning for Modeling and Computing · OSTI ID:3362498

Related Subjects

Mathematics

Efficient and Reliable Overlay Networks for Decentralized Federated Learning

Citation Formats

References (33)

Similar Records

Related Subjects