A Sharp Estimate on the Transient Time of Distributed Stochastic Gradient Descent

Pu, Shi; Olshevsky, Alex; Paschalidis, Ioannis Ch.

doi:10.1109/tac.2021.3126253

A Sharp Estimate on the Transient Time of Distributed Stochastic Gradient Descent

Journal Article · 01 November 2022 · IEEE Transactions on Automatic Control

DOI:https://doi.org/10.1109/tac.2021.3126253· OSTI ID:2422352

^[1]; ^[2]; ^[2]

School of Data Science, Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong, Shenzhen, China; OSTI
Department of Electrical and Computer Engineering and the Division of Systems Engineering, Boston University, Boston, MA, USA

Not provided.

Research Organization:: Boston Univ., MA (United States); Fraunhofer USA Inc., Plymouth, MI (United States)

Sponsoring Organization:: USDOE Advanced Research Projects Agency - Energy (ARPA-E)

DOE Contract Number:: AR0001282; EE0009696

OSTI ID:: 2422352

Journal Information:: IEEE Transactions on Automatic Control, Journal Name: IEEE Transactions on Automatic Control Journal Issue: 11 Vol. 67; ISSN 0018-9286

Publisher:: IEEE

Country of Publication:: United States

Language:: English

References (48)

Success and failure of adaptation-diffusion algorithms for consensus in multi-agent networks Morral, Gemma; Bianchi, Pascal; Fort, Gersende 53rd IEEE Conference on Decision and Control https://doi.org/10.1109/CDC.2014.7039609	conference	December 2014
A Flocking-Based Approach for Distributed Stochastic Optimization Pu, Shi; Garcia, Alfredo Operations Research, Vol. 66, Issue 1 https://doi.org/10.1287/opre.2017.1666	journal	February 2018
NEXT: In-Network Nonconvex Optimization Lorenzo, Paolo Di; Scutari, Gesualdo IEEE Transactions on Signal and Information Processing over Networks, Vol. 2, Issue 2 https://doi.org/10.1109/TSIPN.2016.2524588	journal	June 2016
Convergence Rates for Distributed Stochastic Optimization Over Random Networks Jakovetic, Dusan; Bajovic, Dragana; Sahu, Anit Kumar 2018 IEEE Conference on Decision and Control (CDC) https://doi.org/10.1109/CDC.2018.8619228	conference	December 2018
Excess-Risk of Distributed Stochastic Learners Towfic, Zaid J.; Chen, Jianshu; Sayed, Ali H. IEEE Transactions on Information Theory, Vol. 62, Issue 10 https://doi.org/10.1109/TIT.2016.2593769	journal	October 2016
On the Learning Behavior of Adaptive Networks—Part II: Performance Analysis No authors listed IEEE Transactions on Information Theory, Vol. 61, Issue 6 https://doi.org/10.1109/TIT.2015.2427352	journal	June 2015
Fast Convergence Rates for Distributed Non-Bayesian Learning Nedic, Angelia; Olshevsky, Alex; Uribe, Cesar A. IEEE Transactions on Automatic Control, Vol. 62, Issue 11 https://doi.org/10.1109/TAC.2017.2690401	journal	November 2017
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks Chen, Jianshu; Sayed, Ali H. IEEE Transactions on Signal Processing, Vol. 60, Issue 8 https://doi.org/10.1109/TSP.2012.2198470	journal	August 2012
Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs Nedic, Angelia; Olshevsky, Alex IEEE Transactions on Automatic Control, Vol. 61, Issue 12 https://doi.org/10.1109/TAC.2016.2529285	journal	December 2016
Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling Duchi, J. C.; Agarwal, A.; Wainwright, M. J. IEEE Transactions on Automatic Control, Vol. 57, Issue 3 https://doi.org/10.1109/TAC.2011.2161027	journal	March 2012
Distributed multi-agent optimization with state-dependent communication Lobel, Ilan; Ozdaglar, Asuman; Feijer, Diego Mathematical Programming, Vol. 129, Issue 2 https://doi.org/10.1007/s10107-011-0467-x	journal	June 2011
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs Nedić, Angelia; Olshevsky, Alex; Shi, Wei SIAM Journal on Optimization, Vol. 27, Issue 4 https://doi.org/10.1137/16M1084316	journal	January 2017
Adaptive Penalty-Based Distributed Stochastic Convex Optimization Towfic, Zaid J.; Sayed, Ali H. IEEE Transactions on Signal Processing, Vol. 62, Issue 15 https://doi.org/10.1109/TSP.2014.2331615	journal	August 2014
Swarming for Faster Convergence in Stochastic Optimization Pu, Shi; Garcia, Alfredo SIAM Journal on Control and Optimization, Vol. 56, Issue 4 https://doi.org/10.1137/17M1111085	journal	January 2018
Communication-efficient algorithms for decentralized and stochastic optimization Lan, Guanghui; Lee, Soomin; Zhou, Yi Mathematical Programming, Vol. 180, Issue 1-2 https://doi.org/10.1007/s10107-018-1355-4	journal	December 2018
A Stochastic Approximation Method Robbins, Herbert; Monro, Sutton The Annals of Mathematical Statistics, Vol. 22, Issue 3 https://doi.org/10.1214/aoms/1177729586	journal	September 1951
Distributed Learning Algorithms for Spectrum Sharing in Spatial Random Access Wireless Networks Cohen, Kobi; Nedic, Angelia; Srikant, R. IEEE Transactions on Automatic Control, Vol. 62, Issue 6 https://doi.org/10.1109/TAC.2016.2626578	journal	June 2017
Variance-Reduced Decentralized Stochastic Optimization With Accelerated Convergence Xin, Ran; Khan, Usman A.; Kar, Soummya IEEE Transactions on Signal Processing, Vol. 68 https://doi.org/10.1109/TSP.2020.3031071	journal	January 2020
Supervised Learning Under Distributed Features Ying, Bicheng; Yuan, Kun; Sayed, Ali H. IEEE Transactions on Signal Processing, Vol. 67, Issue 4 https://doi.org/10.1109/TSP.2018.2881661	journal	February 2019
Harnessing Smoothness to Accelerate Distributed Optimization Qu, Guannan; Li, Na IEEE Transactions on Control of Network Systems, Vol. 5, Issue 3 https://doi.org/10.1109/TCNS.2017.2698261	journal	September 2018
Distributed Recursive Least-Squares: Stability and Performance Analysis Mateos, Gonzalo; Giannakis, Georgios B. IEEE Transactions on Signal Processing, Vol. 60, Issue 7 https://doi.org/10.1109/TSP.2012.2194290	journal	July 2012
An Exact Quantized Decentralized Gradient Descent Algorithm Reisizadeh, Amirhossein; Mokhtari, Aryan; Hassani, Hamed IEEE Transactions on Signal Processing, Vol. 67, Issue 19 https://doi.org/10.1109/TSP.2019.2932876	journal	October 2019
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization Nedic, Angelia; Olshevsky, Alex; Rabbat, Michael G. Proceedings of the IEEE, Vol. 106, Issue 5 https://doi.org/10.1109/JPROC.2018.2817461	journal	May 2018
EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization Shi, Wei; Ling, Qing; Wu, Gang SIAM Journal on Optimization, Vol. 25, Issue 2 https://doi.org/10.1137/14096668X	journal	January 2015
Distributed Coupled Multiagent Stochastic Optimization Alghunaim, Sulaiman A.; Sayed, Ali H. IEEE Transactions on Automatic Control, Vol. 65, Issue 1 https://doi.org/10.1109/TAC.2019.2906495	journal	January 2020
On Projected Stochastic Gradient Descent Algorithm with Weighted Averaging for Least Squares Regression Cohen, Kobi; Nedic, Angelia; Srikant, R. IEEE Transactions on Automatic Control, Vol. 62, Issue 11 https://doi.org/10.1109/TAC.2017.2705559	journal	November 2017
Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization Bianchi, Pascal; Jakubowicz, Jérémie IEEE Transactions on Automatic Control, Vol. 58, Issue 2 https://doi.org/10.1109/TAC.2012.2209984	journal	February 2013
Fast Distributed Gradient Methods Jakovetic, Dusan; Xavier, Joao; Moura, Jose M. F. IEEE Transactions on Automatic Control, Vol. 59, Issue 5 https://doi.org/10.1109/TAC.2014.2298712	journal	May 2014
Multi-fidelity optimization via surrogate modelling Forrester, Alexander I. J.; Sóbester, András; Keane, Andy J. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 463, Issue 2088 https://doi.org/10.1098/rspa.2007.1900	journal	September 2007
Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication Kia, Solmaz S.; Cortés, Jorge; Martínez, Sonia Automatica, Vol. 55 https://doi.org/10.1016/j.automatica.2015.03.001	journal	May 2015
Asymptotic Network Independence in Distributed Stochastic Optimization for Machine Learning: Examining Distributed and Centralized Stochastic Gradient Descent Pu, Shi; Olshevsky, Alex; Paschalidis, Ioannis Ch. IEEE Signal Processing Magazine, Vol. 37, Issue 3 https://doi.org/10.1109/MSP.2020.2975212	journal	May 2020
Federated learning of predictive models from federated Electronic Health Records Brisimi, Theodora S.; Chen, Ruidi; Mela, Theofanie International Journal of Medical Informatics, Vol. 112 https://doi.org/10.1016/j.ijmedinf.2018.01.007	journal	April 2018
Decentralized Consensus Algorithm with Delayed and Stochastic Gradients Sirb, Benjamin; Ye, Xiaojing SIAM Journal on Optimization, Vol. 28, Issue 2 https://doi.org/10.1137/16M1081257	journal	January 2018
Convergence of Asynchronous Distributed Gradient Methods Over Stochastic Networks Xu, Jinming; Zhu, Shanying; Soh, Yeng Chai IEEE Transactions on Automatic Control, Vol. 63, Issue 2 https://doi.org/10.1109/TAC.2017.2730481	journal	February 2018
On the limiting behavior of distributed optimization strategies Chen, Jianshu; Sayed, Ali H. 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton) https://doi.org/10.1109/Allerton.2012.6483402	conference	October 2012
Distributed Subgradient Methods for Multi-Agent Optimization Nedic, Angelia; Ozdaglar, Asuman IEEE Transactions on Automatic Control, Vol. 54, Issue 1 https://doi.org/10.1109/TAC.2008.2009515	journal	January 2009
Constrained Consensus and Optimization in Multi-Agent Networks Nedic, A.; Ozdaglar, A.; Parrilo, P. A. IEEE Transactions on Automatic Control, Vol. 55, Issue 4 https://doi.org/10.1109/TAC.2010.2041686	journal	April 2010
Linear Time Average Consensus and Distributed Optimization on Fixed Graphs Olshevsky, Alex SIAM Journal on Control and Optimization, Vol. 55, Issue 6 https://doi.org/10.1137/16m1076629	journal	January 2017
Stochastic Subgradient Algorithms for Strongly Convex Optimization Over Distributed Networks Sayin, Muhammed O.; Vanli, N. Denizcan; Kozat, Suleyman S. IEEE Transactions on Network Science and Engineering, Vol. 4, Issue 4 https://doi.org/10.1109/TNSE.2017.2713396	journal	October 2017
A Distributed Algorithm for Convex Constrained Optimization Under Noise Chatzipanagiotis, Nikolaos; Zavlanos, Michael M. IEEE Transactions on Automatic Control, Vol. 61, Issue 9 https://doi.org/10.1109/TAC.2015.2504932	journal	September 2016
Success and Failure of Adaptation-Diffusion Algorithms With Decaying Step Size in Multiagent Networks Morral, Gemma; Bianchi, Pascal; Fort, Gersende IEEE Transactions on Signal Processing, Vol. 65, Issue 11 https://doi.org/10.1109/TSP.2017.2666771	journal	June 2017
Distributed asynchronous deterministic and stochastic gradient optimization algorithms Tsitsiklis, J.; Bertsekas, D.; Athans, M. IEEE Transactions on Automatic Control, Vol. 31, Issue 9 https://doi.org/10.1109/TAC.1986.1104412	journal	September 1986
Robust Stochastic Approximation Approach to Stochastic Programming Nemirovski, A.; Juditsky, A.; Lan, G. SIAM Journal on Optimization, Vol. 19, Issue 4 https://doi.org/10.1137/070704277	journal	January 2009
Distributed Asynchronous Constrained Stochastic Optimization Srivastava, Kunal; Nedic, Angelia IEEE Journal of Selected Topics in Signal Processing, Vol. 5, Issue 4 https://doi.org/10.1109/JSTSP.2011.2118740	journal	August 2011
Distributed stochastic gradient tracking methods Pu, Shi; Nedić, Angelia Mathematical Programming, Vol. 187, Issue 1-2 https://doi.org/10.1007/s10107-020-01487-0	journal	March 2020
On the Learning Behavior of Adaptive Networks—Part I: Transient Analysis No authors listed IEEE Transactions on Information Theory, Vol. 61, Issue 6 https://doi.org/10.1109/TIT.2015.2427360	journal	June 2015
Push–Pull Gradient Methods for Distributed Optimization in Networks Pu, Shi; Shi, Wei; Xu, Jinming IEEE Transactions on Automatic Control, Vol. 66, Issue 1 https://doi.org/10.1109/TAC.2020.2972824	journal	January 2021
Proximal-Gradient Algorithms for Tracking Cascades Over Social Networks Baingana, Brian; Mateos, Gonzalo; Giannakis, Georgios B. IEEE Journal of Selected Topics in Signal Processing, Vol. 8, Issue 4 https://doi.org/10.1109/JSTSP.2014.2317284	journal	August 2014

Similar Records

A Stochastic Gradient Descent Approach for Stochastic Optimal Control

Journal Article · 2020 · East Asian Journal on Applied Mathematics · OSTI ID:1814258

Stochastic gradient descent for optimization for nuclear systems

Journal Article · 2023 · Scientific Reports · OSTI ID:2417878

Stochastic Gradient-Based Distributed Bayesian Estimation in Cooperative Sensor Networks

Journal Article · 2021 · IEEE Transactions on Signal Processing · OSTI ID:1811776

Related Subjects

Automation & Control Systems
Engineering

A Sharp Estimate on the Transient Time of Distributed Stochastic Gradient Descent

Citation Formats

References (48)

Similar Records

Related Subjects