A Decentralized Primal-Dual Framework for Non-Convex Smooth Consensus Optimization

Mancino-Ball, Gabriel; Xu, Yangyang; Chen, Jie

doi:10.1109/tsp.2023.3239799

A Decentralized Primal-Dual Framework for Non-Convex Smooth Consensus Optimization

Journal Article · 01 January 2023 · IEEE Transactions on Signal Processing

DOI:https://doi.org/10.1109/tsp.2023.3239799· OSTI ID:2418275

^[1]; ^[2]; ^[3]

Department of Mathematical Sciences, Rensselaer Polytechnic Institute, Troy, NY, USA; OSTI
Department of Mathematical Sciences, Rensselaer Polytechnic Institute, Troy, NY, USA
MIT-IBM Watson AI Lab, IBM, Cambridge, MA, USA

Not provided.

Research Organization:: Iowa State Univ., Ames, IA (United States)

Sponsoring Organization:: USDOE Office of Electricity Delivery and Energy Reliability (OE)

DOE Contract Number:: OE0000910

OSTI ID:: 2418275

Journal Information:: IEEE Transactions on Signal Processing, Journal Name: IEEE Transactions on Signal Processing Vol. 71; ISSN 1053-587X

Publisher:: IEEE

Country of Publication:: United States

Language:: English

References (34)

NEXT: In-Network Nonconvex Optimization Lorenzo, Paolo Di; Scutari, Gesualdo IEEE Transactions on Signal and Information Processing over Networks, Vol. 2, Issue 2 https://doi.org/10.1109/TSIPN.2016.2524588	journal	June 2016
Balancing Communication and Computation in Distributed Optimization Berahas, Albert S.; Bollapragada, Raghu; Keskar, Nitish Shirish IEEE Transactions on Automatic Control, Vol. 64, Issue 8 https://doi.org/10.1109/TAC.2018.2880407	journal	August 2019
On the Linear Convergence of the ADMM in Decentralized Consensus Optimization Shi, Wei; Ling, Qing; Yuan, Kun IEEE Transactions on Signal Processing, Vol. 62, Issue 7 https://doi.org/10.1109/TSP.2014.2304432	journal	April 2014
Decentralized multi-vehicle path coordination under communication constraints Abichandani, Pramod; Benson, Hande Y.; Kam, Moshe 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems https://doi.org/10.1109/IROS.2011.6095093	conference	September 2011
Distributed nonconvex constrained optimization over time-varying digraphs Scutari, Gesualdo; Sun, Ying Mathematical Programming, Vol. 176, Issue 1-2 https://doi.org/10.1007/s10107-018-01357-w	journal	February 2019
Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks Chen, Jianshu; Sayed, Ali H. IEEE Transactions on Signal Processing, Vol. 60, Issue 8 https://doi.org/10.1109/TSP.2012.2198470	journal	August 2012
Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs Nedić, Angelia; Olshevsky, Alex; Shi, Wei SIAM Journal on Optimization, Vol. 27, Issue 4 https://doi.org/10.1137/16M1084316	journal	January 2017
FlexPD: A Flexible Framework of First-Order Primal-Dual Algorithms for Distributed Optimization Mansoori, Fatemeh; Wei, Ermin IEEE Transactions on Signal Processing, Vol. 69 https://doi.org/10.1109/TSP.2021.3083981	journal	January 2021
Distributed Non-Convex First-Order Optimization and Information Processing: Lower Complexity Bounds and Rate Optimal Algorithms Sun, Haoran; Hong, Mingyi IEEE Transactions on Signal Processing, Vol. 67, Issue 22 https://doi.org/10.1109/TSP.2019.2943230	journal	November 2019
Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems Wang, Zhiguo; Zhang, Jiawei; Chang, Tsung-Hui IEEE Transactions on Signal Processing, Vol. 69 https://doi.org/10.1109/TSP.2021.3097211	journal	January 2021
Gradient-based learning applied to document recognition Lecun, Y.; Bottou, L.; Bengio, Y. Proceedings of the IEEE, Vol. 86, Issue 11 https://doi.org/10.1109/5.726791	journal	January 1998
EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization Shi, Wei; Ling, Qing; Wu, Gang SIAM Journal on Optimization, Vol. 25, Issue 2 https://doi.org/10.1137/14096668X	journal	January 2015
A fast Iterative Shrinkage-Thresholding Algorithm with application to wavelet-based image deblurring Beck, Amir; Teboulle, Marc 2009 IEEE International Conference on Acoustics, Speech and Signal Processing https://doi.org/10.1109/ICASSP.2009.4959678	conference	April 2009
On the Convergence of Decentralized Gradient Descent Yuan, Kun; Ling, Qing; Yin, Wotao SIAM Journal on Optimization, Vol. 26, Issue 3 https://doi.org/10.1137/130943170	journal	January 2016
Accelerated linear iterations for distributed averaging Liu, Ji; Morse, A. Stephen Annual Reviews in Control, Vol. 35, Issue 2 https://doi.org/10.1016/j.arcontrol.2011.10.005	journal	December 2011
Fast linear iterations for distributed averaging Xiao, Lin; Boyd, Stephen Systems & Control Letters, Vol. 53, Issue 1 https://doi.org/10.1016/j.sysconle.2004.02.022	journal	September 2004
On Nonconvex Decentralized Gradient Descent Zeng, Jinshan; Yin, Wotao IEEE Transactions on Signal Processing, Vol. 66, Issue 11 https://doi.org/10.1109/TSP.2018.2818081	journal	June 2018
A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization Yi, Xinlei; Zhang, Shengjun; Yang, Tao IEEE/CAA Journal of Automatica Sinica, Vol. 9, Issue 5 https://doi.org/10.1109/JAS.2022.105554	journal	May 2022
A dual approach for optimal algorithms in distributed optimization over networks Uribe, César A.; Lee, Soomin; Gasnikov, Alexander Optimization Methods and Software, Vol. 36, Issue 1 https://doi.org/10.1080/10556788.2020.1750013	journal	April 2020
Decentralized Consensus Optimization With Asynchrony and Delays Wu, Tianyu; Yuan, Kun; Ling, Qing IEEE Transactions on Signal and Information Processing over Networks, Vol. 4, Issue 2 https://doi.org/10.1109/TSIPN.2017.2695121	journal	June 2018
Fast Decentralized Nonconvex Finite-Sum Optimization with Recursive Variance Reduction Xin, Ran; Khan, Usman A.; Kar, Soummya SIAM Journal on Optimization, Vol. 32, Issue 1 https://doi.org/10.1137/20M1361158	journal	January 2022
Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers Boyd, Stephen; Parikh, Neal; Chu, Eric https://doi.org/10.1561/2200000016	book	January 2011
Relative-error approximate versions of Douglas–Rachford splitting and special cases of the ADMM Eckstein, Jonathan; Yao, Wang Mathematical Programming, Vol. 170, Issue 2 https://doi.org/10.1007/s10107-017-1160-5	journal	May 2017
Prox-PDA: The Proximal Primal-Dual Algorithm for Fast Distributed Nonconvex Optimization and Learning Over Networks Hong, Mingyi; Hajinezhad, Davood; Zhao, Ming-Min Unpublished https://doi.org/10.13140/RG.2.2.25204.14729	text	January 2017
Distributed Subgradient Methods for Multi-Agent Optimization Nedic, Angelia; Ozdaglar, Asuman IEEE Transactions on Automatic Control, Vol. 54, Issue 1 https://doi.org/10.1109/TAC.2008.2009515	journal	January 2009
Microsoft Academic Graph: When experts are not enough Wang, Kuansan; Shen, Zhihong; Huang, Chiyuan Quantitative Science Studies, Vol. 1, Issue 1 https://doi.org/10.1162/qss_a_00021	journal	February 2020
Global Convergence of ADMM in Nonconvex Nonsmooth Optimization Wang, Yu; Yin, Wotao; Zeng, Jinshan Journal of Scientific Computing, Vol. 78, Issue 1 https://doi.org/10.1007/s10915-018-0757-z	journal	June 2018
FedPD: A Federated Learning Framework With Adaptivity to Non-IID Data Zhang, Xinwei; Hong, Mingyi; Dhople, Sairaj IEEE Transactions on Signal Processing, Vol. 69 https://doi.org/10.1109/TSP.2021.3115952	journal	January 2021
Asynchrounous Decentralized Learning of a Neural Network Liang, Xinyue; Javid, Alireza M.; Skoglund, Mikael ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) https://doi.org/10.1109/ICASSP40776.2020.9053996	conference	May 2020
A Distributed, Asynchronous, and Incremental Algorithm for Nonconvex Optimization: An ADMM Approach Hong, Mingyi IEEE Transactions on Control of Network Systems, Vol. 5, Issue 3 https://doi.org/10.1109/TCNS.2017.2657460	journal	September 2018
Push–Pull Gradient Methods for Distributed Optimization in Networks Pu, Shi; Shi, Wei; Xu, Jinming IEEE Transactions on Automatic Control, Vol. 66, Issue 1 https://doi.org/10.1109/TAC.2020.2972824	journal	January 2021
Accelerated Distributed Nesterov Gradient Descent Qu, Guannan; Li, Na IEEE Transactions on Automatic Control, Vol. 65, Issue 6 https://doi.org/10.1109/TAC.2019.2937496	journal	June 2020
On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers Wei, Ermin; Ozdaglar, Asuman 2013 IEEE Global Conference on Signal and Information Processing (GlobalSIP) https://doi.org/10.1109/GlobalSIP.2013.6736937	conference	December 2013
Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems Hong, Mingyi; Luo, Zhi-Quan; Razaviyayn, Meisam SIAM Journal on Optimization, Vol. 26, Issue 1 https://doi.org/10.1137/140990309	journal	January 2016

Similar Records

Online Primal-Dual Methods With Measurement Feedback for Time-Varying Convex Optimization

Journal Article · 2019 · IEEE Transactions on Signal Processing · OSTI ID:1496848

A Smoothed Augmented Lagrangian Framework for Convex Optimization with Nonsmooth Constraints

Journal Article · 2025 · Journal of Scientific Computing · OSTI ID:3010461

Primal-Dual Mesh Optimization with Mathematical Foundations.

Conference · 2018 · OSTI ID:1596226

Related Subjects

Engineering

A Decentralized Primal-Dual Framework for Non-Convex Smooth Consensus Optimization

Citation Formats

References (34)

Similar Records

Related Subjects