arxivcs.DCcs.LGeess.SP2026-07-13
Decentralized Gradient Descent: Bottleneck Regimes and Budget Complexity
Decentralized gradient descent (DGD) is widely used for solving distributed optimization problems over networks of agents. While its convergence properties are well understood, less is known about the communication and computation resources required to attain a prescribed accurac…