Rate analysis of dual averaging for nonconvex distributed optimizationShow others and affiliations
2023 (English)In: IFAC-PapersOnLine, Elsevier BV , 2023, Vol. 56, p. 5209-5214Conference paper, Published paper (Refereed)
Abstract [en]
This work studies nonconvex distributed constrained optimization over stochastic communication networks. We revisit the distributed dual averaging algorithm, which is known to converge for convex problems. We start from the centralized case, for which the change of two consecutive updates is taken as the suboptimality measure. We validate the use of such a measure by showing that it is closely related to stationarity. This equips us with a handle to study the convergence of dual averaging in nonconvex optimization. We prove that the squared norm of this suboptimality measure converges at rate O(1/t). Then, for the distributed setup we show convergence to the stationary point at rate O(1/t). Finally, a numerical example is given to illustrate our theoretical results.
Place, publisher, year, edition, pages
Elsevier BV , 2023. Vol. 56, p. 5209-5214
Series
IFAC-PapersOnLine, ISSN 2405-8963 ; 56
Keywords [en]
distributed constrained optimization, Dual averaging, multi-agent consensus, nonconvex optimization, stochastic networks
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:kth:diva-343686DOI: 10.1016/j.ifacol.2023.10.117Scopus ID: 2-s2.0-85184963049OAI: oai:DiVA.org:kth-343686DiVA, id: diva2:1839880
Conference
22nd IFAC World Congress, Yokohama, Japan, Jul 9 2023 - Jul 14 2023
Note
QC 20240223
Part of ISBN 9781713872344
2024-02-222024-02-222024-02-23Bibliographically approved