kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control). (Digital Futures)ORCID iD: 0000-0003-4299-0471
Show others and affiliations
2023 (English)In: IEEE Transactions on Control of Network Systems, E-ISSN 2325-5870, Vol. 10, no 1, p. 75-86Article in journal (Refereed) Published
Abstract [en]

In this article, we consider distributed nonconvex optimization over an undirected connected network. Each agent can only access to its own local nonconvex cost function and all agents collaborate to minimize the sum of these functions by using local information exchange. We first propose a modified alternating direction method of multipliers (ADMM) algorithm. We show that the proposed algorithm converges to a stationary point with the sublinear rate O(1/T) if each local cost function is smooth and the algorithm parameters are chosen appropriately. We also show that the proposed algorithm linearly converges to a global optimum under an additional condition that the global cost function satisfies the Polyak-Łojasiewicz condition, which is weaker than the commonly used conditions for showing linear convergence rates including strong convexity. We then propose a distributed linearized ADMM (L-ADMM) algorithm, derived from the modified ADMM algorithm, by linearizing the local cost function at each iteration. We show that the L-ADMM algorithm has the same convergence properties as the modified ADMM algorithm under the same conditions. Numerical simulations are included to verify the correctness and efficiency of the proposed algorithms. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023. Vol. 10, no 1, p. 75-86
Keywords [en]
Alternating direction method of multipliers (ADMM), distributed optimization, linear convergence, linearized ADMM, Polyak ojasiewicz condition, Costs, Iterative methods, Alternating directions method of multipliers, Communications networks, Condition, Convergence, Convex functions, Cost-function, Nonconvex optimization, Nonconvex-optimization, Sublinear, Symmetric matrices, Cost functions
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:kth:diva-325690DOI: 10.1109/TCNS.2022.3186653ISI: 000967284600001Scopus ID: 2-s2.0-85133731914OAI: oai:DiVA.org:kth-325690DiVA, id: diva2:1750026
Note

QC 20230412

Available from: 2023-04-12 Created: 2023-04-12 Last updated: 2023-05-15Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Yi, XinleiJohansson, Karl Henrik

Search in DiVA

By author/editor
Yi, XinleiJohansson, Karl Henrik
By organisation
Decision and Control Systems (Automatic Control)
In the same journal
IEEE Transactions on Control of Network Systems
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 49 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf