kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Communication Compression for Distributed Nonconvex Optimization
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control).ORCID iD: 0000-0003-4299-0471
AlgoRhythm Inc, Wuhan, China.
State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang, China.
State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang, China.
Show others and affiliations
2023 (English)In: IEEE Transactions on Automatic Control, ISSN 0018-9286, E-ISSN 1558-2523, Vol. 68, no 9, p. 5477-5492Article in journal (Refereed) Published
Abstract [en]

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents iteratively communicate with neighbors, we propose three distributed primal–dual algorithms with compressed communication. The first two algorithms are applicable to a general class of compressors with bounded relative compression error and the third algorithm is suitable for two general classes of compressors with bounded absolute compression error. We show that the proposed distributed algorithms with compressed communication have comparable convergence properties as state-of-the-art algorithms with exact communication. Specifically, we show that they can find first-order stationary points with sublinear convergence rate when each local cost function is smooth, where is the total number of iterations, and find global optima with linear convergence rate under an additional condition that the global cost function satisfies the Polyak–Łojasiewicz condition. Numerical simulations are provided to illustrate the effectiveness of the theoretical results.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023. Vol. 68, no 9, p. 5477-5492
Keywords [en]
Communication compression, distributed optimization, linear convergence, nonconvex optimization, Polyak–Łojasiewicz condition
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:kth:diva-335765DOI: 10.1109/TAC.2022.3225515ISI: 001059698200021Scopus ID: 2-s2.0-85144046697OAI: oai:DiVA.org:kth-335765DiVA, id: diva2:1795785
Note

QC 20230911

Available from: 2023-09-11 Created: 2023-09-11 Last updated: 2023-10-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Yi, XinleiJohansson, Karl H.

Search in DiVA

By author/editor
Yi, XinleiJohansson, Karl H.
By organisation
Decision and Control Systems (Automatic Control)
In the same journal
IEEE Transactions on Automatic Control
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 76 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf