kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Distributed Online Optimization with Long-Term Constraints
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control).ORCID iD: 0000-0002-4679-4673
2022 (English)In: IEEE Transactions on Automatic Control, ISSN 0018-9286, E-ISSN 1558-2523, Vol. 67, no 3, p. 1089-1104Article in journal (Refereed) Published
Abstract [en]

In this article, we consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained vector, experiences a loss equal to an arbitrary convex function evaluated at this vector, and may communicate to its neighbors in the graph. The objective is to minimize the system-wide loss accumulated over time. We propose a decentralized algorithm with regret and cumulative constraint violation in O(T c,1-c ) and O(T1-c/2), respectively, for any cin (0,1), where T is the time horizon. When the loss functions are strongly convex, we establish improved regret and constraint violation upper bounds in O( (T)) and O(T (T)). These regret scalings match those obtained by state-of-the-art algorithms and fundamental limits in the corresponding centralized online optimization problem (for both convex and strongly convex loss functions). In the case of bandit feedback, the proposed algorithms achieve a regret and constraint violation in O(T c,1-c/3 ) and O(T1-c/2) for any cin (0,1). We numerically illustrate the performance of our algorithms for the particular case of distributed online regularized linear regression problems on synthetic and real data.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2022. Vol. 67, no 3, p. 1089-1104
Keywords [en]
absolute constraint violation, Distributed online convex optimization, longterm constraints, one-point bandit feedback, regret, Convex optimization, Distributed database systems, Functions, Communication graphs, Constraint violation, Cumulative constraints, Decentralized algorithms, Distributed systems, Online convex optimizations, Online optimization, State-of-the-art algorithms, Distributed computer systems
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:kth:diva-305491DOI: 10.1109/TAC.2021.3057601ISI: 000761219400005Scopus ID: 2-s2.0-85100858757OAI: oai:DiVA.org:kth-305491DiVA, id: diva2:1615461
Note

QC 20220323

Available from: 2021-11-30 Created: 2021-11-30 Last updated: 2022-06-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Proutiere, Alexandre

Search in DiVA

By author/editor
Proutiere, Alexandre
By organisation
Decision and Control Systems (Automatic Control)
In the same journal
IEEE Transactions on Automatic Control
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 47 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf