kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Federated Learning Using Three-Operator ADMM
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Network and Systems Engineering. Ericsson AB.ORCID iD: 0000-0002-5334-4734
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Network and Systems Engineering. Princeton University, Princeton, NJ, USA.ORCID iD: 0000-0002-4503-4242
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control). Ericsson AB.ORCID iD: 0000-0002-2289-3159
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering. Ericsson AB.ORCID iD: 0000-0002-7882-3280
Show others and affiliations
2023 (English)In: IEEE Journal on Selected Topics in Signal Processing, ISSN 1932-4553, E-ISSN 1941-0484, Vol. 17, no 1, p. 205-221Article in journal (Refereed) Published
Abstract [en]

Federated learning (FL) has emerged as an instance of distributed machine learning paradigm that avoids the transmission of data generated on the users' side. Although data are not transmitted, edge devices have to deal with limited communication bandwidths, data heterogeneity, and straggler effects due to the limited computational resources of users' devices. A prominent approach to overcome such difficulties is FedADMM, which is based on the classical two-operator consensus alternating direction method of multipliers (ADMM). The common assumption of FL algorithms, including FedADMM, is that they learn a global model using data only on the users' side and not on the edge server. However, in edge learning, the server is expected to be near the base station and have direct access to rich datasets. In this paper, we argue that leveraging the rich data on the edge server is much more beneficial than utilizing only user datasets. Specifically, we show that the mere application of FL with an additional virtual user node representing the data on the edge server is inefficient. We propose FedTOP-ADMM, which generalizes FedADMM and is based on a three-operator ADMM-type technique that exploits a smooth cost function on the edge server to learn a global model parallel to the edge devices. Our numerical experiments indicate that FedTOP-ADMM has substantial gain up to 33% in communication efficiency to reach a desired test accuracy with respect to FedADMM, including a virtual user on the edge server.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023. Vol. 17, no 1, p. 205-221
National Category
Communication Systems
Identifiers
URN: urn:nbn:se:kth:diva-323513DOI: 10.1109/jstsp.2022.3221681ISI: 000937190500014Scopus ID: 2-s2.0-85142775857OAI: oai:DiVA.org:kth-323513DiVA, id: diva2:1732721
Note

QC 20230426

Available from: 2023-01-31 Created: 2023-01-31 Last updated: 2024-07-24Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Kant, ShashiBarros da Silva Jr., José MairtonFodor, GaborGöransson, BoBengtsson, MatsFischione, Carlo

Search in DiVA

By author/editor
Kant, ShashiBarros da Silva Jr., José MairtonFodor, GaborGöransson, BoBengtsson, MatsFischione, Carlo
By organisation
Network and Systems EngineeringDecision and Control Systems (Automatic Control)Information Science and Engineering
In the same journal
IEEE Journal on Selected Topics in Signal Processing
Communication Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 258 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf