COMPOSITE FEDERATED LEARNING WITH HETEROGENEOUS DATA
2024 (English)In: 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2024, p. 8946-8950Conference paper, Published paper (Refereed)
Abstract [en]
We propose a novel algorithm for solving the composite Federated Learning (FL) problem. This algorithm manages non-smooth regularization by strategically decoupling the proximal operator and communication, and addresses client drift without any assumptions about data similarity. Moreover, each worker uses local updates to reduce the communication frequency with the server and transmits only a d-dimensional vector per communication round. We prove that our algorithm converges linearly to a neighborhood of the optimal solution and demonstrate the superiority of our algorithm over state-of-the-art methods in numerical experiments.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. p. 8946-8950
Series
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, ISSN 1520-6149
Keywords [en]
Composite federated learning, heterogeneous data, local update
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-348288DOI: 10.1109/ICASSP48485.2024.10447718ISI: 001396233802047Scopus ID: 2-s2.0-85195366479OAI: oai:DiVA.org:kth-348288DiVA, id: diva2:1874656
Conference
49th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024, Seoul, Korea, Apr 14 2024 - Apr 19 2024
Note
QC 20240626
Part of ISBN 979-835034485-1
2024-06-202024-06-202025-03-24Bibliographically approved