kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (4 of 4) Show all publications
Isaksson, M., Listo Zec, E., Coster, R., Gillblad, D. & Girdzijauskas, S. (2023). Adaptive Expert Models for Federated Learning. In: Goebel, R Yu, H Faltings, B Fan, L Xiong, Z (Ed.), Trustworthy Federated Learning: First International Workshop, FL 2022. Paper presented at Trustworthy Federated Learning - First International Workshop, FL 2022, Held in Conjunction with IJCAI 2022, Vienna, Austria, July 23, 2022 (pp. 1-16). Springer Nature, 13448
Open this publication in new window or tab >>Adaptive Expert Models for Federated Learning
Show others...
2023 (English)In: Trustworthy Federated Learning: First International Workshop, FL 2022 / [ed] Goebel, R Yu, H Faltings, B Fan, L Xiong, Z, Springer Nature , 2023, Vol. 13448, p. 1-16Conference paper, Published paper (Refereed)
Abstract [en]

Federated Learning (FL) is a promising framework for distributed learning when data is private and sensitive. However, the state-of-the-art solutions in this framework are not optimal when data is heterogeneous and non-IID. We propose a practical and robust approach to personalization in FL that adjusts to heterogeneous and non-IID data by balancing exploration and exploitation of several global models. To achieve our aim of personalization, we use a Mixture of Experts (MoE) that learns to group clients that are similar to each other, while using the global models more efficiently. We show that our approach achieves an accuracy up to 29.78% better than the state-of-the-art and up to 4.38% better compared to a local model in a pathological non-IID setting, even though we tune our approach in the IID setting.

Place, publisher, year, edition, pages
Springer Nature, 2023
Series
Lecture Notes in Artificial Intelligence, ISSN 2945-9133
Keywords
Federated learning, Personalization, Privacy preserving
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-330493 (URN)10.1007/978-3-031-28996-5_1 (DOI)000999818400001 ()2-s2.0-85152565856 (Scopus ID)
Conference
Trustworthy Federated Learning - First International Workshop, FL 2022, Held in Conjunction with IJCAI 2022, Vienna, Austria, July 23, 2022
Note

Part of proceedings ISBN 978-3-031-28995-8  978-3-031-28996-5

QC 20230630

Available from: 2023-06-30 Created: 2023-06-30 Last updated: 2024-05-27Bibliographically approved
Isaksson, M., Vannella, F., Sandberg, D. & Coster, R. (2023). mmWave Beam Selection in Analog Beamforming Using Personalized Federated Learning. In: Proceedings - 2023 IEEE Future Networks World Forum: Future Networks: Imagining the Network of the Future, FNWF 2023: . Paper presented at 6th IEEE Future Networks World Forum, FNWF 2023, Baltimore, United States of America, Nov 13 2023 - Nov 15 2023. Institute of Electrical and Electronics Engineers Inc.
Open this publication in new window or tab >>mmWave Beam Selection in Analog Beamforming Using Personalized Federated Learning
2023 (English)In: Proceedings - 2023 IEEE Future Networks World Forum: Future Networks: Imagining the Network of the Future, FNWF 2023, Institute of Electrical and Electronics Engineers Inc. , 2023Conference paper, Published paper (Refereed)
Abstract [en]

Using analog beamforming in mmWave frequency bands we can focus the energy towards a receiver to achieve high throughput. However, this requires the network to quickly find the best downlink beam configuration in the face of non-IID data. We propose a personalized Federated Learning (FL) method to address this challenge, where we learn a mapping between uplink Sub-6GHz channel estimates and the best downlink beam in heterogeneous scenarios with non-IID characteristics. We also devise FedLion, a FL implementation of the Lion optimization algorithm. Our approach reduces the signalling overhead and provides superior performance, up to 33.6% higher accuracy than a single FL model and 6 % higher than a local model.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2023
Keywords
beam selection, beamforming, distributed learning, federated learning
National Category
Signal Processing
Identifiers
urn:nbn:se:kth:diva-347321 (URN)10.1109/FNWF58287.2023.10520606 (DOI)001229556600119 ()2-s2.0-85194158189 (Scopus ID)
Conference
6th IEEE Future Networks World Forum, FNWF 2023, Baltimore, United States of America, Nov 13 2023 - Nov 15 2023
Note

QC 20240612

Part of ISBN 979-835032458-7

Available from: 2024-06-10 Created: 2024-06-10 Last updated: 2024-10-11Bibliographically approved
Isaksson, M., Listo Zec, E., Cöster, R., Daniel, G. & Girdzijauskas, S. (2022). Adaptive Expert Models for Personalization in Federated Learning. In: International Workshop on Trustworthy Federated Learningin Conjunction with IJCAI 2022 (FL-IJCAI'22): . Paper presented at International Workshop on Trustworthy Federated Learning , Vienna, Austria, July 23, 2022.
Open this publication in new window or tab >>Adaptive Expert Models for Personalization in Federated Learning
Show others...
2022 (English)In: International Workshop on Trustworthy Federated Learningin Conjunction with IJCAI 2022 (FL-IJCAI'22), 2022Conference paper, Published paper (Refereed)
Abstract [en]

Federated Learning (FL) is a promising framework for distributed learning whendata is private and sensitive. However, the state-of-the-art solutions in thisframework are not optimal when data is heterogeneous and non-Independent andIdentically Distributed (non-IID). We propose a practical and robust approachto personalization in FL that adjusts to heterogeneous and non-IID data bybalancing exploration and exploitation of several global models. To achieve ouraim of personalization, we use a Mixture of Experts (MoE) that learns to groupclients that are similar to each other, while using the global models moreefficiently. We show that our approach achieves an accuracy up to 29.78 % andup to 4.38 % better compared to a local model in a pathological non-IIDsetting, even though we tune our approach in the IID setting.

National Category
Computer Systems
Identifiers
urn:nbn:se:kth:diva-314805 (URN)10.48550/ARXIV.2206.07832 (DOI)
Conference
International Workshop on Trustworthy Federated Learning , Vienna, Austria, July 23, 2022
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Swedish National Infrastructure for Computing (SNIC), 2018–05973
Note

QC 20220628

Available from: 2022-06-23 Created: 2022-06-23 Last updated: 2024-05-27Bibliographically approved
Isaksson, M. & Norrman, K. (2020). Secure Federated Learning in 5G Mobile Networks. In: 2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings: . Paper presented at 2020 IEEE Global Communications Conference, GLOBECOM 2020, 7-11 December 2020. Institute of Electrical and Electronics Engineers Inc. (IEEE)
Open this publication in new window or tab >>Secure Federated Learning in 5G Mobile Networks
2020 (English)In: 2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings, Institute of Electrical and Electronics Engineers Inc. (IEEE) , 2020Conference paper, Published paper (Refereed)
Abstract [en]

Machine Learning (ML) is an important enabler for optimizing, securing and managing mobile networks. This leads to increased collection and processing of data from network functions, which in turn may increase threats to sensitive end-user information. Consequently, mechanisms to reduce threats to end-user privacy are needed to take full advantage of ML. We seamlessly integrate Federated Learning (FL) into the 3GPP5G Network Data Analytics (NWDA) architecture, and add a Multi-Party Computation (MPC) protocol for protecting the confidentiality of local updates. We evaluate the protocol and find that it has much lower communication overhead than previous work, without affecting ML performance.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. (IEEE), 2020
Keywords
5G, federated learning, machine learning, privacy, security, Data Analytics, Data handling, Mobile security, Mobile telecommunication systems, Network architecture, Wireless networks, Communication overheads, End users, Multiparty computation, Network data, Network functions, 5G mobile communication systems
National Category
Communication Systems Computer Sciences Computer Systems
Identifiers
urn:nbn:se:kth:diva-301215 (URN)10.1109/GLOBECOM42002.2020.9322479 (DOI)000668970502104 ()2-s2.0-85100375388 (Scopus ID)
Conference
2020 IEEE Global Communications Conference, GLOBECOM 2020, 7-11 December 2020
Note

QC 20210907

Available from: 2021-09-07 Created: 2021-09-07 Last updated: 2022-06-25Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-9972-0179

Search in DiVA

Show all publications