kth.sePublications KTH
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Label leakage from Regression Models Gradients in Federated Learning
KTH, School of Engineering Sciences (SCI), Mathematics (Dept.), Probability, Mathematical Physics and Statistics.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesisAlternative title
Etikettläckage från regressionsmodellernas gradienter i federerad inlärning (Swedish)
Abstract [en]

Federated learning (FL) is one of the most popular way to collaboratively train models while preserving data privacy. Participants train their model locally and share only their gradients instead of their personal data. However, recent gradient attacks have shaken this guarantee of "privacy by design" by reconstructing the participants data from the shared gradients. Serious improvements have been achieved by first inferring the labels of the data, making it easier to then reconstruct the input data. Until now these attacks have been studied only in the context of classification models, leaving the regression case unaddressed. In this paper we develop a gradient-based attack on labels in the context of a regression model being trained under a FL framework. This attack relies on solving an approximated linear system of equations of gradients and labels, calibrated using auxiliary data. Our experiments show promising results about inferring labels considering a FL regression model.

Abstract [sv]

Federated learning (FL) är ett av de mest populära sätten att gemensamt träna modeller med bibehållen integritet. Deltagarna tränar sin modell lokalt och delar bara sina gradienter istället för sina personuppgifter. Nya gradientattacker har dock skakat denna garanti för ”privacy by design” genom att rekonstruera deltagarnas data från de delade gradienterna. Stora förbättringar har uppnåtts genom att först härleda datans etiketter, vilket gör det lättare att sedan rekonstruera indata. Hittills har dessa attacker endast studerats i samband med klassificeringsmodeller, vilket innebär att regressionsfallet inte har behandlats. I det här dokumentet utvecklar vi en gradientbaserad attack på etiketter i samband med en regressionsmodell som tränas under ett FL-ramverk. Denna attack bygger på att lösa ett approximerat linjärt system av ekvationer av gradienter och etiketter, kalibrerade med hjälp av hjälpdata. Våra experiment visar lovande resultat när det gäller att härleda etiketter med hänsyn till en FL-regressionsmodell.

Place, publisher, year, edition, pages
2024.
Series
TRITA-SCI-GRU ; 2024:476
Keywords [en]
Label leakage, Federated learning, Gradient attack, Privacy attack
Keywords [sv]
Etikettläckage, Federerad inlärning, Gradientattack, Sekretessattack
National Category
Probability Theory and Statistics
Identifiers
URN: urn:nbn:se:kth:diva-377651OAI: oai:DiVA.org:kth-377651DiVA, id: diva2:2042824
External cooperation
French Atomic Energy and Alternative Energies Commission (CEA)
Subject / course
Mathematical Statistics
Educational program
Master of Science in Engineering -Engineering Physics
Supervisors
Examiners
Available from: 2026-03-03 Created: 2026-03-03 Last updated: 2026-03-03Bibliographically approved

Open Access in DiVA

fulltext(1323 kB)12 downloads
File information
File name FULLTEXT01.pdfFile size 1323 kBChecksum SHA-512
2c9f6734133869a50f9f30070b0a910b0b64f286a274649f8f7f02a7c97c472902cc9013c0a68e417aa98664250815784b41c98874b1695cb24877a700e4b0e1
Type fulltextMimetype application/pdf

By organisation
Probability, Mathematical Physics and Statistics
Probability Theory and Statistics

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 117 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf