kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On Information Theoretic Fairness: Compressed Representations with Perfect Demographic Parity
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0001-9296-4939
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-0862-1333
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-7926-5081
2024 (English)In: 2024 IEEE Information Theory Workshop, ITW 2024, Institute of Electrical and Electronics Engineers (IEEE) , 2024, p. 25-30Conference paper, Published paper (Refereed)
Abstract [en]

In this article, we study the fundamental limits in the design of fair and/or private representations achieving perfect demographic parity and/or perfect privacy through the lens of information theory. More precisely, given some useful data X that we wish to employ to solve a task T, we consider the design of a representation Y that has no information of some sensitive attribute or secret s, that is, such that I(Y;S)=0. We consider two scenarios. First, we consider a design desiderata where we want to maximize the information I(Y;T) that the representation contains about the task, while constraining the level of compression (or encoding rate), that is, ensuring that I(Y;X)≤q r. Second, inspired by the Conditional Fairness Bottleneck problem, we consider a design desiderata where we want to maximize the information I(Y, Tvert S) that the representation contains about the task which is not shared by the sensitive attribute or secret, while constraining the amount of irrelevant information, that is, ensuring that I(Y;Xvert T, S)≤q r. In both cases, we employ extended versions of the Functional Representation Lemma and the Strong Functional Representation Lemma and study the tightness of the obtained bounds. Every result here can also be interpreted as a coding with perfect privacy problem by considering the sensitive attribute as a secret.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. p. 25-30
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-359866DOI: 10.1109/ITW61385.2024.10807019ISI: 001433908800005Scopus ID: 2-s2.0-85216512755OAI: oai:DiVA.org:kth-359866DiVA, id: diva2:1937175
Conference
2024 IEEE Information Theory Workshop, ITW 2024, Shenzhen, China, Nov 24 2024 - Nov 28 2024
Note

Part of ISBN 9798350348934]

QC 20250213

Available from: 2025-02-12 Created: 2025-02-12 Last updated: 2025-04-30Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Zamani, AmirrezaRodríguez Gálvez, BorjaSkoglund, Mikael

Search in DiVA

By author/editor
Zamani, AmirrezaRodríguez Gálvez, BorjaSkoglund, Mikael
By organisation
Information Science and Engineering
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 59 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf