kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Diffusion-Based Causal Representation Learning
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control).ORCID iD: 0000-0002-6820-948X
Helmholtz AI, Munich, 85764, Germany; MPI for Intelligent Systems, Tübingen, 72076, Germany; School of Computation, Information and Technology, TU Munich, Munich, 80333, Germany.
Helmholtz AI, Munich, 85764, Germany; School of Computation, Information and Technology, TU Munich, Munich, 80333, Germany.
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control). Digital Futures, 114 28 Stockholm, Sweden.ORCID iD: 0000-0001-9940-5929
Show others and affiliations
2024 (English)In: Entropy, E-ISSN 1099-4300, Vol. 26, no 7, article id 556Article in journal (Refereed) Published
Abstract [en]

Causal reasoning can be considered a cornerstone of intelligent systems. Having access to an underlying causal graph comes with the promise of cause–effect estimation and the identification of efficient and safe interventions. However, learning causal representations remains a major challenge, due to the complexity of many real-world systems. Previous works on causal representation learning have mostly focused on Variational Auto-Encoders (VAEs). These methods only provide representations from a point estimate, and they are less effective at handling high dimensions. To overcome these problems, we propose a Diffusion-based Causal Representation Learning (DCRL) framework which uses diffusion-based representations for causal discovery in the latent space. DCRL provides access to both single-dimensional and infinite-dimensional latent codes, which encode different levels of information. In a first proof of principle, we investigate the use of DCRL for causal representation learning in a weakly supervised setting. We further demonstrate experimentally that this approach performs comparably well in identifying the latent causal structure and causal variables.

Place, publisher, year, edition, pages
MDPI AG , 2024. Vol. 26, no 7, article id 556
Keywords [en]
causal representation learning, diffusion models, diffusion-based representations, weak supervision
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:kth:diva-351698DOI: 10.3390/e26070556ISI: 001277545500001Scopus ID: 2-s2.0-85199923243OAI: oai:DiVA.org:kth-351698DiVA, id: diva2:1888661
Note

QC 20240823

Available from: 2024-08-13 Created: 2024-08-13 Last updated: 2024-08-27Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Mamaghan, Amir Mohammad KarimiJohansson, Karl H.

Search in DiVA

By author/editor
Mamaghan, Amir Mohammad KarimiJohansson, Karl H.
By organisation
Decision and Control Systems (Automatic Control)
In the same journal
Entropy
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 50 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf