kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality
EURECOM, Commun Syst Dept, F-06904 Sophia Antipolis, France..
EURECOM, Commun Syst Dept, F-06904 Sophia Antipolis, France..
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-7926-5081
2022 (English)In: Entropy, E-ISSN 1099-4300, Vol. 24, no 2, p. 306-, article id 306Article in journal (Refereed) Published
Abstract [en]

The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies.

Place, publisher, year, edition, pages
MDPI AG , 2022. Vol. 24, no 2, p. 306-, article id 306
Keywords [en]
entropic optimal transport, Schrodinger problem, Talagrand inequality, entropy power inequality, log-concave measures
National Category
Computational Mathematics
Identifiers
URN: urn:nbn:se:kth:diva-315819DOI: 10.3390/e24020306ISI: 000824083100001PubMedID: 35205600Scopus ID: 2-s2.0-85125175566OAI: oai:DiVA.org:kth-315819DiVA, id: diva2:1684088
Note

QC 20220721

Available from: 2022-07-21 Created: 2022-07-21 Last updated: 2023-03-28Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopus

Authority records

Skoglund, Mikael

Search in DiVA

By author/editor
Skoglund, Mikael
By organisation
Information Science and Engineering
In the same journal
Entropy
Computational Mathematics

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 53 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf