kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (3 of 3) Show all publications
Leake, J. & Vishnoi, N. K. (2022). ON THE COMPUTABILITY OF CONTINUOUS MAXIMUM ENTROPY DISTRIBUTIONS WITH APPLICATIONS. SIAM journal on computing (Print), 51(5), 1451-1505
Open this publication in new window or tab >>ON THE COMPUTABILITY OF CONTINUOUS MAXIMUM ENTROPY DISTRIBUTIONS WITH APPLICATIONS
2022 (English)In: SIAM journal on computing (Print), ISSN 0097-5397, E-ISSN 1095-7111, Vol. 51, no 5, p. 1451-1505Article in journal (Refereed) Published
Abstract [en]

We study the following problem: Given a continuous domain Omega along with its convex hull K, a point A is an element of K, and a measure mu on Omega, find the probability density over Omega whose marginal is A and that minimizes the KL divergence to the uniform density with respect to mu. Several distributions in mathematics, physics, statistics, and theoretical computer science arise by different settings of the parameters of this problem. We give a polynomial bound on the norm of the optimizer of the dual problem that holds in a very general setting and relies on a "balance" property of the measure mu on Omega, and exact algorithms for evaluating the dual and its gradient for several interesting settings of Omega and mu. Together, along with the ellipsoid method, these results imply polynomial-time algorithms to compute such KL divergence minimizing distributions in several cases. Applications of our results include (1) an optimization characterization of the Goemans-Williamson measure [M. X. Goemans and D. P. Williamson, J ACM, 42 (1995), pp. 1115-1145] that is used to round a positive semidefinite matrix to a vector; (2) the computability of the entropic barrier for convex bodies, given a strong integration oracle, studied by [S. Bubeck and R. Eldan, Proc. Mach. Learn. Res. (PMLR), 40 (2015), p. 279], and (3) a polynomial-time algorithm to compute the barycentric quantum entropy of a density matrix that was proposed as an alternative to von Neumann entropy [W. Band and J. L. Park, Found. Phys., 6 (1976), pp. 249-262; J. L. Park and W. Band, Found. Phys., 7 (1977), pp. 233-244; P. B. Slater, Phys. Lett. A, 159 (1991), pp. 411-414]; this corresponds to the case when Omega is the set of rank-one projection matrices and mu is derived from the Haar measure on the unit sphere.

Place, publisher, year, edition, pages
Society for Industrial & Applied Mathematics (SIAM), 2022
Keywords
maximum entropy distributions, barycentric quantum entropy, Goemans-Williamson measure, projection matrices, unitary integrals
National Category
Discrete Mathematics
Identifiers
urn:nbn:se:kth:diva-322228 (URN)10.1137/21M1440864 (DOI)000883719100001 ()2-s2.0-85142085297 (Scopus ID)
Note

QC 20221205

Available from: 2022-12-05 Created: 2022-12-05 Last updated: 2022-12-05Bibliographically approved
Gurvits, L. & Leake, J. (2021). Counting matchings via capacity-preserving operators. Combinatorics, probability & computing, 30(6), 956-981
Open this publication in new window or tab >>Counting matchings via capacity-preserving operators
2021 (English)In: Combinatorics, probability & computing, ISSN 0963-5483, E-ISSN 1469-2163, Vol. 30, no 6, p. 956-981Article in journal (Refereed) Published
Abstract [en]

The notion of the capacity of a polynomial was introduced by Gurvits around 2005, originally to give drastically simplified proofs of the van der Waerden lower bound for permanents of doubly stochastic matrices and Schrijver's inequality for perfect matchings of regular bipartite graphs. Since this seminal work, the notion of capacity has been utilised to bound various combinatorial quantities and to give polynomial-time algorithms to approximate such quantities (e.g. the number of bases of a matroid). These types of results are often proven by giving bounds on how much a particular differential operator can change the capacity of a given polynomial. In this paper, we unify the theory surrounding such capacity-preserving operators by giving tight capacity preservation bounds for all nondegenerate real stability preservers. We then use this theory to give a new proof of a recent result of Csikvari, which settled Friedland's lower matching conjecture.

Place, publisher, year, edition, pages
Cambridge University Press (CUP), 2021
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-309280 (URN)10.1017/S0963548321000122 (DOI)000753894400008 ()2-s2.0-85105592971 (Scopus ID)
Note

QC 20220224

Available from: 2022-02-24 Created: 2022-02-24 Last updated: 2022-06-25Bibliographically approved
Leake, J. & Vishnoi, N. K. (2020). On the Computability of Continuous Maximum Entropy Distributions with Applications. In: Makarychev, K Makarychev, Y Tulsiani, M Kamath, G Chuzhoy, J (Ed.), PROCEEDINGS OF THE 52ND ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '20): . Paper presented at 52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC), JUN 22-26, 2020, ELECTR NETWORK (pp. 930-943). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>On the Computability of Continuous Maximum Entropy Distributions with Applications
2020 (English)In: PROCEEDINGS OF THE 52ND ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '20) / [ed] Makarychev, K Makarychev, Y Tulsiani, M Kamath, G Chuzhoy, J, Association for Computing Machinery (ACM) , 2020, p. 930-943Conference paper, Published paper (Refereed)
Abstract [en]

We initiate a study of the following problem: Given a continuous domain Omega along with its convex hull K, a point A is an element of K and a prior measure mu on Omega, find the probability density over Omega whose marginal is A and that minimizes the KL-divergence to mu. This framework gives rise to several extremal distributions that arise in mathematics, quantum mechanics, statistics, and theoretical computer science. Our technical contributions include a polynomial bound on the norm of the optimizer of the dual problem that holds in a very general setting and relies on a "balance" property of the measure mu on Omega, and exact algorithms for evaluating the dual and its gradient for several interesting settings of Omega and mu. Together, along with the ellipsoid method, these results imply polynomial-time algorithms to compute such KL-divergence minimizing distributions in several cases. Applications of our results include: 1) an optimization characterization of the Goemans-Williamson measure that is used to round a positive semidefinite matrix to a vector, 2) the computability of the entropic barrier for polytopes studied by Bubeck and Eldan, and 3) a polynomial-time algorithm to compute the barycentric quantum entropy of a density matrix that was proposed as an alternative to von Neumann entropy by Band and Park in the 1970s: this corresponds to the case when Omega is the set of rank one projection matrices and mu corresponds to the Haar measure on the unit sphere. Our techniques generalize to the setting of rank k projections using the Harish-Chandra-Itzykson-Zuber formula, and are applicable even beyond, to adjoint orbits of compact Lie groups.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2020
Series
Annual ACM Symposium on Theory of Computing, ISSN 0737-8017
Keywords
Entropy, Optimization, Quantum entropy
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:kth:diva-291085 (URN)10.1145/3357713.3384302 (DOI)000614624700074 ()2-s2.0-85086766560 (Scopus ID)
Conference
52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC), JUN 22-26, 2020, ELECTR NETWORK
Note

QC 20210301

Available from: 2021-03-01 Created: 2021-03-01 Last updated: 2023-03-30Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0003-4123-4949

Search in DiVA

Show all publications