kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (10 of 30) Show all publications
Huang, X., Plecháč, P., Sandberg, M. & Szepessy, A. (2025). Convergence rates for random feature neural network approximation in molecular dynamics. BIT Numerical Mathematics, 65(1), Article ID 9.
Open this publication in new window or tab >>Convergence rates for random feature neural network approximation in molecular dynamics
2025 (English)In: BIT Numerical Mathematics, ISSN 0006-3835, E-ISSN 1572-9125, Vol. 65, no 1, article id 9Article in journal (Refereed) Published
Abstract [en]

Random feature neural network approximations of the potential in Hamiltonian systems yield approximations of molecular dynamics correlation observables that have the expected error OK-1+J-1212, for networks with K nodes using J data points, provided the Hessians of the potential and the observables are bounded. The loss function is based on the least squares error of the potential and regularizations, with the data points sampled from the Gibbs density. The proof uses a new derivation of the generalization error for random feature networks that does not apply the Rademacher or related complexities.

Place, publisher, year, edition, pages
Springer Nature, 2025
Keywords
Canonical molecular dynamics, Correlation observable, Generalization error estimate, Neural network approximation, Random Fourier feature representation
National Category
Computational Mathematics Probability Theory and Statistics
Identifiers
urn:nbn:se:kth:diva-358666 (URN)10.1007/s10543-025-01052-1 (DOI)001399507600001 ()2-s2.0-85217776125 (Scopus ID)
Funder
Swedish Research Council, 2019-03725KTH Royal Institute of Technology
Note

QC 20250226

Available from: 2025-01-20 Created: 2025-01-20 Last updated: 2025-02-26Bibliographically approved
Huang, X., Plecháč, P., Sandberg, M. & Szepessy, A. (2025). Path integral molecular dynamics approximations of quantum canonical observables. Journal of Computational Physics, 523, Article ID 113625.
Open this publication in new window or tab >>Path integral molecular dynamics approximations of quantum canonical observables
2025 (English)In: Journal of Computational Physics, ISSN 0021-9991, E-ISSN 1090-2716, Vol. 523, article id 113625Article in journal (Refereed) Published
Abstract [en]

Mean-field molecular dynamics based on path integrals is used to approximate canonical quantum observables for particle systems consisting of nuclei and electrons. A computational bottleneck is the Monte Carlo sampling from the Gibbs density of the electron operator, which due to the fermion sign problem has a computational complexity that scales exponentially with the number of electrons. In this work, we construct an algorithm that approximates the mean-field Hamiltonian by path integrals for fermions. The algorithm is based on the determinant of a matrix with components built on Brownian bridges connecting permuted electron coordinates. The computational work for n electrons is O(n3), which reduces the computational complexity associated with the fermion sign problem. We analyze a bias resulting from this approximation and provide a rough computational error indicator. It remains to rigorously explain the surprisingly high accuracy for high temperatures. The method becomes infeasible at low temperatures due to a large sample variance.

Place, publisher, year, edition, pages
Elsevier BV, 2025
Keywords
Ab initio molecular dynamics, Canonical ensemble, Fermion sign problem, Gibbs distribution, Path integral
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-357912 (URN)10.1016/j.jcp.2024.113625 (DOI)001408434500001 ()2-s2.0-85211016610 (Scopus ID)
Note

QC 20250217

Available from: 2024-12-19 Created: 2024-12-19 Last updated: 2025-02-17Bibliographically approved
Huang, X., Plechac, P., Sandberg, M. & Szepessy, A. (2022). Canonical mean-field molecular dynamics derived from quantum mechanics. ESAIM: Mathematical Modelling and Numerical Analysis (ESAIM: M2AN), 56(6), 2197-2238
Open this publication in new window or tab >>Canonical mean-field molecular dynamics derived from quantum mechanics
2022 (English)In: ESAIM: Mathematical Modelling and Numerical Analysis (ESAIM: M2AN), ISSN 2822-7840, E-ISSN 2804-7214, Vol. 56, no 6, p. 2197-2238Article in journal (Refereed) Published
Abstract [en]

Canonical quantum correlation observables can be approximated by classical molecular dynamics. In the case of low temperature the ab initio molecular dynamics potential energy is based on the ground state electron eigenvalue problem and the accuracy has been proven to be O(M-1), provided the first electron eigenvalue gap is sufficiently large compared to the given temperature and M is the ratio of nuclei and electron masses. For higher temperature eigenvalues corresponding to excited electron states are required to obtain O(M-1) accuracy and the derivations assume that all electron eigenvalues are separated, which for instance excludes conical intersections. This work studies a mean-field molecular dynamics approximation where the mean-field Hamiltonian for the nuclei is the partial trace h := Tr(He-beta H)/Tr(e(-beta H)) with respect to the electron degrees of freedom and H is the Weyl symbol corresponding to a quantum many body Hamiltonian (sic). It is proved that the mean-field molecular dynamics approximates canonical quantum correlation observables with accuracy O(M-1 + t epsilon(2)), for correlation time t where epsilon(2) is related to the variance of mean value approximation h. Furthermore, the proof derives a precise asymptotic representation of the Weyl symbol of the Gibbs density operator using a path integral formulation. Numerical experiments on a model problem with one nuclei and two electron states show that the mean-field dynamics has similar or better accuracy than standard molecular dynamics based on the ground state electron eigenvalue.

Place, publisher, year, edition, pages
EDP Sciences, 2022
Keywords
Quantum canonical ensemble, correlation observables, molecular dynamics, excited states, mean-field approximation, semi-classical analysis, Weyl calculus, path integral
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-322938 (URN)10.1051/m2an/2022079 (DOI)000895479800001 ()2-s2.0-85145431921 (Scopus ID)
Note

QC 20230110

Available from: 2023-01-10 Created: 2023-01-10 Last updated: 2025-08-28Bibliographically approved
Kammonen, A., Kiessling, J., Plechac, P., Sandberg, M., Szepessy, A. & Tempone, R. (2022). Smaller generalization error derived for a deep residual neural network compared with shallow networks. IMA Journal of Numerical Analysis, 43(5), 2585-2632
Open this publication in new window or tab >>Smaller generalization error derived for a deep residual neural network compared with shallow networks
Show others...
2022 (English)In: IMA Journal of Numerical Analysis, ISSN 0272-4979, E-ISSN 1464-3642, Vol. 43, no 5, p. 2585-2632Article in journal (Refereed) Published
Abstract [en]

Estimates of the generalization error are proved for a residual neural network with L random Fourier features layers z¯+1 = ¯z + ReK k=1 b¯k eiωkz¯ + ReK k=1 c¯k eiω k·x. An optimal distribution for the frequencies (ωk, ω k) of the random Fourier features eiωkz¯ and eiω k·x is derived. This derivation is based on the corresponding generalization error for the approximation of the function values f(x). The generalization error turns out to be smaller than the estimate ˆf 2 L1(Rd) /(KL) of the generalization error for random Fourier features, with one hidden layer and the same total number of nodes KL, in the case of the L∞-norm of f is much less than the L1-norm of its Fourier transform ˆf . This understanding of an optimal distribution for random features is used to construct a new training method for a deep residual network. Promising performance of the proposed new algorithm is demonstrated in computational experiments.

Place, publisher, year, edition, pages
Oxford University Press (OUP), 2022
Keywords
residual network, deep random feature networks, supervised learning, error estimates, layer-by-layer algorithm
National Category
Computational Mathematics
Identifiers
urn:nbn:se:kth:diva-336842 (URN)10.1093/imanum/drac049 (DOI)000853541200001 ()2-s2.0-85174497733 (Scopus ID)
Note

QC 20250513

Available from: 2023-09-21 Created: 2023-09-21 Last updated: 2025-05-13Bibliographically approved
Hoel, H. & Szepessy, A. (2020). Classical langevin dynamics derived from quantum mechanics. Discrete and continuous dynamical systems. Series B, 25(10), 4001-4038
Open this publication in new window or tab >>Classical langevin dynamics derived from quantum mechanics
2020 (English)In: Discrete and continuous dynamical systems. Series B, ISSN 1531-3492, E-ISSN 1553-524X, Vol. 25, no 10, p. 4001-4038Article in journal (Refereed) Published
Abstract [en]

The classical work by Zwanzig [J. Stat. Phys. 9 (1973) 215-220] derived Langevin dynamics from a Hamiltonian system of a heavy particle coupled to a heat bath. This work extends Zwanzig's model to a quantum system and formulates a more general coupling between a particle system and a heat bath. The main result proves, for a particular heat bath model, that ab initio Langevin molecular dynamics, with a certain rank one friction matrix determined by the coupling, approximates for any temperature canonical quantum observables, based on the system coordinates, more accurately than any Hamiltonian system in these coordinates, for large mass ratio between the system and the heat bath nuclei.

Place, publisher, year, edition, pages
AMER INST MATHEMATICAL SCIENCES-AIMS, 2020
Keywords
Quantum mechanics, heat bath dynamics, generalized Langevin dynamics, classical Langevin dynamics, weak convergence
National Category
Condensed Matter Physics
Identifiers
urn:nbn:se:kth:diva-280193 (URN)10.3934/dcdsb.2020135 (DOI)000561191100012 ()2-s2.0-85093695805 (Scopus ID)
Note

QC 20201118

Available from: 2020-11-18 Created: 2020-11-18 Last updated: 2022-06-25Bibliographically approved
Kammonen, A., Kiessling, J., Plecháč, P., Sandberg, M. & Szepessy, A. (2019). Adaptive random fourier features with metropolis sampling. Foundations of Data Science, 0(0), 0-0
Open this publication in new window or tab >>Adaptive random fourier features with metropolis sampling
Show others...
2019 (English)In: Foundations of Data Science, E-ISSN 2639-8001, Vol. 0, no 0, p. 0-0Article in journal (Refereed) Published
Abstract [en]

The supervised learning problem todetermine a neural network approximation $\mathbb{R}^d\ni x\mapsto\sum_{k=1}^K\hat\beta_k e^{{\mathrm{i}}\omega_k\cdot x}$with one hidden layer is studied asa random Fourier features algorithm.  The Fourier features, i.e., the frequencies $\omega_k\in\mathbb{R}^d$,are sampled using an adaptive Metropolis sampler.The Metropolis test accepts proposal frequencies $\omega_k'$, having corresponding amplitudes $\hat\beta_k'$, with the probability$\min\big\{1, (|\hat\beta_k'|/|\hat\beta_k|)^\gamma\big\}$,for a certain positive parameter $\gamma$, determined by minimizing the approximation error for given computational work.This adaptive, non-parametric stochastic method leads asymptotically, as $K\to\infty$, to equidistributed amplitudes $|\hat\beta_k|$, analogous  to deterministic adaptive algorithms for differential equations. The equidistributed amplitudes are shown to asymptotically correspond to the optimal density for independent samples in random Fourier features methods.Numerical evidence is provided in order to demonstrate the approximation properties and efficiency of the proposed algorithm. The algorithm is testedboth on synthetic data and a real-world high-dimensional benchmark.

Place, publisher, year, edition, pages
American Institute of Mathematical Sciences, 2019
Keywords
Random Fourier features, neural networks, Metropolis algorithm, stochastich gradient descent
National Category
Computational Mathematics Probability Theory and Statistics
Research subject
Applied and Computational Mathematics, Numerical Analysis
Identifiers
urn:nbn:se:kth:diva-287767 (URN)10.3934/fods.2020014 (DOI)000663367000004 ()2-s2.0-85098437855 (Scopus ID)
Funder
Swedish Research Council, 2019-03725
Note

QC 20201221

Available from: 2020-12-17 Created: 2020-12-17 Last updated: 2023-06-08Bibliographically approved
Kammonen, A., Plechac, P., Sandberg, M. & Szepessy, A. (2019). Canonical Quantum Observables for Molecular Systems Approximated by Ab Initio Molecular Dynamics (vol 19, pg 2727, 2018). Annales de l'Institute Henri Poincare. Physique theorique, 20(8), 2873-2875
Open this publication in new window or tab >>Canonical Quantum Observables for Molecular Systems Approximated by Ab Initio Molecular Dynamics (vol 19, pg 2727, 2018)
2019 (English)In: Annales de l'Institute Henri Poincare. Physique theorique, ISSN 1424-0637, E-ISSN 1424-0661, Vol. 20, no 8, p. 2873-2875Article in journal (Refereed) Published
Abstract [en]

On page 2744 in [1], it is stated that the nonlinear eigenvalue problem (3.8).

Place, publisher, year, edition, pages
Springer Nature, 2019
National Category
Computational Mathematics
Identifiers
urn:nbn:se:kth:diva-303305 (URN)10.1007/s00023-019-00819-x (DOI)000475516100010 ()2-s2.0-85068153037 (Scopus ID)
Note

QC 20211013

Available from: 2021-10-13 Created: 2021-10-13 Last updated: 2022-06-25Bibliographically approved
Plechác, P., Sandberg, M. & Szepessy, A. (2019). The classical limit of quantum observables in the conservation laws of fluid dynamics. Communications in Mathematical Sciences, 17(8), 2191-2221
Open this publication in new window or tab >>The classical limit of quantum observables in the conservation laws of fluid dynamics
2019 (English)In: Communications in Mathematical Sciences, ISSN 1539-6746, E-ISSN 1945-0796, Vol. 17, no 8, p. 2191-2221Article in journal (Refereed) Published
Abstract [en]

In the classical work by Irving and Zwanzig [J.H. Irving and R.W. Zwanzig, J. Chem. Phys., 19, 1173-1180, 1951] it has been shown that quantum observables for macroscopic density, momentum and energy satisfy the conservation laws of fluid dynamics. In this work we derive the corresponding classical molecular dynamics limit by extending Irving and Zwanzig's result to matrix-valued potentials for a general quantum particle system. The matrix formulation provides the classical limit of the quantum observables in the conservation laws also in the case where the temperature is large compared to the electron eigenvalue gaps. The classical limit of the quantum observables in the conservation laws is useful in order to determine the constitutive relations for the stress tensor and the heat flux by molecular dynamics simulations. The main new steps to obtain the molecular dynamics limit are: (i) to approximate the dynamics of quantum observables accurately by classical dynamics, by diagonalizing the Hamiltonian using a nonlinear eigenvalue problem, (ii) to define the local energy density by partitioning a general potential, applying perturbation analysis of the electron eigenvalue problem, (iii) to determine the molecular dynamics stress tensor and heat flux in the case of several excited electron states, and (iv) to construct the initial particle phase-space density as a local grand canonical quantum ensemble determined by the initial conservation variables.

Place, publisher, year, edition, pages
International Press of Boston, Inc., 2019
Keywords
Conservation laws, Heat ux, Molecular dynamics, Stress tensor, Weyl quantization
National Category
Physical Sciences
Identifiers
urn:nbn:se:kth:diva-274900 (URN)10.4310/CMS.2019.v17.n8.a5 (DOI)000512296100005 ()2-s2.0-85080857748 (Scopus ID)
Note

QC 20200609

Available from: 2020-06-09 Created: 2020-06-09 Last updated: 2022-12-12Bibliographically approved
Kammonen, A., Plecháč, P., Sandberg, M. & Szepessy, A. (2018). Canonical quantum observables for molecular systems approximated by ab initio molecular dynamics. Annales Henri Poincaré, 19, 2727-2781
Open this publication in new window or tab >>Canonical quantum observables for molecular systems approximated by ab initio molecular dynamics
2018 (English)In: Annales Henri Poincaré, ISSN 1424-0637, Vol. 19, p. 2727-2781Article in journal (Refereed) Published
Abstract [en]

It is known that ab initio molecular dynamics based on the electron ground state eigenvaluecan be used to approximate quantum observables in the canonical ensemble when the temperature is low compared tothe first electron eigenvalue gap. This work proves that a certain weighted average of the different ab initio dynamics,  corresponding to each electron eigenvalue, approximates quantum observables for any temperature.The proof uses the semi-classical Weyl law to show thatcanonical quantum observables of nuclei-electron systems, based on matrix valued Hamiltonian symbols, can be approximated by ab initio molecular dynamics with the error proportional to the electron-nuclei mass ratio. The resultincludes observables that depend on correlations in time. A combination of the Hilbert-Schmidt inner product for quantum operators and Weyl's lawshows that the error estimate holds %for observables and Hamiltonian symbols  that have three and five bounded derivatives, respectively, provided the electron eigenvalues are distinct for any nuclei positionand the observables are in diagonal form with respect to the electron eigenstates.

Place, publisher, year, edition, pages
Springer Nature, 2018
National Category
Computational Mathematics
Research subject
Applied and Computational Mathematics, Numerical Analysis
Identifiers
urn:nbn:se:kth:diva-287770 (URN)10.1007/s00023-018-0699-x (DOI)000441905800007 ()2-s2.0-85049569877 (Scopus ID)
Funder
Swedish Research Council, 621-2014-4776
Note

QC 20201221

Available from: 2020-12-17 Created: 2020-12-17 Last updated: 2022-06-25Bibliographically approved
Hall, E. J., Hoel, H., Sandberg, M., Szepessy, A. & Tempone, R. (2016). Computable error estimates for finite element approximations of elliptic partial differential equations with rough stochastic data. SIAM Journal on Scientific Computing, 38(6), A3773-A3807
Open this publication in new window or tab >>Computable error estimates for finite element approximations of elliptic partial differential equations with rough stochastic data
Show others...
2016 (English)In: SIAM Journal on Scientific Computing, ISSN 1064-8275, E-ISSN 1095-7197, Vol. 38, no 6, p. A3773-A3807Article in journal (Refereed) Published
Abstract [en]

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that standard a posteriori error estimates fail to capture. We propose goal-oriented estimates, based on local error indicators, for the pathwise Galerkin and expected quadrature errors committed in standard, continuous, piecewise linear finite element approximations. Derived using easily validated assumptions, these novel estimates can be computed at a relatively low cost and have applications to subsurface flow problems in geophysics where the conductivities are assumed to have lognormal distributions with low regularity. Our theory is supported by numerical experiments on test problems in one and two dimensions.

Place, publisher, year, edition, pages
Society for Industrial and Applied Mathematics Publications, 2016
Keywords
A posteriori error, Elliptic PDE, Galerkin error, Lognormal, Monte Carlo methods, Quadrature error, Random PDE
National Category
Mathematics
Identifiers
urn:nbn:se:kth:diva-201587 (URN)10.1137/15M1044266 (DOI)000391853100029 ()2-s2.0-85007124170 (Scopus ID)
Funder
Swedish Research Council, VR-621-2014-4776Swedish e‐Science Research Center
Note

QC 20170210

Available from: 2017-02-10 Created: 2017-02-10 Last updated: 2024-03-15Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0869-4209

Search in DiVA

Show all publications