Fast simulated annealing in Rd with an application to maximum likelihood estimation in state-space models
2009 (English)In: Stochastic Processes and their Applications, ISSN 0304-4149, Vol. 119, no 6, 1912-1931 p.Article in journal (Refereed) Published
We study simulated annealing algorithms to maximise a function psi on a subset of R(d). In classical simulated annealing, given a current state theta(n) in stage n of the algorithm, the probability to accept a proposed state z at which psi is smaller, is exp(-beta(n+1)(psi(z) - psi (theta(n))) where (beta(n)) is the inverse temperature. With the standard logarithmic increase of (beta(n)) the probability P(psi(theta(n)) <= psi(max) - epsilon), with psi(max) the maximal value of psi, then tends to zero at a logarithmic rate as n increases. We examine variations of this scheme in which (beta(n)) is allowed to grow faster, but also consider other functions than the exponential for determining acceptance probabilities. The main result shows that faster rates of convergence can be obtained, both with the exponential and other acceptance functions. We also show how the algorithm may be applied to functions that cannot be computed exactly but only approximated, and give an example of maximising the log-likelihood function for a state-space model.
Place, publisher, year, edition, pages
2009. Vol. 119, no 6, 1912-1931 p.
Simulated annealing, Convergence rate, Maximum likelihood estimation
Probability Theory and Statistics
IdentifiersURN: urn:nbn:se:kth:diva-61181DOI: 10.1016/j.spa.2008.09.007ISI: 000266149100007OAI: oai:DiVA.org:kth-61181DiVA: diva2:478680
QC 201201172012-01-162012-01-162012-01-17Bibliographically approved