On the use of Markov chain Monte Carlo methods for the sampling of mixture models: a statistical perspective
2015 (English)In: Statistics and computing, ISSN 0960-3174, E-ISSN 1573-1375, Vol. 25, no 1, 95-110 p.Article in journal (Refereed) Published
In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is the situation where sampling from the conditional distribution of the continuous component given the discrete component is infeasible. In this context, we advance Carlin & Chib's pseudo-prior method as an alternative way of infering mixture models and discuss and compare different algorithms based on this scheme. We propose a novel algorithm, the Frozen Carlin & Chib sampler, which is computationally less demanding than any Metropolised Carlin & Chib-type algorithm. The significant gain of computational efficiency is however obtained at the cost of some asymptotic variance. The performance of the algorithm vis-A -vis alternative schemes is, using some recent results obtained in Maire et al. (Ann Stat 42: 1483-1510, 2014) for inhomogeneous Markov chains evolving alternatingly according to two different -reversible Markov transition kernels, investigated theoretically as well as numerically.
Place, publisher, year, edition, pages
2015. Vol. 25, no 1, 95-110 p.
Asymptotic variance, Carlin & Chib's pseudo-prior method, Inhomogeneous Markov chains, Metropolisation, Mixture models, Peskun ordering
Computer Science Mathematics
IdentifiersURN: urn:nbn:se:kth:diva-161641DOI: 10.1007/s11222-014-9526-5ISI: 000349028500015ScopusID: 2-s2.0-84925482882OAI: oai:DiVA.org:kth-161641DiVA: diva2:795916
QC 201503172015-03-172015-03-132015-03-17Bibliographically approved