Recursive identification of chain dynamics in Hidden Markov Models using Non-Negative Matrix Factorization
2016 (English)In: Proceedings of the IEEE Conference on Decision and Control, IEEE conference proceedings, 2016, 4011-4016 p.Conference paper (Refereed)Text
Hidden Markov Models (HMMs) and associated Markov modulated time series are widely used for estimation and control in e.g. robotics, econometrics and bioinformatics. In this paper, we modify and extend a recently proposed approach in the machine learning literature that uses the method of moments and a Non-Negative Matrix Factorization (NNMF) to estimate the parameters of an HMM. In general, the method aims to solve a constrained non-convex optimization problem. In this paper, it is shown that if the observation probabilities of the HMM are known, then estimating the transition probabilities reduces to a convex optimization problem. Three recursive algorithms are proposed for estimating the transition probabilities of the underlying Markov chain, one of which employs a generalization of the Pythagorean trigonometric identity to recast the problem into a non-constrained optimization problem. Numerical examples are presented to illustrate how these algorithms can track slowly time-varying transition probabilities.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2016. 4011-4016 p.
IdentifiersURN: urn:nbn:se:kth:diva-188258DOI: 10.1109/CDC.2015.7402843ScopusID: 2-s2.0-84962016914ISBN: 9781479978861OAI: oai:DiVA.org:kth-188258DiVA: diva2:937432
54th IEEE Conference on Decision and Control, CDC 2015, 15 December 2015 through 18 December 2015
QC 201606152016-06-152016-06-092016-06-15Bibliographically approved