CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Hidden Markov Models: Identification, Inverse Filtering and Applications
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Decision and Control Systems (Automatic Control).
2020 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

A hidden Markov model (HMM) comprises a state with Markovian dynamics that is hidden in the sense that it can only be observed via a noisy sensor. This thesis considers three themes in relation to HMMs, namely, identification, inverse filtering and applications.

In order to employ an HMM, its parameters have first to be identified (or, estimated) from data. Traditional maximum-likelihood estimation procedures may, in practice, suffer from convergence to bad local optima and high computational cost. Recently proposed methods of moments address these shortcomings, but are less accurate. We explore how such methods can be extended to incorporate non-consecutive correlations in data so as to improve their accuracy (while still retaining their attractive properties).

Motivated by applications in the design of counter-adversarial autonomous (CAA) systems, we then ask the question: Is it possible to estimate the parameters of an HMM from other data sources than just raw measurements from its sensor? To answer this question, we consider a number of inverse filtering problems. First, we demonstrate how HMM parameters and sensor measurements can be reconstructed from posterior distributions from an HMM filter. Next, we show how to estimate such posterior distributions from actions taken by a rational agent. Finally, we bridge our results to provide a solution to the CAA problem of remotely estimating the accuracy of an adversary’s sensor based on its actions.

Throughout the thesis, we motivate our results with applications in various domains. A real-world application that we investigate in particular detail is how the treatment of abdominal aortic aneurysms can be modeled in the Markovian framework. Our findings suggest that the structural properties of the optimal treatment policy are different than those recommended by current clinical guidelines – in particular, that younger patients could benefit from earlier surgery. This indicates an opportunity for improved care of patients with the disease.

Place, publisher, year, edition, pages
KTH Royal Institute of Technology, 2020. , p. 244
Series
TRITA-EECS-AVL ; 2020:26
Keywords [en]
hidden Markov models, HMM, inverse filtering, identification, estimation, method of moments, counter-adversarial autonomous systems, adversarial signal processing, belief estimation, abdominal aortic aneurysm, medical
National Category
Control Engineering
Research subject
Electrical Engineering
Identifiers
URN: urn:nbn:se:kth:diva-273061ISBN: 978-91-7873-523-5 (print)OAI: oai:DiVA.org:kth-273061DiVA, id: diva2:1428900
Public defence
2020-06-02, Online: https://kth-se.zoom.us/webinar/register/WN_94cOBU56TluzJktLxD9ZAQ, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20200511

Available from: 2020-05-11 Created: 2020-05-07 Last updated: 2020-05-13Bibliographically approved

Open Access in DiVA

fulltext(4369 kB)37 downloads
File information
File name FULLTEXT01.pdfFile size 4369 kBChecksum SHA-512
83a9bea082a61ec731f0fbb4481ee54e415921718b46a0da2c01d786966fdac5925b18d7bf2825eaf2ffd358b0c535273e7eadb2ea6aa6a01e406b4aed312181
Type fulltextMimetype application/pdf

Other links

zoomlänk för disputation: https://kth-se.zoom.us/webinar/register/WN_94cOBU56TluzJktLxD9ZAQ

Authority records BETA

Mattila, Robert

Search in DiVA

By author/editor
Mattila, Robert
By organisation
Decision and Control Systems (Automatic Control)
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 37 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 201 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf