Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Learning Stochastic Nonlinear Dynamical Systems Using Non-stationary Linear Predictors
KTH, School of Electrical Engineering (EES), Automatic Control. (System Identification)ORCID iD: 0000-0001-5474-7060
2017 (English)Licentiate thesis, monograph (Other academic)
Abstract [en]

The estimation problem of stochastic nonlinear parametric models is recognized to be very challenging due to the intractability of the likelihood function. Recently, several methods have been developed to approximate the maximum likelihood estimator and the optimal mean-square error predictor using Monte Carlo methods. Albeit asymptotically optimal, these methods come with several computational challenges and fundamental limitations.

The contributions of this thesis can be divided into two main parts. In the first part, approximate solutions to the maximum likelihood problem are explored. Both analytical and numerical approaches, based on the expectation-maximization algorithm and the quasi-Newton algorithm, are considered. While analytic approximations are difficult to analyze, asymptotic guarantees can be established for methods based on Monte Carlo approximations. Yet, Monte Carlo methods come with their own computational difficulties; sampling in high-dimensional spaces requires an efficient proposal distribution to reduce the number of required samples to a reasonable value.

In the second part, relatively simple prediction error method estimators are proposed. They are based on non-stationary one-step ahead predictors which are linear in the observed outputs, but are nonlinear in the (assumed known) input. These predictors rely only on the first two moments of the model and the computation of the likelihood function is not required. Consequently, the resulting estimators are defined via analytically tractable objective functions in several relevant cases. It is shown that, under mild assumptions, the estimators are consistent and asymptotically normal. In cases where the first two moments are analytically intractable due to the complexity of the model, it is possible to resort to vanilla Monte Carlo approximations. Several numerical examples demonstrate a good performance of the suggested estimators in several cases that are usually considered challenging.

Place, publisher, year, edition, pages
Stockholm, Sweden: KTH Royal Institute of Technology, 2017. , p. 186
Series
TRITA-EE, ISSN 1653-5146 ; 2017:172
Keywords [en]
Stochastic Nonlinear Systems, Nonlinear System Identification, Learning Dynamical Models, Maximum Likelihood, Estimation, Process Disturbance, Prediction Error Method, Non-stationary Linear Predictors, Intractable Likelihood, Latent Variable Models
National Category
Control Engineering Signal Processing Other Electrical Engineering, Electronic Engineering, Information Engineering Probability Theory and Statistics
Research subject
Electrical Engineering
Identifiers
URN: urn:nbn:se:kth:diva-218100ISBN: 978-91-7729-624-9 OAI: oai:DiVA.org:kth-218100DiVA, id: diva2:1160265
Presentation
2017-12-20, B:218 (Hörsal Q2), Osquldas väg 10, Q-huset, våningsplan 2, KTH Campus, Stockholm, 10:00 (English)
Opponent
Supervisors
Note

QC 20171128

Available from: 2017-11-28 Created: 2017-11-25 Last updated: 2017-11-28Bibliographically approved

Open Access in DiVA

fulltext(4929 kB)258 downloads
File information
File name FULLTEXT01.pdfFile size 4929 kBChecksum SHA-512
9ff22c40c2d3a772a6b170a79f2818c2cffbc574dc658f8548d9611eb709466ad243a3f8e6758adc2c315dd1f00b6d1c1b60b9f6a24cafe9ebd5060c9df4dcd9
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Abdalmoaty, Mohamed
By organisation
Automatic Control
Control EngineeringSignal ProcessingOther Electrical Engineering, Electronic Engineering, Information EngineeringProbability Theory and Statistics

Search outside of DiVA

GoogleGoogle Scholar
Total: 258 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 3840 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf