Network Weight Estimation for Binary-Valued Observation Models
2019 (English)In: Proceedings of the IEEE Conference on Decision and Control, Institute of Electrical and Electronics Engineers Inc. , 2019, p. 2278-2283Conference paper, Published paper (Refereed)
Abstract [en]
This paper studies the estimation of network weights for a class of systems with binary-valued observations. In these systems only quantized observations are available for the network estimation. Furthermore, system states are coupled with observations, and the quantization parts are unknown inherent components, which hinder the design of inputs and quantizers. In order to deal with the temporal dependency of observations and achieve the recursive estimation of network weights, a deterministic objective function is constructed based on the likelihood function by extending the dimension of observations and applying ergodic properties of Markov chains. By imposing an independent Gaussian assumption on disturbances, we show that the function is strictly concave and has a unique maximum identical to the true parameter vector, so in this way the estimation problem is transformed to an optimization problem. A recursive algorithm based on stochastic approximation techniques is proposed to solve this problem, and the strong consistency of the algorithm is established. Our recursive algorithm can be applied to online tasks like real-time decision-making and surveillance for networked systems. This work also provides a new scheme for the identification of systems with quantized observations.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2019. p. 2278-2283
Keywords [en]
Approximation algorithms, Decision making, Markov chains, Online systems, Real time systems, Stochastic control systems, Stochastic systems, Identification of systems, Likelihood functions, Optimization problems, Quantized observations, Real time decision-making, Recursive algorithms, Recursive estimation, Stochastic approximations, Maximum likelihood estimation
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:kth:diva-274086DOI: 10.1109/CDC40024.2019.9029754ISI: 000560779002023Scopus ID: 2-s2.0-85082478454OAI: oai:DiVA.org:kth-274086DiVA, id: diva2:1451205
Conference
58th IEEE Conference on Decision and Control, CDC 2019, 11 December 2019 through 13 December 2019
Note
QC 20200702
Part of ISBN 9781728113982
2020-07-022020-07-022024-10-24Bibliographically approved