kth.sePublications KTH
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
Link to record
Permanent link

Direct link
Bereza-Jarocinski, RobertORCID iD iconorcid.org/0000-0001-6490-1885
Publications (5 of 5) Show all publications
Bereza, R. (2024). Identification of Non-Linear Differential-Algebraic Equations: Scalable and Consistent Parameter Estimation with Process Disturbances. (Licentiate dissertation). Stockholm: KTH Royal Institute of Technology
Open this publication in new window or tab >>Identification of Non-Linear Differential-Algebraic Equations: Scalable and Consistent Parameter Estimation with Process Disturbances
2024 (English)Licentiate thesis, monograph (Other academic)
Abstract [en]

This thesis is concerned with system identification for non-linear differential-algebraic equations affected by process disturbances. This model class is chosen because it is more general than, e.g., ordinary differential equation models, and in particular, is the underlying type of model for equation-based object-oriented modeling languages, such as Modelica or VHDL-AMS, and is thus suitable for modeling a large family of physical systems. A particular focus is placed on modeling process disturbances and taking them into account during the identification to address issues with biased estimates that can occur when process disturbances are neglected. Furthermore, the methods in this thesis are developed to be computationally tractable and to produce consistent estimators. In particular, approaches to improve the scaling of the methods with the number of unknown parameters are studied. This is important because many conventional identification methods are intractable in complex settings like the one considered in this thesis.

As a first step, a sub-optimal but consistent estimator is proposed for solving the problem, and it is shown how it can be computed using stochastic approximation methods. Forward sensitivity analysis for differential-algebraic equations is studied and applied to compute unbiased gradient estimates of the considered cost function. The tractability of the method is demonstrated through a simulation experiment on a pendulum model, where the benefits of taking process disturbances into account are also shown. To identify the parameters of the disturbance model, access to derivatives of the disturbances with respect to the parameters is required.

Because forward sensitivity analysis can become intractable as the number of unknown parameters grows, adjoint sensitivity methods are investigated as a second step. Adjoint sensitivity analysis for differential-algebraic equations is not applicable to our problem formulation, which is why we extend it so that it can be used to compute unbiased gradient estimates while avoiding unnecessary intermediate computations present in forward sensitivity analysis. The extension is also applicable to identifying parameters of the disturbance model if gradients of the disturbances with respect to their parameters are available. The computational benefits of the adjoint method are demonstrated through a simulation experiment on a delta robot, where we also observe some numerical challenges that can occur when solving differential-algebraic equations.

As a third and final part of the thesis, disturbance models are studied in more detail. In particular, the necessity and challenges of modeling disturbances in continuous time are discussed, and it is shown how derivatives of the disturbances with respect to their parameters can be computed. Insights about stochastic differential equations are used to develop a way to approximate these types of equations by ordinary differential equations, which allows us to apply adjoint sensitivity analysis without computing derivatives of the disturbances with respect to the parameters as an intermediate step. This can improve the efficiency of the adjoint method, especially under some mild assumptions on the poles of the disturbance model. The necessary theory for using larger and more complex disturbance models is thus developed. 

Together, these developments allow for tractable estimation methods that are expected to produce consistent estimators even when the system is affected by process disturbances. As the number of unknown parameters grows, computational tractability still becomes an issue, but the methods presented in this thesis allow us to push the boundary of how many unknown parameters we can handle. This, other future challenges, and further potential research directions are discussed at the end of the thesis.

Abstract [sv]

Denna avhandling handlar om identifiering av icke-linjära differential-algebraiska ekvationer som påverkas av processtörningar. Denna typ av modell är vald eftersom den är mer generell än ordinära differentialekvationer, och särskilt eftersom den är den underliggande modelltypen för objektorienterade ekvations-baserade modelleringsspråk så som Modelica eller VHDL-AMS, och är därför lämplig för att modellera en stor mängd olika fysikaliska system. Avhandlingen fokuserar särskilt på att modellera processtörningar och på att ta hänsyn till dem under identifieringen, för att åtgärda problem med att skattningar kan bli icke-väntevärdesriktiga när störningar annars försummas. Metoderna i denna avhandling är även utvecklade för att vara beräkningsmässigt gångbara och för att producera konsistenta parameterskattningar. Särskilt så undersöks sätt att förbättra metodernas skalbarhet då antalet okända parametrar växer. Detta är viktigt eftersom många konventionella identifieringsmetoder inte är gångbara för komplexa problemställningar så som den som betraktas i denna avhandling.

Som ett första steg så föreslår vi en suboptimal men konsistent skattare för att lösa problemet och visar hur den kan beräknas med hjälp av stokastiska approximationsmetoder. Framåtriktad känslighetsanalys för differential-algebraiska metoder studeras och appliceras för att beräkna väntevärdesriktiga skattningar av gradienten för den betraktade kostnadsfunktionen. Den beräkningsmässiga gångbarheten demonstreras genom ett simuleringsexperiment men en pendelmodell, där vi även visar fördelarna med att ta hänsyn till processtörningar. För att identifiera parametrar för störningsmodellen så krävs det att man har tillgång till derivatan av störningen med avseende på parametrarna.

Som ett andra steg så väljer vi att studera adjunkt känslighetsanalys, eftersom framåtriktad känslighetsanalys kan bli beräkningsmässigt svårhanterligt när antalet okända parametrar växer. Adjunkt känslighetsanalys för differential-algebraiska ekvationer är inte applicerbar till vår problemformulering, vilket är varför vi utökar metoden så att den även kan användas för att beräkna väntevärdesriktiga skattningar av gradienten på ett vis som, till skillnad från framåtriktad känslighetsanalys, undviker att genomföra vissa onödiga mellanliggande beräkningar. Utökningen av metoden kan även appliceras på att identifiera parametrar av störningsmodellen, om man har tillgång till derivator av störningarna med avseende på deras parametrar. De beräkningsmässiga fördelarna med den adjunkta metoden demonstreras genom ett simuleringsexperiment med en deltarobot, där vi även observerar vissa numeriska problem som kan uppstå vid lösningen av differential-algebraiska ekvationer.

I den tredje och sista delen av avhandlingen så studerar vi störningsmodeller mer i detalj. Specifikt så diskuterar vi nödvändigheten av och svårigheterna med att modellera störningar i kontinuerlig tid, och vi visar även hur derivatan av störningarna med avseende på deras parametrar kan beräknas. Vi använder insikter om stokastiska differentialekvationer för att hitta ett sätt att approximera dessa ekvationer med ordinära differentialekvationen. Denna approximation låter oss använda adjunkt känslighetsanalys utan att behöva beräkna derivator av störningarna som ett mellanliggande steg. Detta kan förbättra beräkningshastigheten av den adjunkta metoden, särskilt under ytterligare milda antaganden om störningsmodellens poler. Med detta så kan vi slutföra utvecklingen av den nödvändiga teorin för användningen av större och mer komplexa störningsmodeller. 

Tillsammans så möjliggör dessa utvecklingar för beräkningsmässigt gångbara estimeringsmetoder som förväntas resultera i konsistenta skattare även när systemet påverkas utav processtörningar. När antalet okända parametrar växer så kommer den beräkningsmässiga gångbarheten till slut åter igen att vara ett problem, men metoderna i denna avhandling tillåter oss att tänja på gränserna för hur många okända parametrar som vi kan hantera. Detta, andra kvarstående utmaningar, och vidare möjligheter för fortsatt forskning diskuteras i slutet av avhandlingen.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2024. p. xiii, 156
Series
TRITA-EECS-AVL ; 2024:91
Keywords
differential-algebraic equation, nonlinear, stochastic, process disturbance, estimation, prediction error method
National Category
Control Engineering
Research subject
Electrical Engineering
Identifiers
urn:nbn:se:kth:diva-356579 (URN)978-91-8106-124-6 (ISBN)
Presentation
2024-12-13, https://kth-se.zoom.us/j/69456726748, D3, Lindstedtsvägen 9, Stockholm, 10:00 (English)
Opponent
Supervisors
Note

QC 20241120

Available from: 2024-11-20 Created: 2024-11-19 Last updated: 2024-12-19Bibliographically approved
Bereza-Jarocinski, R., Eriksson, O., Abdalmoaty, M.-H. R., Broman, D. & Hjalmarsson, H. (2022). Stochastic Approximation for Identification of Non-Linear Differential-Algebraic Equations with Process Disturbances. In: 2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC): . Paper presented at IEEE 61st Conference on Decision and Control (CDC), DEC 06-09, 2022, Cancun, MEXICO (pp. 6712-6717). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Stochastic Approximation for Identification of Non-Linear Differential-Algebraic Equations with Process Disturbances
Show others...
2022 (English)In: 2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), Institute of Electrical and Electronics Engineers (IEEE) , 2022, p. 6712-6717Conference paper, Published paper (Refereed)
Abstract [en]

Differential-algebraic equations, commonly used to model physical systems, are the basis for many equation-based object-oriented modeling languages. When systems described by such equations are influenced by unknown process disturbances, estimating unknown parameters from experimental data becomes difficult. This is because of problems with the existence of well-defined solutions and the computational tractability of estimators. In this paper, we propose a way to minimize a cost function-whose minimizer is a consistent estimator of the true parameters-using stochastic gradient descent. This approach scales significantly better with the number of unknown parameters than other currently available methods for the same type of problem. The performance of the method is demonstrated through a simulation study with three unknown parameters. The experiments show a significantly reduced variance of the estimator, compared to an output error method neglecting the influence of process disturbances, as well as an ability to reduce the estimation bias of parameters that the output error method particularly struggles with.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Series
IEEE Conference on Decision and Control, ISSN 0743-1546
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-326394 (URN)10.1109/CDC51059.2022.9993085 (DOI)000948128105103 ()2-s2.0-85147002802 (Scopus ID)
Conference
IEEE 61st Conference on Decision and Control (CDC), DEC 06-09, 2022, Cancun, MEXICO
Note

QC 20250929

Available from: 2023-05-03 Created: 2023-05-03 Last updated: 2025-09-29Bibliographically approved
Abdalmoaty, M., Eriksson, O., Bereza-Jarocinski, R., Broman, D. & Hjalmarsson, H. (2021). Identification of Non-Linear Differential-Algebraic Equation Models with Process Disturbances. In: Proceedings The 60th IEEE conference on Decision and Control (CDC): . Paper presented at The 60th IEEE conference on Decision and Control (CDC), Dec. 13-17, 2021, Austin, Texas, USA. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Identification of Non-Linear Differential-Algebraic Equation Models with Process Disturbances
Show others...
2021 (English)In: Proceedings The 60th IEEE conference on Decision and Control (CDC), Institute of Electrical and Electronics Engineers (IEEE) , 2021Conference paper, Published paper (Refereed)
Abstract [en]

Differential-algebraic equations (DAEs) arise naturally as a result of equation-based object-oriented modeling. In many cases, these models contain unknown parameters that have to be estimated using experimental data. However, often the system is subject to unknown disturbances which, if not taken into account in the estimation, can severely affect the model's accuracy. For non-linear state-space models, particle filter methods have been developed to tackle this issue. Unfortunately, applying such methods to non-linear DAEs requires a transformation into a state-space form, which is particularly difficult to obtain for models with process disturbances. In this paper, we propose a simulation-based prediction error method that can be used for non-linear DAEs where disturbances are modeled as continuous-time stochastic processes. To the authors' best knowledge, there are no general methods successfully dealing with parameter estimation for this type of model. One of the challenges in particle filtering  methods are random variations in the minimized cost function due to the nature of the algorithm. In our approach, a similar phenomenon occurs and we explicitly consider how to sample the underlying continuous process to mitigate this problem. The method is illustrated numerically on a pendulum example. The results suggest that the method is able to deliver consistent estimates.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2021
Series
IEEE Conference on Decision and Control, ISSN 0743-1546
Keywords
Nonlinear Identification; Process Disturbance; Differential-Algebraic Equations; Parameter Estimation; Simulated PEM
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-292187 (URN)10.1109/CDC45484.2021.9683787 (DOI)000781990302018 ()2-s2.0-85126001444 (Scopus ID)
Conference
The 60th IEEE conference on Decision and Control (CDC), Dec. 13-17, 2021, Austin, Texas, USA
Funder
Swedish Research Council, 2019-04956 and 2016-06079 (the research environment NewLEADS)Swedish Foundation for Strategic Research, FFL15-0032
Note

Financially also supported by SRA ICT TNG (Digital Futures) and KTH.

Part of ISBN 978-1-6654-3659-5

QC 20250929

Available from: 2021-03-26 Created: 2021-03-26 Last updated: 2025-09-29Bibliographically approved
Bereza-Jarocinski, R., Persson, L. & Wahlberg, B. (2020). Distributed Model Predictive Control for Cooperative Landing. In: Proceedings 21st IFAC World Congress on Automatic Control - Meeting Societal Challenges: . Paper presented at 21st IFAC World Congress on Automatic Control - Meeting Societal Challenges, JUL 11-17, 2020, ELECTR NETWORK (pp. 15180-15185). Elsevier BV, 53(2)
Open this publication in new window or tab >>Distributed Model Predictive Control for Cooperative Landing
2020 (English)In: Proceedings 21st IFAC World Congress on Automatic Control - Meeting Societal Challenges, Elsevier BV , 2020, Vol. 53, no 2, p. 15180-15185Conference paper, Published paper (Refereed)
Abstract [en]

We design, implement and test two control algorithms for autonomously landing a drone on an autonomous boat. The first algorithm uses distributed model predictive control (DMPC), while the second combines a cascade controller with DMPC. The algorithms are implemented on a real drone, while the boat's motion is simulated, and their performance is compared to a centralized model predictive controller. Field experiments are performed, where all algorithms show an ability to land while avoiding violation of the safety constraints. The two distributed algorithms further show the ability to use longer prediction horizons than the centralized model predictive controller, especially in the cascade case, and also demonstrate improved robustness towards breaks in communication.

Place, publisher, year, edition, pages
Elsevier BV, 2020
Keywords
Autonomous vehicles, Distributed control, Model-based control, Flight control, Autonomous landing, Cooperative control
National Category
Control Engineering
Identifiers
urn:nbn:se:kth:diva-298638 (URN)10.1016/j.ifacol.2020.12.2290 (DOI)000652593600316 ()2-s2.0-85117904409 (Scopus ID)
Conference
21st IFAC World Congress on Automatic Control - Meeting Societal Challenges, JUL 11-17, 2020, ELECTR NETWORK
Note

QC 20210710

Available from: 2021-07-10 Created: 2021-07-10 Last updated: 2022-06-25Bibliographically approved
Bereza-Jarocinski, R. & Persson, T. (2017). Autonomous Trajectory Tracking and Obstacle Avoidance. (Student paper). KTH
Open this publication in new window or tab >>Autonomous Trajectory Tracking and Obstacle Avoidance
2017 (English)Student thesis
Abstract [en]

Autonomous ground vehicles (AGVs), such as selfdrivingcars, are expected to become a central part of infrastructurein future smart cities. There are many technicalchallenges with making vehicles autonomous. They have to beable to find their way in both free environments as well asin environments with obstacles and other vehicles. To achievethis, they require many sensors to analyze their surroundings.The aim with this paper is to investigate the sensor typesnormally used in AGVs, describe their functionality and alsoprovide a model of how an autonomous vehicle can navigate indifferent environments, and verify this model through simulation.Lidar, Radar, accelerometers, gyroscopes, positioning systems andcameras are the sensors that are listed. It is described whatthey measure and what this data can be used for. To model theautonomous vehicle, a car-like vehicle model is used. A trajectorytracking controller is proposed, together with a proof of itsstability using Lyapunov functions. A way to avoid stationaryobstacles using potential fields is also described. Both the trackingcontroller and the obstacle avoidance controller are shown towork as expected through simulation. The used model only allowsfor the vehicle to travel in directions within a span of ±45 of itsforward direction. Lastly, a new application for AGVs in smartcities is also proposed.

National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:kth:diva-214704 (URN)
Thesis level
Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE credits
Available from: 2017-09-20 Created: 2017-09-20 Last updated: 2022-06-27Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-6490-1885

Search in DiVA

Show all publications