kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Modelling and Learning Dynamics for Robotic Food-Cutting
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0003-4933-1778
Dept. of Electrical Engineering, Division of Systems and Control, Chalmers University of Technology, Gothenburg, Sweden.ORCID iD: 0000-0001-5129-342X
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0003-2965-2953
2021 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Interaction dynamics are difficult to model analytically, making data-driven controllers preferable for contact-rich manipulation tasks. In this work, we approximate the intricate dynamics of food-cutting with a Long Short-Term Memory (LSTM) model to apply a Model Predictive Controller (MPC). We propose a problem formulation that allows velocity-controlled robots to learn the interaction dynamics and tackle the difficulty of multi-step predictions by training the model with a horizon curriculum. We experimentally demonstrate that our approach leads to good predictive performance that scales for longer prediction horizons, generalizes to unseen object classes and results in controller behaviors with an understanding of the cutting dynamics.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2021. p. 1194-1200
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-305257DOI: 10.1109/CASE49439.2021.9551558ISI: 000878693200156Scopus ID: 2-s2.0-85117040503OAI: oai:DiVA.org:kth-305257DiVA, id: diva2:1624053
Conference
2021 IEEE 17th International Conference on Automation Science and Engineering (CASE)
Note

Part of proceedings: ISBN 978-1-6654-1873-7, QC 20230118

Available from: 2022-01-03 Created: 2022-01-03 Last updated: 2025-02-09Bibliographically approved
In thesis
1. Safety Aspects of Data-Driven Control in Contact-Rich Manipulation
Open this publication in new window or tab >>Safety Aspects of Data-Driven Control in Contact-Rich Manipulation
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

A crucial step towards robot autonomy-in environments other than the strictly regulated industrial ones-is to create controllers capable of adapting to diverse conditions. Human-centric environments are filled with a plethora of objects with very distinct properties that can still be manipulated without the need to painstakingly model the interaction dynamics. Furthermore, we do not need an explicit model to safely complete our tasks; rather, we rely on our intuition about the evolution of the interaction that is built upon multiple repetitions of the same task.Accurately translating this ability in how we control our robots in contact-rich tasks is almost infeasible if we rely on controllers that operate based on analytical models of the contacts. Instead, it is advantageous to utilize data-driven techniques that approximate the models based on interactions, much like humans do, and encompass the varying dynamics with a single model. However, for this to be a feasible alternative, we need to consider the safety aspects that occur when we move away from rigorous mathematical models and replace them with approximate data-driven ones.

This thesis identifies three safety aspects of data-driven control in contact-rich manipulation: good predictive performance, increased interpretability for the models, and explicit consideration of safe inputs in the face of modelling errors or uninterpretable predictions. The first point is addressed through a model-training scheme that improves the long-term predictions in a food cutting task. In the experiments it is shown that models trained this way are able to adapt to different dynamics efficiently and their prediction error scales better with longer horizons. The second point is addressed by introducing a framework that allows the evaluation of data-driven classification models based on interpretability techniques. The interpretation of the model decisions helps to anticipate failure cases before the model is deployed on the robot, as well as to understand what the models have learned. Finally, the third point is addressed by learning sets of safe states through data. These safe sets are then used to avoid dangerous control inputs in a control scheme that is flexible and adapts to dynamic variations while effectively encouraging the safety of the system.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2022. p. 57
Series
TRITA-EECS-AVL ; 2022:3
Keywords
Robotic manipulation, model learning
National Category
Robotics and automation
Identifiers
urn:nbn:se:kth:diva-307662 (URN)978-91-8040-118-0 (ISBN)
Public defence
2022-03-04, U1, Brinellvägen 26, vån 6, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20220203

Available from: 2022-02-03 Created: 2022-02-02 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

fulltext(1715 kB)177 downloads
File information
File name FULLTEXT01.pdfFile size 1715 kBChecksum SHA-512
9eee8c0a4a4b0486d9b16632285ec9094ee40ab63eb931da458971ee349fd5639b327a19595120aca58add22e1058b6ef5cbe29281fd4045455346ad5d2bb278
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Mitsioni, IoannaKarayiannidis, YiannisKragic, Danica

Search in DiVA

By author/editor
Mitsioni, IoannaKarayiannidis, YiannisKragic, Danica
By organisation
Robotics, Perception and Learning, RPL
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar
Total: 177 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 206 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf