kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Safe Data-Driven Contact-Rich Manipulation
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0001-9516-6764
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0003-2965-2953
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Robotics, Perception and Learning, RPL.ORCID iD: 0000-0003-4173-2593
Show others and affiliations
2021 (English)In: Proceedings of the 2020 IEEE-RAS 20th international conference on humanoid robots (Humanoids 2020), Institute of Electrical and Electronics Engineers (IEEE) , 2021, p. 120-127Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we address the safety of data-driven control for contact-rich manipulation. We propose to restrict the controller's action space to keep the system in a set of safe states. In the absence of an analytical model, we show how Gaussian Processes (GP) can be used to approximate safe sets. We disable inputs for which the predicted states are likely to be unsafe using the GP. Furthermore, we show how locally designed feedback controllers can be used to improve the execution precision in the presence of modelling errors. We demonstrate the benefits of our method on a pushing task with a variety of dynamics, by using known and unknown surfaces and different object loads. Our results illustrate that the proposed approach significantly improves the performance and safety of the baseline controller.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2021. p. 120-127
Series
IEEE-RAS International Conference on Humanoid Robots, ISSN 2164-0572
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-306992DOI: 10.1109/HUMANOIDS47582.2021.9555680ISI: 000728400200016Scopus ID: 2-s2.0-85126066745OAI: oai:DiVA.org:kth-306992DiVA, id: diva2:1631253
Conference
20th IEEE-RAS International Conference on Humanoid Robots (HUMANOIDS), JUL 19-21, 2021, ELECTR NETWORK
Note

QC 20220124

Proceedings ISBN 978-1-7281-9372-4

Available from: 2022-01-24 Created: 2022-01-24 Last updated: 2025-02-09Bibliographically approved
In thesis
1. Safety Aspects of Data-Driven Control in Contact-Rich Manipulation
Open this publication in new window or tab >>Safety Aspects of Data-Driven Control in Contact-Rich Manipulation
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

A crucial step towards robot autonomy-in environments other than the strictly regulated industrial ones-is to create controllers capable of adapting to diverse conditions. Human-centric environments are filled with a plethora of objects with very distinct properties that can still be manipulated without the need to painstakingly model the interaction dynamics. Furthermore, we do not need an explicit model to safely complete our tasks; rather, we rely on our intuition about the evolution of the interaction that is built upon multiple repetitions of the same task.Accurately translating this ability in how we control our robots in contact-rich tasks is almost infeasible if we rely on controllers that operate based on analytical models of the contacts. Instead, it is advantageous to utilize data-driven techniques that approximate the models based on interactions, much like humans do, and encompass the varying dynamics with a single model. However, for this to be a feasible alternative, we need to consider the safety aspects that occur when we move away from rigorous mathematical models and replace them with approximate data-driven ones.

This thesis identifies three safety aspects of data-driven control in contact-rich manipulation: good predictive performance, increased interpretability for the models, and explicit consideration of safe inputs in the face of modelling errors or uninterpretable predictions. The first point is addressed through a model-training scheme that improves the long-term predictions in a food cutting task. In the experiments it is shown that models trained this way are able to adapt to different dynamics efficiently and their prediction error scales better with longer horizons. The second point is addressed by introducing a framework that allows the evaluation of data-driven classification models based on interpretability techniques. The interpretation of the model decisions helps to anticipate failure cases before the model is deployed on the robot, as well as to understand what the models have learned. Finally, the third point is addressed by learning sets of safe states through data. These safe sets are then used to avoid dangerous control inputs in a control scheme that is flexible and adapts to dynamic variations while effectively encouraging the safety of the system.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2022. p. 57
Series
TRITA-EECS-AVL ; 2022:3
Keywords
Robotic manipulation, model learning
National Category
Robotics and automation
Identifiers
urn:nbn:se:kth:diva-307662 (URN)978-91-8040-118-0 (ISBN)
Public defence
2022-03-04, U1, Brinellvägen 26, vån 6, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20220203

Available from: 2022-02-03 Created: 2022-02-02 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Mitsioni, IoannaTajvar, PouriaKragic, DanicaTumova, JanaPek, Christian

Search in DiVA

By author/editor
Mitsioni, IoannaTajvar, PouriaKragic, DanicaTumova, JanaPek, Christian
By organisation
Robotics, Perception and Learning, RPL
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 93 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf