kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A digital twin-based sim-to-real transfer for deep reinforcement learning-enabled industrial robot grasping
Xidian Univ, Sch Mechanoelect Engn, Xi'an 710071, Peoples R China..
Xidian Univ, Sch Mechanoelect Engn, Xi'an 710071, Peoples R China..
Xidian Univ, Sch Mechanoelect Engn, Xi'an 710071, Peoples R China.;Xidian Univ, Hangzhou Inst Technol, Intelligent Robot Lab, Hangzhou, Peoples R China..
KTH, School of Industrial Engineering and Management (ITM), Production Engineering.ORCID iD: 0000-0001-8679-8049
2022 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 78, p. 102365-, article id 102365Article in journal (Refereed) Published
Abstract [en]

Deep reinforcement learning (DRL) has proven to be an effective framework for solving various complex control problems. In manufacturing, industrial robots can be trained to learn dexterous manipulation skills from raw pixels with DRL. However, training robots in the real world is a time-consuming, high-cost and of safety concerns process. A frequently adopted approach for easing this is to train robots through simulations first and then deploy algorithms (or policies) on physical robots. How to transfer policies of robot learning from simulation to the real world is a challenging issue. Digital twin that is able to create a dynamic, up-to-date representation of a physical robotic grasping system provides an effective approach for addressing this issue. In this paper, we focus on the scenario of DRL-based assembly-oriented industrial grasping and propose a digital twin-enabled approach for achieving effective transfer of DRL algorithms to a physical robot. Two parallel training systems, i.e., the physical robotic system and corresponding digital twin system, respectively, are established, which take virtual and real images as inputs. The output of the digital twin system is used to correct the real grasping point so that accurate grasping can be achieved. Experimental results verify the effectiveness of the intelligent grasping algorithm and the digital twin-enabled sim-to-real transfer approach and mechanism.

Place, publisher, year, edition, pages
Elsevier BV , 2022. Vol. 78, p. 102365-, article id 102365
Keywords [en]
Deep reinforcement learning, Sim-to-real transfer, Digital twin, Robot grasping
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-314865DOI: 10.1016/j.rcim.2022.102365ISI: 000807421500001Scopus ID: 2-s2.0-85131222861OAI: oai:DiVA.org:kth-314865DiVA, id: diva2:1676654
Note

QC 20220627

Available from: 2022-06-27 Created: 2022-06-27 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Wang, Lihui

Search in DiVA

By author/editor
Wang, Lihui
By organisation
Production Engineering
In the same journal
Robotics and Computer-Integrated Manufacturing
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 473 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf