A digital twin-based sim-to-real transfer for deep reinforcement learning-enabled industrial robot grasping
2022 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 78, p. 102365-, article id 102365Article in journal (Refereed) Published
Abstract [en]
Deep reinforcement learning (DRL) has proven to be an effective framework for solving various complex control problems. In manufacturing, industrial robots can be trained to learn dexterous manipulation skills from raw pixels with DRL. However, training robots in the real world is a time-consuming, high-cost and of safety concerns process. A frequently adopted approach for easing this is to train robots through simulations first and then deploy algorithms (or policies) on physical robots. How to transfer policies of robot learning from simulation to the real world is a challenging issue. Digital twin that is able to create a dynamic, up-to-date representation of a physical robotic grasping system provides an effective approach for addressing this issue. In this paper, we focus on the scenario of DRL-based assembly-oriented industrial grasping and propose a digital twin-enabled approach for achieving effective transfer of DRL algorithms to a physical robot. Two parallel training systems, i.e., the physical robotic system and corresponding digital twin system, respectively, are established, which take virtual and real images as inputs. The output of the digital twin system is used to correct the real grasping point so that accurate grasping can be achieved. Experimental results verify the effectiveness of the intelligent grasping algorithm and the digital twin-enabled sim-to-real transfer approach and mechanism.
Place, publisher, year, edition, pages
Elsevier BV , 2022. Vol. 78, p. 102365-, article id 102365
Keywords [en]
Deep reinforcement learning, Sim-to-real transfer, Digital twin, Robot grasping
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-314865DOI: 10.1016/j.rcim.2022.102365ISI: 000807421500001Scopus ID: 2-s2.0-85131222861OAI: oai:DiVA.org:kth-314865DiVA, id: diva2:1676654
Note
QC 20220627
2022-06-272022-06-272025-02-09Bibliographically approved