kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A vision-language-guided and deep reinforcement learning-enabled approach for unstructured human-robot collaborative manufacturing task fulfilment
Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China..ORCID iD: 0000-0002-2329-8634
Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China..
Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China..
KTH, School of Industrial Engineering and Management (ITM), Production engineering, Industrial Production Systems.ORCID iD: 0000-0001-8679-8049
2024 (English)In: CIRP annals, ISSN 0007-8506, E-ISSN 1726-0604, Vol. 73, no 1, p. 341-344Article in journal (Refereed) Published
Abstract [en]

Human-Robot Collaboration (HRC) has emerged as a pivot in contemporary human-centric smart manufacturing scenarios. However, the fulfilment of HRC tasks in unstructured scenes brings many challenges to be overcome. In this work, mixed reality head-mounted display is modelled as an effective data collection, communication, and state representation interface/tool for HRC task settings. By integrating vision-language cues with large language model, a vision-language-guided HRC task planning approach is firstly proposed. Then, a deep reinforcement learning-enabled mobile manipulator motion control policy is generated to fulfil HRC task primitives. Its feasibility is demonstrated in several HRC unstructured manufacturing tasks with comparative results.

Place, publisher, year, edition, pages
Elsevier BV , 2024. Vol. 73, no 1, p. 341-344
Keywords [en]
Human-robot collaboration, Manufacturing system, Human-guided robot learning
National Category
Production Engineering, Human Work Science and Ergonomics Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-352248DOI: 10.1016/j.cirp.2024.04.003ISI: 001278260600001Scopus ID: 2-s2.0-85190754943OAI: oai:DiVA.org:kth-352248DiVA, id: diva2:1892741
Note

QC 20240827

Available from: 2024-08-27 Created: 2024-08-27 Last updated: 2025-02-05Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Wang, Lihui

Search in DiVA

By author/editor
Zheng, PaiWang, Lihui
By organisation
Industrial Production Systems
In the same journal
CIRP annals
Production Engineering, Human Work Science and ErgonomicsRobotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 65 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf