kth.sePublikationer KTH
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Integrating Large Language Model for Natural Language-Based Instruction toward Robust Human-Robot Collaboration
Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.
Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.
Department of Mechanical and Aerospace Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.
KTH, Skolan för industriell teknik och management (ITM), Produktionsutveckling, Industriella produktionssystem.ORCID-id: 0000-0002-1909-0507
Visa övriga samt affilieringar
2024 (Engelska)Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Human-Robot Collaboration (HRC) aims to create environments where robots can understand workspace dynamics and actively assist humans in operations, with the human intention recognition being fundamental to efficient and safe task fulfillment. Language-based control and communication is a natural and convenient way to convey human intentions. However, traditional language models require instructions to be articulated following a rigid, predefined syntax, which can be unnatural, inefficient, and prone to errors. This paper investigates the reasoning abilities that emerged from the recent advancement of Large Language Models (LLMs) to overcome these limitations, allowing for human instructions to be used to enhance human-robot communication. For this purpose, a generic GPT 3.5 model has been fine-tuned to interpret and translate varied human instructions into essential attributes, such as task relevancy and tools and/or parts required for the task. These attributes are then fused with perceived on-going robot action to generate a sequence of relevant actions. The developed technique is evaluated in a case study where robots initially misinterpreted human actions and picked up wrong tools and parts for assembly. It is shown that the fine-tuned LLM can effectively identify corrective actions across a diverse range of instructional human inputs, thereby enhancing the robustness of human-robot collaborative assembly for smart manufacturing.

Ort, förlag, år, upplaga, sidor
Elsevier BV , 2024. s. 313-318
Nyckelord [en]
Error correction, Human-robot collaboration, Large language model, Natural language processing
Nationell ämneskategori
Produktionsteknik, arbetsvetenskap och ergonomi Robotik och automation
Identifikatorer
URN: urn:nbn:se:kth:diva-358215DOI: 10.1016/j.procir.2024.10.093Scopus ID: 2-s2.0-85214970201OAI: oai:DiVA.org:kth-358215DiVA, id: diva2:1924849
Konferens
18th IFAC Workshop on Time Delay Systems, TDS 2024, Udine, Italy, October 2-5, 2023
Anmärkning

QC 20250114

Tillgänglig från: 2025-01-07 Skapad: 2025-01-07 Senast uppdaterad: 2025-02-05Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopus

Person

Liu, SichaoWang, Lihui

Sök vidare i DiVA

Av författaren/redaktören
Liu, SichaoWang, Lihui
Av organisationen
Industriella produktionssystem
Produktionsteknik, arbetsvetenskap och ergonomiRobotik och automation

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 239 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf