kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A multi-stage approach for desired part grasping under complex backgrounds in human-robot collaborative assembly
Changan Univ, Key Lab Rd Construct Technol & Equipment, MOE, Xian 710064, Shaanxi, Peoples R China..
Changan Univ, Key Lab Rd Construct Technol & Equipment, MOE, Xian 710064, Shaanxi, Peoples R China.;Changan Univ, Inst Smart Mfg Syst Engn, Xian 710064, Shaanxi, Peoples R China.;Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore, Singapore..
Changan Univ, Key Lab Rd Construct Technol & Equipment, MOE, Xian 710064, Shaanxi, Peoples R China.;Changan Univ, Inst Smart Mfg Syst Engn, Xian 710064, Shaanxi, Peoples R China..
Changan Univ, Key Lab Rd Construct Technol & Equipment, MOE, Xian 710064, Shaanxi, Peoples R China..
Show others and affiliations
2024 (English)In: Advanced Engineering Informatics, ISSN 1474-0346, E-ISSN 1873-5320, Vol. 62, article id 102778Article in journal (Refereed) Published
Abstract [en]

Human-robot collaborative assembly can leverage the unique capabilities of humans and robots to provide a flexible and efficient way for complex tasks. In this context, robots are expected to be endowed with the perception ability to collaborate with humans. For flexible processes, robotic grasping for a desired assembly part from variable multi-parts is essential but remains challenging, especially in situations of complex backgrounds including disordered placement, occlusion, similarity, and large-scale differences in size. To improve the perception and decision-making abilities of robots in collaborative assembly, firstly, a multi-stage approach integrating 2D part recognition and 6D pose estimation with perspective-focusing is proposed for desired part grasping under complex backgrounds. Secondly, to efficiently and accurately recognize a desired part from variable multi-parts under complex backgrounds, based on RGB data, an enhanced detector is adopted, which lays the foundation for the subsequent pose estimation. Thirdly, based on point cloud data, a pose estimation method based on perspective-focusing is proposed to enhance the success rate and efficiency of pose acquisition. Additionally, a modular autonomous robotic grasping system is designed. Finally, taking decelerator assembly as a case, the proposed approaches are comprehensively validated and compared on a real collaborative robot platform. Under complex backgrounds with occlusion, our approach shows stable performance with an average grasping success rate of 90.0 % and an average cycle time of 6.4175 s. Our work is expected to improve robots' perception and decision-making capabilities while further reducing the cycle time of collaborative assembly tasks.

Place, publisher, year, edition, pages
Elsevier , 2024. Vol. 62, article id 102778
Keywords [en]
Human-robot collaborative assembly, Complex backgrounds, Desired part grasping, Pose estimation, Perspective-focusing
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-353183DOI: 10.1016/j.aei.2024.102778ISI: 001301669800001Scopus ID: 2-s2.0-85201758386OAI: oai:DiVA.org:kth-353183DiVA, id: diva2:1898505
Note

QC 20240917

Available from: 2024-09-17 Created: 2024-09-17 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Wang, Lihui

Search in DiVA

By author/editor
Wang, Lihui
By organisation
Production engineering
In the same journal
Advanced Engineering Informatics
Robotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 57 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf