Change search
ReferencesLink to record
Permanent link

Direct link
A strategy for grasping unknown objects based on co-planarity and colour information
Show others and affiliations
2010 (English)In: Robotics and Autonomous Systems, ISSN 0921-8890, E-ISSN 0921-8830, Vol. 58, no 5, 551-565 p.Article in journal (Refereed) Published
Abstract [en]

In this work, we describe and evaluate a grasping mechanism that does not make use of any specific object prior knowledge. The mechanism makes use of second-order relations between visually extracted multi-modal 3D features provided by an early cognitive vision system. More specifically, the algorithm is based on two relations covering geometric information in terms of a co-planarity constraint as well as appearance based information in terms of co-occurrence of colour properties. We show that our algorithm, although making use of such rather simple constraints, is able to grasp objects with a reasonable success rate in rather complex environments (i.e., cluttered scenes with multiple objects). Moreover, we have embedded the algorithm within a cognitive system that allows for autonomous exploration and learning in different contexts. First, the system is able to perform long action sequences which, although the grasping attempts not being always successful, can recover from mistakes and more importantly, is able to evaluate the success of the grasps autonomously by haptic feedback (i.e., by a force torque sensor at the wrist and proprioceptive information about the distance of the gripper after a gasping attempt). Such labelled data is then used for improving the initially hard-wired algorithm by learning. Moreover, the grasping behaviour has been used in a cognitive system to trigger higher level processes such as object learning and learning of object specific grasping. (C) 2010 Elsevier B.V. All rights reserved.

Place, publisher, year, edition, pages
2010. Vol. 58, no 5, 551-565 p.
Keyword [en]
Vision based grasping, Cognitive systems, Early cognitive vision
National Category
Engineering and Technology
URN: urn:nbn:se:kth:diva-27847DOI: 10.1016/j.robot.2010.01.003ISI: 000277926200012ScopusID: 2-s2.0-77950188636OAI: diva2:386638
QC 20110113Available from: 2011-01-13 Created: 2011-01-03 Last updated: 2012-01-19Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Kragic, Danica
By organisation
Computer Vision and Active Perception, CVAP
In the same journal
Robotics and Autonomous Systems
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 10 hits
ReferencesLink to record
Permanent link

Direct link