Change search
ReferencesLink to record
Permanent link

Direct link
Visual Servoing for Manipulation: Robustness and Integration Issues
KTH, Superseded Departments, Numerical Analysis and Computer Science, NADA.ORCID iD: 0000-0003-2965-2953
2001 (English)In: IEEE transactions on robotics and automation, ISSN 1042-296X, 230- p.Article in journal (Refereed) Published
Abstract [en]

Service robots are gradually extended to operation in everyday environments. To be truly useful, a mobile robot should include facilities for interaction with the envi- ronment, in particular methods for manipulation of objects. One of the most flexible sensory modalities to enable this is computational vision. In this thesis the issue of visual servoing and grasping to facilitate such interaction is investigated. A notorious problem for use of vision in natural environments is robustness with respect to variations in the environment. It is also well-known that no single technique is suitable for different tasks a robot is supposed to perform. Robustness is here investigated using several different approaches. The issues of variability are formulated with respect to visual features, the number of cameras used, and task constraints. It is argued that integration of methods facilitate construction of more robust visual servoing systems for realistic tasks. Traditionally, fusion of visual information has been based on explicit models for uncertainty and integration. The most dominating technique has been use of Bayesian statistics, where strong models are employed. Where a large number of visual features are available it is suggested that it might be possible to perform tasks such as visual tracking using weak models for integration. In particular, integration using voting based methods is analyzed. If the object to be manipulated is known or has been recognized, it is possible to use explicit geometric models to facilitate the estimation of its pose. Consequently, a methodology for tracking of objects using wire-frame models has been developed and evaluated in the context of grasping. Visual servoing can be carried out in the image domain and/or using 3D in- formation. In this context, the tradeoff between explicit models and use of multiple cameras strongly influences the performance of a visual servoing system. The relation between visual features, the number of cameras and their placement has been studied to provide guidelines for a design of such a system. An integration of a multi-ocular vision system, suitable visual techniques and task constraints facilitate flexible manipulation of everyday objects. To demonstrate this the developed techniques have been evaluated in the context of manipulation for opening/closing of doors in an everyday setting. In addition, it is demonstrated how the techniques, together with model based information, may be used for grasping and grasp monitoring in the context of a well-known set of objects. In summary, a toolkit for interaction with everyday objects has been investigated and evaluated for real-world tasks. The developed methods provide a rich basis for real-world manipulation of objects in everyday settings.

Place, publisher, year, edition, pages
2001. 230- p.
National Category
Computer and Information Science
URN: urn:nbn:se:kth:diva-82188OAI: diva2:498012
QC 20120301Available from: 2012-02-11 Created: 2012-02-11 Last updated: 2012-03-01Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Kragic, Danica
By organisation
Numerical Analysis and Computer Science, NADA
In the same journal
IEEE transactions on robotics and automation
Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 501 hits
ReferencesLink to record
Permanent link

Direct link