Simultaneous Visual Recognition of Manipulation Actions and Manipulated Objects
2008 (English)In: Computer Vision - Eccv 2008, Pt Ii, Proceedings / [ed] Forsyth, D; Torr, P; Zisserman, A, 2008, Vol. 5303, 336-349 p.Conference paper (Refereed)
The visual analysis of human manipulation actions is of interest for e.g. human-robot interaction applications where a robot learns how to perform a task by watching a human. In this paper, a method for classifying manipulation actions in the context of the objects manipulated, and classifying objects in the context of the actions used to manipulate them is presented. Hand and object features are extracted from the video sequence using a segmentation based approach. A shape based representation is used for both the hand and the object. Experiments show this representation suitable for representing generic shape classes. The action-object correlation over time is then modeled using conditional random fields. Experimental comparison show great improvement in classification rate when the action-object correlation is taken into account, compared to separate classification of manipulation actions and manipulated objects.
Place, publisher, year, edition, pages
2008. Vol. 5303, 336-349 p.
, Lecture Notes in Computer Science, ISSN 0302-9743 ; 5303
IdentifiersURN: urn:nbn:se:kth:diva-38135DOI: 10.1007/978-3-540-88688-4-25ISI: 000260658500025ScopusID: 2-s2.0-56749091660ISBN: 978-3-540-88685-3OAI: oai:DiVA.org:kth-38135DiVA: diva2:435924
10th European Conference on Computer Vision (ECCV 2008) Location: Marseille, FRANCE Date: OCT 12-18, 2008