Non-parametric hand pose estimation with object context
2013 (English)In: Image and Vision Computing, ISSN 0262-8856, Vol. 31, no 8, 555-564 p.Article in journal (Refereed) Published
In the spirit of recent work on contextual recognition and estimation, we present a method for estimating the pose of human hands, employing information about the shape of the object in the hand. Despite the fact that most applications of human hand tracking involve grasping and manipulation of objects, the majority of methods in the literature assume a free hand, isolated from the surrounding environment. Occlusion of the hand from grasped objects does in fact often pose a severe challenge to the estimation of hand pose. In the presented method, object occlusion is not only compensated for, it contributes to the pose estimation in a contextual fashion; this without an explicit model of object shape. Our hand tracking method is non-parametric, performing a nearest neighbor search in a large database (.. entries) of hand poses with and without grasped objects. The system that operates in real time, is robust to self occlusions, object occlusions and segmentation errors, and provides full hand pose reconstruction from monocular video. Temporal consistency in hand pose is taken into account, without explicitly tracking the hand in the high-dim pose space. Experiments show the non-parametric method to outperform other state of the art regression methods, while operating at a significantly lower computational cost than comparable model-based hand tracking methods.
Place, publisher, year, edition, pages
2013. Vol. 31, no 8, 555-564 p.
Articulated hand pose, Approximate nearest neighbor, Context
Computer Vision and Robotics (Autonomous Systems)
IdentifiersURN: urn:nbn:se:kth:diva-126874DOI: 10.1016/j.imavis.2013.04.002ISI: 000321993400003ScopusID: 2-s2.0-84878861191OAI: oai:DiVA.org:kth-126874DiVA: diva2:642765
FunderEU, FP7, Seventh Framework Programme, ICT-FP7-270436Swedish Foundation for Strategic Research
QC 201308232013-08-232013-08-222013-08-23Bibliographically approved