Predicting human intention in visual observations of hand/object interactions
2013 (English)In: 2013 IEEE International Conference On Robotics And Automation (ICRA), New York: IEEE , 2013, 1608-1615 p.Conference paper (Refereed)
The main contribution of this paper is a probabilistic method for predicting human manipulation intention from image sequences of human-object interaction. Predicting intention amounts to inferring the imminent manipulation task when human hand is observed to have stably grasped the object. Inference is performed by means of a probabilistic graphical model that encodes object grasping tasks over the 3D state of the observed scene. The 3D state is extracted from RGB-D image sequences by a novel vision-based, markerless hand-object 3D tracking framework. To deal with the high-dimensional state-space and mixed data types (discrete and continuous) involved in grasping tasks, we introduce a generative vector quantization method using mixture models and self-organizing maps. This yields a compact model for encoding of grasping actions, able of handling uncertain and partial sensory data. Experimentation showed that the model trained on simulated data can provide a potent basis for accurate goal-inference with partial and noisy observations of actual real-world demonstrations. We also show a grasp selection process, guided by the inferred human intention, to illustrate the use of the system for goal-directed grasp imitation.
Place, publisher, year, edition, pages
New York: IEEE , 2013. 1608-1615 p.
, Proceedings - IEEE International Conference on Robotics and Automation, ISSN 1050-4729
High-dimensional, Human manipulation, Human-object interaction, Manipulation task, Noisy observations, Probabilistic graphical models, Probabilistic methods, Visual observations, Computer vision, Conformal mapping, Encoding (symbols), Forecasting, Three dimensional, Vector quantization, Robotics
IdentifiersURN: urn:nbn:se:kth:diva-139955DOI: 10.1109/ICRA.2013.6630785ISI: 000337617301091ScopusID: 2-s2.0-84887266463ISBN: 978-1-4673-5643-5ISBN: 978-1-4673-5641-1OAI: oai:DiVA.org:kth-139955DiVA: diva2:688215
2013 IEEE International Conference on Robotics and Automation, ICRA 2013; Karlsruhe, Germany, 6-10 May 2013
QC 201401162014-01-162014-01-162014-08-04Bibliographically approved