Change search
ReferencesLink to record
Permanent link

Direct link
Direct hand pose estimation for immersive gestural interaction
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.
Show others and affiliations
2015 (English)In: Pattern Recognition Letters, ISSN 0167-8655, E-ISSN 1872-7344, Vol. 66, 91-99 p.Article in journal (Refereed) Published
Abstract [en]

This paper presents a novel approach for performing intuitive gesture based interaction using depth data acquired by Kinect. The main challenge to enable immersive gestural interaction is dynamic gesture recognition. This problem can be formulated as a combination of two tasks; gesture recognition and gesture pose estimation. Incorporation of fast and robust pose estimation method would lessen the burden to a great extent. In this paper we propose a direct method for real-time hand pose estimation. Based on the range images, a new version of optical flow constraint equation is derived, which can be utilized to directly estimate 3D hand motion without any need of imposing other constraints. Extensive experiments illustrate that the proposed approach performs properly in real-time with high accuracy. As a proof of concept, we demonstrate the system performance in 3D object manipulation On two different setups; desktop computing, and mobile platform. This reveals the system capability to accommodate different interaction procedures. In addition, a user study is conducted to evaluate learnability, user experience and interaction quality in 3D gestural interaction in comparison to 2D touchscreen interaction.

Place, publisher, year, edition, pages
[Kondori, Farid Abedan; Kouma, Jean-Paul; Liu, Li] Umea Univ, Dept Appl Phys & Elect, S-90187 Umea, Sweden. [Yousefi, Shahrouz; Li, Haibo] KTH Royal Inst Technol, Dept Media Technol & Interact Design, S-10041 Stockholm, Sweden., 2015. Vol. 66, 91-99 p.
Keyword [en]
Immersive gestural interaction, Dynamic gesture recognition, Hand pose estimation
National Category
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-176325DOI: 10.1016/j.patrec.2015.03.013ISI: 000362271100011ScopusID: 2-s2.0-84943197653OAI: oai:DiVA.org:kth-176325DiVA: diva2:871893
Note

QC 20151117

Available from: 2015-11-17 Created: 2015-11-03 Last updated: 2015-11-17Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Yousefi, ShahrouzLi, Haibo
By organisation
Media Technology and Interaction Design, MID
In the same journal
Pattern Recognition Letters
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 63 hits
ReferencesLink to record
Permanent link

Direct link