Multimodal Hand and Foot Gesture Interaction for Handheld Devices
2014 (English)In: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), ISSN 1551-6857, E-ISSN 1551-6865, Vol. 11, 10Article in journal (Refereed) Published
We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.
Place, publisher, year, edition, pages
2014. Vol. 11, 10
Computer Science Software Engineering Information Systems
IdentifiersURN: urn:nbn:se:kth:diva-156537DOI: 10.1145/2645860ISI: 000343984800002ScopusID: 2-s2.0-84907808678OAI: oai:DiVA.org:kth-156537DiVA: diva2:767094
QC 201504102014-11-292014-11-292015-04-10Bibliographically approved