Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Multimodal Hand and Foot Gesture Interaction for Handheld Devices
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.ORCID iD: 0000-0003-3779-5647
Show others and affiliations
2014 (English)In: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), ISSN 1551-6857, E-ISSN 1551-6865, Vol. 11, 10Article in journal (Refereed) Published
Abstract [en]

We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.

Place, publisher, year, edition, pages
2014. Vol. 11, 10
National Category
Computer Science Software Engineering Information Systems
Identifiers
URN: urn:nbn:se:kth:diva-156537DOI: 10.1145/2645860ISI: 000343984800002Scopus ID: 2-s2.0-84907808678OAI: oai:DiVA.org:kth-156537DiVA: diva2:767094
Note

QC 20150410

Available from: 2014-11-29 Created: 2014-11-29 Last updated: 2017-12-05Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Authority records BETA

Li, Haibo

Search in DiVA

By author/editor
Li, Haibo
By organisation
Media Technology and Interaction Design, MID
In the same journal
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Computer ScienceSoftware EngineeringInformation Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 37 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf