Change search
ReferencesLink to record
Permanent link

Direct link
Recognition of gestures in the context of speech
KTH, Superseded Departments, Numerical Analysis and Computer Science, NADA.ORCID iD: 0000-0002-5750-9655
KTH, Superseded Departments, Numerical Analysis and Computer Science, NADA.
2002 (English)In: 16th International Conference on Pattern Recognition, 2002. Proceedings., 2002Conference paper (Refereed)
Abstract [en]

The scope of this paper is the interpretation of a user's intention via a video camera and a speech recognizer In comparison to previous work which only takes into account gesture recognition, we demonstrate that by including speech, system comprehension increases. For the gesture recognition, the user must wear a colored glove, then we extract the velocity of the center of gravity of the hand. A Hidden Markov Model (HMM) is learned for each gesture that we want to recognize. In a dynamic action, to know if a gesture has been performed or not, we implement a threshold model below which the gesture is not detected. The off line tests for gesture recognition have a success rate exceeding 85% for each gesture. The combination of speech and gestures is realized using Bayesian theory.

Place, publisher, year, edition, pages
National Category
URN: urn:nbn:se:kth:diva-49465DOI: 10.1109/ICPR.2002.1044723OAI: diva2:459711
IAPR International Conference on Pattern Recognition.
QC 20111201Available from: 2011-11-28 Created: 2011-11-28 Last updated: 2011-12-01Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Sidenbladh, HedvigEklundh, Jan-Olof
By organisation
Numerical Analysis and Computer Science, NADA

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 19 hits
ReferencesLink to record
Permanent link

Direct link