kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Motion Capture Driven Avatars for Swedish Sign Language
KTH, School of Electrical Engineering and Computer Science (EECS), Speech, Music and Hearing.ORCID iD: 0009-0002-2374-0856
Stockholm University, Stockholm, Sweden.ORCID iD: 0000-0002-0612-6304
KTH, School of Electrical Engineering and Computer Science (EECS), Speech, Music and Hearing.ORCID iD: 0000-0003-1399-6604
2025 (English)In: IVA 2025 - Adjunct Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents, Association for Computing Machinery (ACM) , 2025, article id 27Conference paper, Published paper (Refereed)
Abstract [en]

This paper investigates the requirements for intelligible high-quality motion capture of sign language, with a particular focus on face animation. There are several methods for capturing facial animation, yet there is no established standard for which type of facial animation is the most optimal for sign languages. We compare two facial animation approaches-ARKit and Metahuman Animator (MHA) in terms of intelligibility. As expected, a human evaluation study with deaf Swedish Sign Language signers showed that MHA outperforms ARKit because MHA has a higher number of facial controls and an advanced depth data solver. In addition, we introduce a biLSTM-based occlusion infilling technique for MHA data as opposed to linear interpolation. Although biLSTM infilled MHA animations showed no improvement in human evaluation compared to original MHA animations, the model produces linguistically reasonable infillings upon qualitative exploration of the renders.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2025. article id 27
Keywords [en]
Swedish Sign Language, animation occlusions infilling, face animation, intelligibility study, metahuman animator, motion capture, sign language motion capture dataset
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-377738DOI: 10.1145/3742886.3756726ISI: 001661038600027Scopus ID: 2-s2.0-105020970603OAI: oai:DiVA.org:kth-377738DiVA, id: diva2:2045045
Conference
25th International Conference on Intelligent Virtual Agents, IVA 2025, Berlin, Germany, Sep 16 2025 - Sep 19 2025
Note

Part of ISBN 9798400719967

QC 20260311

Available from: 2026-03-11 Created: 2026-03-11 Last updated: 2026-03-11Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Klezovich, AnnaBeskow, Jonas

Search in DiVA

By author/editor
Klezovich, AnnaMesch, JohannaBeskow, Jonas
By organisation
Speech, Music and Hearing
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 39 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf