Capturing massively multimodal dialogues: affordable synchronization and visualization
2010 (English)In: Proc. of Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality (MMC 2010) / [ed] Kipp, Michael; Martin, Jean-Claude; Paggio, Patrizia; Heylen, Dirk, 2010, 160-161 p.Conference paper (Refereed)
In this demo, we show (a) affordable and relatively easy-to-implement means to facilitate synchronization of audio, video and motion capture data in post processing, and (b) a flexible tool for 3D visualization of recorded motion capture data aligned with audio and video sequences. The synchronisation is made possible by the use of two simple and analogues devices: a turntable and an easy to build electronic clapper board. The demo shows examples of how the signals from the turntable and the clapper board are traced over the three modalities, using the 3D visualisation tool. We also demonstrate how the visualisation tool shows head and torso movements captured by the motion capture system.
Place, publisher, year, edition, pages
2010. 160-161 p.
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-52131OAI: oai:DiVA.org:kth-52131DiVA: diva2:465426
Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality (MMC 2010). 18 May 2010, Valetta, Malta
QC 20120111. tmh_import_11_12_142011-12-142011-12-142012-01-11Bibliographically approved