Face-to-Face Interaction and the KTH Cooking Show
2010 (English)In: DEVELOPMENT OF MULTIMODAL INTERFACES: ACTIVE LISTING AND SYNCHRONY / [ed] Esposito A; Campbell N; Vogel C; Hussain A; Nijholt A, 2010, Vol. 5967, 157-168 p.Conference paper (Refereed)
We share our experiences with integrating motion capture recordings in speech and dialogue research by describing (1) Spontal, a large project collecting 60 hours of video, audio and motion capture spontaneous dialogues, is described with special attention to motion capture and its pitfalls; (2) a tutorial where we use motion capture, speech synthesis and an animated talking head to allow students to create an active listener; and (3) brief preliminary results in the form of visualizations of motion capture data over time in a Spontal dialogue. We hope that given the lack of writings on the use of motion capture for speech research, these accounts will prove inspirational and informative.
Place, publisher, year, edition, pages
2010. Vol. 5967, 157-168 p.
, Lecture Notes in Computer Science, ISSN 0302-9743 ; 5967
Face-to-face interaction, synchrony/convergence, motion capture
IdentifiersURN: urn:nbn:se:kth:diva-29669ISI: 000279734900013ScopusID: 2-s2.0-77952081630ISBN: 978-3-642-12396-2OAI: oai:DiVA.org:kth-29669DiVA: diva2:398677
2nd COST 2102 International Training School on Development of Multimodal Interfaces
QC 201102182011-02-182011-02-112011-02-18Bibliographically approved