MushyPeek: A Framework for Online Investigation of Audiovisual Dialogue Phenomena
2009 (English)In: Language and Speech, ISSN 0023-8309, E-ISSN 1756-6053, Vol. 52, 351-367 p.Article in journal (Refereed) Published
Evaluation of methods and techniques for conversational and multimodal spoken dialogue systems is complex, as is gathering data for the modeling and tuning of such techniques. This article describes MushyPeek, all experiment framework that allows us to manipulate the audiovisual behavior of interlocutors in a setting similar to face-to-face human-human dialogue. The setup connects two subjects to each other over a Voice over Internet Protocol (VoIP) telephone connection and simultaneously provides each of them with an avatar representing the other. We present a first experiment which inaugurates, exemplifies, and validates the framework. The experiment corroborates earlier findings on the use of gaze and head pose gestures in turn-taking.
Place, publisher, year, edition, pages
2009. Vol. 52, 351-367 p.
audiovisual online manipulation, avatar-mediated conversation, experiment framework, human-human multimodal dialogue, social-interaction, systems, gaze, form
IdentifiersURN: urn:nbn:se:kth:diva-18492DOI: 10.1177/0023830909103179ISI: 000266765200010ScopusID: 2-s2.0-67949088004OAI: oai:DiVA.org:kth-18492DiVA: diva2:336539
QC 201005252010-08-052010-08-052010-12-20Bibliographically approved