Analysis and synthesis of multimodal verbal and non-verbal interaction for animated interface agents
2007 (English)In: VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS / [ed] Esposito, A; FaundezZanuy, M; Keller, E; Marinaro, M, BERLIN: SPRINGER-VERLAG BERLIN , 2007, Vol. 4775, 250-263 p.Conference paper (Refereed)
The use of animated talking agents is a novel feature of many multimodal spoken dialogue systems. The addition and integration of a virtual talking head has direct implications for the way in which users approach and interact with such systems. However, understanding the interactions between visual expressions, dialogue functions and the acoustics of the corresponding speech presents a substantial challenge. Some of the visual articulation is closely related to the speech acoustics, while there are other articulatory movements affecting speech acoustics that are not visible on the outside of the face. Many facial gestures used for communicative purposes do not affect the acoustics directly, but might nevertheless be connected on a higher communicative level in which the timing of the gestures could play an important role. This chapter looks into the communicative function of the animated talking agent, and its effect on intelligibility and the flow of the dialogue.
Place, publisher, year, edition, pages
BERLIN: SPRINGER-VERLAG BERLIN , 2007. Vol. 4775, 250-263 p.
, VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS, ISSN 0302-9743 ; 4775
ECA, animated agent, audiovisual speech, non-verbal communication, visual prosody
Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-39405DOI: 10.1007/978-3-540-76442-7_22ISI: 000251471900022ScopusID: 2-s2.0-38149057443ISBN: 978-3-540-76441-0OAI: oai:DiVA.org:kth-39405DiVA: diva2:440601
International Workshop on Verbal and Nonverbal Communication Behaviours. Vietri sul Mare, ITALY. MAR 29-31, 2007