kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Analysis and synthesis of multimodal verbal and non-verbal interaction for animated interface agents
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.ORCID iD: 0000-0003-1399-6604
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.ORCID iD: 0000-0002-4628-3769
2007 (English)In: VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS / [ed] Esposito, A; FaundezZanuy, M; Keller, E; Marinaro, M, BERLIN: SPRINGER-VERLAG BERLIN , 2007, Vol. 4775, p. 250-263Conference paper, Published paper (Refereed)
Abstract [en]

The use of animated talking agents is a novel feature of many multimodal spoken dialogue systems. The addition and integration of a virtual talking head has direct implications for the way in which users approach and interact with such systems. However, understanding the interactions between visual expressions, dialogue functions and the acoustics of the corresponding speech presents a substantial challenge. Some of the visual articulation is closely related to the speech acoustics, while there are other articulatory movements affecting speech acoustics that are not visible on the outside of the face. Many facial gestures used for communicative purposes do not affect the acoustics directly, but might nevertheless be connected on a higher communicative level in which the timing of the gestures could play an important role. This chapter looks into the communicative function of the animated talking agent, and its effect on intelligibility and the flow of the dialogue.

Place, publisher, year, edition, pages
BERLIN: SPRINGER-VERLAG BERLIN , 2007. Vol. 4775, p. 250-263
Series
VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS, ISSN 0302-9743 ; 4775
Keywords [en]
ECA, animated agent, audiovisual speech, non-verbal communication, visual prosody
National Category
Natural Language Processing
Identifiers
URN: urn:nbn:se:kth:diva-39405DOI: 10.1007/978-3-540-76442-7_22ISI: 000251471900022Scopus ID: 2-s2.0-38149057443ISBN: 978-3-540-76441-0 (print)OAI: oai:DiVA.org:kth-39405DiVA, id: diva2:440601
Conference
International Workshop on Verbal and Nonverbal Communication Behaviours. Vietri sul Mare, ITALY. MAR 29-31, 2007
Available from: 2011-09-13 Created: 2011-09-09 Last updated: 2025-02-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopusSpringerlink

Authority records

Beskow, JonasHouse, David

Search in DiVA

By author/editor
Beskow, JonasGranström, BjörnHouse, David
By organisation
Speech Communication and Technology
Natural Language Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 218 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf