Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Facial expression as an input annotation modality for affective speech-to-speech translation
2012 (English)Conference paper, Published paper (Refereed)
Resource type
Text
Abstract [en]

One of the challenges of speech-to-speech translation is to accurately preserve the paralinguistic information in the speaker’s message. In this work we explore the use of automatic facial expression analysis as an input annotation modality to transfer paralinguistic information at a symbolic level from input to output in speech-to-speech translation. To evaluate the feasibility of this ap- proach, a prototype system, FEAST (Facial Expression-based Affective Speech Translation) has been developed. FEAST classifies the emotional state of the user and uses it to render the translated output in an appropriate voice style, using expressive speech synthesis. 

Place, publisher, year, edition, pages
2012.
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:kth:diva-185527OAI: oai:DiVA.org:kth-185527DiVA: diva2:922771
Conference
Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction
Note

QC 20160426

Available from: 2016-04-25 Created: 2016-04-21 Last updated: 2016-06-02Bibliographically approved

Open Access in DiVA

fulltext(853 kB)45 downloads
File information
File name FULLTEXT01.pdfFile size 853 kBChecksum SHA-512
1b32ae8fb3e7374a03dcdceef0ce91c85e6a95a9411d9d5bdb2386796484f0408b4310da5160409b32bddb53760099a2c78c87a63fdee7f0e25d47ff39583253
Type fulltextMimetype application/pdf

Authority records BETA

Székely, Éva

Search in DiVA

By author/editor
Székely, Éva
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 45 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 21 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf