Change search
ReferencesLink to record
Permanent link

Direct link
WinkTalk: a multimodal speech synthesis interface linking facial expressions to expressive synthetic voices
2012 (English)In: Proceedings of the Third Workshop on Speech and Language Processing for Assistive Technologies, 2012Conference paper (Refereed)Text
Abstract [en]

This paper describes a demonstration of the WinkTalk system, which is a speech synthe- sis platform using expressive synthetic voices. With the help of a webcamera and facial ex- pression analysis, the system allows the user to control the expressive features of the syn- thetic speech for a particular utterance with their facial expressions. Based on a person- alised mapping between three expressive syn- thetic voices and the users facial expressions, the system selects a voice that matches their face at the moment of sending a message. The WinkTalk system is an early research pro- totype that aims to demonstrate that facial expressions can be used as a more intuitive control over expressive speech synthesis than manual selection of voice types, thereby con- tributing to an improved communication expe- rience for users of speech generating devices. 

Place, publisher, year, edition, pages
National Category
Engineering and Technology
URN: urn:nbn:se:kth:diva-185532OAI: diva2:922171
Third Workshop on Speech and Language Processing for Assistive Technologies. 7th to 8th of June.

QC 20160422

Available from: 2016-04-22 Created: 2016-04-21 Last updated: 2016-04-22Bibliographically approved

Open Access in DiVA

fulltext(581 kB)7 downloads
File information
File name FULLTEXT01.pdfFile size 581 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Székely, Éva
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 7 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 16 hits
ReferencesLink to record
Permanent link

Direct link