Can visualization of internal articulators support speech perception?
2008 (English)In: INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, BAIXAS: ISCA-INST SPEECH COMMUNICATION ASSOC , 2008, 2627-2630 p.Conference paper (Refereed)
This paper describes the contribution to speech perception given by animations of intra-oral articulations. 18 subjects were asked to identify the words in acoustically degraded sentences in three different presentation modes: acoustic signal only, audiovisual with a front view of a synthetic face and an audiovisual with both front face view and a side view, where tongue movements were visible by making parts of the cheek transparent. The augmented reality side-view did not help subjects perform better overall than with the front view only, but it seems to have been beneficial for the perception of palatal plosives, liquids and rhotics, especially in clusters. The results indicate that it cannot be expected that intra-oral animations support speech perception in general, but that information on some articulatory features can be extracted. Animations of tongue movements have hence more potential for use in computer-assisted pronunciation and perception training than as a communication aid for the hearing-impaired.
Place, publisher, year, edition, pages
BAIXAS: ISCA-INST SPEECH COMMUNICATION ASSOC , 2008. 2627-2630 p.
talking head, speech perception, speech visualization, audiovisual speech, internal articulation
General Language Studies and Linguistics Computer and Information Science
IdentifiersURN: urn:nbn:se:kth:diva-29856ISI: 000277026101236ScopusID: 2-s2.0-84867227459ISBN: 978-1-61567-378-0OAI: oai:DiVA.org:kth-29856DiVA: diva2:399603
9th Annual Conference of the International-Speech-Communication-Association (INTERSPEECH 2008), Brisbane, AUSTRALIA, SEP 22-26, 2008
QC 201102222011-02-232011-02-172011-02-23Bibliographically approved