Effects of Visual Prominence Cues on Speech Intelligibility
2009 (English)In: Proceedings of Auditory-Visual Speech Processing AVSP'09, Norwich, England, 2009Conference paper, Published paper (Refereed)
Abstract [en]
This study reports experimental results on the effect of visual prominence, presented as gestures, on speech intelligibility. 30 acoustically vocoded sentences, permutated into different gestural conditions were presented audio-visually to 12 subjects. The analysis of correct word recognition shows a significant increase in intelligibility when focally-accented (prominent) words are supplemented with head-nods or with eye-brow raise gestures. The paper also examines coupling other acoustic phenomena to brow-raise gestures. As a result, the paper introduces new evidence on the ability of the non-verbal movements in the visual modality to support audio-visual speech perception.
Place, publisher, year, edition, pages
Norwich, England, 2009.
Keywords [en]
prominence, head-nod, eye-brow, speech intelligibility, talking heads, lip-reading, gesture, visual prosody
National Category
Computer Sciences Language Technology (Computational Linguistics)
Identifiers
URN: urn:nbn:se:kth:diva-52099OAI: oai:DiVA.org:kth-52099DiVA, id: diva2:465394
Conference
Auditory-Visual Speech Processing (AVSP) 2009, University of East Anglia, Norwich, UK, September 10-13, 2009
Note
tmh_import_11_12_14. QC 20111222
2011-12-142011-12-142022-06-24Bibliographically approved