Effects of Visual Prominence Cues on Speech Intelligibility
2009 (English)In: Proceedings of Auditory-Visual Speech Processing AVSP'09, Norwich, England, 2009Conference paper (Refereed)
This study reports experimental results on the effect of visual prominence, presented as gestures, on speech intelligibility. 30 acoustically vocoded sentences, permutated into different gestural conditions were presented audio-visually to 12 subjects. The analysis of correct word recognition shows a significant increase in intelligibility when focally-accented (prominent) words are supplemented with head-nods or with eye-brow raise gestures. The paper also examines coupling other acoustic phenomena to brow-raise gestures. As a result, the paper introduces new evidence on the ability of the non-verbal movements in the visual modality to support audio-visual speech perception.
Place, publisher, year, edition, pages
Norwich, England, 2009.
prominence, head-nod, eye-brow, speech intelligibility, talking heads, lip-reading, gesture, visual prosody
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-52099OAI: oai:DiVA.org:kth-52099DiVA: diva2:465394
Auditory-Visual Speech Processing (AVSP) 2009, University of East Anglia, Norwich, UK, September 10-13, 2009
tmh_import_11_12_14. QC 201112222011-12-142011-12-142011-12-22Bibliographically approved