Interdependencies among voice source parameters in emotional speech
2011 (English)In: IEEE Transactions on Affective Computing, ISSN 1949-3045, Vol. 2, no 3, 162-174 p.Article in journal (Refereed) Published
Emotions have strong effects on the voice production mechanisms and consequently on voice characteristics. The magnitude of these effects, measured using voice source parameters, and the interdependencies among parameters have not been examined. To better understand these relationships, voice characteristics were analyzed in 10 actors' productions of a sustained/a/vowel in five emotions. Twelve acoustic parameters were studied and grouped according to their physiological backgrounds, three related to subglottal pressure, five related to the transglottal airflow waveform derived from inverse filtering the audio signal, and four related to vocal fold vibration. Each emotion appeared to possess a specific combination of acoustic parameters reflecting a specific mixture of physiologic voice control parameters. Features related to subglottal pressure showed strong within-group and between-group correlations, demonstrating the importance of accounting for vocal loudness in voice analyses. Multiple discriminant analysis revealed that a parameter selection that was based, in a principled fashion, on production processes could yield rather satisfactory discrimination outcomes (87.1 percent based on 12 parameters and 78 percent based on three parameters). The results of this study suggest that systems to automatically detect emotions use a hypothesis-driven approach to selecting parameters that directly reflect the physiological parameters underlying voice and speech production.
Place, publisher, year, edition, pages
2011. Vol. 2, no 3, 162-174 p.
Paralanguage analysis, affect sensing and analysis, affective computing, voice source, vocal physiology
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-52246DOI: 10.1109/T-AFFC.2011.14ISI: 000208758300004ScopusID: 2-s2.0-80054843364OAI: oai:DiVA.org:kth-52246DiVA: diva2:465542
FunderEU, European Research Council, ERC-2008-AdG-230331-PROPEREMO
QC 201112202011-12-142011-12-142013-12-13Bibliographically approved