An Analysis of Shallow and Deep Representations of Speech Based on Unsupervised Classification of Isolated Words
2015 (English)In: Proceedings of Nonlinear Speech Processing, Springer, 2015Conference paper (Refereed)
We analyse the properties of shallow and deep representa-tions of speech. Mel frequency cepstral coefficients (MFCC) are compared to representations learned by a four layer Deep Belief Network (DBN) in terms of discriminative power and invariance to irrelevant factors such as speaker identity or gender. To avoid the influence of supervised statistical modelling, an unsupervised isolated word classification task is used for the comparison. The deep representations are also obtained with unsupervised training (no back-propagation pass is performed). The results show that DBN features provide a more concise clustering and higher match between clusters and word categories in terms of adjusted Rand score. Some of the confusions present with the MFCC features are, however, retained even with the DBN features.
Place, publisher, year, edition, pages
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-180414DOI: 10.1007/978-3-319-28109-4_15ScopusID: 2-s2.0-84955471729OAI: oai:DiVA.org:kth-180414DiVA: diva2:893723
Nonlinear Speech Processing
QC 201606152016-01-132016-01-132016-06-15Bibliographically approved