Detection of Specific Mispronunciations using Audiovisual FeaturesShow others and affiliations
2010 (English)In: Auditory-Visual Speech Processing (AVSP) 2010, The International Society for Computers and Their Applications (ISCA) , 2010Conference paper, Published paper (Refereed)
Abstract [en]
This paper introduces a general approach for binaryclassification of audiovisual data. The intended application ismispronunciation detection for specific phonemic errors, usingvery sparse training data. The system uses a Support VectorMachine (SVM) classifier with features obtained from a TimeVarying Discrete Cosine Transform (TV-DCT) on the audiolog-spectrum as well as on the image sequences. Theconcatenated feature vectors from both the modalities werereduced to a very small subset using a combination of featureselection methods. We achieved 95-100% correctclassification for each pair-wise classifier on a database ofSwedish vowels with an average of 58 instances per vowel fortraining. The performance was largely unaffected when testedon data from a speaker who was not included in the training.
Place, publisher, year, edition, pages
The International Society for Computers and Their Applications (ISCA) , 2010.
National Category
Computer Sciences Natural Language Processing
Identifiers
URN: urn:nbn:se:kth:diva-52156Scopus ID: 2-s2.0-84944324391OAI: oai:DiVA.org:kth-52156DiVA, id: diva2:465451
Conference
International Conference on Auditory-Visual Speech Processing, AVSP 2010. Hakone, Kanagawa, Japan. September 30-October 3, 2010
Note
tmh_import_11_12_14. QC 20111215
2011-12-142011-12-142025-02-01Bibliographically approved