kth.sePublikationer KTH
Systemuppdatering
På tisdag 18 augusti mellan kl. 12-13 kommer en planerad systemuppdatering av DiVA att ske. Under denna tid är DiVA inte tillgängligt.
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
A WaveNet-based model for predicting the electroglottographic signal from the acoustic voice signal
KTH, Skolan för elektroteknik och datavetenskap (EECS), Intelligenta system, Tal, musik och hörsel, TMH. (Music Acoustics)ORCID-id: 0000-0003-0700-7216
KTH, Skolan för elektroteknik och datavetenskap (EECS), Intelligenta system, Tal, musik och hörsel, TMH, Tal-kommunikation.ORCID-id: 0000-0002-3362-7518
2025 (Engelska)Ingår i: Journal of the Acoustical Society of America, ISSN 0001-4966, E-ISSN 1520-8524, Vol. 157, nr 4, s. 3033-3044Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The electroglottographic (EGG) signal offers a non-invasive approach to analyze phonation. It is known, if not obvious, that the onset of vocal fold contacting has a substantial effect on how the vocal folds vibrate and on the quality of the voice. Given that the presence or absence of vocal fold contacting has major consequences also for the interpretation of acoustic metrics, it is compelling to consider the possibility of predicting EGG signals directly from the microphone speech signal. This retrospective study presents a neural network model for EGG signal estimation utilizing a WaveNet architecture augmented with a self-attention mechanism. The model was trained on an existing dataset that comprehensively recorded participants' full voice range. The proposed model effectively captures the temporal dynamics and morphological characteristics of normophonic EGG waveforms, achieving outputs that closely resemble the ground truth in terms of EGG waveshape and extracted EGG metrics. For evaluation, voice mapping was used to display the distribution similarities of extracted metrics from predicted and ground truth EGG waveforms. The model exhibits proficiency in accurately estimating EGG signals in areas of stable and contacting voicing but displays reduced accuracy in transitional and breathy phonatory conditions.

Ort, förlag, år, upplaga, sidor
American Institute of Physics (AIP), 2025. Vol. 157, nr 4, s. 3033-3044
Nyckelord [en]
Phonetics, Vocalization, Vocal folds, Microphones, Speech analysis, Speech processing systems, Electroglottography, Acoustic signal processing, Artificial neural networks
Nationell ämneskategori
Oto-rino-laryngologi Medicinsk instrumentering Signalbehandling
Forskningsämne
Tal- och musikkommunikation
Identifikatorer
URN: urn:nbn:se:kth:diva-362580DOI: 10.1121/10.0036514ISI: 001472395500002PubMedID: 40249176Scopus ID: 2-s2.0-105003174138OAI: oai:DiVA.org:kth-362580DiVA, id: diva2:1953319
Anmärkning

A precursor to this article was included in Huanchen Cai's doctoral thesis. This is the revised and accepted version.

QC 20250425

Tillgänglig från: 2025-04-20 Skapad: 2025-04-20 Senast uppdaterad: 2025-12-08Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextPubMedScopusJASA

Person

Cai, HuanchenTernström, Sten

Sök vidare i DiVA

Av författaren/redaktören
Cai, HuanchenTernström, Sten
Av organisationen
Tal, musik och hörsel, TMHTal-kommunikation
I samma tidskrift
Journal of the Acoustical Society of America
Oto-rino-laryngologiMedicinsk instrumenteringSignalbehandling

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetricpoäng

doi
pubmed
urn-nbn
Totalt: 230 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf