Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Classification of Feedback Functions in Spoken Dialog Using Large Language Models and Prosodic Features
Furhat Robotics.
Aix-Marseille Université.ORCID-id: 0000-0001-7919-5688
KTH, Skolan för elektroteknik och datavetenskap (EECS), Intelligenta system, Tal, musik och hörsel, TMH.ORCID-id: 0000-0002-8579-1790
2023 (engelsk)Inngår i: 27th Workshop on the Semantics and Pragmatics of Dialogue, Maribor: University of Maribor , 2023, s. 15-24Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Feedback utterances such as ‘yeah’, ‘mhm’,and ‘okay’, convey different communicative functions depending on their prosodic realizations, as well as the conversational context in which they are produced. In this paper, we investigate the performance of different models and features for classifying the communicative function of short feedback tokens in American English dialog. We experiment with a combination of lexical and prosodic features extracted from the feedback utterance, as well as context features from the preceding utterance of the interlocutor. Given the limited amount of training data, we explore the use of a pre-trained large language model (GPT-3) to encode contextual information, as well as SimCSE sentence embeddings. The results show that good performance can be achieved with only SimCSE and lexical features, while the best performance is achieved by solely fine-tuning GPT-3, even if it does not have access to any prosodic features.

sted, utgiver, år, opplag, sider
Maribor: University of Maribor , 2023. s. 15-24
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-341388OAI: oai:DiVA.org:kth-341388DiVA, id: diva2:1821225
Konferanse
27th Workshop on the Semantics and Pragmatics of Dialogue, 16th and 17th August 2023, University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Slovenia
Merknad

QC 20231220

Tilgjengelig fra: 2023-12-19 Laget: 2023-12-19 Sist oppdatert: 2023-12-20bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Conference websiteProceedings

Person

Skantze, Gabriel

Søk i DiVA

Av forfatter/redaktør
Ochs, MagalieSkantze, Gabriel
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric

urn-nbn
Totalt: 55 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf