kth.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Classification of Feedback Functions in Spoken Dialog Using Large Language Models and Prosodic Features
Furhat Robotics.
Aix-Marseille Université.ORCID-id: 0000-0001-7919-5688
KTH, Skolan för elektroteknik och datavetenskap (EECS), Intelligenta system, Tal, musik och hörsel, TMH.ORCID-id: 0000-0002-8579-1790
2023 (Engelska)Ingår i: 27th Workshop on the Semantics and Pragmatics of Dialogue, Maribor: University of Maribor , 2023, s. 15-24Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Feedback utterances such as ‘yeah’, ‘mhm’,and ‘okay’, convey different communicative functions depending on their prosodic realizations, as well as the conversational context in which they are produced. In this paper, we investigate the performance of different models and features for classifying the communicative function of short feedback tokens in American English dialog. We experiment with a combination of lexical and prosodic features extracted from the feedback utterance, as well as context features from the preceding utterance of the interlocutor. Given the limited amount of training data, we explore the use of a pre-trained large language model (GPT-3) to encode contextual information, as well as SimCSE sentence embeddings. The results show that good performance can be achieved with only SimCSE and lexical features, while the best performance is achieved by solely fine-tuning GPT-3, even if it does not have access to any prosodic features.

Ort, förlag, år, upplaga, sidor
Maribor: University of Maribor , 2023. s. 15-24
Nationell ämneskategori
Språkteknologi (språkvetenskaplig databehandling)
Identifikatorer
URN: urn:nbn:se:kth:diva-341388OAI: oai:DiVA.org:kth-341388DiVA, id: diva2:1821225
Konferens
27th Workshop on the Semantics and Pragmatics of Dialogue, 16th and 17th August 2023, University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Slovenia
Anmärkning

QC 20231220

Tillgänglig från: 2023-12-19 Skapad: 2023-12-19 Senast uppdaterad: 2023-12-20Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Conference websiteProceedings

Person

Skantze, Gabriel

Sök vidare i DiVA

Av författaren/redaktören
Ochs, MagalieSkantze, Gabriel
Av organisationen
Tal, musik och hörsel, TMH
Språkteknologi (språkvetenskaplig databehandling)

Sök vidare utanför DiVA

GoogleGoogle Scholar

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 64 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf