kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Deep learning-based dimensional emotion recognition for conversational agent-based cognitive behavioral therapy
Tech Univ Dresden, Ctr Scalable Data Analyt, Artificial Intelligence ScaDS Dresden Leipzig, Dresden, Saxony, Germany..
Tech Univ Dresden, Chair Human Comp Interact, Dresden, Saxony, Germany..
Karolinska Inst, Ctr Psychiat Res, Huddinge & Stockholm Hlth Care Serv, Dept Clin Neurosci,Reg Stockholm, Stockholm, Sweden..
Karolinska Inst, Ctr Psychiat Res, Huddinge & Stockholm Hlth Care Serv, Dept Clin Neurosci,Reg Stockholm, Stockholm, Sweden..
Show others and affiliations
2024 (English)In: PeerJ Computer Science, E-ISSN 2376-5992, Vol. 10, article id e2104Article in journal (Refereed) Published
Abstract [en]

Internet-based cognitive behavioral therapy (iCBT) offers a scalable, cost-effective, accessible, and low-threshold form of psychotherapy. Recent advancements explored the use of conversational agents such as chatbots and voice assistants to enhance the delivery of iCBT. These agents can deliver iCBT-based exercises, recognize and track emotional states, assess therapy progress, convey empathy, and potentially predict longterm therapy outcome. However, existing systems predominantly utilize categorical approaches for emotional modeling, which can oversimplify the complexity of human emotional states. To address this, we developed a transformer-based model for dimensional text-based emotion recognition, fine-tuned with a novel, comprehensive dimensional emotion dataset comprising 75,503 samples. This model significantly outperforms existing state-of-the-art models in detecting the dimensions of valence, arousal, and dominance, achieving a Pearson correlation coefficient of r = 0 . 90, r = 0 . 77, and r = 0 . 64, respectively. Furthermore, a feasibility study involving 20 participants confirmed the model's technical effectiveness and its usability, acceptance, and empathic understanding in a conversational agent-based iCBT setting, marking a substantial improvement in personalized and effective therapy experiences.

Place, publisher, year, edition, pages
PeerJ , 2024. Vol. 10, article id e2104
Keywords [en]
Emotion recognition, Empathic dialog management, Conversational agents, Cognitive behavioral therapy, Chatbots, Voice assistants
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-350748DOI: 10.7717/peerj-cs.2104ISI: 001259231100005Scopus ID: 2-s2.0-85199115503OAI: oai:DiVA.org:kth-350748DiVA, id: diva2:1884849
Note

QC 20240718

Available from: 2024-07-18 Created: 2024-07-18 Last updated: 2024-08-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Gotthardt, Marie
By organisation
Computer Science
In the same journal
PeerJ Computer Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 29 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf