Deep learning-based dimensional emotion recognition for conversational agent-based cognitive behavioral therapyShow others and affiliations
2024 (English)In: PeerJ Computer Science, E-ISSN 2376-5992, Vol. 10, article id e2104Article in journal (Refereed) Published
Abstract [en]
Internet-based cognitive behavioral therapy (iCBT) offers a scalable, cost-effective, accessible, and low-threshold form of psychotherapy. Recent advancements explored the use of conversational agents such as chatbots and voice assistants to enhance the delivery of iCBT. These agents can deliver iCBT-based exercises, recognize and track emotional states, assess therapy progress, convey empathy, and potentially predict longterm therapy outcome. However, existing systems predominantly utilize categorical approaches for emotional modeling, which can oversimplify the complexity of human emotional states. To address this, we developed a transformer-based model for dimensional text-based emotion recognition, fine-tuned with a novel, comprehensive dimensional emotion dataset comprising 75,503 samples. This model significantly outperforms existing state-of-the-art models in detecting the dimensions of valence, arousal, and dominance, achieving a Pearson correlation coefficient of r = 0 . 90, r = 0 . 77, and r = 0 . 64, respectively. Furthermore, a feasibility study involving 20 participants confirmed the model's technical effectiveness and its usability, acceptance, and empathic understanding in a conversational agent-based iCBT setting, marking a substantial improvement in personalized and effective therapy experiences.
Place, publisher, year, edition, pages
PeerJ , 2024. Vol. 10, article id e2104
Keywords [en]
Emotion recognition, Empathic dialog management, Conversational agents, Cognitive behavioral therapy, Chatbots, Voice assistants
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-350748DOI: 10.7717/peerj-cs.2104ISI: 001259231100005Scopus ID: 2-s2.0-85199115503OAI: oai:DiVA.org:kth-350748DiVA, id: diva2:1884849
Note
QC 20240718
2024-07-182024-07-182024-08-13Bibliographically approved