The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human-Agent Interaction TaskShow others and affiliations
2021 (English)In: ACM Transactions on Computer-Human Interaction, ISSN 1073-0516, E-ISSN 1557-7325, Vol. 28, no 6, article id 44Article in journal (Refereed) Published
Abstract [en]
Emotional expressivity is essential for human interactions, informing both perception and decision-making. Here, we examine whether creating an audio-visual emotional channel mismatch influences decision-making in a cooperative task with a virtual character. We created a virtual character that was either congruent in its emotional expression (smiling in the face and voice) or incongruent (smiling in only one channel). People (N = 98) evaluated the character in terms of valence and arousal in an online study; then, visitors in a museum played the "lunar survival task" with the character over three experiments (N = 597, 78, 101, respectively). Exploratory results suggest that multi-modal expressions are perceived, and reacted upon, differently than unimodal expressions, supporting previous theories of audio-visual integration.
Place, publisher, year, edition, pages
ASSOC COMPUTING MACHINERY , 2021. Vol. 28, no 6, article id 44
Keywords [en]
Multimodal emotional expression, artificial agent, social influence, smiling
National Category
Computer Sciences Human Computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-307022DOI: 10.1145/3469232ISI: 000734831300008Scopus ID: 2-s2.0-85122460647OAI: oai:DiVA.org:kth-307022DiVA, id: diva2:1626771
Note
QC 20220112
2022-01-122022-01-122022-06-25Bibliographically approved