Evaluating data-driven co-speech gestures of embodied conversational agents through real-time interaction
2022 (English)In: IVA '22: Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, Association for Computing Machinery (ACM) , 2022Conference paper, Published paper (Refereed)
Abstract [en]
Embodied Conversational Agents (ECAs) that make use of co-speech gestures can enhance human-machine interactions in many ways. In recent years, data-driven gesture generation approaches for ECAs have attracted considerable research attention, and related methods have continuously improved. Real-time interaction is typically used when researchers evaluate ECA systems that generate rule-based gestures. However, when evaluating the performance of ECAs based on data-driven methods, participants are often required only to watch pre-recorded videos, which cannot provide adequate information about what a person perceives during the interaction. To address this limitation, we explored use of real-time interaction to assess data-driven gesturing ECAs. We provided a testbed framework, and investigated whether gestures could affect human perception of ECAs in the dimensions of human-likeness, animacy, perceived intelligence, and focused attention. Our user study required participants to interact with two ECAs - one with and one without hand gestures. We collected subjective data from the participants' self-report questionnaires and objective data from a gaze tracker. To our knowledge, the current study represents the first attempt to evaluate data-driven gesturing ECAs through real-time interaction and the first experiment using gaze-tracking to examine the effect of ECAs' gestures.
Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2022.
Keywords [en]
data-driven, embodied conversational agent, evaluation instrument, gaze tracking, gesture generation, user study, Interactive computer systems, Real time systems, Surveys, User interfaces, Agent systems, Data driven, Gaze-tracking, Human machine interaction, Real time interactions, Rule based, Eye tracking
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-327286DOI: 10.1145/3514197.3549697ISI: 001118873500032Scopus ID: 2-s2.0-85138695641OAI: oai:DiVA.org:kth-327286DiVA, id: diva2:1758957
Conference
IVA 2022 - Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents
Note
QC 20230524
2023-05-242023-05-242025-12-05Bibliographically approved