Evaluating users reactions to human-like interfaces: Prosodic and paralinguistic features as new evaluation measures for users satisfaction
2004 (English)In: From Brows to Trust: Evaluating Embodied Conversational Agents / [ed] Ruttkay, Z.; Pelachaud, C., Dordrecht: Kluwer Academic Publishers, 2004, 101-124 p.Chapter in book (Refereed)
An increasing number of dialogue systems are deployed to provide publicservices in our everyday lives. They are becoming more service-minded and several ofthem provide diﬀerent channels for interaction. The rationale is to make automaticservices available in new environments and more attractive to use. From a developerperspective, this aﬀects the complexity of the requirements elicitation activity, as newcombinations and variations in end-user interaction need to be considered. The aimof our investigation is to propose new parameters and metrics to evaluate multimodaldialogue systems endowed with embodied conversational agents (ECAs). These newmetrics focus on the users, rather than on the system. Our assumption is that theintentional use of prosodic variation and the production of communicative non-verbalbehaviour by users can give an indication of their attitude towards the system andmight also help to evaluate the users’ overall experience of the interaction. To testour hypothesis we carried out analyses on diﬀerent Swedish corpora of interactionsbetween users and multimodal dialogue systems. We analysed the prosodic variationin the way the users ended their interactions with the system and we observed theproduction of non-verbal communicative expressions by users. Our study supports theidea that the observation of users’ prosodic variation and production of communicativenon-verbal behaviour during the interaction with dialogue systems could be used asan indication of whether or not the users are satisﬁed with the system performance.
Place, publisher, year, edition, pages
Dordrecht: Kluwer Academic Publishers, 2004. 101-124 p.
, Human-Computer Interaction Series, ISSN 1571-5035 ; 7
Conversational agents, evaluation, multimodal interface, non-verbal behaviour, communicative gestures, prosodic cues
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-51789ISBN: 1-4020-2729-XISBN: 978-1-4020-2730-7OAI: oai:DiVA.org:kth-51789DiVA: diva2:465084
tmh_import_11_12_14. QC 201201032011-12-142011-12-142012-01-03Bibliographically approved