Change search
ReferencesLink to record
Permanent link

Direct link
Evaluating users reactions to human-like interfaces: Prosodic and paralinguistic features as new evaluation measures for users satisfaction
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.
2004 (English)In: From Brows to Trust: Evaluating Embodied Conversational Agents / [ed] Ruttkay, Z.; Pelachaud, C., Dordrecht: Kluwer Academic Publishers, 2004, 101-124 p.Chapter in book (Refereed)
Abstract [en]

An increasing number of dialogue systems are deployed to provide publicservices in our everyday lives. They are becoming more service-minded and several ofthem provide different channels for interaction. The rationale is to make automaticservices available in new environments and more attractive to use. From a developerperspective, this affects the complexity of the requirements elicitation activity, as newcombinations and variations in end-user interaction need to be considered. The aimof our investigation is to propose new parameters and metrics to evaluate multimodaldialogue systems endowed with embodied conversational agents (ECAs). These newmetrics focus on the users, rather than on the system. Our assumption is that theintentional use of prosodic variation and the production of communicative non-verbalbehaviour by users can give an indication of their attitude towards the system andmight also help to evaluate the users’ overall experience of the interaction. To testour hypothesis we carried out analyses on different Swedish corpora of interactionsbetween users and multimodal dialogue systems. We analysed the prosodic variationin the way the users ended their interactions with the system and we observed theproduction of non-verbal communicative expressions by users. Our study supports theidea that the observation of users’ prosodic variation and production of communicativenon-verbal behaviour during the interaction with dialogue systems could be used asan indication of whether or not the users are satisfied with the system performance.

Place, publisher, year, edition, pages
Dordrecht: Kluwer Academic Publishers, 2004. 101-124 p.
, Human-Computer Interaction Series, ISSN 1571-5035 ; 7
Keyword [en]
Conversational agents, evaluation, multimodal interface, non-verbal behaviour, communicative gestures, prosodic cues
National Category
Computer Science Language Technology (Computational Linguistics)
URN: urn:nbn:se:kth:diva-51789ISBN: 1-4020-2729-XISBN: 978-1-4020-2730-7OAI: diva2:465084
tmh_import_11_12_14. QC 20120103Available from: 2011-12-14 Created: 2011-12-14 Last updated: 2012-01-03Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Cerrato, Loredana
By organisation
Speech Communication and Technology
Computer ScienceLanguage Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 21 hits
ReferencesLink to record
Permanent link

Direct link