Generating context-sensitive ECA responses to user barge-in interruptions
2012 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, Vol. 6, no 1-2, 13-25 p.Article in journal (Refereed) Published
We present an Embodied Conversational Agent (ECA) that incorporates a context-sensitive mechanism for handling user barge-in. The affective ECA engages the user in social conversation, and is fully implemented. We will use actual examples of system behaviour to illustrate. The ECA is designed to recognise and be empathetic to the emotional state of the user. It is able to detect, react quickly to, and then follow up with considered responses to different kinds of user interruptions. The design of the rules which enable the ECA to respond intelligently to different types of interruptions was informed by manually analysed real data from human-human dialogue. The rules represent recoveries from interruptions as two-part structures: an address followed by a resumption. The system is robust enough to manage long, multi-utterance turns by both user and system, which creates good opportunities for the user to interrupt while the ECA is speaking.
Place, publisher, year, edition, pages
2012. Vol. 6, no 1-2, 13-25 p.
ECA, Interruption, Recovery, Spoken dialogue system, User barge-in
Computer and Information Science
IdentifiersURN: urn:nbn:se:kth:diva-100498DOI: 10.1007/s12193-012-0090-zISI: 000309998800003ScopusID: 2-s2.0-84863189004OAI: oai:DiVA.org:kth-100498DiVA: diva2:543819
FunderEU, European Research Council, IST-FP6-034434
QC 201208102012-08-102012-08-092012-11-30Bibliographically approved