Towards rich multimodal behavior in spoken dialogues with embodied agents
2013 (English)In: 4th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2013 - Proceedings, IEEE Computer Society, 2013, 817-822 p.Conference paper (Refereed)
Spoken dialogue frameworks have traditionally been designed to handle a single stream of data - the speech signal. Research on human-human communication has been providing large evidence and quantifying the effects and the importance of a multitude of other multimodal nonverbal signals that people use in their communication, that shape and regulate their interaction. Driven by findings from multimodal human spoken interaction, and the advancements of capture devices and robotics and animation technologies, new possibilities are rising for the development of multimodal human-machine interaction that is more affective, social, and engaging. In such face-to-face interaction scenarios, dialogue systems can have a large set of signals at their disposal to infer context and enhance and regulate the interaction through the generation of verbal and nonverbal facial signals. This paper summarizes several design decision, and experiments that we have followed in attempts to build rich and fluent multimodal interactive systems using a newly developed hybrid robotic head called Furhat, and discuss issues and challenges that this effort is facing.
Place, publisher, year, edition, pages
IEEE Computer Society, 2013. 817-822 p.
Dialogue Systems, Facial Synthesis, Furhat Robot, Multimodal communication, Social Robots
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-137415DOI: 10.1109/CogInfoCom.2013.6719212ISI: 000349770000140ScopusID: 2-s2.0-84894193853ISBN: 978-1-4799-1543-9OAI: oai:DiVA.org:kth-137415DiVA: diva2:678887
4th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2013; Budapest; Hungary; 2 December 2013 through 5 December 2013
QC 201406032013-12-132013-12-132015-12-07Bibliographically approved