Multimodal conversational interaction with a humanoid robot
2012 (English)In: 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2012 - Proceedings, IEEE , 2012, 667-672 p.Conference paper (Refereed)
The paper presents a multimodal conversational interaction system for the Nao humanoid robot. The system was developed at the 8th International Summer Workshop on Multimodal Interfaces, Metz, 2012. We implemented WikiTalk, an existing spoken dialogue system for open-domain conversations, on Nao. This greatly extended the robot's interaction capabilities by enabling Nao to talk about an unlimited range of topics. In addition to speech interaction, we developed a wide range of multimodal interactive behaviours by the robot, including face-tracking, nodding, communicative gesturing, proximity detection and tactile interrupts. We made video recordings of user interactions and used questionnaires to evaluate the system. We further extended the robot's capabilities by linking Nao with Kinect.
Place, publisher, year, edition, pages
IEEE , 2012. 667-672 p.
communicative gesturing, human-robot interaction, spoken dialogue systems
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-109396DOI: 10.1109/CogInfoCom.2012.6421935ScopusID: 2-s2.0-84874432668ISBN: 978-146735187-4OAI: oai:DiVA.org:kth-109396DiVA: diva2:581693
3rd International Conference on Cognitive Infocommunications (CogInfoCom 2012), Kosice, Slovakia, December 2-5, 2012
QC 201301082013-01-022013-01-022013-03-27Bibliographically approved