Opportunities and obligations to take turns in collaborative multi-party human-robot interaction
2015 (English)In: SIGDIAL 2015 - 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference, Association for Computational Linguistics, 2015, 305-314 p.Conference paper (Refereed)
In this paper we present a data-driven model for detecting opportunities and obligations for a robot to take turns in multi-party discussions about objects. The data used for the model was collected in a public setting, where the robot head Furhat played a collaborative card sorting game together with two users. The model makes a combined detection of addressee and turn-yielding cues, using multi-modal data from voice activity, syntax, prosody, head pose, movement of cards, and dialogue context. The best result for a binary decision is achieved when several modalities are combined, giving a weighted F1 score of 0.876 on data from a previously unseen interaction, using only automatically extractable features.
Place, publisher, year, edition, pages
Association for Computational Linguistics, 2015. 305-314 p.
Human computer interaction, Modal analysis, Robots, Binary decision, Card-sorting, Combined detections, Data-driven model, Head pose, Multi-modal data, Robot head, Voice activity, Human robot interaction
Other Engineering and Technologies
IdentifiersURN: urn:nbn:se:kth:diva-194745ScopusID: 2-s2.0-84988311526ISBN: 9781941643754OAI: oai:DiVA.org:kth-194745DiVA: diva2:1047279
16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2015, 2 September 2015 through 4 September 2015
QC 201611172016-11-172016-10-312016-11-17Bibliographically approved