Opportunities and obligations to take turns in collaborative multi-party human-robot interaction
2015 (English)In: SIGDIAL 2015 - 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference, Association for Computational Linguistics, 2015, p. 305-314Conference paper, Published paper (Refereed)
Abstract [en]
In this paper we present a data-driven model for detecting opportunities and obligations for a robot to take turns in multi-party discussions about objects. The data used for the model was collected in a public setting, where the robot head Furhat played a collaborative card sorting game together with two users. The model makes a combined detection of addressee and turn-yielding cues, using multi-modal data from voice activity, syntax, prosody, head pose, movement of cards, and dialogue context. The best result for a binary decision is achieved when several modalities are combined, giving a weighted F1 score of 0.876 on data from a previously unseen interaction, using only automatically extractable features.
Place, publisher, year, edition, pages
Association for Computational Linguistics, 2015. p. 305-314
Keywords [en]
Human computer interaction, Modal analysis, Robots, Binary decision, Card-sorting, Combined detections, Data-driven model, Head pose, Multi-modal data, Robot head, Voice activity, Human robot interaction
National Category
Other Engineering and Technologies
Identifiers
URN: urn:nbn:se:kth:diva-194745DOI: 10.18653/v1/w15-4642Scopus ID: 2-s2.0-84988311526ISBN: 9781941643754 (print)OAI: oai:DiVA.org:kth-194745DiVA, id: diva2:1047279
Conference
16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2015, 2 September 2015 through 4 September 2015
Note
QC 20161117
2016-11-172016-10-312024-03-15Bibliographically approved