Change search
ReferencesLink to record
Permanent link

Direct link
Opportunities and obligations to take turns in collaborative multi-party human-robot interaction
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH.ORCID iD: 0000-0002-8579-1790
2015 (English)In: SIGDIAL 2015 - 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference, Association for Computational Linguistics, 2015, 305-314 p.Conference paper (Refereed)
Abstract [en]

In this paper we present a data-driven model for detecting opportunities and obligations for a robot to take turns in multi-party discussions about objects. The data used for the model was collected in a public setting, where the robot head Furhat played a collaborative card sorting game together with two users. The model makes a combined detection of addressee and turn-yielding cues, using multi-modal data from voice activity, syntax, prosody, head pose, movement of cards, and dialogue context. The best result for a binary decision is achieved when several modalities are combined, giving a weighted F1 score of 0.876 on data from a previously unseen interaction, using only automatically extractable features.

Place, publisher, year, edition, pages
Association for Computational Linguistics, 2015. 305-314 p.
Keyword [en]
Human computer interaction, Modal analysis, Robots, Binary decision, Card-sorting, Combined detections, Data-driven model, Head pose, Multi-modal data, Robot head, Voice activity, Human robot interaction
National Category
Other Engineering and Technologies
URN: urn:nbn:se:kth:diva-194745ScopusID: 2-s2.0-84988311526ISBN: 9781941643754OAI: diva2:1047279
16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2015, 2 September 2015 through 4 September 2015

QC 20161117

Available from: 2016-11-17 Created: 2016-10-31 Last updated: 2016-11-17Bibliographically approved

Open Access in DiVA

No full text


Search in DiVA

By author/editor
Skantze, Gabriel
By organisation
Speech, Music and Hearing, TMH
Other Engineering and Technologies

Search outside of DiVA

GoogleGoogle Scholar

ReferencesLink to record
Permanent link

Direct link