Change search
ReferencesLink to record
Permanent link

Direct link
Opportunities and Obligations to Take Turns in Collaborative Multi-Party Human-Robot Interaction
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.ORCID iD: 0000-0002-3242-3935
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Speech Communication and Technology.ORCID iD: 0000-0002-8579-1790
2015 (English)In: Proceedings of SIGDIAL, 2015Conference paper (Refereed)
Abstract [en]

In this paper we present a data-driven model for detecting opportunities and obligations for a robot to take turns in multi-party discussions about objects. The data used for the model was collected in a public setting, where the robot head Furhat played a collaborative card sorting game together with two users. The model makes a combined detection of addressee and turn-yielding cues, using multi-modal data from voice activity, syntax, prosody, head pose, movement of cards, and dialogue context. The best result for a binary decision is achieved when several modalities are com-bined, giving a weighted F1 score of 0.876 on data from a previously unseen interaction, using only automatically extractable features.

Place, publisher, year, edition, pages
2015.
National Category
Computer Science Language Technology (Computational Linguistics)
Identifiers
URN: urn:nbn:se:kth:diva-180409OAI: oai:DiVA.org:kth-180409DiVA: diva2:893739
Conference
SIGDIAL
Note

QC 20160215

Available from: 2016-01-13 Created: 2016-01-13 Last updated: 2016-02-15Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Johansson, MartinSkantze, Gabriel
By organisation
Speech Communication and Technology
Computer ScienceLanguage Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 18 hits
ReferencesLink to record
Permanent link

Direct link