kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Opportunities and obligations to take turns in collaborative multi-party human-robot interaction
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH.ORCID iD: 0000-0002-8579-1790
2015 (English)In: SIGDIAL 2015 - 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference, Association for Computational Linguistics, 2015, p. 305-314Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we present a data-driven model for detecting opportunities and obligations for a robot to take turns in multi-party discussions about objects. The data used for the model was collected in a public setting, where the robot head Furhat played a collaborative card sorting game together with two users. The model makes a combined detection of addressee and turn-yielding cues, using multi-modal data from voice activity, syntax, prosody, head pose, movement of cards, and dialogue context. The best result for a binary decision is achieved when several modalities are combined, giving a weighted F1 score of 0.876 on data from a previously unseen interaction, using only automatically extractable features.

Place, publisher, year, edition, pages
Association for Computational Linguistics, 2015. p. 305-314
Keywords [en]
Human computer interaction, Modal analysis, Robots, Binary decision, Card-sorting, Combined detections, Data-driven model, Head pose, Multi-modal data, Robot head, Voice activity, Human robot interaction
National Category
Other Engineering and Technologies
Identifiers
URN: urn:nbn:se:kth:diva-194745DOI: 10.18653/v1/w15-4642Scopus ID: 2-s2.0-84988311526ISBN: 9781941643754 (print)OAI: oai:DiVA.org:kth-194745DiVA, id: diva2:1047279
Conference
16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2015, 2 September 2015 through 4 September 2015
Note

QC 20161117

Available from: 2016-11-17 Created: 2016-10-31 Last updated: 2024-03-15Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Skantze, Gabriel

Search in DiVA

By author/editor
Skantze, Gabriel
By organisation
Speech, Music and Hearing, TMH
Other Engineering and Technologies

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 352 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf