CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Chinese Whispers: A Multimodal Dataset for Embodied Language Grounding
2020 (English)Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we introduce a multimodal dataset in which subjects are instructing each other how to assemble IKEA furniture. Using the concept of ‘Chinese Whispers’, an old children’s game, we employ a novel method to avoid implicit experimenter biases. We let subjects instruct each other on the nature of the task: the process of the furniture assembly. Uncertainty, hesitations, repairs and self-corrections are naturally introduced in the incremental process of establishing common ground. The corpus consists of 34 interactions, where each subject first assembles and then instructs. We collected speech, eye-gaze, pointing gestures, and object movements, as well as subjective interpretations of mutual understanding, collaboration and task recall. The corpus is of particular interest to researchers who are interested in multimodal signals in situated dialogue, especially in referential communication and the process of language grounding.

Place, publisher, year, edition, pages
2020.
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-273215OAI: oai:DiVA.org:kth-273215DiVA, id: diva2:1429524
Conference
Language Resources and Evaluation (LREC)
Available from: 2020-05-11 Created: 2020-05-11 Last updated: 2020-05-16Bibliographically approved

Open Access in DiVA

fulltext(2592 kB)10 downloads
File information
File name FULLTEXT01.pdfFile size 2592 kBChecksum SHA-512
6980d31f562cb4c2fb78044eaa0173838887e4236e37d844d22c7edb3a9b34ac467b4e8e04a2c6f8671642fa5cc2a0fe0085f2ed9360e7996a32c4ff2df58275
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Kontogiorgos, Dimosthenis
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 10 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 62 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf