Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Mimebot—Investigating the Expressibility of Non-Verbal Communication Across Agent Embodiments
KTH, Skolan för datavetenskap och kommunikation (CSC), Tal, musik och hörsel, TMH.ORCID-id: 0000-0002-7801-7617
KTH, Skolan för datavetenskap och kommunikation (CSC), Tal, musik och hörsel, TMH.
2017 (engelsk)Inngår i: ACM Transactions on Applied Perception, ISSN 1544-3558, E-ISSN 1544-3965, Vol. 14, nr 4, artikkel-id 24Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Unlike their human counterparts, artificial agents such as robots and game characters may be deployed with a large variety of face and body configurations. Some have articulated bodies but lack facial features, and others may be talking heads ending at the neck. Generally, they have many fewer degrees of freedom than humans through which they must express themselves, and there will inevitably be a filtering effect when mapping human motion onto the agent. In this article, we investigate filtering effects on three types of embodiments: (a) an agent with a body but no facial features, (b) an agent with a head only, and (c) an agent with a body and a face. We performed a full performance capture of a mime actor enacting short interactions varying the non-verbal expression along five dimensions (e.g., level of frustration and level of certainty) for each of the three embodiments. We performed a crowd-sourced evaluation experiment comparing the video of the actor to the video of an animated robot for the different embodiments and dimensions. Our findings suggest that the face is especially important to pinpoint emotional reactions but is also most volatile to filtering effects. The body motion, on the other hand, had more diverse interpretations but tended to preserve the interpretation after mapping and thus proved to be more resilient to filtering.

sted, utgiver, år, opplag, sider
Association for Computing Machinery (ACM), 2017. Vol. 14, nr 4, artikkel-id 24
Emneord [en]
Motion capture, cross-mapping, perception
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-218270DOI: 10.1145/3127590ISI: 000415407300003Scopus ID: 2-s2.0-85029893975OAI: oai:DiVA.org:kth-218270DiVA, id: diva2:1160136
Merknad

QC 20171127

Tilgjengelig fra: 2017-11-24 Laget: 2017-11-24 Sist oppdatert: 2018-01-13bibliografisk kontrollert
Inngår i avhandling
1. Performance, Processing and Perception of Communicative Motion for Avatars and Agents
Åpne denne publikasjonen i ny fane eller vindu >>Performance, Processing and Perception of Communicative Motion for Avatars and Agents
2017 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Artificial agents and avatars are designed with a large variety of face and body configurations. Some of these (such as virtual characters in films) may be highly realistic and human-like, while others (such as social robots) have considerably more limited expressive means. In both cases, human motion serves as the model and inspiration for the non-verbal behavior displayed. This thesis focuses on increasing the expressive capacities of artificial agents and avatars using two main strategies: 1) improving the automatic capturing of the most communicative areas for human communication, namely the face and the fingers, and 2) increasing communication clarity by proposing novel ways of eliciting clear and readable non-verbal behavior.

The first part of the thesis covers automatic methods for capturing and processing motion data. In paper A, we propose a novel dual sensor method for capturing hands and fingers using optical motion capture in combination with low-cost instrumented gloves. The approach circumvents the main problems with marker-based systems and glove-based systems, and it is demonstrated and evaluated on a key-word signing avatar. In paper B, we propose a robust method for automatic labeling of sparse, non-rigid motion capture marker sets, and we evaluate it on a variety of marker configurations for finger and facial capture. In paper C, we propose an automatic method for annotating hand gestures using Hierarchical Hidden Markov Models (HHMMs).

The second part of the thesis covers studies on creating and evaluating multimodal databases with clear and exaggerated motion. The main idea is that this type of motion is appropriate for agents under certain communicative situations (such as noisy environments) or for agents with reduced expressive degrees of freedom (such as humanoid robots). In paper D, we record motion capture data for a virtual talking head with variable articulation style (normal-to-over articulated). In paper E, we use techniques from mime acting to generate clear non-verbal expressions custom tailored for three agent embodiments (face-and-body, face-only and body-only).

sted, utgiver, år, opplag, sider
Stockholm: KTH Royal Institute of Technology, 2017. s. 73
Serie
TRITA-CSC-A, ISSN 1653-5723 ; 24
HSV kategori
Forskningsprogram
Tal- och musikkommunikation
Identifikatorer
urn:nbn:se:kth:diva-218272 (URN)978-91-7729-608-9 (ISBN)
Disputas
2017-12-15, F3, Lindstedtsvägen 26, Stockholm, 14:00 (engelsk)
Opponent
Veileder
Merknad

QC 20171127

Tilgjengelig fra: 2017-11-27 Laget: 2017-11-24 Sist oppdatert: 2018-01-13bibliografisk kontrollert

Open Access i DiVA

fulltext(15630 kB)135 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 15630 kBChecksum SHA-512
cc89fbb1e2703ce9d8b515a55f973bac9ab9ec107a427a1f989d97902a9405bb508743f74ab353633cf51fb4fec0a1c8ac2428c6adde640609911bd97325b8fd
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstScopus

Søk i DiVA

Av forfatter/redaktør
Alexanderson, SimonBeskow, Jonas
Av organisasjonen
I samme tidsskrift
ACM Transactions on Applied Perception

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 135 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 612 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf