How does varying gaze direction affect interaction between a virtual agent and participant in an on-line communication scenario?
2014 (English)In: 6th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2014 - Held as Part of 16th International Conference on Human-Computer Interaction, HCI International 2014, 2014, Vol. 8525, no PART 1, 305-316 p.Conference paper (Refereed)
Computer based perspective taking tasks in cognitive psychology often utilise static images and auditory instructions to assess online communication. Results are then explained in terms of theory of mind (the ability to understand that other agents have different beliefs, desires and knowledge to oneself).The current study utilises a scenario in which participants were required to select objects in a grid after listening to instructions from an on-screen director. The director was positioned behind the grid from the participants' view. As objects in some slots were concealed from the view of the director, participants needed to take the perspective of the director into account in order to respond accurately. Results showed that participants reliably made errors, attributable to not using the information from the director's perspective efficiently, rather than not being able to take the director's perspective. However, the fact that the director was represented by a static sprite meant that even for a laboratory based experiment, the level of realism was low. This could have affected the level of participant engagement with the director and the task. This study, a collaboration between computer science and psychology, advances the static sprite model by incorporating head movement into a more realistic on-screen director with the aim of a.) Improving engagement and b.) investigating whether gaze direction affects accuracy and response times of object selection. Results suggest that gaze direction can influence the speed of accurate object selection, but only slightly and in certain situations; specifically those complex enough to warrant the participant paying additional attention to gaze direction and those that highlight perspective differences between themselves and the director. This in turn suggests that engagement with a virtual agent could be improved by taking these factors into account.
Place, publisher, year, edition, pages
2014. Vol. 8525, no PART 1, 305-316 p.
, Lecture Notes in Computer Science, ISSN 03029743
engagement, gaze direction, on-line communication, Theory of mind, Virtual reality, Cognitive psychology, Head movements, Object selection, Perspective taking, Theory of minds, Online systems
IdentifiersURN: urn:nbn:se:kth:diva-167620DOI: 10.1007/978-3-319-07458-0_29ScopusID: 2-s2.0-84903639121ISBN: 9783319074573OAI: oai:DiVA.org:kth-167620DiVA: diva2:813955
22 June 2014 - 27 June 2014, Heraklion, Crete
QC 201505252015-05-252015-05-222015-05-25Bibliographically approved