Turn-taking Control Using Gaze in Multiparty Human-Computer Dialogue: Effects of 2D and 3D Displays
2011 (English)In: Proceedings of the International Conference on Audio-Visual Speech Processing 2011, Stockholm: KTH Royal Institute of Technology, 2011, 99-102 p.Conference paper (Refereed)
In a previous experiment we found that the perception of gazefrom an animated agent on a two-dimensional display suffersfrom the Mona Lisa effect, which means that exclusive mutual gaze cannot be established if there is more than one observer. By using a three-dimensional projection surface, this effect can be eliminated. In this study, we investigate whether this difference also holds for the turn-taking behaviour of subjects interacting with the animated agent in a multi-party dialogue. We present a Wizard-of-Oz experiment where ﬁve subjects talk toan animated agent in a route direction dialogue. The results show that the subjects to some extent can infer the intended target of the agent’s questions, in spite of the Mona Lisa effect, but that the accuracy of gaze when it comes to selecting an addressee is still signiﬁcantly lower in the 2D condition, ascompared to the 3D condition. The response time is also significantly longer in the 2D condition, indicating that the inference of intended gaze may require additional cognitive efforts.
Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2011. 99-102 p.
, Proceedings of the International Conference on Audio-Visual Speech Processing, ISSN 1680-8908 ; 2011
Turn-taking, Multi-party Dialogue, Gaze, Facial Interaction, Mona Lisa Effect, Facial Projection, Wizard of Oz
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-52205ISBN: 978-91-7501-080-9ISBN: 978-91-7501-079-3OAI: oai:DiVA.org:kth-52205DiVA: diva2:465503
International Conference on Audio-Visual Speech Processing 2011, Aug 31- Sep 3 2011, Volterra, Italy
tmh_import_11_12_14. QC 201112222011-12-142011-12-142012-11-23Bibliographically approved