Deciphering the Silent Participant: On the Use of Audio-Visual Cues for the Classification of Listener Categories in Group Discussions
2015 (English)In: Proccedings of ICMI 2015, ACM Digital Library, 2015Conference paper (Refereed)
Estimating a silent participant's degree of engagement and his role within a group discussion can be challenging, as there are no speech related cues available at the given time. Having this information available, however, can provide important insights into the dynamics of the group as a whole. In this paper, we study the classification of listeners into several categories (attentive listener, side participant and bystander). We devised a thin-sliced perception test where subjects were asked to assess listener roles and engagement levels in 15-second video-clips taken from a corpus of group interviews. Results show that humans are usually able to assess silent participant roles. Using the annotation to identify from a set of multimodal low-level features, such as past speaking activity, backchannels (both visual and verbal), as well as gaze patterns, we could identify the features which are able to distinguish between different listener categories. Moreover, the results show that many of the audio-visual effects observed on listeners in dyadic interactions, also hold for multi-party interactions. A preliminary classifier achieves an accuracy of 64 %.
Place, publisher, year, edition, pages
ACM Digital Library, 2015.
Computer Science Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-180426DOI: 10.1145/2818346.2820759ISI: 000380609500018ScopusID: 2-s2.0-84959309012ISBN: 978-1-4503-3912-4OAI: oai:DiVA.org:kth-180426DiVA: diva2:893710
QC 201601212016-01-132016-01-132016-09-20Bibliographically approved