User-Centered Control of Audio and Visual Expressive Feedback by Full-Body Movements
2007 (English)In: Affective Computing and Intelligent Interaction / [ed] Paiva, Ana; Prada, Rui; Picard, Rosalind W., Berlin / Heidelberg: Springer Berlin/Heidelberg, 2007, 501-510 p.Chapter in book (Refereed)
In this paper we describe a system allowing users to express themselves through their full-body movement and gesture and to control in real-time the generation of an audio-visual feedback. The systems analyses in real-time the user’s full-body movement and gesture, extracts expressive motion features and maps the values of the expressive motion features onto real-time control of acoustic parameters for rendering a music performance. At the same time, a visual feedback generated in real-time is projected on a screen in front of the users with their coloured silhouette, depending on the emotion their movement communicates. Human movement analysis and visual feedback generation were done with the EyesWeb software platform and the music performance rendering with pDM. Evaluation tests were done with human participants to test the usability of the interface and the effectiveness of the design.
Place, publisher, year, edition, pages
Berlin / Heidelberg: Springer Berlin/Heidelberg, 2007. 501-510 p.
, Lecture Notes in Computer Science, ISSN 0302-9743 ; 4738
Affective interaction, expressive gesture, multimodal environments, interactive music systems
Computer Science Human Computer Interaction Computer Vision and Robotics (Autonomous Systems) Psychology Music
IdentifiersURN: urn:nbn:se:kth:diva-51975DOI: 10.1007/978-3-540-74889-2_44ScopusID: 2-s2.0-38049037289ISBN: 978-3-540-74888-5OAI: oai:DiVA.org:kth-51975DiVA: diva2:465265
tmh_import_11_12_14. QC 201112302011-12-142011-12-142016-08-18Bibliographically approved