Change search
ReferencesLink to record
Permanent link

Direct link
User-Centered Control of Audio and Visual Expressive Feedback by Full-Body Movements
KTH, School of Computer Science and Communication (CSC), Speech, Music and Hearing, TMH, Music Acoustics.ORCID iD: 0000-0002-3086-0322
2007 (English)In: Affective Computing and Intelligent Interaction / [ed] Paiva, Ana; Prada, Rui; Picard, Rosalind W., Berlin / Heidelberg: Springer Berlin/Heidelberg, 2007, 501-510 p.Chapter in book (Refereed)
Abstract [en]

In this paper we describe a system allowing users to express themselves through their full-body movement and gesture and to control in real-time the generation of an audio-visual feedback. The systems analyses in real-time the user’s full-body movement and gesture, extracts expressive motion features and maps the values of the expressive motion features onto real-time control of acoustic parameters for rendering a music performance. At the same time, a visual feedback generated in real-time is projected on a screen in front of the users with their coloured silhouette, depending on the emotion their movement communicates. Human movement analysis and visual feedback generation were done with the EyesWeb software platform and the music performance rendering with pDM. Evaluation tests were done with human participants to test the usability of the interface and the effectiveness of the design.

Place, publisher, year, edition, pages
Berlin / Heidelberg: Springer Berlin/Heidelberg, 2007. 501-510 p.
, Lecture Notes in Computer Science, ISSN 0302-9743 ; 4738
Keyword [en]
Affective interaction, expressive gesture, multimodal environments, interactive music systems
National Category
Computer Science Human Computer Interaction Computer Vision and Robotics (Autonomous Systems) Psychology Music
URN: urn:nbn:se:kth:diva-51975DOI: 10.1007/978-3-540-74889-2_44ScopusID: 2-s2.0-38049037289ISBN: 978-3-540-74888-5OAI: diva2:465265

tmh_import_11_12_14. QC 20111230

Available from: 2011-12-14 Created: 2011-12-14 Last updated: 2016-08-18Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Bresin, Roberto
By organisation
Music Acoustics
Computer ScienceHuman Computer InteractionComputer Vision and Robotics (Autonomous Systems)PsychologyMusic

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 87 hits
ReferencesLink to record
Permanent link

Direct link