Expressive multimedia: Bringing action to physical world by dancing-tablet
2015 (English)In: HCMC 2015 - Proceedings of the 2nd Workshop on Computational Models of Social Interactions: Human-Computer-Media Communication, co-located with ACM MM 2015, ACM Digital Library, 2015, 9-14 p.Conference paper (Refereed)Text
The design practice based on embodied interaction concept focuses on developing new user interfaces for computer devices that merge the digital content with the physical world. In this work we have proposed a novel embodied interaction based design in which the 'action' information of the digital content is presented in the physical world. More specifically, we have mapped the 'action' information of the video content from the digital world into the physical world. The motivating example presented in this paper is our novel dancing-tablet, in which a tablet-PC dances on the rhythm of the song, hence the 'action' information is not just confined into a 2D flat display but also expressed by it. This paper presents i) hardware design of our mechatronic dancingtablet platform, ii) software algorithm for musical feature extraction and iii) embodied computational model for mapping 'action' information of the musical expression to the mechatronic platform. Our user study shows that the overall perception of audio-video music is enhanced by our dancingtablet setup.
Place, publisher, year, edition, pages
ACM Digital Library, 2015. 9-14 p.
Beat tracking, Computational model, Dancing robots, Embodied interaction, Musical interface, Tablet pc, Audio acoustics, Computation theory, Computational methods, Digital devices, Feature extraction, Personal computers, Social sciences, User interfaces, Digital contents, Mechatronic platform, Musical expression, Software algorithms, Tablet PCs, Human computer interaction
IdentifiersURN: urn:nbn:se:kth:diva-186844DOI: 10.1145/2810397.2810399ScopusID: 2-s2.0-84964344557ISBN: 9781450337472Archive number: 10.1145/2810397.2810399OAI: oai:DiVA.org:kth-186844DiVA: diva2:931403
2nd Workshop on Computational Models of Social Interactions: Human-Computer-Media Communication, HCMC 2015, 30 October 2015
QC 201605272016-05-272016-05-132016-05-27Bibliographically approved