Change search
ReferencesLink to record
Permanent link

Direct link
Expressive multimedia: Bringing action to physical world by dancing-tablet
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.ORCID iD: 0000-0003-3779-5647
2015 (English)In: HCMC 2015 - Proceedings of the 2nd Workshop on Computational Models of Social Interactions: Human-Computer-Media Communication, co-located with ACM MM 2015, ACM Digital Library, 2015, 9-14 p.Conference paper (Refereed)Text
Abstract [en]

The design practice based on embodied interaction concept focuses on developing new user interfaces for computer devices that merge the digital content with the physical world. In this work we have proposed a novel embodied interaction based design in which the 'action' information of the digital content is presented in the physical world. More specifically, we have mapped the 'action' information of the video content from the digital world into the physical world. The motivating example presented in this paper is our novel dancing-tablet, in which a tablet-PC dances on the rhythm of the song, hence the 'action' information is not just confined into a 2D flat display but also expressed by it. This paper presents i) hardware design of our mechatronic dancingtablet platform, ii) software algorithm for musical feature extraction and iii) embodied computational model for mapping 'action' information of the musical expression to the mechatronic platform. Our user study shows that the overall perception of audio-video music is enhanced by our dancingtablet setup.

Place, publisher, year, edition, pages
ACM Digital Library, 2015. 9-14 p.
Keyword [en]
Beat tracking, Computational model, Dancing robots, Embodied interaction, Musical interface, Tablet pc, Audio acoustics, Computation theory, Computational methods, Digital devices, Feature extraction, Personal computers, Social sciences, User interfaces, Digital contents, Mechatronic platform, Musical expression, Software algorithms, Tablet PCs, Human computer interaction
National Category
Robotics
Identifiers
URN: urn:nbn:se:kth:diva-186844DOI: 10.1145/2810397.2810399ScopusID: 2-s2.0-84964344557ISBN: 9781450337472Archive number: 10.1145/2810397.2810399OAI: oai:DiVA.org:kth-186844DiVA: diva2:931403
Conference
2nd Workshop on Computational Models of Social Interactions: Human-Computer-Media Communication, HCMC 2015, 30 October 2015
Note

QC 20160527

Available from: 2016-05-27 Created: 2016-05-13 Last updated: 2016-05-27Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopusExpressive multimedia

Search in DiVA

By author/editor
Li, Haibo
By organisation
Media Technology and Interaction Design, MID
Robotics

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 3 hits
ReferencesLink to record
Permanent link

Direct link