Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Interactive sonification of a fluid dance movement: an exploratory study
KTH, School of Electrical Engineering and Computer Science (EECS), Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-4422-5223
KTH, School of Electrical Engineering and Computer Science (EECS), Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-2659-0411
KTH, School of Electrical Engineering and Computer Science (EECS), Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-3086-0322
2019 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 13, no 3, p. 181-189Article in journal (Refereed) Published
Abstract [en]

In this paper we present three different experiments designed to explore sound properties associated with fluid movement: (1) an experiment in which participants adjusted parameters of a sonification model developed for a fluid dance movement, (2) a vocal sketching experiment in which participants sketched sounds portraying fluid versus nonfluid movements, and (3) a workshop in which participants discussed and selected fluid versus nonfluid sounds. Consistent findings from the three experiments indicated that sounds expressing fluidity generally occupy a lower register and has less high frequency content, as well as a lower bandwidth, than sounds expressing nonfluidity. The ideal sound to express fluidity is continuous, calm, slow, pitched, reminiscent of wind, water or an acoustic musical instrument. The ideal sound to express nonfluidity is harsh, non-continuous, abrupt, dissonant, conceptually associated with metal or wood, unhuman and robotic. Findings presented in this paper can be used as design guidelines for future applications in which the movement property fluidity is to be conveyed through sonification.

Place, publisher, year, edition, pages
Springer, 2019. Vol. 13, no 3, p. 181-189
Keywords [en]
Interactive sonification, Fluid movement, Vocal sketching, sound and music computing
National Category
Media Engineering Media and Communication Technology Human Computer Interaction Other Natural Sciences Interaction Technologies
Research subject
Media Technology; Human-computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-239168DOI: 10.1007/s12193-018-0278-yISI: 000480549700004Scopus ID: 2-s2.0-85056702595OAI: oai:DiVA.org:kth-239168DiVA, id: diva2:1263917
Projects
DANCE
Funder
EU, Horizon 2020, 645553
Note

QC 20190904

Available from: 2018-11-18 Created: 2018-11-18 Last updated: 2019-12-11Bibliographically approved
In thesis
1. Diverse Sounds: Enabling Inclusive Sonic Interaction
Open this publication in new window or tab >>Diverse Sounds: Enabling Inclusive Sonic Interaction
2019 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This compilation thesis collects a series of publications on designing sonic interactions for diversity and inclusion. The presented papers focus on case studies in which musical interfaces were either developed or reviewed. While the described studies are substantially different in their nature, they all contribute to the thesis by providing reflections on how musical interfaces could be designed to enable inclusion rather than exclusion. Building on this work, I introduce two terms: inclusive sonic interaction design and Accessible Digital Musical Instruments (ADMIs). I also define nine properties to consider in the design and evaluation of ADMIs: expressiveness, playability, longevity, customizability, pleasure, sonic quality, robustness, multimodality and causality. Inspired by the experience of playing an acoustic instrument, I propose to enable musical inclusion for under-represented groups (for example persons with visual- and hearing-impairments, as well as elderly people) through the design of Digital Musical Instruments (DMIs) in the form of rich multisensory experiences allowing for multiple modes of interaction. At the same time, it is important to enable customization to fit user needs, both in terms of gestural control and provided sonic output. I conclude that the computer music community has the potential to actively engage more people in music-making activities. In addition, I stress the importance of identifying challenges that people face in these contexts, thereby enabling initiatives towards changing practices.

Abstract [sv]

I denna sammanläggningsavhandling presenteras ett antal artiklar med fokus på mångfald och breddat deltagande inom fältet sonisk interaktionsdesign (engelska: Sonic Interaction Design). Publikationerna behandlar utvecklingen av musikgränssnitt samt en översikt av sådana system. De studier som beskrivs i denna avhandling skiljer sig väsentligt åt sinsemellan men bidrar alla till avhandlingens tes genom att förse läsaren med reflektioner kring hur musikgränssnitt kan utformas för att främja breddat deltagande inom musikskapande. Baserat på dessa studier introducerar jag två begrepp: inkluderande sonisk interaktionsdesign (engelska: inclusive sonic interaction design) och tillgängliga digitala musikinstrument (engelska: Accessible Digital Musical Instruments, ADMIs). Jag definierar även nio egenskaper att ta i beaktning vid design och utvärdering av sådana instrument: uttrycksfullhet, spelbarhet, livslängd, anpassningsbarhet, nöje/välbehag, musik och ljudkvalitet, robusthet, multimodalitet samt kausalitiet. Inspirerad av akustiska musikinstrument föreslår jag att främja ökat deltagande av underrepresenterade grupper (exempelvis personer med syn- eller hörselnedsättningar samt äldre människor) genom att designa digitala musikinstrument i form av multimodala gränssnitt. På så sätt kan instrumenten öppna upp för fler olika interaktionssätt och möjliggöra multisensorisk återkoppling. Det är också viktigt att dessa instrument kan anpassas till respektive användares behov, både när det gäller ljudskapande gester samt ljudande material. Jag drar slutsatsen att forskningsfältet inom datormusik (engelska: computer music) har potential att främja breddat deltagande inom musikskapande. Genom att identifiera de utmaningar som personer i underrepresenterade grupper möter kan vi agera för att skapa en mer inkluderande praktik.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2019. p. 81
Series
TRITA-EECS-AVL ; 2020:2
Keywords
Accessible Digital Musical Instruments, Sonic Interaction Design, Sound and Music Computing, New Interfaces for Musical Expression
National Category
Media and Communication Technology Human Computer Interaction
Research subject
Media Technology; Human-computer Interaction
Identifiers
urn:nbn:se:kth:diva-265159 (URN)978-91-7873-378-1 (ISBN)
Public defence
2020-01-10, Kollegiesalen, Brinellvägen 8, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20191212

Available from: 2019-12-12 Created: 2019-12-11 Last updated: 2019-12-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopusFull Paper

Search in DiVA

By author/editor
Frid, EmmaElblaus, LudvigBresin, Roberto
By organisation
Media Technology and Interaction Design, MID
In the same journal
Journal on Multimodal User Interfaces
Media EngineeringMedia and Communication TechnologyHuman Computer InteractionOther Natural SciencesInteraction Technologies

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 712 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf