kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Customizing and Evaluating Accessible Multisensory Music Experiences with Pre-Verbal Children: A Case Study on the Perception of Musical Haptics Using Participatory Design with Proxies
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. IRCAM, STMS Sci & Technol Mus & Son UMR9912, 1 Pl Igor Stravinsky, F-75004 Paris, France..ORCID iD: 0000-0002-4422-5223
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0002-1244-881x
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0001-7454-8659
2022 (English)In: Multimodal Technologies and Interaction, ISSN 2414-4088, Vol. 6, no 7, article id 55Article in journal (Refereed) Published
Abstract [en]

Research on Accessible Digital Musical Instruments (ADMIs) has highlighted the need for participatory design methods, i.e., to actively include users as co-designers and informants in the design process. However, very little work has explored how pre-verbal children with Profound and Multiple Disabilities (PMLD) can be involved in such processes. In this paper, we apply in-depth qualitative and mixed methodologies in a case study with four students with PMLD. Using Participatory Design with Proxies (PDwP), we assess how these students can be involved in the customization and evaluation of the design of a multisensory music experience intended for a large-scale ADMI. Results from an experiment focused on communication of musical haptics highlighted the diversity in employed interaction strategies used by the children, accessibility limitations of the current multisensory experience design, and the importance of using a multifaceted variety of qualitative and quantitative methods to arrive at more informed conclusions when applying a design with proxies methodology.

Place, publisher, year, edition, pages
MDPI AG , 2022. Vol. 6, no 7, article id 55
Keywords [en]
accessible digital musical instruments, multimodal feedback, haptics, multisensory rooms, participatory design, disability studies
National Category
Music Other Engineering and Technologies Computer and Information Sciences
Research subject
Media Technology; Human-computer Interaction; Art, Technology and Design
Identifiers
URN: urn:nbn:se:kth:diva-316293DOI: 10.3390/mti6070055ISI: 000832049500001Scopus ID: 2-s2.0-85136133459OAI: oai:DiVA.org:kth-316293DiVA, id: diva2:1686950
Projects
Ljudskogen
Funder
Swedish Research Council, 2020-00343
Note

QC 20220812

Available from: 2022-08-12 Created: 2022-08-12 Last updated: 2025-02-21Bibliographically approved
In thesis
1. Converging Creativity: Intertwining Music and Code
Open this publication in new window or tab >>Converging Creativity: Intertwining Music and Code
2023 (English)Doctoral thesis, comprehensive summary (Other academic) [Artistic work]
Abstract [en]

This compilation thesis is a collection of case studies that presents examples of creative coding in various contexts, focusing on how such practice led to the creation and exploration of musical expressions, and how I in- interact with the design of the code itself. My own experience as a music composer influences this thesis work. By saying so, I mean that although the thesis places itself in the Sound and Music Computing academic tradition, it is also profoundly founded upon a personal artistic perspective. This perspective has been the overarching view that has informed the studies included in the thesis, despite all being quite different. The first part of the thesis describes the practice of creative coding, creativity models, and the interaction between code and coder. Then I propose a perspective on creative coding based on the idea of asymptotic convergence of creativity. This is followed by a presentation of five papers and three music works, all inspected through my stance on this creative practice. Finally, I examine and discuss these works in detail, concluding by suggesting that the asymptotic convergence of creativity framework might serve as a useful tool that adds to the literature on creative coding practice, especially for situations in which such work is carried out in an academic research setting. 

Abstract [sv]

I denna sammanläggningsavhandling presenteras ett antal fallstudier med fokus på kreativ programmering (engelska: creative coding) i en rad olika sammanhang. Fokus ligger på hur kreativ programmering stimulerat musikskapande och utforskning av olika musikaliska uttryck, samt hur jag själv interagerat med kod i sådana kontexter. Detta avhandlingsarbete är till stor del influerat av min personliga erfarenheter och bakgrund som kompositör. Även om avhandlingen befinner sig i en akademisk kontext, närmare bestämt inom den vetenskapliga traditionen för ljud- och musikbehandling, så är avhandlingsarbetet också djupt rotat i ett konstnärligt perspektiv. Detta perspektiv har influerat och präglat de studier som beskrivs i denna avhandling, trots att studierna sinsemellan är av ganska skiljd karaktär. Den första delen av denna avhandling beskriver kreativ programmering och dess praktik, olika kreativitetsmodeller samt samspelet mellan utvecklare och kod. Sedan föreslår jag ett perspektiv på kreativ kodning som bygger på idén om kreativitetens asymptotiska konvergens. Detta efterföljs av en genomgång av fem artiklar och tre musikverk, vilka analyseras med hjälp av min ansats till denna praktik. Slutligen granskar och diskuterar jag dessa verk i detalj och avslutar med att föreslå att ramverket för kreativitetens asymptotiska konvergens kan fungera som ett användbart verktyg som bidrar till litteraturen om kreativ kodningspraxis, särskilt för situationer där sådant arbete utförs i en akademisk forskningsmiljö. 

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2023. p. 71
Series
TRITA-EECS-AVL ; 2023:40
Keywords
Sound and Music Computing, Music Composition
National Category
Computer and Information Sciences Human Computer Interaction Music Arts
Research subject
Media Technology
Identifiers
urn:nbn:se:kth:diva-327072 (URN)978-91-8040-585-0 (ISBN)
Public defence
2023-06-09, https://kth-se.zoom.us/j/62182993824, Kollegiesalen, Brinellvägen 6, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20230522

Available from: 2023-05-22 Created: 2023-05-17 Last updated: 2025-02-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopushttps://doi.org/10.3390/mti6070055

Authority records

Frid, EmmaPanariello, ClaudioNúñez-Pacheco, Claudia

Search in DiVA

By author/editor
Frid, EmmaPanariello, ClaudioNúñez-Pacheco, Claudia
By organisation
Media Technology and Interaction Design, MID
MusicOther Engineering and TechnologiesComputer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 448 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf