kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Collaborative music-making: special educational needs school assistants as facilitators in performances with accessible digital musical instruments
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. KMH Royal Coll Mus, Dept Mus & Media Prod, Stockholm, Sweden.ORCID iD: 0000-0003-3399-8869
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0003-4259-484X
Show others and affiliations
2023 (English)In: Frontiers in Computer Science, E-ISSN 2624-9898, Vol. 5, article id 1165442Article in journal (Refereed) Published
Abstract [en]

The field of research dedicated to Accessible Digital Musical Instruments (ADMIs) is growing and there is an increased interest in promoting diversity and inclusion in music-making. We have designed a novel system built into previously tested ADMIs that aims at involving assistants, students with Profound and Multiple Learning Disabilities (PMLD), and a professional musician in playing music together. In this study the system is evaluated in a workshop setting using quantitative as well as qualitative methods. One of the main findings was that the sounds from the ADMIs added to the musical context without making errors that impacted the music negatively even when the assistants mentioned experiencing a split between attending to different tasks, and a feeling of insecurity toward their musical contribution. We discuss the results in terms of how we perceive them as drivers or barriers toward reaching our overarching goal of organizing a joint concert that brings together students from the SEN school with students from a music school with a specific focus on traditional orchestral instruments. Our study highlights how a system of networked and synchronized ADMIs could be conceptualized to include assistants more actively in collaborative music-making, as well as design considerations that support them as facilitators.

Place, publisher, year, edition, pages
Frontiers Media SA , 2023. Vol. 5, article id 1165442
Keywords [en]
collaborative music-making, Web Audio, assistants as facilitators, accessible digital musical instruments, interactive musical systems
National Category
Musicology Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-334301DOI: 10.3389/fcomp.2023.1165442ISI: 001039158900001Scopus ID: 2-s2.0-85166582445OAI: oai:DiVA.org:kth-334301DiVA, id: diva2:1789176
Note

QC 20230818

Available from: 2023-08-18 Created: 2023-08-18 Last updated: 2024-05-21Bibliographically approved
In thesis
1. Interactive Sound and Music Technology for Everyone: Designing Inclusive Standards for Web Audio Applications
Open this publication in new window or tab >>Interactive Sound and Music Technology for Everyone: Designing Inclusive Standards for Web Audio Applications
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

In this compilation thesis, I examine how systems and formats can be designed to include more people in creating interactive sound and music applications. I contribute knowledge, aiming to include everyone, but focus specifically on musicians with no programming skills and little interest in technical challenges. 

I have designed, developed, and evaluated a system – WebAudioXML (WAXML) – for implementing interactive sound and music in web pages using native web technologies. The system’s design is novel, and the work contributes knowledge about how markup language and spreadsheet concepts can describe sound and music structures. The results give insights into how high-level musical representation can be structured, named, and designed to be understood by those without prior programming experience. 

I also use WAXML to address musical diversity in interactive applications. I identify and solve technical challenges where current systems struggle to implement traditionally performed music. Novel solutions are designed, evaluated, discussed, and presented in the included papers. 

The system is finally implemented in applications aimed at education and inclusion, where I evaluate them through a series of case studies. The results confirm Web Audio as a solid platform for accessible learning, sharing, and distribution of audio applications and suggest that collective efforts shaping an ecosystem with a universal format would enable even more creators to make interactive sound and music applications. 

I research FOR the art THROUGH design. The knowledge output is valid for any interactive sound and music system but specifically addresses the design of Web Audio applications. 

Abstract [sv]

I denna sammanläggningsavhandling undersöker jag hur interaktiva system och format kan utformas för att inkludera fler personer i skapandet av inter- aktiva ljud- och musikapplikationer. Jag bidrar med kunskap med målet att inkludera alla, men fokuserar särskilt på musiker utan programmeringskunskaper och med begränsat intresse för tekniska utmaningar.

Jag har designat, utvecklat och utvärderat ett system – WebAudioXML (WAXML) – för att implementera interaktivt ljud och musik på webbsidor med hjälp av standardiserade webbtekniker. Systemet är nyskapande i sin design och arbetet bidrar med kunskap om hur markup-kod and koncept från kalkylblad kan användas för att beskriva ljud- och musikstrukturer. Resultaten ger insikter i hur musikalisk representation på en övergripande nivå kan struktureras, namnges och utformas för att bli förstådd av av dem som inte har tidigare erfarenhet av programmering.

Jag använder också WAXML som plattform för att utforska möjligheter till större musikalisk mångfald i interaktiva applikationer. Jag identifierar och löser tekniska utmaningar där nuvarande system har problem med att implementera musik som spelas enligt traditionen. Jag designar, utvärderar, diskuterar och presenterar nya lösningar i de inkluderade artiklarna.

Jag tillämpar även WAXML på applikationer avsedda för utbildning och inkludering, där jag utvärderar dem genom en serie fallstudier. Dessa bekräftar Web Audio som en stabil plattform för tillgängligt lärande, delning och distribution och pekar på att gemensamma insatser för att skapa ett ekosystem med ett universellt format skulle möjliggöra för fler att kunna skapa interaktiva ljud- och musikapplikationer.

Jag bedriver forskning FÖR konsten GENOM design. Resultatet är relevant för interaktiva ljud- och musiksystem i allmänhet och Web Audio- applikationer i synnerhet.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2024. p. 69
Series
TRITA-EECS-AVL ; 2024:52
Keywords
Interactive Music, Web Audio, Markup Language, Inclusion, Open Source Standards, Interaktiv musik, Web Audio, Markup-kod, Inkludering, Öppna Standarder
National Category
Human Computer Interaction
Research subject
Human-computer Interaction
Identifiers
urn:nbn:se:kth:diva-346629 (URN)978-91-8040-950-6 (ISBN)
Public defence
2024-06-11, https://kmh-se.zoom.us/j/62738893688?pwd=L3hQTWZqRVg3OExJenliTE1kbnhtUT09, Lilla salen, Royal College of Music, Valhallavägen105, Stockholm, 13:00 (English)
Opponent
Supervisors
Funder
Royal College of Music in Stockholm
Note

QC 20240521

Available from: 2024-05-21 Created: 2024-05-21 Last updated: 2024-06-10Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Lindetorp, HansSvahn, MariaHölling, JosefineFalkenberg, KjetilFrid, Emma

Search in DiVA

By author/editor
Lindetorp, HansSvahn, MariaHölling, JosefineFalkenberg, KjetilFrid, Emma
By organisation
Media Technology and Interaction Design, MID
In the same journal
Frontiers in Computer Science
MusicologyComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 99 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf