kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Solving the Problem of Expressive Musical Timing in Interactive Music Systems
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. Royal College of Music. (Sound and Music Computing)ORCID iD: 0000-0003-3399-8869
Royal College of Music.ORCID iD: 0000-0002-4756-1441
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Interactive music systems often implement music into games using approaches that tend to premiere music with a steady beat and quantized onsets to make seamless transitions. We identified a problem in which folk music and other genres with expressive musical timing cannot be used in these systems without violating musical traditions.

This design study explores a novel solution and extends current practices with Flexible Horizontal Re-sequencing to solve the problem. We designed a system to evaluate the concept by running a project with all the necessary steps, from recording the music to implementing it into an open, accessible web application.

We use notes from the development process, musicians’ evaluations, and interviews to validate the system and learn what features are needed to succeed and what musical factors contribute to the result. We conclude that the solution works well and that the system can perform seamless transitions if it has features for implementing sync points and phrase annotations to make individual crossfades for different instruments.

We found critical musical aspects of the recording session that can improve the result without violating genre traditions or musicians’ playing styles. We also suggest that a shared file format for MIR and interactive music systems would contribute to an efficient ecosystem where Flexible Horizontal Re-sequencing could complement current interactive music approaches to include expressive musical timing.

Keywords [en]
Interactive Music, Folk Music, Expressive Musical Timing
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-346626OAI: oai:DiVA.org:kth-346626DiVA, id: diva2:1859170
Note

QC 20240521

Available from: 2024-05-21 Created: 2024-05-21 Last updated: 2024-05-21Bibliographically approved
In thesis
1. Interactive Sound and Music Technology for Everyone: Designing Inclusive Standards for Web Audio Applications
Open this publication in new window or tab >>Interactive Sound and Music Technology for Everyone: Designing Inclusive Standards for Web Audio Applications
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

In this compilation thesis, I examine how systems and formats can be designed to include more people in creating interactive sound and music applications. I contribute knowledge, aiming to include everyone, but focus specifically on musicians with no programming skills and little interest in technical challenges. 

I have designed, developed, and evaluated a system – WebAudioXML (WAXML) – for implementing interactive sound and music in web pages using native web technologies. The system’s design is novel, and the work contributes knowledge about how markup language and spreadsheet concepts can describe sound and music structures. The results give insights into how high-level musical representation can be structured, named, and designed to be understood by those without prior programming experience. 

I also use WAXML to address musical diversity in interactive applications. I identify and solve technical challenges where current systems struggle to implement traditionally performed music. Novel solutions are designed, evaluated, discussed, and presented in the included papers. 

The system is finally implemented in applications aimed at education and inclusion, where I evaluate them through a series of case studies. The results confirm Web Audio as a solid platform for accessible learning, sharing, and distribution of audio applications and suggest that collective efforts shaping an ecosystem with a universal format would enable even more creators to make interactive sound and music applications. 

I research FOR the art THROUGH design. The knowledge output is valid for any interactive sound and music system but specifically addresses the design of Web Audio applications. 

Abstract [sv]

I denna sammanläggningsavhandling undersöker jag hur interaktiva system och format kan utformas för att inkludera fler personer i skapandet av inter- aktiva ljud- och musikapplikationer. Jag bidrar med kunskap med målet att inkludera alla, men fokuserar särskilt på musiker utan programmeringskunskaper och med begränsat intresse för tekniska utmaningar.

Jag har designat, utvecklat och utvärderat ett system – WebAudioXML (WAXML) – för att implementera interaktivt ljud och musik på webbsidor med hjälp av standardiserade webbtekniker. Systemet är nyskapande i sin design och arbetet bidrar med kunskap om hur markup-kod and koncept från kalkylblad kan användas för att beskriva ljud- och musikstrukturer. Resultaten ger insikter i hur musikalisk representation på en övergripande nivå kan struktureras, namnges och utformas för att bli förstådd av av dem som inte har tidigare erfarenhet av programmering.

Jag använder också WAXML som plattform för att utforska möjligheter till större musikalisk mångfald i interaktiva applikationer. Jag identifierar och löser tekniska utmaningar där nuvarande system har problem med att implementera musik som spelas enligt traditionen. Jag designar, utvärderar, diskuterar och presenterar nya lösningar i de inkluderade artiklarna.

Jag tillämpar även WAXML på applikationer avsedda för utbildning och inkludering, där jag utvärderar dem genom en serie fallstudier. Dessa bekräftar Web Audio som en stabil plattform för tillgängligt lärande, delning och distribution och pekar på att gemensamma insatser för att skapa ett ekosystem med ett universellt format skulle möjliggöra för fler att kunna skapa interaktiva ljud- och musikapplikationer.

Jag bedriver forskning FÖR konsten GENOM design. Resultatet är relevant för interaktiva ljud- och musiksystem i allmänhet och Web Audio- applikationer i synnerhet.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2024. p. 69
Series
TRITA-EECS-AVL ; 2024:52
Keywords
Interactive Music, Web Audio, Markup Language, Inclusion, Open Source Standards, Interaktiv musik, Web Audio, Markup-kod, Inkludering, Öppna Standarder
National Category
Human Computer Interaction
Research subject
Human-computer Interaction
Identifiers
urn:nbn:se:kth:diva-346629 (URN)978-91-8040-950-6 (ISBN)
Public defence
2024-06-11, https://kmh-se.zoom.us/j/62738893688?pwd=L3hQTWZqRVg3OExJenliTE1kbnhtUT09, Lilla salen, Royal College of Music, Valhallavägen105, Stockholm, 13:00 (English)
Opponent
Supervisors
Funder
Royal College of Music in Stockholm
Note

QC 20240521

Available from: 2024-05-21 Created: 2024-05-21 Last updated: 2026-01-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records

Lindetorp, Hans

Search in DiVA

By author/editor
Lindetorp, HansAhlbäck, Sven
By organisation
Media Technology and Interaction Design, MID
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 258 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf