Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Music Creation by Example
(Sound and Music Computing)ORCID iD: 0000-0002-4422-5223
(Adobe Research)
(Adobe Research)
2020 (English)Manuscript (preprint) (Other academic)
Abstract [en]

Short online videos have become the dominating media on social platforms. However, finding suitable music to accompany videos can be a challenging task to some video creators, due to copyright constraints, limitations in search engines, and required audio-editing expertise. One possible solution to these problems is to use AI music generation. In this paper we present a user interface (UI) paradigm that allows users to input a song to an AI music engine and then interactively regenerate and mix AI-generated music. To arrive at this design, we conducted user studies with a total of 104 video creators at several stages of our design and development process. User studies supported the effectiveness of our approach and provided valuable insights about humanAI interaction as well as the design and evaluation of mixedinitiative interfaces in creative practice.

Place, publisher, year, edition, pages
2020.
Keywords [en]
Music Generation, Human-AI Interaction
National Category
Media and Communication Technology Human Computer Interaction
Research subject
Media Technology; Human-computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-265519OAI: oai:DiVA.org:kth-265519DiVA, id: diva2:1377625
Conference
CHI Conference on Human Factors in Computing Systems
Note

QC 20191212

Available from: 2019-12-12 Created: 2019-12-12 Last updated: 2019-12-12Bibliographically approved
In thesis
1. Diverse Sounds: Enabling Inclusive Sonic Interaction
Open this publication in new window or tab >>Diverse Sounds: Enabling Inclusive Sonic Interaction
2019 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This compilation thesis collects a series of publications on designing sonic interactions for diversity and inclusion. The presented papers focus on case studies in which musical interfaces were either developed or reviewed. While the described studies are substantially different in their nature, they all contribute to the thesis by providing reflections on how musical interfaces could be designed to enable inclusion rather than exclusion. Building on this work, I introduce two terms: inclusive sonic interaction design and Accessible Digital Musical Instruments (ADMIs). I also define nine properties to consider in the design and evaluation of ADMIs: expressiveness, playability, longevity, customizability, pleasure, sonic quality, robustness, multimodality and causality. Inspired by the experience of playing an acoustic instrument, I propose to enable musical inclusion for under-represented groups (for example persons with visual- and hearing-impairments, as well as elderly people) through the design of Digital Musical Instruments (DMIs) in the form of rich multisensory experiences allowing for multiple modes of interaction. At the same time, it is important to enable customization to fit user needs, both in terms of gestural control and provided sonic output. I conclude that the computer music community has the potential to actively engage more people in music-making activities. In addition, I stress the importance of identifying challenges that people face in these contexts, thereby enabling initiatives towards changing practices.

Abstract [sv]

I denna sammanläggningsavhandling presenteras ett antal artiklar med fokus på mångfald och breddat deltagande inom fältet sonisk interaktionsdesign (engelska: Sonic Interaction Design). Publikationerna behandlar utvecklingen av musikgränssnitt samt en översikt av sådana system. De studier som beskrivs i denna avhandling skiljer sig väsentligt åt sinsemellan men bidrar alla till avhandlingens tes genom att förse läsaren med reflektioner kring hur musikgränssnitt kan utformas för att främja breddat deltagande inom musikskapande. Baserat på dessa studier introducerar jag två begrepp: inkluderande sonisk interaktionsdesign (engelska: inclusive sonic interaction design) och tillgängliga digitala musikinstrument (engelska: Accessible Digital Musical Instruments, ADMIs). Jag definierar även nio egenskaper att ta i beaktning vid design och utvärdering av sådana instrument: uttrycksfullhet, spelbarhet, livslängd, anpassningsbarhet, nöje/välbehag, musik och ljudkvalitet, robusthet, multimodalitet samt kausalitiet. Inspirerad av akustiska musikinstrument föreslår jag att främja ökat deltagande av underrepresenterade grupper (exempelvis personer med syn- eller hörselnedsättningar samt äldre människor) genom att designa digitala musikinstrument i form av multimodala gränssnitt. På så sätt kan instrumenten öppna upp för fler olika interaktionssätt och möjliggöra multisensorisk återkoppling. Det är också viktigt att dessa instrument kan anpassas till respektive användares behov, både när det gäller ljudskapande gester samt ljudande material. Jag drar slutsatsen att forskningsfältet inom datormusik (engelska: computer music) har potential att främja breddat deltagande inom musikskapande. Genom att identifiera de utmaningar som personer i underrepresenterade grupper möter kan vi agera för att skapa en mer inkluderande praktik.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2019. p. 81
Series
TRITA-EECS-AVL ; 2020:2
Keywords
Accessible Digital Musical Instruments, Sonic Interaction Design, Sound and Music Computing, New Interfaces for Musical Expression
National Category
Media and Communication Technology Human Computer Interaction
Research subject
Media Technology; Human-computer Interaction
Identifiers
urn:nbn:se:kth:diva-265159 (URN)978-91-7873-378-1 (ISBN)
Public defence
2020-01-10, Kollegiesalen, Brinellvägen 8, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20191212

Available from: 2019-12-12 Created: 2019-12-11 Last updated: 2019-12-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records BETA

Frid, Emma

Search in DiVA

By author/editor
Frid, Emma
Media and Communication TechnologyHuman Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 105 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf