kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Converging Creativity: Intertwining Music and Code
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-1244-881x
2023 (English)Doctoral thesis, comprehensive summary (Other academic) [Artistic work]
Abstract [en]

This compilation thesis is a collection of case studies that presents examples of creative coding in various contexts, focusing on how such practice led to the creation and exploration of musical expressions, and how I in- interact with the design of the code itself. My own experience as a music composer influences this thesis work. By saying so, I mean that although the thesis places itself in the Sound and Music Computing academic tradition, it is also profoundly founded upon a personal artistic perspective. This perspective has been the overarching view that has informed the studies included in the thesis, despite all being quite different. The first part of the thesis describes the practice of creative coding, creativity models, and the interaction between code and coder. Then I propose a perspective on creative coding based on the idea of asymptotic convergence of creativity. This is followed by a presentation of five papers and three music works, all inspected through my stance on this creative practice. Finally, I examine and discuss these works in detail, concluding by suggesting that the asymptotic convergence of creativity framework might serve as a useful tool that adds to the literature on creative coding practice, especially for situations in which such work is carried out in an academic research setting. 

Abstract [sv]

I denna sammanläggningsavhandling presenteras ett antal fallstudier med fokus på kreativ programmering (engelska: creative coding) i en rad olika sammanhang. Fokus ligger på hur kreativ programmering stimulerat musikskapande och utforskning av olika musikaliska uttryck, samt hur jag själv interagerat med kod i sådana kontexter. Detta avhandlingsarbete är till stor del influerat av min personliga erfarenheter och bakgrund som kompositör. Även om avhandlingen befinner sig i en akademisk kontext, närmare bestämt inom den vetenskapliga traditionen för ljud- och musikbehandling, så är avhandlingsarbetet också djupt rotat i ett konstnärligt perspektiv. Detta perspektiv har influerat och präglat de studier som beskrivs i denna avhandling, trots att studierna sinsemellan är av ganska skiljd karaktär. Den första delen av denna avhandling beskriver kreativ programmering och dess praktik, olika kreativitetsmodeller samt samspelet mellan utvecklare och kod. Sedan föreslår jag ett perspektiv på kreativ kodning som bygger på idén om kreativitetens asymptotiska konvergens. Detta efterföljs av en genomgång av fem artiklar och tre musikverk, vilka analyseras med hjälp av min ansats till denna praktik. Slutligen granskar och diskuterar jag dessa verk i detalj och avslutar med att föreslå att ramverket för kreativitetens asymptotiska konvergens kan fungera som ett användbart verktyg som bidrar till litteraturen om kreativ kodningspraxis, särskilt för situationer där sådant arbete utförs i en akademisk forskningsmiljö. 

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2023. , p. 71
Series
TRITA-EECS-AVL ; 2023:40
Keywords [en]
Sound and Music Computing, Music Composition
National Category
Media and Communication Technology Human Computer Interaction Music Arts
Research subject
Media Technology
Identifiers
URN: urn:nbn:se:kth:diva-327072ISBN: 978-91-8040-585-0 (print)OAI: oai:DiVA.org:kth-327072DiVA, id: diva2:1757774
Public defence
2023-06-09, https://kth-se.zoom.us/j/62182993824, Kollegiesalen, Brinellvägen 6, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20230522

Available from: 2023-05-22 Created: 2023-05-17 Last updated: 2023-06-13Bibliographically approved
List of papers
1. “WYPYM”: A Study for Feedback-Augmented Bass Clarinet
Open this publication in new window or tab >>“WYPYM”: A Study for Feedback-Augmented Bass Clarinet
2023 (English)Conference paper, Poster (with or without abstract) (Refereed)
Keywords
Augmented instruments, Feedback systems, Co-creativity, Music Human-Computer Interaction, Performance
National Category
Music Human Computer Interaction Arts
Identifiers
urn:nbn:se:kth:diva-327070 (URN)
Conference
NIME 2023 - New Interfaces for Musical Expression, 31 May — 3 June, 2023, Mexico City, Mexico
Note

QC 20230707

Available from: 2023-05-17 Created: 2023-05-17 Last updated: 2023-07-07Bibliographically approved
2. Study in three phases: An Adaptive Sound Installation
Open this publication in new window or tab >>Study in three phases: An Adaptive Sound Installation
2020 (English)In: Leonardo music journal, ISSN 0961-1215, E-ISSN 1531-4812, Vol. 30, p. 44-49Article in journal (Refereed) Published
Abstract [en]

Study in three phases is an adaptive site-specific sound installation that includes 22 solenoids placed on metallic arches that surround visitors and react to environmental perturbations, creating a self-regulating soundscape of metallic hits that serves to renew the visitors' acoustic perspective. Adaptivity is a crucial aspect of the work: Similar perturbations will not generally cause similar reactions from the installation based on past interactions, thus allowing evolution over time to play a key role artistically and technically. This article discusses the author's position on adaptivity in music interaction and composition and reports on the technical and artistic aspects of the installation.

Place, publisher, year, edition, pages
MIT Press - Journals, 2020
National Category
Music
Identifiers
urn:nbn:se:kth:diva-288744 (URN)10.1162/lmj_a_01092 (DOI)000596744600011 ()2-s2.0-85097281404 (Scopus ID)
Note

QC 20210113

Available from: 2021-01-13 Created: 2021-01-13 Last updated: 2023-05-17Bibliographically approved
3. SuperOM: a SuperCollider class to generate music scores in OpenMusic
Open this publication in new window or tab >>SuperOM: a SuperCollider class to generate music scores in OpenMusic
2023 (English)In: Proceedings of the 8th International Conference on Technologies for Music Notation and Representation (TENOR) / [ed] Anthony Paul De Ritis, Victor Zappi, Jeremy Van Buskirk and John Mallia, Boston, MA, USA: Northeastern University Library , 2023, p. 68-75Conference paper, Published paper (Refereed)
Abstract [en]

This paper introduces SuperOM, a class built for the software SuperCollider in order to create a bridge to OpenMu- sic and thus facilitate the creation of musical scores from SuperCollider patches. SuperOM is primarily intended to be used as a tool for SuperCollider users who make use of assisted composition techniques and want the output of such processes to be captured through automatic notation transcription. This paper first presents an overview of existing transcription tools for SuperCollider, followed by a detailed description of SuperOM and its implementation, as well as examples of how it can be used in practice. Finally, a case study in which the transcription tool was used as an assistive composition tool to generate the score of a sonification – which later was turned into a piano piece – is discussed. 

Place, publisher, year, edition, pages
Boston, MA, USA: Northeastern University Library, 2023
Keywords
SuperCollider, OpenMusic, class, computer assisted composition, automatic music notation
National Category
Music
Identifiers
urn:nbn:se:kth:diva-327068 (URN)10.17760/D20511476 (DOI)
Conference
TENOR - International Conference on Technologies for Music Notation and Representation, Boston, MA, USA, May 15-17, 2023
Note

QC 20230630

Available from: 2023-05-17 Created: 2023-05-17 Last updated: 2023-07-05Bibliographically approved
4. Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
Open this publication in new window or tab >>Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
2022 (English)In: Frontiers in Neuroscience, ISSN 1662-4548, E-ISSN 1662-453X, Vol. 16, article id 862663Article in journal (Refereed) Published
Abstract [en]

Software is intangible, invisible, and at the same time pervasive in everyday devices, activities, and services accompanying our life. Therefore, citizens hardly realize its complexity, power, and impact in many aspects of their daily life. In this study, we report on one experiment that aims at letting citizens make sense of software presence and activity in their everyday lives, through sound: the invisible complexity of the processes involved in the shutdown of a personal computer. We used sonification to map information embedded in software events into the sound domain. The software events involved in a shutdown have names related to the physical world and its actions: write events (information is saved into digital memories), kill events (running processes are terminated), and exit events (running programs are exited). The research study presented in this article has a "double character. " It is an artistic realization that develops specific aesthetic choices, and it has also pedagogical purposes informing the causal listener about the complexity of software behavior. Two different sound design strategies have been applied: one strategy is influenced by the sonic characteristics of the Glitch music scene, which makes deliberate use of glitch-based sound materials, distortions, aliasing, quantization noise, and all the "failures " of digital technologies; and a second strategy based on the sound samples of a subcontrabass Paetzold recorder, an unusual and special acoustic instrument which unique sound has been investigated in the contemporary art music scene. Analysis of quantitative ratings and qualitative comments of 37 participants revealed that the sound design strategies succeeded in communicating the nature of the computer processes. Participants also showed in general an appreciation of the aesthetics of the peculiar sound models used in this study.

Place, publisher, year, edition, pages
Frontiers Media SA, 2022
Keywords
sonification, software processes, aesthetic, glitch, Paetzold recorder
National Category
Media and Communication Technology
Identifiers
urn:nbn:se:kth:diva-313328 (URN)10.3389/fnins.2022.862663 (DOI)000797869400001 ()35600615 (PubMedID)2-s2.0-85134158938 (Scopus ID)
Projects
FutureSoundSONAO
Funder
Swedish Research Council, 2017-03979NordForsk, 86892
Note

QC 20230404

Available from: 2022-06-02 Created: 2022-06-02 Last updated: 2023-05-17Bibliographically approved
5. Customizing and Evaluating Accessible Multisensory Music Experiences with Pre-Verbal Children: A Case Study on the Perception of Musical Haptics Using Participatory Design with Proxies
Open this publication in new window or tab >>Customizing and Evaluating Accessible Multisensory Music Experiences with Pre-Verbal Children: A Case Study on the Perception of Musical Haptics Using Participatory Design with Proxies
2022 (English)In: Multimodal Technologies and Interaction, ISSN 2414-4088, Vol. 6, no 7, article id 55Article in journal (Refereed) Published
Abstract [en]

Research on Accessible Digital Musical Instruments (ADMIs) has highlighted the need for participatory design methods, i.e., to actively include users as co-designers and informants in the design process. However, very little work has explored how pre-verbal children with Profound and Multiple Disabilities (PMLD) can be involved in such processes. In this paper, we apply in-depth qualitative and mixed methodologies in a case study with four students with PMLD. Using Participatory Design with Proxies (PDwP), we assess how these students can be involved in the customization and evaluation of the design of a multisensory music experience intended for a large-scale ADMI. Results from an experiment focused on communication of musical haptics highlighted the diversity in employed interaction strategies used by the children, accessibility limitations of the current multisensory experience design, and the importance of using a multifaceted variety of qualitative and quantitative methods to arrive at more informed conclusions when applying a design with proxies methodology.

Place, publisher, year, edition, pages
MDPI AG, 2022
Keywords
accessible digital musical instruments, multimodal feedback, haptics, multisensory rooms, participatory design, disability studies
National Category
Music Interaction Technologies Media and Communication Technology
Research subject
Media Technology; Human-computer Interaction; Art, Technology and Design
Identifiers
urn:nbn:se:kth:diva-316293 (URN)10.3390/mti6070055 (DOI)000832049500001 ()2-s2.0-85136133459 (Scopus ID)
Projects
Ljudskogen
Funder
Swedish Research Council, 2020-00343
Note

QC 20220812

Available from: 2022-08-12 Created: 2022-08-12 Last updated: 2023-05-17Bibliographically approved

Open Access in DiVA

Claudio Panariello - PhD Thesis(44473 kB)287 downloads
File information
File name FULLTEXT01.pdfFile size 44473 kBChecksum SHA-512
b438b5620dc26de8705cd5dd524fda50b41f134d600ec754c8d28e804ef08866ddf35d07791d4d83c61bd177122cd4f4135ecb73228370d75ddf8ae08149a55f
Type fulltextMimetype application/pdf

Authority records

Panariello, Claudio

Search in DiVA

By author/editor
Panariello, Claudio
By organisation
Media Technology and Interaction Design, MID
Media and Communication TechnologyHuman Computer InteractionMusicArts

Search outside of DiVA

GoogleGoogle Scholar
Total: 287 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1043 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf