kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sonification of Computer Processes: The Cases of Computer Shutdown and Idle Mode
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0002-1244-881x
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0002-3086-0322
2022 (English)In: Frontiers in Neuroscience, ISSN 1662-4548, E-ISSN 1662-453X, Vol. 16, article id 862663Article in journal (Refereed) Published
Abstract [en]

Software is intangible, invisible, and at the same time pervasive in everyday devices, activities, and services accompanying our life. Therefore, citizens hardly realize its complexity, power, and impact in many aspects of their daily life. In this study, we report on one experiment that aims at letting citizens make sense of software presence and activity in their everyday lives, through sound: the invisible complexity of the processes involved in the shutdown of a personal computer. We used sonification to map information embedded in software events into the sound domain. The software events involved in a shutdown have names related to the physical world and its actions: write events (information is saved into digital memories), kill events (running processes are terminated), and exit events (running programs are exited). The research study presented in this article has a "double character. " It is an artistic realization that develops specific aesthetic choices, and it has also pedagogical purposes informing the causal listener about the complexity of software behavior. Two different sound design strategies have been applied: one strategy is influenced by the sonic characteristics of the Glitch music scene, which makes deliberate use of glitch-based sound materials, distortions, aliasing, quantization noise, and all the "failures " of digital technologies; and a second strategy based on the sound samples of a subcontrabass Paetzold recorder, an unusual and special acoustic instrument which unique sound has been investigated in the contemporary art music scene. Analysis of quantitative ratings and qualitative comments of 37 participants revealed that the sound design strategies succeeded in communicating the nature of the computer processes. Participants also showed in general an appreciation of the aesthetics of the peculiar sound models used in this study.

Place, publisher, year, edition, pages
Frontiers Media SA , 2022. Vol. 16, article id 862663
Keywords [en]
sonification, software processes, aesthetic, glitch, Paetzold recorder
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:kth:diva-313328DOI: 10.3389/fnins.2022.862663ISI: 000797869400001PubMedID: 35600615Scopus ID: 2-s2.0-85134158938OAI: oai:DiVA.org:kth-313328DiVA, id: diva2:1663485
Projects
FutureSoundSONAO
Funder
Swedish Research Council, 2017-03979NordForsk, 86892
Note

QC 20230404

Available from: 2022-06-02 Created: 2022-06-02 Last updated: 2025-02-18Bibliographically approved
In thesis
1. Converging Creativity: Intertwining Music and Code
Open this publication in new window or tab >>Converging Creativity: Intertwining Music and Code
2023 (English)Doctoral thesis, comprehensive summary (Other academic) [Artistic work]
Abstract [en]

This compilation thesis is a collection of case studies that presents examples of creative coding in various contexts, focusing on how such practice led to the creation and exploration of musical expressions, and how I in- interact with the design of the code itself. My own experience as a music composer influences this thesis work. By saying so, I mean that although the thesis places itself in the Sound and Music Computing academic tradition, it is also profoundly founded upon a personal artistic perspective. This perspective has been the overarching view that has informed the studies included in the thesis, despite all being quite different. The first part of the thesis describes the practice of creative coding, creativity models, and the interaction between code and coder. Then I propose a perspective on creative coding based on the idea of asymptotic convergence of creativity. This is followed by a presentation of five papers and three music works, all inspected through my stance on this creative practice. Finally, I examine and discuss these works in detail, concluding by suggesting that the asymptotic convergence of creativity framework might serve as a useful tool that adds to the literature on creative coding practice, especially for situations in which such work is carried out in an academic research setting. 

Abstract [sv]

I denna sammanläggningsavhandling presenteras ett antal fallstudier med fokus på kreativ programmering (engelska: creative coding) i en rad olika sammanhang. Fokus ligger på hur kreativ programmering stimulerat musikskapande och utforskning av olika musikaliska uttryck, samt hur jag själv interagerat med kod i sådana kontexter. Detta avhandlingsarbete är till stor del influerat av min personliga erfarenheter och bakgrund som kompositör. Även om avhandlingen befinner sig i en akademisk kontext, närmare bestämt inom den vetenskapliga traditionen för ljud- och musikbehandling, så är avhandlingsarbetet också djupt rotat i ett konstnärligt perspektiv. Detta perspektiv har influerat och präglat de studier som beskrivs i denna avhandling, trots att studierna sinsemellan är av ganska skiljd karaktär. Den första delen av denna avhandling beskriver kreativ programmering och dess praktik, olika kreativitetsmodeller samt samspelet mellan utvecklare och kod. Sedan föreslår jag ett perspektiv på kreativ kodning som bygger på idén om kreativitetens asymptotiska konvergens. Detta efterföljs av en genomgång av fem artiklar och tre musikverk, vilka analyseras med hjälp av min ansats till denna praktik. Slutligen granskar och diskuterar jag dessa verk i detalj och avslutar med att föreslå att ramverket för kreativitetens asymptotiska konvergens kan fungera som ett användbart verktyg som bidrar till litteraturen om kreativ kodningspraxis, särskilt för situationer där sådant arbete utförs i en akademisk forskningsmiljö. 

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2023. p. 71
Series
TRITA-EECS-AVL ; 2023:40
Keywords
Sound and Music Computing, Music Composition
National Category
Computer and Information Sciences Human Computer Interaction Music Arts
Research subject
Media Technology
Identifiers
urn:nbn:se:kth:diva-327072 (URN)978-91-8040-585-0 (ISBN)
Public defence
2023-06-09, https://kth-se.zoom.us/j/62182993824, Kollegiesalen, Brinellvägen 6, Stockholm, 09:00 (English)
Opponent
Supervisors
Note

QC 20230522

Available from: 2023-05-22 Created: 2023-05-17 Last updated: 2025-02-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopus

Authority records

Panariello, ClaudioBresin, Roberto

Search in DiVA

By author/editor
Panariello, ClaudioBresin, Roberto
By organisation
Media Technology and Interaction Design, MID
In the same journal
Frontiers in Neuroscience
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 396 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf