kth.sePublications
Change search
Link to record
Permanent link

Direct link
Larson Holmgren, David
Publications (2 of 2) Show all publications
Larson Holmgren, D., Särnell, A. & Bresin, R. (2022). Facilitating reflection on climate change using interactive sonification. In: Proceedings of ISon 2022, 7th Interactive Sonification Workshop, BSCC, University of Bremen, Germany, September 22–23, 2022: . Paper presented at ISon 2022, 7th Interactive Sonification Workshop, BSCC, University of Bremen, Germany, September 22–23, 2022.
Open this publication in new window or tab >>Facilitating reflection on climate change using interactive sonification
2022 (English)In: Proceedings of ISon 2022, 7th Interactive Sonification Workshop, BSCC, University of Bremen, Germany, September 22–23, 2022, 2022Conference paper, Published paper (Refereed)
Abstract [en]

This study explores the possibility of using musical soundscapes to facilitate reflection on the impacts of climate change. By sonifying historic and future climate data, an interactive timeline was created where the user can explore a soundscape changing in time. A prototype was developed and tested in a user study with 15 participants. Results indicate that the prototype successfully elicits the emotions that it was designed to communicate and that it does influence the participants’ reflections. However, it remains uncertain how much the prototype actually helped them while reflecting.

Keywords
sonification, climate change, climate action, sound, soundscape
National Category
Other Computer and Information Science Media and Communication Technology Human Computer Interaction
Research subject
Media Technology
Identifiers
urn:nbn:se:kth:diva-321421 (URN)
Conference
ISon 2022, 7th Interactive Sonification Workshop, BSCC, University of Bremen, Germany, September 22–23, 2022
Projects
FutureSound
Note

QC 20221115

Available from: 2022-11-14 Created: 2022-11-14 Last updated: 2022-11-15Bibliographically approved
Myresten, E., Larson Holmgren, D. & Bresin, R. (2021). Sonification of Twitter Hashtags Using Earcons Based on the Sound of Vowels. In: Proceedigns of the 2nd Nordic Sound and Music Computing Conference: . Paper presented at Nordic Sound and Music Computing Conference. Zenodo
Open this publication in new window or tab >>Sonification of Twitter Hashtags Using Earcons Based on the Sound of Vowels
2021 (English)In: Proceedigns of the 2nd Nordic Sound and Music Computing Conference, Zenodo , 2021Conference paper, Published paper (Refereed)
Abstract [en]

The amount of notifications we receive from our digital devices is higher today than ever, often causing distress in users constantly having to move their devices into the center of attention, digesting the information received visually. In this study we have tested the use of short sound messages, earcons, in order to notify users about the arrival of different Twitter messages. The idea was to keep the arrival of new messages in the periphery of attention while simultaneously monitoring other activities. Using Twitter hashtags as the underlying data, a sonic abstraction was made by mapping the vowels present in a hashtag to a melody, and by enhancing the formant frequencies of these vowels. This gives rise to the question of whether enhancing vowel presence through formant synthesis aids the implicit learning of earcons, with Twitter hashtags as the underlying text data. A methodology is described, with a mapping of several phonetic vowels containing the fundamental frequency, f0, the first two formant frequencies, f1 and f2, for each vowel, as well as a rhythmic mapping based on the hashtags’ syllables as well as where the emphasis lies. An application was developed to receive tweets in real time using real data from Twitter, playing the earcons associated with hashtags of actual Twitter messages. Results of a user test show that participants were able to recognize the earcons related to each of the hashtags used in the experiment to a certain degree.

Place, publisher, year, edition, pages
Zenodo, 2021
Keywords
Sonification, Twitter, Hashtags, Earcons
National Category
Human Computer Interaction Media and Communication Technology Interaction Technologies Other Computer and Information Science
Research subject
Media Technology; Media Technology
Identifiers
urn:nbn:se:kth:diva-310447 (URN)10.5281/zenodo.5723812 (DOI)
Conference
Nordic Sound and Music Computing Conference
Projects
SONAOFutureSound
Funder
Swedish Research Council, 2017-03979NordForsk, 86892
Note

QC 20221114

Available from: 2022-03-31 Created: 2022-03-31 Last updated: 2022-11-14Bibliographically approved
Organisations

Search in DiVA

Show all publications