kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sonification of Twitter Hashtags Using Earcons Based on the Sound of Vowels
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-3086-0322
2021 (English)In: Proceedigns of the 2nd Nordic Sound and Music Computing Conference, Zenodo , 2021Conference paper, Published paper (Refereed)
Abstract [en]

The amount of notifications we receive from our digital devices is higher today than ever, often causing distress in users constantly having to move their devices into the center of attention, digesting the information received visually. In this study we have tested the use of short sound messages, earcons, in order to notify users about the arrival of different Twitter messages. The idea was to keep the arrival of new messages in the periphery of attention while simultaneously monitoring other activities. Using Twitter hashtags as the underlying data, a sonic abstraction was made by mapping the vowels present in a hashtag to a melody, and by enhancing the formant frequencies of these vowels. This gives rise to the question of whether enhancing vowel presence through formant synthesis aids the implicit learning of earcons, with Twitter hashtags as the underlying text data. A methodology is described, with a mapping of several phonetic vowels containing the fundamental frequency, f0, the first two formant frequencies, f1 and f2, for each vowel, as well as a rhythmic mapping based on the hashtags’ syllables as well as where the emphasis lies. An application was developed to receive tweets in real time using real data from Twitter, playing the earcons associated with hashtags of actual Twitter messages. Results of a user test show that participants were able to recognize the earcons related to each of the hashtags used in the experiment to a certain degree.

Place, publisher, year, edition, pages
Zenodo , 2021.
Keywords [en]
Sonification, Twitter, Hashtags, Earcons
National Category
Human Computer Interaction Computer and Information Sciences Other Engineering and Technologies Other Computer and Information Science
Research subject
Media Technology; Media Technology
Identifiers
URN: urn:nbn:se:kth:diva-310447DOI: 10.5281/zenodo.5723812OAI: oai:DiVA.org:kth-310447DiVA, id: diva2:1648647
Conference
Nordic Sound and Music Computing Conference
Projects
SONAOFutureSound
Funder
Swedish Research Council, 2017-03979NordForsk, 86892
Note

QC 20221114

Available from: 2022-03-31 Created: 2022-03-31 Last updated: 2025-02-18Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full texthttps://doi.org/10.5281/zenodo.5723812

Authority records

Myresten, EmilLarson Holmgren, DavidBresin, Roberto

Search in DiVA

By author/editor
Myresten, EmilLarson Holmgren, DavidBresin, Roberto
By organisation
Media Technology and Interaction Design, MID
Human Computer InteractionComputer and Information SciencesOther Engineering and TechnologiesOther Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 161 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf