kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Unlocking music with CI: Active listening based on a learning mechanics-game mechanics model game prototype
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0002-8923-9215
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0003-4259-484X
2025 (English)In: INTED2025 Proceedings, IATED Academy , 2025Conference paper, Published paper (Refereed)
Abstract [en]

Sound plays a crucial role in daily life, with music being essential for emotional connection [1]. For cochlear implant (CI) users, hearing music is challenging as the brain must adapt to the implant’s signals, which differ from normal hearing [2]. Music training is vital for improving auditory skills but is particularly difficult for CI users, especially those who enjoyed music prior to their implant. Serious games offer a promising way to make this training more engaging and effective.

This study explores how a serious game can enhance music listening skills in CI users, focusing on pedagogical training to support active listening and analytical skills in cognitive audio processing. The game is designed to aid auditory training through top-down restoration [3], helping users better perceive music by focusing on spectral and timbral elements. The game was developed in a User-Centered Design approach together with a musician with mixed hearing loss, drawing on his particular challenges and background as a music producer. The game, set in a music store, involves repairing broken musical components in a 2D puzzle format, with three stages that focus on subtle auditory cues and pitch tuning through slider stages. Dynamic auditory feedback adjusts in real-time based on player actions.

The Learning Mechanics-Game Mechanics (LM-GM) model was employed to integrate educational content with gameplay [4]. This model helps align the educational objectives of the game with its interactive components, ensuring that the learning process is both engaging and effective. The game mechanics are designed to train problem-solving, cognitive audio processing, and auditory discrimination while providing meaningful feedback that supports skill development.The participant responded positively to the game, enjoying its balance of challenge and usability. The game’s light-hearted narrative encourages altruism, and there is potential for adding a progression system, customizable auditory profiles, and social features. Also, AI-driven adaptability could make the game more personalized, adjusting difficulty based on user performance in real-time. Future studies will incorporate additional in-game training activities to tackle challenges such as audio scene analysis, while also expanding the game's accessibility to areas beyond hearing.

Place, publisher, year, edition, pages
IATED Academy , 2025.
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:kth:diva-363904DOI: 10.21125/inted.2025.1848OAI: oai:DiVA.org:kth-363904DiVA, id: diva2:1960934
Conference
International Technology, Education and Development Conference, 3-5 March, 2025, Valencia, Spain
Note

Part of ISBN 978-84-09-70107-0

QC 20250528

Available from: 2025-05-26 Created: 2025-05-26 Last updated: 2025-05-28Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Andersson, Henric

Search in DiVA

By author/editor
Andersson, HenricFalkenberg, Kjetil
By organisation
Media Technology and Interaction Design, MID
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 31 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf