kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (1 of 1) Show all publications
Andersson, H. & Falkenberg, K. (2025). Unlocking music with CI: Active listening based on a learning mechanics-game mechanics model game prototype. In: INTED2025 Proceedings: . Paper presented at International Technology, Education and Development Conference, 3-5 March, 2025, Valencia, Spain. IATED Academy
Open this publication in new window or tab >>Unlocking music with CI: Active listening based on a learning mechanics-game mechanics model game prototype
2025 (English)In: INTED2025 Proceedings, IATED Academy , 2025Conference paper, Published paper (Refereed)
Abstract [en]

Sound plays a crucial role in daily life, with music being essential for emotional connection [1]. For cochlear implant (CI) users, hearing music is challenging as the brain must adapt to the implant’s signals, which differ from normal hearing [2]. Music training is vital for improving auditory skills but is particularly difficult for CI users, especially those who enjoyed music prior to their implant. Serious games offer a promising way to make this training more engaging and effective.

This study explores how a serious game can enhance music listening skills in CI users, focusing on pedagogical training to support active listening and analytical skills in cognitive audio processing. The game is designed to aid auditory training through top-down restoration [3], helping users better perceive music by focusing on spectral and timbral elements. The game was developed in a User-Centered Design approach together with a musician with mixed hearing loss, drawing on his particular challenges and background as a music producer. The game, set in a music store, involves repairing broken musical components in a 2D puzzle format, with three stages that focus on subtle auditory cues and pitch tuning through slider stages. Dynamic auditory feedback adjusts in real-time based on player actions.

The Learning Mechanics-Game Mechanics (LM-GM) model was employed to integrate educational content with gameplay [4]. This model helps align the educational objectives of the game with its interactive components, ensuring that the learning process is both engaging and effective. The game mechanics are designed to train problem-solving, cognitive audio processing, and auditory discrimination while providing meaningful feedback that supports skill development.The participant responded positively to the game, enjoying its balance of challenge and usability. The game’s light-hearted narrative encourages altruism, and there is potential for adding a progression system, customizable auditory profiles, and social features. Also, AI-driven adaptability could make the game more personalized, adjusting difficulty based on user performance in real-time. Future studies will incorporate additional in-game training activities to tackle challenges such as audio scene analysis, while also expanding the game's accessibility to areas beyond hearing.

Place, publisher, year, edition, pages
IATED Academy, 2025
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:kth:diva-363904 (URN)10.21125/inted.2025.1848 (DOI)
Conference
International Technology, Education and Development Conference, 3-5 March, 2025, Valencia, Spain
Note

Part of ISBN 978-84-09-70107-0

QC 20250528

Available from: 2025-05-26 Created: 2025-05-26 Last updated: 2025-05-28Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8923-9215

Search in DiVA

Show all publications