kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures: Augmenting Consequential Sounds to Improve Non-verbal Robot Communication
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-4422-5223
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-3086-0322
2022 (English)In: International Journal of Social Robotics, ISSN 1875-4791, E-ISSN 1875-4805, Vol. 14, no 2, p. 357-372Article in journal (Refereed) Published
Abstract [en]

This paper presents two experiments focusing on perception of mechanical sounds produced by expressive robot movement and blended sonifications thereof. In the first experiment, 31 participants evaluated emotions conveyed by robot sounds through free-form text descriptions. The sounds were inherently produced by the movements of a NAO robot and were not specifically designed for communicative purposes. Results suggested no strong coupling between the emotional expression of gestures and how sounds inherent to these movements were perceived by listeners; joyful gestures did not necessarily result in joyful sounds. A word that reoccurred in text descriptions of all sounds, regardless of the nature of the expressive gesture, was “stress”. In the second experiment, blended sonification was used to enhance and further clarify the emotional expression of the robot sounds evaluated in the first experiment. Analysis of quantitative ratings of 30 participants revealed that the blended sonification successfully contributed to enhancement of the emotional message for sound models designed to convey frustration and joy. Our findings suggest that blended sonification guided by perceptual research on emotion in speech and music can successfully improve communication of emotions through robot sounds in auditory-only conditions.

Place, publisher, year, edition, pages
Springer Nature , 2022. Vol. 14, no 2, p. 357-372
Keywords [en]
Blended Sonification, Robot Sounds, Emotions, Expressive Gestures, Robot, Perception, smc, sonification, Non-verbal sounds, Affective computing, Emotions in robotics, Sonic interaction design
National Category
Human Computer Interaction Computer graphics and computer vision Robotics and automation
Research subject
Media Technology; Human-computer Interaction; Art, Technology and Design
Identifiers
URN: urn:nbn:se:kth:diva-295568DOI: 10.1007/s12369-021-00788-4ISI: 000652904000001Scopus ID: 2-s2.0-85106399168OAI: oai:DiVA.org:kth-295568DiVA, id: diva2:1556531
Projects
SONAO
Funder
Swedish Research Council, 2017-03979NordForsk, 86892
Note

QC 20250326

Available from: 2021-05-22 Created: 2021-05-22 Last updated: 2025-03-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Frid, EmmaBresin, Roberto

Search in DiVA

By author/editor
Frid, EmmaBresin, Roberto
By organisation
Media Technology and Interaction Design, MID
In the same journal
International Journal of Social Robotics
Human Computer InteractionComputer graphics and computer visionRobotics and automation

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 370 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf