Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Auditory Feedback in Haptic Collaborative Interfaces
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.ORCID iD: 0000-0002-4772-4730
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI (closed 20111231).ORCID iD: 0000-0003-3743-100X
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.
2012 (English)In: International journal of human-computer studies, ISSN 1071-5819, E-ISSN 1095-9300, Vol. 70, no 4, 257-270 p.Article in journal (Refereed) Published
Abstract [en]

The combined effect of haptic and auditory feedback in shared interfaces, on the cooperation between visually impaired and sighted persons is under-investigated. A central challenge for cooperating group members lies in obtaining a common understanding of the elements of the workspace and maintaining awareness of the other members’, as well as one’s own, actions during the work process. The aim of the experimental study presented here, was to investigate if adding audio cues in a haptic and visual interface makes collaboration between a sighted and a blindfolded person more efficient. Results showed that task performance was significantly faster in the audio, haptic and visual feedback condition compared to the haptic and visual feedback condition. One special focus was also to study how participants utilize the auditory and haptic force feedback in order to obtain a common understanding of the workspace and to maintain an awareness of the group members’ actions. Results from a qualitative analysis showed that the auditory and haptic feedback was used in a number of important ways for the group members’ action awareness and in the participants’ grounding process.

Place, publisher, year, edition, pages
2012. Vol. 70, no 4, 257-270 p.
Keyword [en]
Awareness, Collaboration, Common ground, Force feedback, Haptic, Multimodal interface, Virtual environments
National Category
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-13887DOI: 10.1016/j.ijhcs.2011.11.006ISI: 000301313100001Scopus ID: 2-s2.0-84855266298OAI: oai:DiVA.org:kth-13887DiVA: diva2:328007
Funder
Swedish e‐Science Research CenterStandUp
Note

QC 20100701

Available from: 2010-07-01 Created: 2010-07-01 Last updated: 2017-12-12Bibliographically approved
In thesis
1. Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
Open this publication in new window or tab >>Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
2010 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Spatial information presented visually is not easily accessible to visually impairedusers. Current technologies, such as screen readers, cannot intuitively conveyspatial layout or structure. This lack of overview is an obstacle for a visuallyimpaired user, both when using the computer individually and when collaboratingwith other users. With the development of haptic and audio technologies, it ispossible to let visually impaired users access to three-dimensional (3D) VirtualReality (VR) environments through the senses of touch and hearing.The work presented in this thesis comprises investigations of haptic and audiointeraction for visually impaired computer users in two stages.The first stage of my research focused on collaborations between sighted andblind-folded computer users in a shared virtual environment. One aspect Iconsidered is how different modalities affect one’s awareness of the other’sactions, as well as of one’s own actions, during the work process. The secondaspect I investigated is common ground, i.e. how visually impaired people obtaina common understanding of the elements of their workspace through differentmodalities. A third aspect I looked at was how different modalities affectperceived social presence, i.e. their ability to perceive the other person’sintentions and emotions. Finally, I attempted to understand how human behaviorand efficiency in task performance are affected when different modalities are usedin collaborative situations.The second stage of my research focused on how the visually impaired access3D multimodal virtual environment individually. I conducted two studies basedon two different haptic and audio prototypes concerning understanding the effectof haptic-audio modalities on navigation and interface design. One prototype thatI created was a haptic and audio game, a labyrinth. The other is a virtualsimulation environment based on the real world of Kulturhuset in Stockholm. Oneaspect I investigated in this individual interaction is how it is possible for users toaccess the spatial layout through a multimodal virtual environment. The secondaspect I investigated is usability; how the haptic and audio cues help visuallyimpaired people understand the spatial layout. The third aspect concernsnavigation and cognitive mapping in a multimodal virtual environment.This thesis contributes to the field of human-computer interaction for thevisually impaired with a set of studies of multimodal interactive systems, andbrings new perspectives to the enhancement of understanding real environmentsfor visually impaired users through a haptic and audio virtual computerenvironment.

Place, publisher, year, edition, pages
Stockholm: KTH, 2010. 82 p.
Series
Trita-CSC-A, ISSN 1653-5723 ; 2010:09
Keyword
Multimodal interaction, 3D worlds, Haptics, Audio, Visually impaired users, Collaboration, Navigation
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-13140 (URN)978-91-7415-683-6 (ISBN)
Public defence
2010-06-10, F3, Lindstedtsvägen 26, KTH, Stockholm, 10:15 (English)
Opponent
Supervisors
Note
QC20100701Available from: 2010-05-31 Created: 2010-05-29 Last updated: 2010-07-01Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Authority records BETA

Moll, JonasSallnäs Pysander, Eva-Lotta

Search in DiVA

By author/editor
Huang, Ying YingMoll, JonasSallnäs Pysander, Eva-LottaSundblad, Yngve
By organisation
Media Technology and Interaction Design, MIDHuman - Computer Interaction, MDI (closed 20111231)
In the same journal
International journal of human-computer studies
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 292 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf