Change search
ReferencesLink to record
Permanent link

Direct link
Audio makes a difference in haptic collaborative virtual environments
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.ORCID iD: 0000-0002-4772-4730
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.ORCID iD: 0000-0003-3743-100X
2010 (English)In: Interacting with computers, ISSN 0953-5438, Vol. 22, no 6, 544-555 p.Article in journal (Refereed) Published
Abstract [en]

In this paper a study is presented which aimed at exploring the effects of audio feedback in a haptic and visual interface supporting collaboration among sighted and people who cannot see. A between group design was used and the participants worked in pairs with one sighted and one blindfolded in each. The application used was a haptic 3D environment in which participants could build composed objects out of building blocks. The building blocks could be picked up and moved around by means of a touch feedback pointing device. In one version of the application sound cues could be used to tell the other person whereyou were, and to get feedback on your own and the other person’s actions. Results showed that sound cues together with haptic feedback made a difference in the interaction between the collaborators regarding their shared understanding of the workspace and the work process. Especially, sound cues played an important role for maintaining awareness of ongoing work – you knew what was going on, and you got a response on your own actions.

Place, publisher, year, edition, pages
2010. Vol. 22, no 6, 544-555 p.
Keyword [en]
Haptic, Audio, Multimodal Interfaces, Collaboration, Problem solving
National Category
Computer Science
URN: urn:nbn:se:kth:diva-13889DOI: 10.1016/j.intcom.2010.06.001ISI: 000285176600010ScopusID: 2-s2.0-78149469381OAI: diva2:328061
Swedish Research Council
QC20100701Available from: 2010-07-01 Created: 2010-07-01 Last updated: 2011-01-17Bibliographically approved
In thesis
1. Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
Open this publication in new window or tab >>Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
2010 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Spatial information presented visually is not easily accessible to visually impairedusers. Current technologies, such as screen readers, cannot intuitively conveyspatial layout or structure. This lack of overview is an obstacle for a visuallyimpaired user, both when using the computer individually and when collaboratingwith other users. With the development of haptic and audio technologies, it ispossible to let visually impaired users access to three-dimensional (3D) VirtualReality (VR) environments through the senses of touch and hearing.The work presented in this thesis comprises investigations of haptic and audiointeraction for visually impaired computer users in two stages.The first stage of my research focused on collaborations between sighted andblind-folded computer users in a shared virtual environment. One aspect Iconsidered is how different modalities affect one’s awareness of the other’sactions, as well as of one’s own actions, during the work process. The secondaspect I investigated is common ground, i.e. how visually impaired people obtaina common understanding of the elements of their workspace through differentmodalities. A third aspect I looked at was how different modalities affectperceived social presence, i.e. their ability to perceive the other person’sintentions and emotions. Finally, I attempted to understand how human behaviorand efficiency in task performance are affected when different modalities are usedin collaborative situations.The second stage of my research focused on how the visually impaired access3D multimodal virtual environment individually. I conducted two studies basedon two different haptic and audio prototypes concerning understanding the effectof haptic-audio modalities on navigation and interface design. One prototype thatI created was a haptic and audio game, a labyrinth. The other is a virtualsimulation environment based on the real world of Kulturhuset in Stockholm. Oneaspect I investigated in this individual interaction is how it is possible for users toaccess the spatial layout through a multimodal virtual environment. The secondaspect I investigated is usability; how the haptic and audio cues help visuallyimpaired people understand the spatial layout. The third aspect concernsnavigation and cognitive mapping in a multimodal virtual environment.This thesis contributes to the field of human-computer interaction for thevisually impaired with a set of studies of multimodal interactive systems, andbrings new perspectives to the enhancement of understanding real environmentsfor visually impaired users through a haptic and audio virtual computerenvironment.

Place, publisher, year, edition, pages
Stockholm: KTH, 2010. 82 p.
Trita-CSC-A, ISSN 1653-5723 ; 2010:09
Multimodal interaction, 3D worlds, Haptics, Audio, Visually impaired users, Collaboration, Navigation
National Category
Computer Science
urn:nbn:se:kth:diva-13140 (URN)978-91-7415-683-6 (ISBN)
Public defence
2010-06-10, F3, Lindstedtsvägen 26, KTH, Stockholm, 10:15 (English)
QC20100701Available from: 2010-05-31 Created: 2010-05-29 Last updated: 2010-07-01Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Moll, JonasHuang, Ying YingSallnäs, Eva-Lotta
By organisation
Human - Computer Interaction, MDI
In the same journal
Interacting with computers
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 78 hits
ReferencesLink to record
Permanent link

Direct link