Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Exploration in 3D Virtual Worlds with Haptic-Audio Support for Nonvisual Spatial Recognition
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.
2010 (English)In: Human Computer Interaction Symposium, World Computer Congress, 2010Conference paper, Published paper (Refereed)
Abstract [en]

Mobility indoors or outdoors is a problem for visually impaired people because of lacking the visual channel. Appropriate learning tools about spatial information could be used as a preparation for navigation before going to the real place. Current accessibility technologies, such as screen readers, do not well convey spatial layout or structure. In this paper, an study on accessing non-visual spatial information and on support for efficient navigation and orientation with haptic and audio cues is presented. A 3D virtual simulation prototype of a real world environment was created for this purpose. Different navigation tools were designed in the prototype with haptic and audio cues. The main results of the study reported are: (a) the development of a virtual 3D environment helping visually impaired users to learn about real space where they are required to navigate (e.g. in schools, work places, public buildings), (b) whether the spatial information for establishing the mental mapping of the space could be acquired by using compensatory sensorial channels (e.g., touch and hearing), as an alternative to the visual channel; (c) how haptic and audio cues can enable the efficient navigation, mobility and orientation in such 3D virtual environments. Results from qualitative analysis regarding learning process and actual performance in the 3D virtual world are presented.

Place, publisher, year, edition, pages
2010.
Keyword [en]
Haptic; Audio; Virtual Reality; Navigation; Cognitive Mapping
National Category
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-13905OAI: oai:DiVA.org:kth-13905DiVA: diva2:328070
Note
QC20100701Available from: 2010-07-01 Created: 2010-07-01 Last updated: 2010-07-01Bibliographically approved
In thesis
1. Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
Open this publication in new window or tab >>Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
2010 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Spatial information presented visually is not easily accessible to visually impairedusers. Current technologies, such as screen readers, cannot intuitively conveyspatial layout or structure. This lack of overview is an obstacle for a visuallyimpaired user, both when using the computer individually and when collaboratingwith other users. With the development of haptic and audio technologies, it ispossible to let visually impaired users access to three-dimensional (3D) VirtualReality (VR) environments through the senses of touch and hearing.The work presented in this thesis comprises investigations of haptic and audiointeraction for visually impaired computer users in two stages.The first stage of my research focused on collaborations between sighted andblind-folded computer users in a shared virtual environment. One aspect Iconsidered is how different modalities affect one’s awareness of the other’sactions, as well as of one’s own actions, during the work process. The secondaspect I investigated is common ground, i.e. how visually impaired people obtaina common understanding of the elements of their workspace through differentmodalities. A third aspect I looked at was how different modalities affectperceived social presence, i.e. their ability to perceive the other person’sintentions and emotions. Finally, I attempted to understand how human behaviorand efficiency in task performance are affected when different modalities are usedin collaborative situations.The second stage of my research focused on how the visually impaired access3D multimodal virtual environment individually. I conducted two studies basedon two different haptic and audio prototypes concerning understanding the effectof haptic-audio modalities on navigation and interface design. One prototype thatI created was a haptic and audio game, a labyrinth. The other is a virtualsimulation environment based on the real world of Kulturhuset in Stockholm. Oneaspect I investigated in this individual interaction is how it is possible for users toaccess the spatial layout through a multimodal virtual environment. The secondaspect I investigated is usability; how the haptic and audio cues help visuallyimpaired people understand the spatial layout. The third aspect concernsnavigation and cognitive mapping in a multimodal virtual environment.This thesis contributes to the field of human-computer interaction for thevisually impaired with a set of studies of multimodal interactive systems, andbrings new perspectives to the enhancement of understanding real environmentsfor visually impaired users through a haptic and audio virtual computerenvironment.

Place, publisher, year, edition, pages
Stockholm: KTH, 2010. 82 p.
Series
Trita-CSC-A, ISSN 1653-5723 ; 2010:09
Keyword
Multimodal interaction, 3D worlds, Haptics, Audio, Visually impaired users, Collaboration, Navigation
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-13140 (URN)978-91-7415-683-6 (ISBN)
Public defence
2010-06-10, F3, Lindstedtsvägen 26, KTH, Stockholm, 10:15 (English)
Opponent
Supervisors
Note
QC20100701Available from: 2010-05-31 Created: 2010-05-29 Last updated: 2010-07-01Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Huang, Ying Ying
By organisation
Human - Computer Interaction, MDI
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 97 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf