Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Integrating Audio and Haptic Feedback in a Collaborative Virtual Environment
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.ORCID iD: 0000-0002-4772-4730
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.ORCID iD: 0000-0003-3743-100X
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI.
2007 (English)In: proceeding of HCI International Conference, 2007Conference paper, Published paper (Other academic)
Abstract [en]

An ongoing study is presented here. The purpose is to design and evaluate an experiment comparing an audio/haptic/visual and ahaptic/visual VR environment supporting collaborative work among sighted and blindfolded people. We want to investigate how hapticand audio functions could improve collaboration in a shared workspace. We used a 3D VR environment that supports learning of spatial geometry. The scene is a room containing objects which you can pick up and move around by means of a touch feedback pointing device called Phantom. An experiment was performed with group work in the VR environment comparing an audio/haptic/visual interface with a haptic/visual interface of the application in alaboratory. We investigate if adding audio cues improves awareness, common ground, social presence, perceivedperformance and work efficiency. The aim is also to conduct aquantitative and qualitative analysis of the video-recordedcollaboration in order to obtain information about whether and howthe added audio information changes the work process in the groups.

Place, publisher, year, edition, pages
2007.
Keyword [en]
HCI, Haptic, Audio, Multimodal interface, Awareness, Common ground
National Category
Computer Engineering
Identifiers
URN: urn:nbn:se:kth:diva-13879OAI: oai:DiVA.org:kth-13879DiVA: diva2:328002
Note
QC20100701Available from: 2010-07-01 Created: 2010-07-01 Last updated: 2010-07-01Bibliographically approved
In thesis
1. Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
Open this publication in new window or tab >>Design and Evaluation of 3D Multimodal Virtual Environments for Visually Impaired People
2010 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Spatial information presented visually is not easily accessible to visually impairedusers. Current technologies, such as screen readers, cannot intuitively conveyspatial layout or structure. This lack of overview is an obstacle for a visuallyimpaired user, both when using the computer individually and when collaboratingwith other users. With the development of haptic and audio technologies, it ispossible to let visually impaired users access to three-dimensional (3D) VirtualReality (VR) environments through the senses of touch and hearing.The work presented in this thesis comprises investigations of haptic and audiointeraction for visually impaired computer users in two stages.The first stage of my research focused on collaborations between sighted andblind-folded computer users in a shared virtual environment. One aspect Iconsidered is how different modalities affect one’s awareness of the other’sactions, as well as of one’s own actions, during the work process. The secondaspect I investigated is common ground, i.e. how visually impaired people obtaina common understanding of the elements of their workspace through differentmodalities. A third aspect I looked at was how different modalities affectperceived social presence, i.e. their ability to perceive the other person’sintentions and emotions. Finally, I attempted to understand how human behaviorand efficiency in task performance are affected when different modalities are usedin collaborative situations.The second stage of my research focused on how the visually impaired access3D multimodal virtual environment individually. I conducted two studies basedon two different haptic and audio prototypes concerning understanding the effectof haptic-audio modalities on navigation and interface design. One prototype thatI created was a haptic and audio game, a labyrinth. The other is a virtualsimulation environment based on the real world of Kulturhuset in Stockholm. Oneaspect I investigated in this individual interaction is how it is possible for users toaccess the spatial layout through a multimodal virtual environment. The secondaspect I investigated is usability; how the haptic and audio cues help visuallyimpaired people understand the spatial layout. The third aspect concernsnavigation and cognitive mapping in a multimodal virtual environment.This thesis contributes to the field of human-computer interaction for thevisually impaired with a set of studies of multimodal interactive systems, andbrings new perspectives to the enhancement of understanding real environmentsfor visually impaired users through a haptic and audio virtual computerenvironment.

Place, publisher, year, edition, pages
Stockholm: KTH, 2010. 82 p.
Series
Trita-CSC-A, ISSN 1653-5723 ; 2010:09
Keyword
Multimodal interaction, 3D worlds, Haptics, Audio, Visually impaired users, Collaboration, Navigation
National Category
Computer Science
Identifiers
urn:nbn:se:kth:diva-13140 (URN)978-91-7415-683-6 (ISBN)
Public defence
2010-06-10, F3, Lindstedtsvägen 26, KTH, Stockholm, 10:15 (English)
Opponent
Supervisors
Note
QC20100701Available from: 2010-05-31 Created: 2010-05-29 Last updated: 2010-07-01Bibliographically approved

Open Access in DiVA

No full text

Authority records BETA

Moll, JonasSallnäs, Eva-Lotta

Search in DiVA

By author/editor
Huang, Ying YingMoll, JonasSallnäs, Eva-LottaSundblad, Yngve
By organisation
Human - Computer Interaction, MDI
Computer Engineering

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 152 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf