Change search
ReferencesLink to record
Permanent link

Direct link
Face-off: A face reconstruction technique for virtual reality (VR) scenarios
Show others and affiliations
2016 (English)In: 14th European Conference on Computer Vision, ECCV 2016, Springer, 2016, 490-503 p.Conference paper (Refereed)
Abstract [en]

Virtual Reality (VR) headsets occlude a significant portion of human face. The real human face is required in many VR applications, for example, video teleconferencing. This paper proposes a wearable camera setup-based solution to reconstruct the real face of a person wearing VR headset. Our solution lies in the core of asymmetrical principal component analysis (aPCA). A user-specific training model is built using aPCA with full face, lips and eye region information. During testing phase, lower face region and partial eye information is used to reconstruct the wearer face. Online testing session consists of two phases, (i) calibration phase and (ii) reconstruction phase. In former, a small calibration step is performed to align test information with training data, while the later uses half face information to reconstruct the full face using aPCAbased trained-data. The proposed approach is validated with qualitative and quantitative analysis.

Place, publisher, year, edition, pages
Springer, 2016. 490-503 p.
Keyword [en]
Face reconstruction, Oculus, PCA, Virtual reality, VR headset, Wearable setup, Calibration, Computer vision, Wearable technology, Qualitative and quantitative analysis, Test information, Video teleconferencing, Wearable cameras, Principal component analysis
National Category
Computer Science
URN: urn:nbn:se:kth:diva-195544DOI: 10.1007/978-3-319-46604-0_35ScopusID: 2-s2.0-84989829345ISBN: 9783319466033OAI: diva2:1048621
8 October 2016 through 16 October 2016

QC 20161121

Available from: 2016-11-21 Created: 2016-11-03 Last updated: 2016-11-21Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Li, Haibo
By organisation
Media Technology and Interaction Design, MID
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 6 hits
ReferencesLink to record
Permanent link

Direct link