Face-off: A face reconstruction technique for virtual reality (VR) scenarios
2016 (English)In: 14th European Conference on Computer Vision, ECCV 2016, Springer, 2016, 490-503 p.Conference paper (Refereed)
Virtual Reality (VR) headsets occlude a significant portion of human face. The real human face is required in many VR applications, for example, video teleconferencing. This paper proposes a wearable camera setup-based solution to reconstruct the real face of a person wearing VR headset. Our solution lies in the core of asymmetrical principal component analysis (aPCA). A user-specific training model is built using aPCA with full face, lips and eye region information. During testing phase, lower face region and partial eye information is used to reconstruct the wearer face. Online testing session consists of two phases, (i) calibration phase and (ii) reconstruction phase. In former, a small calibration step is performed to align test information with training data, while the later uses half face information to reconstruct the full face using aPCAbased trained-data. The proposed approach is validated with qualitative and quantitative analysis.
Place, publisher, year, edition, pages
Springer, 2016. 490-503 p.
Face reconstruction, Oculus, PCA, Virtual reality, VR headset, Wearable setup, Calibration, Computer vision, Wearable technology, Qualitative and quantitative analysis, Test information, Video teleconferencing, Wearable cameras, Principal component analysis
IdentifiersURN: urn:nbn:se:kth:diva-195544DOI: 10.1007/978-3-319-46604-0_35ScopusID: 2-s2.0-84989829345ISBN: 9783319466033OAI: oai:DiVA.org:kth-195544DiVA: diva2:1048621
8 October 2016 through 16 October 2016
QC 201611212016-11-212016-11-032016-11-21Bibliographically approved