Probabilistic Multiview Depth Image Enhancement Using Variational Inference
2015 (English)In: IEEE Journal on Selected Topics in Signal Processing, ISSN 1932-4553, Vol. 9, no 3, 435-448 p.Article in journal (Refereed) Published
An inference-based multiview depth image enhancement algorithm is introduced and investigated in this paper. Multiview depth imagery plays a pivotal role in free-viewpoint television. This technology requires high-quality virtual view synthesis to enable viewers to move freely in a dynamic real world scene. Depth imagery of different viewpoints is used to synthesize an arbitrary number of novel views. Usually, the depth imagery is estimated individually by stereo-matching algorithms and, hence, shows inter-view inconsistency. This inconsistency affects the quality of view synthesis negatively. This paper enhances the multiview depth imagery at multiple viewpoints by probabilistic weighting of each depth pixel. First, our approach classifies the color pixels in the multiview color imagery. Second, using the resulting color clusters, we classify the corresponding depth values in the multiview depth imagery. Each clustered depth image is subject to further subclustering. Clustering based on generative models is used for assigning probabilistic weights to each depth pixel. Finally, these probabilistic weights are used to enhance the depth imagery at multiple viewpoints. Experiments show that our approach consistently improves the quality of virtual views by 0.2 dB to 1.6 dB, depending on the quality of the input multiview depth imagery.
Place, publisher, year, edition, pages
2015. Vol. 9, no 3, 435-448 p.
Bayes methods, Cameras, Clustering algorithms, Image color analysis, Sensors, Signal processing algorithms, Vectors, Dirichlet mixture model, Multiview video, free-viewpoint television, multiview depth consistency, virtual view synthesis
Research subject Electrical Engineering
IdentifiersURN: urn:nbn:se:kth:diva-163409DOI: 10.1109/JSTSP.2014.2373331ISI: 000351749800006OAI: oai:DiVA.org:kth-163409DiVA: diva2:800080
QC 201504022015-04-012015-04-012015-04-29Bibliographically approved