Real-time depth enhancement by fusion for RGB-D camerasShow others and affiliations
2013 (English)In: IET Computer Vision, ISSN 1751-9632, Vol. 7, no 5Article in journal (Refereed) Published
Abstract [en]
This study presents a real-time refinement procedure for depth data acquired by RGB-D cameras. Data from RGB-Dcameras suffer from undesired artefacts such as edge inaccuracies or holes owing to occlusions or low object remission. In thiswork, the authors use recent depth enhancementfilters intended for time-of-flight cameras, and extend them to structured light-based depth cameras, such as the Kinect camera. Thus, given a depth map and its corresponding two-dimensional image, wecorrect the depth measurements by separately treating its undesired regions. To that end, the authors propose specificconfidence maps to tackle areas in the scene that require a special treatment. Furthermore, in the case offiltering artefacts, theauthors introduce the use of RGB images as guidance images as an alternative to real-time state-of-the-art fusionfilters thatuse greyscale guidance images. The experimental results show that the proposed fusionfilter provides dense depth maps withcorrected erroneous or invalid depth measurements and adjusted depth edges. In addition, the authors propose a mathematicalformulation that enables to use thefilter in real-time applications.
Place, publisher, year, edition, pages
2013. Vol. 7, no 5
Keywords [en]
cameras, filtering theory, image colour analysis, image enhancement, image fusion, mathematical analysis, RGB images, RGB-D cameras fusion, depth enhancement filters, depth measurements, filtering artefacts, fusion filter, greyscale guidance images, mathematical formulation, object remission, real-time depth enhancement, real-time refinement procedure, structured light-based depth cameras, time-of-flight cameras
National Category
Engineering and Technology Signal Processing
Identifiers
URN: urn:nbn:se:kth:diva-137116DOI: 10.1049/iet-cvi.2012.0289ISI: 000326175300005Scopus ID: 2-s2.0-84886660313OAI: oai:DiVA.org:kth-137116DiVA, id: diva2:678029
Note
QC 20131211
2013-12-112013-12-112022-06-23Bibliographically approved