Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Real-Time Enhancement of Dynamic Depth Videos with Non-Rigid Deformations
Show others and affiliations
2017 (English)In: IEEE Transaction on Pattern Analysis and Machine Intelligence, ISSN 0162-8828, E-ISSN 1939-3539, Vol. 39, no 10, p. 2045-2059Article in journal (Refereed) Published
Abstract [en]

We propose a novel approach for enhancing depth videos containing non-rigidly deforming objects. Depth sensors are capable of capturing depth maps in real-time but suffer from high noise levels and low spatial resolutions. While solutions for reconstructing 3D details in static scenes, or scenes with rigid global motions have been recently proposed, handling unconstrained non-rigid deformations in relative complex scenes remains a challenge. Our solution consists in a recursive dynamic multi-frame super-resolution algorithm where the relative local 3D motions between consecutive frames are directly accounted for. We rely on the assumption that these 3D motions can be decoupled into lateral motions and radial displacements. This allows to perform a simple local per-pixel tracking where both depth measurements and deformations are dynamically optimized. The geometric smoothness is subsequently added using a multi-level L1 minimization with a bilateral total variation regularization. The performance of this method is thoroughly evaluated on both real and synthetic data. As compared to alternative approaches, the results show a clear improvement in reconstruction accuracy and in robustness to noise, to relative large non-rigid deformations, and to topological changes. Moreover, the proposed approach, implemented on a CPU, is shown to be computationally efficient and working in real-time. © 1979-2012 IEEE.

Place, publisher, year, edition, pages
IEEE Computer Society, 2017. Vol. 39, no 10, p. 2045-2059
Keywords [en]
Cameras;Heuristic algorithms;Image resolution;Real-time systems;Three-dimensional displays;Two dimensional displays;Videos;Depth enhancement;Kalman filtering;bilateral total variation;non-rigid deformations;registration;super-resolution
National Category
Signal Processing
Identifiers
URN: urn:nbn:se:kth:diva-258994DOI: 10.1109/TPAMI.2016.2622698ISI: 000408807600011PubMedID: 27810799Scopus ID: 2-s2.0-85029920610OAI: oai:DiVA.org:kth-258994DiVA, id: diva2:1350467
Note

QC 20191025

Available from: 2019-09-11 Created: 2019-09-11 Last updated: 2019-10-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopus

Search in DiVA

By author/editor
Ottersten, Björn
In the same journal
IEEE Transaction on Pattern Analysis and Machine Intelligence
Signal Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 1 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf