Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Time-causal and time-recursive receptive fields for invariance and covariance under natural image transformations
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsvetenskap och beräkningsteknik (CST). (Computational Brain Science Lab)ORCID-id: 0000-0002-9081-2170
2016 (engelsk)Konferansepaper, Oral presentation with published abstract (Annet vitenskapelig)
Abstract [en]

Due to the huge variability of image information under natural image transformations, the receptive field responses of the local image operations that serve as input to higher level visual processes will in general be strongly dependent on the geometric and illumination conditions in the image formation process. To obtain robustness of a vision system, it is natural to require the receptive field families underlying the image operators to be either invariant or covariant under the relevant families of natural image transformations.

This talk presents an improved model and theory for time-causal and time-recursive spatio-temporal receptive fields, obtained by a combination of Gaussian receptive fields over the spatial domain and first-order integrators or equivalently truncated exponential filters coupled in cascade over the temporal domain. This model inherits the theoretically attractive properties of the Gaussian scale-space model over a spatial domain in terms of (i) invariance or covariance of receptive field responses under scaling transformation and affine transformations over the spatial domain combined with (ii) non-creation of new image structures from finer to coarser scales. When complemented by velocity adaptation the receptive field responses can be made (iii) Galilean covariant or invariant to account for unknown or variable relative motions between objects in the world and the observer. Additionally when expressed over a logarithmic distribution of the temporal scale levels, this model allows for (iv) scale invariance and self-similarity over the temporal domain while simultaneously expressed over a time-causal and time-recursive temporal domain, which is a theoretically new type of construction.

We propose this axiomatically derived theory as the natural extension of the Gaussian scale-space paradigm for local image operations from a spatial domain to a time-causal spatio-temporal domain, to be used as a general framework for expressing spatial and spatio-temporal image operators for a computer vision system. The theory leads to (v) predictions about spatial and spatio-temporal receptive fields with good qualitative similarity to biological receptive fields measured by cell recordings in the retina, the lateral geniculate nucleus (LGN) and the primary visual cortex (V1). Specifically, this framework allows for (vi) computationally efficient real-time operations and leads to (vii) much better temporal dynamics (shorter temporal delays) compared to previously formulated time-causal temporal scale-space models.

Reference:

Lindeberg (2016) "Time-causal and time-recursive spatio-temporal receptive fields", Journal of Mathematical Imaging and Vision, 55(1): 50-88.

sted, utgiver, år, opplag, sider
2016.
HSV kategori
Identifikatorer
URN: urn:nbn:se:kth:diva-188028OAI: oai:DiVA.org:kth-188028DiVA, id: diva2:933186
Konferanse
First European Machine Vision Forum, Heidelberg, Germany, September 8-9, 2016.
Prosjekter
Scale-space theory for invariant and covariant receptive fields
Forskningsfinansiär
Swedish Research Council, 2014-4083Stiftelsen Olle Engkvist Byggmästare
Merknad

QC 20160603

Tilgjengelig fra: 2016-06-03 Laget: 2016-06-03 Sist oppdatert: 2018-01-10bibliografisk kontrollert

Open Access i DiVA

fulltext(5831 kB)189 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 5831 kBChecksum SHA-512
5a567abc7f54be7e131043e80b0027bfd35d95b8122c29612dafaa539cb78b757244d077c2c028b46338b36d989e03e75a8aa6daee8237df945edf32ceaf6350
Type fulltextMimetype application/pdf

Andre lenker

Video recording of the talk

Personposter BETA

Lindeberg, Tony

Søk i DiVA

Av forfatter/redaktør
Lindeberg, Tony
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 189 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

urn-nbn

Altmetric

urn-nbn
Totalt: 900 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf