kth.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Time-causal and time-recursive spatio-temporal receptive fields for computer vision and computational modelling of biological vision
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsvetenskap och beräkningsteknik (CST). (Computational Brain Science Laboratory)ORCID-id: 0000-0002-9081-2170
2016 (Engelska)Ingår i: International Workshop on Geometry, PDE’s and Lie Groups in Image Analysis, Eindhoven, The Netherlands, August 24-26, 2016., 2016Konferensbidrag, Muntlig presentation med publicerat abstract (Övrigt vetenskapligt)
Abstract [en]

When operating on time-dependent image information in real time, a fundamental constraint originates from the fact that image operations must be both time-causal and time-recursive.

In this talk, we will present an improved model and theory for time-causal and time-recursive spatio-temporal receptive fields, obtained by a combination of Gaussian filters over the spatial domain and first-order integrators or equivalently truncated exponential filters coupled in cascade over the temporal domain. This receptive field family obeys scale-space axiomatics in the sense of non-enhancement of local extrema over the spatial domain and non-creation of new local extrema over time for any purely temporal signal and does in these respects guarantee theoretically well-founded treatment of spatio-temporal image structures at different spatial and temporal scales.

By a logarithmic distribution of the temporal scale levels in combination with the construction of a time-causal limit kernel based on an infinitely dense distribution of the temporal scale levels towards zero temporal scale, it will be shown that this family allows for temporal scale invariance although the temporal scale levels by the theory have to be discrete. Additionally, the family obeys basic invariance or covariance properties under other classes of natural image transformations including spatial scaling transformations, rotations/affine image deformations over the spatial domain, Galilean transformations of space time and local multiplicative intensity transformations. Thereby, this receptive field family allows for the formulation of multi-scale differential geometric image features with invariance or covariance properties under basic classes of natural image transformations over space-time.

It is shown how this spatio-temporal scale-space concept (i) allows for efficient computation of different types of spatio-temporal features for purposes in computer vision and (ii) leads to predictions about biological receptive fields with good qualitative similarities to the results of cell recordings in the lateral geniculate nucleus (LGN) and the primary visual cortex (V1) in biological vision.

References:

T. Lindeberg (2016) ”Time-causal and time-recursive spatio-temporal receptive fields”, Journal of Mathematical Imaging and Vision, 55(1): 50-88.

T. Lindeberg (2013) ”A computational theory of visual receptive fields”, Biological Cybernetics, 107(6): 589–635.

T. Lindeberg (2013) ”Invariance of visual operations at the level of receptive fields”, PLOS One, 8(7): e66990.

T. Lindeberg (2011) ”Generalized Gaussian scale-space axiomatics comprising linear scale space, affine scale space and spatio-temporal scale space”, Journal of Mathematical Imaging and Vision, 40(1): 36–81.

Ort, förlag, år, upplaga, sidor
2016.
Nationell ämneskategori
Datorseende och robotik (autonoma system) Bioinformatik (beräkningsbiologi)
Identifikatorer
URN: urn:nbn:se:kth:diva-188030OAI: oai:DiVA.org:kth-188030DiVA, id: diva2:933205
Konferens
International Workshop on Geometry, PDE’s and Lie Groups in Image Analysis, Eindhoven, The Netherlands, August 24-26, 2016.
Forskningsfinansiär
Vetenskapsrådet, 2014-4083Stiftelsen Olle Engkvist Byggmästare
Anmärkning

QC 20160603

Tillgänglig från: 2016-06-03 Skapad: 2016-06-03 Senast uppdaterad: 2022-06-22Bibliografiskt granskad

Open Access i DiVA

fulltext(16133 kB)314 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 16133 kBChecksumma SHA-512
01b2f74f5c60c68b3ad4ffdfd96bec698011f7f6039d447eaa059ea8115eb738ee08d2f04db3a164f38f5940773a32dadd751bb06fa9d0fd131467b306fe641a
Typ fulltextMimetyp application/pdf

Övriga länkar

Video recording of the talkhttp://bmia.bmt.tue.nl/people/RDuits/workshop/index.html

Person

Lindeberg, Tony

Sök vidare i DiVA

Av författaren/redaktören
Lindeberg, Tony
Av organisationen
Beräkningsvetenskap och beräkningsteknik (CST)
Datorseende och robotik (autonoma system)Bioinformatik (beräkningsbiologi)

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 314 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

urn-nbn

Altmetricpoäng

urn-nbn
Totalt: 1222 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf