kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Time-causal and time-recursive spatio-temporal receptive fields for computer vision and computational modelling of biological vision
KTH, School of Computer Science and Communication (CSC), Computational Science and Technology (CST). (Computational Brain Science Laboratory)ORCID iD: 0000-0002-9081-2170
2016 (English)In: International Workshop on Geometry, PDE’s and Lie Groups in Image Analysis, Eindhoven, The Netherlands, August 24-26, 2016., 2016Conference paper, Oral presentation with published abstract (Other academic)
Abstract [en]

When operating on time-dependent image information in real time, a fundamental constraint originates from the fact that image operations must be both time-causal and time-recursive.

In this talk, we will present an improved model and theory for time-causal and time-recursive spatio-temporal receptive fields, obtained by a combination of Gaussian filters over the spatial domain and first-order integrators or equivalently truncated exponential filters coupled in cascade over the temporal domain. This receptive field family obeys scale-space axiomatics in the sense of non-enhancement of local extrema over the spatial domain and non-creation of new local extrema over time for any purely temporal signal and does in these respects guarantee theoretically well-founded treatment of spatio-temporal image structures at different spatial and temporal scales.

By a logarithmic distribution of the temporal scale levels in combination with the construction of a time-causal limit kernel based on an infinitely dense distribution of the temporal scale levels towards zero temporal scale, it will be shown that this family allows for temporal scale invariance although the temporal scale levels by the theory have to be discrete. Additionally, the family obeys basic invariance or covariance properties under other classes of natural image transformations including spatial scaling transformations, rotations/affine image deformations over the spatial domain, Galilean transformations of space time and local multiplicative intensity transformations. Thereby, this receptive field family allows for the formulation of multi-scale differential geometric image features with invariance or covariance properties under basic classes of natural image transformations over space-time.

It is shown how this spatio-temporal scale-space concept (i) allows for efficient computation of different types of spatio-temporal features for purposes in computer vision and (ii) leads to predictions about biological receptive fields with good qualitative similarities to the results of cell recordings in the lateral geniculate nucleus (LGN) and the primary visual cortex (V1) in biological vision.

References:

T. Lindeberg (2016) ”Time-causal and time-recursive spatio-temporal receptive fields”, Journal of Mathematical Imaging and Vision, 55(1): 50-88.

T. Lindeberg (2013) ”A computational theory of visual receptive fields”, Biological Cybernetics, 107(6): 589–635.

T. Lindeberg (2013) ”Invariance of visual operations at the level of receptive fields”, PLOS One, 8(7): e66990.

T. Lindeberg (2011) ”Generalized Gaussian scale-space axiomatics comprising linear scale space, affine scale space and spatio-temporal scale space”, Journal of Mathematical Imaging and Vision, 40(1): 36–81.

Place, publisher, year, edition, pages
2016.
National Category
Computer Vision and Robotics (Autonomous Systems) Bioinformatics (Computational Biology)
Identifiers
URN: urn:nbn:se:kth:diva-188030OAI: oai:DiVA.org:kth-188030DiVA, id: diva2:933205
Conference
International Workshop on Geometry, PDE’s and Lie Groups in Image Analysis, Eindhoven, The Netherlands, August 24-26, 2016.
Funder
Swedish Research Council, 2014-4083Stiftelsen Olle Engkvist Byggmästare
Note

QC 20160603

Available from: 2016-06-03 Created: 2016-06-03 Last updated: 2022-06-22Bibliographically approved

Open Access in DiVA

fulltext(16133 kB)314 downloads
File information
File name FULLTEXT01.pdfFile size 16133 kBChecksum SHA-512
01b2f74f5c60c68b3ad4ffdfd96bec698011f7f6039d447eaa059ea8115eb738ee08d2f04db3a164f38f5940773a32dadd751bb06fa9d0fd131467b306fe641a
Type fulltextMimetype application/pdf

Other links

Video recording of the talkhttp://bmia.bmt.tue.nl/people/RDuits/workshop/index.html

Authority records

Lindeberg, Tony

Search in DiVA

By author/editor
Lindeberg, Tony
By organisation
Computational Science and Technology (CST)
Computer Vision and Robotics (Autonomous Systems)Bioinformatics (Computational Biology)

Search outside of DiVA

GoogleGoogle Scholar
Total: 314 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1222 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf