Generalized axiomatic scale-space theory
2013 (English)In: Advances in Imaging and Electron Physics, Vol 178 / [ed] P. Hawkes, Elsevier , 2013, Vol. 178, 1-96 p.Chapter in book (Refereed)
A fundamental problem in vision is what types of image operations should be used at the first stages of visual processing. I discuss a principled approach to this problem by describing a generalized axiomatic scale-space theory that makes it possible to derive the notions of linear scale-space, affine Gaussian scale-space, and linear spatio-temporal scale-space using similar sets of assumptions (scale-space axioms).
Based on a requirement that new image structures should not be created with increasing scale formalized into a condition of non-enhancement of local extrema, a complete classification is given of the linear (Gaussian) scale-space concepts that satisfy these conditions on isotropic spatial, non-isotropic spatial, and spatio-temporal domains, which results in a general taxonomy of Gaussian scale-spaces for continuous image data. The resulting theory allows filter shapes to be tuned from specific context information and provides a theoretical foundation for the recently exploited mechanisms of affine shape adaptation and Galilean velocity adaptation, with highly useful applications in computer vision. It is also shown how time-causal and time-recursive spatio-temporal scale-space concepts can be derived from similar or closely related assumptions.
The receptive fields arising from the spatial, spatio-chromatic, and spatio-temporal derivatives resulting from these scale-space concepts can be used as a general basis for expressing image operations for a large class of computer vision or image analysis methods. The receptive field profiles generated by necessity from these theories also have close similarities to receptive fields measured by cell recordings in biological vision, specifically regarding space-time separable cells in the retina and the lateral geniculate nucleus (LGN), as well as both space-time separable and non-separable cells in the striate cortex (V1) of higher mammals.
Place, publisher, year, edition, pages
Elsevier , 2013. Vol. 178, 1-96 p.
, Advances in Imaging and Electron Physics, ISSN 1076-5670 ; 178
scale-space, multiscale representation, scale-space axioms, non-enhancement of local extrema, scale invariance, Gaussian kernel, Gaussian derivative, spatial, affine, spatiochromatic, spatio-temporal, time-causal, time-recursive, receptive field, diffusion, computer vision, image analysis, image processing
Computer Science Computer Vision and Robotics (Autonomous Systems) Mathematics
IdentifiersURN: urn:nbn:se:kth:diva-118695DOI: 10.1016/B978-0-12-407701-0.00001-7ISI: 000321676300001ScopusID: 2-s2.0-84879117649ISBN: 978-0-12-407701-0OAI: oai:DiVA.org:kth-118695DiVA: diva2:607456
FunderSwedish Research Council, 2010-4766Knut and Alice Wallenberg Foundation
QC 201307032013-02-232013-02-232014-01-13Bibliographically approved