kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Covariant spatio-temporal receptive fields for spiking neural networks
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST).
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST).
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST). (Computational Brain Science Lab)ORCID iD: 0000-0002-9081-2170
2025 (English)In: Nature Communications, E-ISSN 2041-1723, Vol. 16, p. 8231:1-8231:14, article id 8231Article in journal (Refereed) Published
Abstract [en]

Biological nervous systems constitute important sources of inspiration towards computers that are faster, cheaper, and more energy efficient. Neuromorphic disciplines view the brain as a coevolved system, simultaneously optimizing the hardware and the algorithms running on it. There are clear efficiency gains when bringing the computations into a physical substrate, but we presently lack theories to guide efficient implementations. Here, we present a principled computational model for neuromorphic systems in terms of spatio-temporal receptive fields, based on affine Gaussian kernels over space and leaky-integrator and leaky integrate-and-fire models over time. Our theory is provably covariant to spatial affine and temporal scaling transformations, with close similarities to visual processing in mammalian brains. We use these spatio-temporal receptive elds as a prior in an event-based vision task, and show that this improves the training of spiking networks, which is otherwise known to be problematic for event-based vision. This work combines efforts within scale-space theory and computational neuroscience to identify theoretically well-founded ways to process spatio-temporal signals in neuromorphic systems. Our contributions are immediately relevant for signal processing and event-based vision, and can be extended to other processing tasks over space and time, such as memory and control.

Place, publisher, year, edition, pages
Springer Nature, 2025. Vol. 16, p. 8231:1-8231:14, article id 8231
National Category
Computer graphics and computer vision
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-369444DOI: 10.1038/s41467-025-63493-0ISI: 001567071200007PubMedID: 40913046Scopus ID: 2-s2.0-105015101977OAI: oai:DiVA.org:kth-369444DiVA, id: diva2:1995516
Projects
Covariant and invariant deep networks
Funder
EU, Horizon 2020, 785907, 945539Swedish Research Council, 2022-02969, 2022-06725Danish National Research Foundation, P1Available from: 2025-09-05 Created: 2025-09-05 Last updated: 2026-06-22
In thesis
1. Neuromorphic computation in space and time: On first-principles approaches to computation in mixed-signal neural networks
Open this publication in new window or tab >>Neuromorphic computation in space and time: On first-principles approaches to computation in mixed-signal neural networks
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Digital computers have advanced to rival human-level intelligence across creative reasoning and complex problem-solving tasks. Yet, theoretical comparisons with unconventional computational substrates suggest we have only scratched the surface of computational potential. Biological nervous systems have long been studied for their efficiency and robustness, inspiring the invention of neuromorphic hardware. Neuromorphic systems have yet to outperform digital computers, likely due to our limited understanding of the governing computational principles.

This work investigates these computational principles using two modes of inquiry. First, axioms for mixed-signal neural networks are studied by induction as necessary conditions for provably correct neuromorphic computations. Part of the axioms are applied in the Neuromorphic Intermediate Representation, a set of neuromorphic primitives, which is demonstrated to work across more than 12 neuromorphic software and hardware platforms. A second inquiry is made into geometric approaches to event-based vision by deduction. By establishing a direct relationship between neuromorphic primitives and signal transformations, it is demonstrated how neural networks can be imbued with covariance properties that enable them to outperform conventional networks of similar complexity in object tracking tasks. The complementary inductive-deductive approaches provide a more complete lens from which to understand and implement neuromorphic computation.

Additionally, a chapter is dedicated to several openly accessible software projects for evaluating neuromorphic systems on commodity hardware. Apart from being the backbone for the research in this thesis, the accessibility and reproducibility may propagate the research and catalyze community efforts.

Finally, the thesis concludes with a discussion on the broader implications of the above findings and the future trajectory of neuromorphic computation.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. p. xi, 81
Series
TRITA-EECS-AVL ; 2025:85
Keywords
Neuromorphic computing, mixed-signal neural networks, event-based vision, scale-space theory, computational primitives, covariance, computational models.
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kth:diva-370478 (URN)978-91-8106-406-3 (ISBN)
Public defence
2025-10-17, https://kth-se.zoom.us/j/68948445390?pwd=DcZEttQgMF9NzidYOSYLzpypopsXVG.1, D3, Lindstedtsvägen 5, KTH, Stockholm, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20250926

Available from: 2025-09-26 Created: 2025-09-25 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

fulltext(2048 kB)99 downloads
File information
File name FULLTEXT01.pdfFile size 2048 kBChecksum SHA-512
8241f739576d410d376513d08b9f416088a2f74a634158f5b029ac4835306e67087c7d745d7fa83051e793a824ea1e4f0ea7616c4ca72a995ad5238af876532e
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Search in DiVA

By author/editor
Pedersen, JensConradt, JörgLindeberg, Tony
By organisation
Computational Science and Technology (CST)
In the same journal
Nature Communications
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar
Total: 99 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 1310 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf