kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Translation and Scale Invariance for Event-Based Object tracking
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST).ORCID iD: 0000-0001-6012-7415
KTH.
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Computational Science and Technology (CST).ORCID iD: 0000-0001-5998-9640
Number of Authors: 32023 (English)In: Proceedings of the 2023 Annual Neuro-Inspired Computational Elements Conference, NICE 2023, Association for Computing Machinery (ACM) , 2023, p. 79-85Conference paper, Published paper (Refereed)
Abstract [en]

Without temporal averaging, such as rate codes, it remains challenging to train spiking neural networks for temporal regression tasks. In this work, we present a novel method to accurately predict spatial coordinates from event data with a fully spiking convolutional neural network (SCNN) without temporal averaging. Our method performs on-par with artificial neural networks (ANN) of similar complexity. Additionally, we demonstrate faster convergence in half the time using translation-and scale-invariant receptive fields. To permit comparison with conventional frame-based ANNs, we base our results on a simulated event-based dataset with an unrealistic high density. Therefore, we hypothesize that our method significantly outperform ANNs in settings with lower event density, as seen in real-life event-based data. Our model is fully spiking and can be ported directly to neuromorphic hardware.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2023. p. 79-85
Keywords [en]
coordinate regression, event-based vision, object tracking, spiking neural networks
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:kth:diva-333350DOI: 10.1145/3584954.3584996ISI: 001089568500013Scopus ID: 2-s2.0-85153677638OAI: oai:DiVA.org:kth-333350DiVA, id: diva2:1784972
Conference
2023 Annual Neuro-Inspired Computational Elements Conference, NICE 2023, San Antonio, United States of America, Apr 11 2023 - Apr 14 2023
Note

Part of ISBN 9781450399470

QC 20230801

Available from: 2023-08-01 Created: 2023-08-01 Last updated: 2025-09-25Bibliographically approved
In thesis
1. Neuromorphic computation in space and time: On first-principles approaches to computation in mixed-signal neural networks
Open this publication in new window or tab >>Neuromorphic computation in space and time: On first-principles approaches to computation in mixed-signal neural networks
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Digital computers have advanced to rival human-level intelligence across creative reasoning and complex problem-solving tasks. Yet, theoretical comparisons with unconventional computational substrates suggest we have only scratched the surface of computational potential. Biological nervous systems have long been studied for their efficiency and robustness, inspiring the invention of neuromorphic hardware. Neuromorphic systems have yet to outperform digital computers, likely due to our limited understanding of the governing computational principles.

This work investigates these computational principles using two modes of inquiry. First, axioms for mixed-signal neural networks are studied by induction as necessary conditions for provably correct neuromorphic computations. Part of the axioms are applied in the Neuromorphic Intermediate Representation, a set of neuromorphic primitives, which is demonstrated to work across more than 12 neuromorphic software and hardware platforms. A second inquiry is made into geometric approaches to event-based vision by deduction. By establishing a direct relationship between neuromorphic primitives and signal transformations, it is demonstrated how neural networks can be imbued with covariance properties that enable them to outperform conventional networks of similar complexity in object tracking tasks. The complementary inductive-deductive approaches provide a more complete lens from which to understand and implement neuromorphic computation.

Additionally, a chapter is dedicated to several openly accessible software projects for evaluating neuromorphic systems on commodity hardware. Apart from being the backbone for the research in this thesis, the accessibility and reproducibility may propagate the research and catalyze community efforts.

Finally, the thesis concludes with a discussion on the broader implications of the above findings and the future trajectory of neuromorphic computation.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2025. p. xi, 81
Series
TRITA-EECS-AVL ; 2025:85
Keywords
Neuromorphic computing, mixed-signal neural networks, event-based vision, scale-space theory, computational primitives, covariance, computational models.
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kth:diva-370478 (URN)978-91-8106-406-3 (ISBN)
Public defence
2025-10-17, https://kth-se.zoom.us/j/68948445390?pwd=DcZEttQgMF9NzidYOSYLzpypopsXVG.1, D3, Lindstedtsvägen 5, KTH, Stockholm, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20250926

Available from: 2025-09-26 Created: 2025-09-25 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Pedersen, JensSinghal, RaghavConradt, Jörg

Search in DiVA

By author/editor
Pedersen, JensSinghal, RaghavConradt, Jörg
By organisation
Computational Science and Technology (CST)KTH
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 86 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf