kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Algebraic complexity and neurovariety of linear convolutional networks
KTH, School of Engineering Sciences (SCI), Mathematics (Dept.), Algebra, Combinatorics and Topology.ORCID iD: 0009-0005-2619-9198
2025 (English)In: Mathematica, ISSN 1844-6094, E-ISSN 2066-7752, Vol. 17, no 1, article id 2Article in journal (Refereed) Published
Abstract [en]

In this paper, we study linear convolutional networks with one-dimensional filters and arbitrary strides. The neuromanifold of such a network is a semialgebraic set, represented by a space of polynomials admitting specific factorizations. Introducing a recursive algorithm, we generate polynomial equations whose common zero locus corresponds to the Zariski closure of the corresponding neuromanifold. Furthermore, we explore the algebraic complexity of training these networks employing tools from metric algebraic geometry. Our findings reveal that the number of all complex critical points in the optimization of such a network is equal to the generic Euclidean distance degree of a Segre variety. Notably, this count significantly surpasses the number of critical points encountered in the training of a fully connected linear network with the same number of parameters.

Place, publisher, year, edition, pages
Springer Nature , 2025. Vol. 17, no 1, article id 2
Keywords [en]
Function space description of neural networks, Linear networks, Euclidean distance degree, Critical points
National Category
Mathematical sciences
Identifiers
URN: urn:nbn:se:kth:diva-367866DOI: 10.1007/s44426-025-00002-2ISI: 001504294400002Scopus ID: 2-s2.0-105006453573OAI: oai:DiVA.org:kth-367866DiVA, id: diva2:1986621
Note

QC 20250801

Available from: 2025-08-01 Created: 2025-08-01 Last updated: 2025-08-01Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Shahverdi, Vahid

Search in DiVA

By author/editor
Shahverdi, Vahid
By organisation
Algebra, Combinatorics and Topology
In the same journal
Mathematica
Mathematical sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 23 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf