Change search
ReferencesLink to record
Permanent link

Direct link
Liquid computing on and off the edge of chaos with a striatal microcircuit
KTH, School of Computer Science and Communication (CSC), Computational Biology, CB.
2014 (English)In: Frontiers in Computational Neuroscience, ISSN 1662-5188, E-ISSN 1662-5188, Vol. 8, 130Article in journal (Refereed) PublishedText
Abstract [en]

In reinforcement learning theories of the basal ganglia, there is a need for the expected rewards corresponding to relevant environmental states to be maintained and modified during the learning process. However, the representation of these states that allows them to be associated with reward expectations remains unclear. Previous studies have tended to rely on pre-defined partitioning of states encoded by disjunct neuronal groups or sparse topological drives. A more likely scenario is that striatal neurons are involved in the encoding of multiple different states through their spike patterns, and that an appropriate partitioning of an environment is learned on the basis of task constraints, thus minimizing the number of states involved in solving a particular task. Here we show that striatal activity is sufficient to implement a liquid state, an important prerequisite for such a computation, whereby transient patterns of striatal activity are mapped onto the relevant states. We develop a simple small scale model of the striatum which can reproduce key features of the experimentally observed activity of the major cell types of the striatum. We then use the activity of this network as input for the supervised training of four simple linear readouts to learn three different functions on a plane, where the network is stimulated with the spike coded position of the agent. We discover that the network configuration that best reproduces striatal activity statistics lies on the edge of chaos and has good performance on all three tasks, but that in general, the edge of chaos is a poor predictor of network performance.

Place, publisher, year, edition, pages
Frontiers Media SA , 2014. Vol. 8, 130
Keyword [en]
striatum, liquid state machine, edge of chaos, state representation, generalization
National Category
Bioinformatics (Computational Biology)
Identifiers
URN: urn:nbn:se:kth:diva-179093DOI: 10.3389/fncom.2014.00130ISI: 000346834900001PubMedID: 25484864OAI: oai:DiVA.org:kth-179093DiVA: diva2:881693
Note

QC 20151211

Available from: 2015-12-11 Created: 2015-12-10 Last updated: 2015-12-11Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textPubMedPublishers website

Search in DiVA

By author/editor
Toledo-Suarez, CarlosDuarte, Renato
By organisation
Computational Biology, CB
In the same journal
Frontiers in Computational Neuroscience
Bioinformatics (Computational Biology)

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 6 hits
ReferencesLink to record
Permanent link

Direct link