Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Functional Relevance of Different Basal Ganglia Pathways Investigated in a Spiking Model with Reward Dependent Plasticity
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsbiologi, CB. Stockholm Univ, Sweden; Karolinska Inst, Sweden.
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsbiologi, CB. Karolinska Inst, Sweden.
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsbiologi, CB. Karolinska Inst, Sweden; Univ Edinburgh, Scotland.ORCID-id: 0000-0001-8796-3237
KTH, Skolan för datavetenskap och kommunikation (CSC), Beräkningsbiologi, CB. Karolinska Inst, Sweden.ORCID-id: 0000-0002-0550-0739
Visa övriga samt affilieringar
2016 (Engelska)Ingår i: Frontiers in Neural Circuits, ISSN 1662-5110, E-ISSN 1662-5110, Vol. 10, artikel-id 53Artikel i tidskrift (Refereegranskat) Published
Resurstyp
Text
Abstract [en]

The brain enables animals to behaviorally adapt in order to survive in a complex and dynamic environment, but how reward-oriented behaviors are achieved and computed by its underlying neural circuitry is an open question. To address this concern, we have developed a spiking model of the basal ganglia (BG) that learns to dis-inhibit the action leading to a reward despite ongoing changes in the reward schedule. The architecture of the network features the two pathways commonly described in BG, the direct (denoted D1) and the indirect (denoted D2) pathway, as well as a loop involving striatum and the dopaminergic system. The activity of these dopaminergic neurons conveys the reward prediction error (RPE), which determines the magnitude of synaptic plasticity within the different pathways. All plastic connections implement a versatile four-factor learning rule derived from Bayesian inference that depends upon pre- and post-synaptic activity, receptor type, and dopamine level. Synaptic weight updates occur in the D1 or D2 pathways depending on the sign of the RPE, and an efference copy informs upstream nuclei about the action selected. We demonstrate successful performance of the system in a multiple-choice learning task with a transiently changing reward schedule. We simulate lesioning of the various pathways and show that a condition without the D2 pathway fares worse than one without D1. Additionally, we simulate the degeneration observed in Parkinson's disease (PD) by decreasing the number of dopaminergic neurons during learning. The results suggest that the D1 pathway impairment in PD might have been overlooked. Furthermore, an analysis of the alterations in the synaptic weights shows that using the absolute reward value instead of the RPE leads to a larger change in D1.

Ort, förlag, år, upplaga, sidor
FRONTIERS MEDIA SA , 2016. Vol. 10, artikel-id 53
Nyckelord [en]
basal ganglia, action selection, reinforcement learning, synaptic plasticity, dopamine, reward, prediction error, Parkinson's disease
Nationell ämneskategori
Neurovetenskaper
Identifikatorer
URN: urn:nbn:se:kth:diva-190552DOI: 10.3389/fncir.2016.00053ISI: 000380103000001PubMedID: 27493625Scopus ID: 2-s2.0-84989947366OAI: oai:DiVA.org:kth-190552DiVA, id: diva2:952588
Anmärkning

QC 20160815

Tillgänglig från: 2016-08-15 Skapad: 2016-08-12 Senast uppdaterad: 2018-01-10Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextPubMedScopus

Sök vidare i DiVA

Av författaren/redaktören
Berthet, PierreLindahl, MikaelTully, Philip J.Hellgren-Kotaleski, JeanetteLansner, Anders
Av organisationen
Beräkningsbiologi, CB
I samma tidskrift
Frontiers in Neural Circuits
Neurovetenskaper

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetricpoäng

doi
pubmed
urn-nbn
Totalt: 101 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf