kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Mesocorticostriatal Reinforcement Learning of State Representation and Value with Implications for the Mechanisms of Schizophrenia
Physical and Health Education, Graduate School of Education, University of Tokyo, 113-0033, Tokyo, Japan; International Research Center for Neurointelligence (WPI-IRCN), University of Tokyo, 113-0033, Tokyo, Japan.
KTH, School of Electrical Engineering and Computer Science (EECS), Computational Science and Technology. KTH, Centres, Science for Life Laboratory, SciLifeLab.ORCID iD: 0000-0002-8044-9195
2026 (English)In: Journal of Neuroscience, ISSN 0270-6474, E-ISSN 1529-2401, Vol. 46, no 16Article in journal (Refereed) Published
Abstract [en]

Mesocorticostriatal dopamine projections are crucial for value learning, motivational control, and cognitive functions. However, while dopamine's role in value learning as reward-prediction-error (RPE) has been much understood, precise roles in motivational control and cognitive functions remain more elusive. Computationally, this corresponds to that while the operation of mesostriatal dopamine could be minimally described by simple reinforcement learning (RL) models with one-dimensional reward/RPE and fixed state representation, (1) how reward-specific motivational control can be achieved through heterogeneous dopamine responses, and (2) how sophisticated cortical state representation can be formed through mesocortical dopamine, cannot be captured by such simple models. To address both of these at once, we combined recent models for each of them: the "Reward Bases (RB)," which achieved reward-specific motivational control through multidimensional RPE (but with fixed cortical representation), and the "online value-recurrent-neutral-network (OVRNN)," which achieved state representation learning through training of RNN by RPE (but of one-dimensional). We show the combined model can achieve both functions simultaneously via double "feedback alignments" of the cortical and striatal downstream connections to the mesocorticostriatal dopamine projections. Crucially, cortical inhibition-dominance is a key for successful learning. Excessive excitation leads to aberrant persistent activity, which disrupts the alignments and impairs reward-specific motivational control and credit assignment. This implies how negative and positive symptoms of schizophrenia could emerge from excitation/inhibition imbalance, and we show how our model could explain altered brain activations in patients. Our model thus provides an integrated computational account for dopamine's functions, with implications on how its dysfunctions link to schizophrenia.

Place, publisher, year, edition, pages
Society for Neuroscience , 2026. Vol. 46, no 16
Keywords [en]
dopamine, excitation/inhibition balance, feedback alignment, recurrent neural networks, reinforcement learning, schizophrenia
National Category
Neurosciences Psychiatry Control Engineering Bioinformatics (Computational Biology)
Identifiers
URN: urn:nbn:se:kth:diva-381614DOI: 10.1523/JNEUROSCI.1762-25.2026ISI: 001760464600010PubMedID: 41775629Scopus ID: 2-s2.0-105036662046OAI: oai:DiVA.org:kth-381614DiVA, id: diva2:2061477
Note

QC 20260521

Available from: 2026-05-21 Created: 2026-05-21 Last updated: 2026-05-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMedScopus

Authority records

Kumar, Arvind

Search in DiVA

By author/editor
Kumar, Arvind
By organisation
Computational Science and TechnologyScience for Life Laboratory, SciLifeLab
In the same journal
Journal of Neuroscience
NeurosciencesPsychiatryControl EngineeringBioinformatics (Computational Biology)

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 16 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf