Mesocorticostriatal Reinforcement Learning of State Representation and Value with Implications for the Mechanisms of Schizophrenia
2026 (English)In: Journal of Neuroscience, ISSN 0270-6474, E-ISSN 1529-2401, Vol. 46, no 16Article in journal (Refereed) Published
Abstract [en]
Mesocorticostriatal dopamine projections are crucial for value learning, motivational control, and cognitive functions. However, while dopamine's role in value learning as reward-prediction-error (RPE) has been much understood, precise roles in motivational control and cognitive functions remain more elusive. Computationally, this corresponds to that while the operation of mesostriatal dopamine could be minimally described by simple reinforcement learning (RL) models with one-dimensional reward/RPE and fixed state representation, (1) how reward-specific motivational control can be achieved through heterogeneous dopamine responses, and (2) how sophisticated cortical state representation can be formed through mesocortical dopamine, cannot be captured by such simple models. To address both of these at once, we combined recent models for each of them: the "Reward Bases (RB)," which achieved reward-specific motivational control through multidimensional RPE (but with fixed cortical representation), and the "online value-recurrent-neutral-network (OVRNN)," which achieved state representation learning through training of RNN by RPE (but of one-dimensional). We show the combined model can achieve both functions simultaneously via double "feedback alignments" of the cortical and striatal downstream connections to the mesocorticostriatal dopamine projections. Crucially, cortical inhibition-dominance is a key for successful learning. Excessive excitation leads to aberrant persistent activity, which disrupts the alignments and impairs reward-specific motivational control and credit assignment. This implies how negative and positive symptoms of schizophrenia could emerge from excitation/inhibition imbalance, and we show how our model could explain altered brain activations in patients. Our model thus provides an integrated computational account for dopamine's functions, with implications on how its dysfunctions link to schizophrenia.
Place, publisher, year, edition, pages
Society for Neuroscience , 2026. Vol. 46, no 16
Keywords [en]
dopamine, excitation/inhibition balance, feedback alignment, recurrent neural networks, reinforcement learning, schizophrenia
National Category
Neurosciences Psychiatry Control Engineering Bioinformatics (Computational Biology)
Identifiers
URN: urn:nbn:se:kth:diva-381614DOI: 10.1523/JNEUROSCI.1762-25.2026ISI: 001760464600010PubMedID: 41775629Scopus ID: 2-s2.0-105036662046OAI: oai:DiVA.org:kth-381614DiVA, id: diva2:2061477
Note
QC 20260521
2026-05-212026-05-212026-05-21Bibliographically approved