Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 3
Encontrada(s) 1 página(s)

Repositori Institucional UIB
Publication Artículo científico (JournalArticle)

Corticostriatal synaptic weight evolution in a two-alternative forced choice task: a computational study

  • Vich, C.
  • Dunovan, K.
  • Verstynen, T.
  • Rubin, J.
[eng] In natural environments, mammals can efficiently select actions based on noisy sensory signals and quickly adapt to unexpected outcomes to better exploit opportunities that arise in the future. Such feedback-based changes in behavior rely, in part, on long term plasticity within cortico-basal-ganglia-thalamic networks, driven by dopaminergic modulation of cortical inputs to the direct and indirect pathway neurons of the striatum. While the firing rates of striatal neurons have been shown to adapt across a range of feedback conditions, it remains difficult to directly assess the corticostriatal synaptic weight changes that contribute to these adaptive firing rates. In this work, we simulate the evolution of corticostriatal synaptic weights based on a spike timing-dependent plasticity rule driven by dopamine signaling that is induced by outcomes of actions in the context of a two-alternative forced choice task. Our results establish 1) that this plasticity model can successfully learn to select the most rewarding actions available, 2) that in the effective regime plasticity predominantly impacts direct pathway weights, evolving to drive action selection toward a more-rewarded action, and 3) that there can be coactivation of opposing populations within selected action channels, as observed experimentally. The model performance also agrees with the results of behavioral experiments carried out previously in human subjects using probabilistic reward paradigms.
Repositori Institucional UIB
Publication Artículo científico (JournalArticle)

The credit assignment problem in cortico‐basal ganglia‐thalamic networks: a review, a problem, and a possible solution

  • Rubin, J.
  • Vich, C.
  • Clapp, M.
  • Noneman, K.
  • Verstynen, T.
[eng] The question of how cortico-basal ganglia-thalamic (CBGT) pathways use dopaminergic feedback signals to modify future decisions has challenged computational neuroscientists for decades. Reviewing the literature on computational representations of dopaminergic corticostriatal plasticity, we show how the field is converging on a normative, synapticlevel learning algorithm that elegantly captures both neurophysiological properties of CBGT circuits and behavioral dynamics during reinforcement learning. Unfortunately, the computational studies that have led to this normative algorithmic model have all relied on simplified circuits that use abstracted action-selection rules. As a result, the application of this corticostriatal plasticity algorithm to a full model of the CBGT pathways immediately fails because the spatiotemporal distance between integration (corticostriatal circuits), action selection (thalamocortical loops), and learning (nigrostriatal circuits) means that the network does not know which synapses should be reinforced to favor previously rewarding actions. We show how observations from neurophysiology, in particular the sustained activation of selected action representations, can provide a simple means of resolving this credit assignment problem in models of CBGT learning. Using a biologically realistic spiking model of the full CBGT circuit, we demonstrate how this solution can allow a network to learn to select optimal targets and to relearn action-outcome contingencies when the environment changes. This simple illustration highlights how the normative framework for corticostriatal plasticity can be expanded to capture macroscopic network dynamics during learning and decision-making.
Repositori Institucional UIB
Publication Artículo científico (JournalArticle)

Reward-driven changes in striatal pathway competition shape evidence evaluation in decision-making

  • Dunovan, K.
  • Vich, C.
  • Clapp M.
  • Verstynen, T.
  • Rubin, J.
[eng] Cortico-basal-ganglia-thalamic (CBGT) networks are critical for adaptive decision-making, yet how changes to circuit-level properties impact cognitive algorithms remains unclear. Here we explore how dopaminergic plasticity at corticostriatal synapses alters competition between striatal pathways, impacting the evidence accumulation process during decisionmaking. Spike-timing dependent plasticity simulations showed that dopaminergic feedback based on rewards modified the ratio of direct and indirect corticostriatal weights within opposing action channels. Using the learned weight ratios in a full spiking CBGT network model, we simulated neural dynamics and decision outcomes in a reward-driven decision task and fit them with a drift diffusion model. Fits revealed that the rate of evidence accumulation varied with inter-channel differences in direct pathway activity while boundary height varied with overall indirect pathway activity. This multi-level modeling approach demonstrates how complementary learning and decision computations can emerge from corticostriatal plasticity