Predictive reward signal of dopamine neurons

Lesions of the lateral habenula excite dopamine neurons in the ventral tegmental area and serotonin neurons in the dorsal raphe nuclei in hemiparkinsonian rats

The lateral habenula (LHb) projects to the ventral tegmental area (VTA) and dorsal raphe nuclei (DRN) that deliver dopamine (DA) and serotonin (5-HT) to cortical and limbic regions such as the medial prefrontal cortex (mPFC), hippocampus and basolateral amygdala (BLA). Dysfunctions of VTA-related mesocorticolimbic dopaminergic and DRN-related serotonergic systems contribute to non-motor symptoms in Parkinson's disease (PD). However, how the LHb affects the VTA and DRN in PD remains unclear. Here, we used electrophysiological and neurochemical approaches to explore the effects of LHb lesions on the firing activity of VTA and DRN neurons, as well as the levels of DA and 5-HT in related brain regions in unilateral 6-hydroxydopamie (6-OHDA)-induced PD rats. We found that compared to sham lesions, lesions of the LHb increased the firing rate of DA neurons in the VTA and 5-HT neurons in the DRN, but decreased the firing rate of GABAergic neurons in the same nucleus. In addition, lesions of the LHb increased the levels of DA and 5-HT in the mPFC, ventral hippocampus and BLA compared to sham lesions. These findings suggest that lesions of the LHb enhance the activity of mesocorticolimbic dopaminergic and serotonergic systems in PD.

Reinforcement Learning May Demystify the Limited Human Motor Learning Efficacy Due to Visual-Proprioceptive Mismatch

Vision and proprioception have fundamental sensory mismatches in delivering locational information, and such mismatches are critical factors limiting the efficacy of motor learning. However, it is still not clear how and to what extent this mismatch limits motor learning outcomes. To further the understanding of the effect of sensory mismatch on motor learning outcomes, a reinforcement learning algorithm and the simplified biomechanical elbow joint model were employed to mimic the motor learning process in a computational environment. By applying a reinforcement learning algorithm to the motor learning of elbow joint flexion task, simulation results successfully explained how visual-proprioceptive mismatch limits motor learning outcomes in terms of motor control accuracy and task completion speed. The larger the perceived angular offset between the two sensory modalities, the lower the motor control accuracy. Also, the more similar the peak reward amplitude of the two sensory modalities, the lower the motor control accuracy. In addition, simulation results suggest that insufficient exploration rate limits task completion speed, and excessive exploration rate limits motor control accuracy. Such a speed-accuracy trade-off shows that a moderate exploration rate could serve as another important factor in motor learning.

Phasic Stimulation of Dopaminergic Neurons of the Lateral Substantia Nigra Increases Open Field Exploratory Behaviour and Reduces Habituation Over Time

Transient nigrostriatal dopaminergic signalling is well known for its role in reinforcement learning and increasingly so for its role in the initiation of voluntary movement. However, how transient bursts of dopamine modulate voluntary movement remains unclear, likely due to the heterogeneity of the nigrostriatal system, the focus of optogenetic studies on locomotion at sub-sec time intervals, and the overlapping roles of phasic dopamine in behaviour and novelty signalling. In this study we investigated how phasic activity in the lateral substantia nigra pars compacta (lateral SNc) over time affects voluntary behaviours during exploration. Using a transgenic mouse model of both sexes expressing channelrhodopsin (ChR2) in dopamine transporter-expressing cells, we stimulated the lateral SNc while mice explored an open field over two consecutive days. We found that phasic activation of the lateral SNc induced an increase in exploratory behaviours including horizontal movement activity, locomotion initiation, and rearing specifically on the first open field exposure, but not on the second day. In addition, stimulated animals did not habituate to the same extent as their ChR2-negative counterparts, as indicated by a lack of decrease in baseline activity. These findings suggest that rather than prompting voluntary movement in general, phasic nigrostriatal dopamine prompts context-appropriate behaviours. In addition, dopamine signalling that modulates movement acts over longer timescales than the transient signal, affecting behaviour even after the signal has ended.

Convergence of oxytocin and dopamine signalling in neuronal circuits: Insights into the neurobiology of social interactions across species

Social behaviour is essential for animal survival, and the hypothalamic neuropeptide oxytocin (OXT) critically impacts bonding, parenting, and decision-making. Dopamine (DA), is released by ventral tegmental area (VTA) dopaminergic neurons, regulating social cues in the mesolimbic system. Despite extensive exploration of OXT and DA roles in social behaviour independently, limited studies investigate their interplay. This narrative review integrates insights from human and animal studies, particularly rodents, emphasising recent research on pharmacological manipulations of OXT or DA systems in social behaviour. Additionally, we review studies correlating social behaviour with blood/cerebral OXT and DA levels. Behavioural facets include sociability, cooperation, pair bonding and parental care. In addition, we provide insights into OXT-DA interplay in animal models of social stress, autism, and schizophrenia. Emphasis is placed on the complex relationship between the OXT and DA systems and their collective influence on social behaviour across physiological and pathological conditions. Understanding OXT and DA imbalance is fundamental for unravelling the neurobiological underpinnings of social interaction and reward processing deficits observed in psychiatric conditions.

Evolution of reciprocity with limited payoff memory

Direct reciprocity is a mechanism for the evolution of cooperation in repeated social interactions. According to the literature, individuals naturally learn to adopt conditionally cooperative strategies if they have multiple encounters with their partner. Corresponding models have greatly facilitated our understanding of cooperation, yet they often make strong assumptions on how individuals remember and process payoff information. For example, when strategies are updated through social learning, it is commonly assumed that individuals compare their average payoffs. This would require them to compute (or remember) their payoffs against everyone else in the population. To understand how more realistic constraints influence direct reciprocity, we consider the evolution of conditional behaviours when individuals learn based on more recent experiences. Even in the most extreme case that they only take into account their very last interaction, we find that cooperation can still evolve. However, such individuals adopt less generous strategies, and they cooperate less often than in the classical setup with average payoffs. Interestingly, once individuals remember the payoffs of two or three recent interactions, cooperation rates quickly approach the classical limit. These findings contribute to a literature that explores which kind of cognitive capabilities are required for reciprocal cooperation. While our results suggest that some rudimentary form of payoff memory is necessary, it suffices to remember a few interactions.

The Mesocortical System Encodes the Strength of Subsequent Force Generation

Our minds impact motor outputs. Such mind-motor interactions are critical for understanding motor control mechanisms and optimizing motor performance. In particular, incentive motivation strongly enhances motor performance. Dopaminergic neurons located in the ventral midbrain (VM) are believed to be the center of incentive motivation. Direct projections from the VM to the primary motor cortex constitute a mesocortical pathway. However, the functional role of this pathway in humans remains unclear. Recently, we demonstrated the functional role of the mesocortical pathway in human motor control in the context of incentive motivation by using functional magnetic resonance imaging (fMRI). Incentive motivation remarkably improved not only reaction times but also the peak grip force in subsequent grip responses. Although the reaction time has been used as a proxy for incentive motivation mediated by dopaminergic midbrain activity, the premovement activity of the mesocortical pathway is involved in controlling the force strength rather than the initiation of subsequent force generation. In this commentary, we review our recent findings and discuss remaining questions regarding the functional role of the mesocortical pathway in mind-motor interactions.

Endogenous opioids in the olfactory tubercle and their roles in olfaction and quality of life

Olfactory dysfunctions decrease daily quality of life (QOL) in part by reducing the pleasure of eating. Olfaction plays an essential role in flavor sensation and palatability. The decreased QOL due to olfactory dysfunction is speculated to result from abnormal neural activities in the olfactory and limbic areas of the brain, as well as peripheral odorant receptor dysfunctions. However, the specific underlying neurobiological mechanisms remain unclear. As the olfactory tubercle (OT) is one of the brain's regions with high expression of endogenous opioids, we hypothesize that the mechanism underlying the decrease in QOL due to olfactory dysfunction involves the reduction of neural activity in the OT and subsequent endogenous opioid release in specialized subregions. In this review, we provide an overview and recent updates on the OT, the endogenous opioid system, and the pleasure systems in the brain and then discuss our hypothesis. To facilitate the effective treatment of olfactory dysfunctions and decreased QOL, elucidation of the neurobiological mechanisms underlying the pleasure of eating through flavor sensation is crucial.

New drug treatments for schizophrenia: a review of approaches to target circuit dysfunction

Schizophrenia is a leading cause of global disease burden. Current drug treatments are associated with significant side-effects and have limited efficacy for many patients; highlighting the need to develop new approaches that target other aspects of the neurobiology of schizophrenia. Preclinical, in vivo imaging, post-mortem, genetic and pharmacological studies have highlighted the key role of cortical GABA-glutamatergic microcircuits and their projections to subcortical dopaminergic circuits in the pathoetiology of negative, cognitive and psychotic symptoms. Antipsychotics primarily act downstream of the dopaminergic component of this circuit. However, multiple drugs are currently in development that could target other elements of this circuit to treat schizophrenia. These include drugs for GABA or glutamatergic targets, including glycine transporters, d-amino acid oxidase, sodium channels or potassium channels. Other drugs in development are likely to primarily act on pathways that regulate the dopaminergic system such as muscarinic or trace amine receptors or serotonin 2A receptors, whilst phosphodiesterase 10 A inhibitors are being developed to modulate the downstream consequences of dopaminergic dysfunction. Our review considers where new drugs may act on this circuit and their latest clinical trial evidence in terms of indication, efficacy and side-effects. Limitations of the circuit model, including whether there are neurobiologically distinct subgroups of patients, and future directions are also considered. Several drugs based on the mechanisms reviewed have promising clinical data, with the muscarinic agonist KarXT most advanced. If they are approved for clinical use, they have the potential to revolutionise understanding of the pathophysiology and treatment of schizophrenia.

Consensus Paper: Cerebellum and Reward

Cerebellum is a key-structure for the modulation of motor, cognitive, social and affective functions, contributing to automatic behaviours through interactions with the cerebral cortex, basal ganglia and spinal cord. The predictive mechanisms used by the cerebellum cover not only sensorimotor functions but also reward-related tasks. Cerebellar circuits appear to encode temporal difference error and reward prediction error. From a chemical standpoint, cerebellar catecholamines modulate the rate of cerebellar-based cognitive learning, and mediate cerebellar contributions during complex behaviours. Reward processing and its associated emotions are tuned by the cerebellum which operates as a controller of adaptive homeostatic processes based on interoceptive and exteroceptive inputs. Lobules VI-VII/areas of the vermis are candidate regions for the cortico-subcortical signaling pathways associated with loss aversion and reward sensitivity, together with other nodes of the limbic circuitry. There is growing evidence that the cerebellum works as a hub of regional dysconnectivity across all mood states and that mental disorders involve the cerebellar circuitry, including mood and addiction disorders, and impaired eating behaviors where the cerebellum might be involved in longer time scales of prediction as compared to motor operations. Cerebellar patients exhibit aberrant social behaviour, showing aberrant impulsivity/compulsivity. The cerebellum is a master-piece of reward mechanisms, together with the striatum, ventral tegmental area (VTA) and prefrontal cortex (PFC). Critically, studies on reward processing reinforce our view that a fundamental role of the cerebellum is to construct internal models, perform predictions on the impact of future behaviour and compare what is predicted and what actually occurs.

Mesolimbic Neural Response Dynamics Predict Future Individual Alcohol Drinking in Mice

BACKGROUND

Individual variability in response to rewarding stimuli is a striking but understudied phenomenon. The mesolimbic dopamine system is critical in encoding the reinforcing properties of both natural reward and alcohol; however, how innate or baseline differences in the response dynamics of this circuit define individual behavior and shape future vulnerability to alcohol remain unknown.

METHODS

Using naturalistic behavioral assays, a voluntary alcohol drinking paradigm, in vivo fiber photometry, in vivo electrophysiology, and chemogenetics, we investigated how differences in mesolimbic neural circuit activity contribute to the individual variability seen in reward processing and, by proxy, alcohol drinking.

RESULTS

We first characterized heterogeneous behavioral and neural responses to natural reward and defined how these baseline responses predicted future individual alcohol-drinking phenotypes in male mice. We then determined spontaneous ventral tegmental area dopamine neuron firing profiles associated with responses to natural reward that predicted alcohol drinking. Using a dual chemogenetic approach, we mimicked specific mesolimbic dopamine neuron firing activity before or during voluntary alcohol drinking to link unique neurophysiological profiles to individual phenotype. We show that hyperdopaminergic individuals exhibit a lower neuronal response to both natural reward and alcohol that predicts lower levels of alcohol consumption in the future.

CONCLUSIONS

These findings reveal unique, circuit-specific neural signatures that predict future individual vulnerability or resistance to alcohol and expand the current knowledge base on how some individuals are able to titrate their alcohol consumption whereas others go on to engage in unhealthy alcohol-drinking behaviors.

A dopamine mechanism for reward maximization

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

CBGTPy: An extensible cortico-basal ganglia-thalamic framework for modeling biological decision making

Here we introduce CBGTPy, a virtual environment for designing and testing goal-directed agents with internal dynamics that are modeled on the cortico-basal-ganglia-thalamic (CBGT) pathways in the mammalian brain. CBGTPy enables researchers to investigate the internal dynamics of the CBGT system during a variety of tasks, allowing for the formation of testable predictions about animal behavior and neural activity. The framework has been designed around the principle of flexibility, such that many experimental parameters in a decision making paradigm can be easily defined and modified. Here we demonstrate the capabilities of CBGTPy across a range of single and multi-choice tasks, highlighting the ease of set up and the biologically realistic behavior that it produces. We show that CBGTPy is extensible enough to apply to a range of experimental protocols and to allow for the implementation of model extensions with minimal developmental effort.

Author summary

We introduce a toolbox for producing biologically realistic simulations of the cortico-basal ganglia-thalamic dynamics during a variety of experimental tasks. The purpose is to foster the theory-experiment cycle, offering a tool for generating testable predictions of behavioral and neural responses that can be validated experimentally, in a framework that allows for simple updating as new experimental evidence emerges. We outline how our toolbox works and demonstrate its performance on a set of normative cognitive tasks.

Reward perseveration is shaped by GABA A -mediated dopamine pauses

Extinction learning is an essential form of cognitive flexibility, which enables obsolete reward associations to be discarded. Its downregulation can lead to perseveration, a symptom seen in several neuropsychiatric disorders. This balance is regulated by dopamine from VTA DA (ventral tegmental area dopamine) neurons, which in turn are largely controlled by GABA (gamma amino-butyric acid) synapses. However, the causal relationship of these circuit elements to extinction and perseveration remain incompletely understood. Here, we employ an innovative drug-targeting technology, DART (drug acutely restricted by tethering), to selectively block GABA A receptors on VTA DA neurons as mice engage in Pavlovian learning. DART eliminated GABA A -mediated pauses-brief decrements in VTA DA activity canonically thought to drive extinction learning. However, contrary to the hypothesis that blocking VTA DA pauses should eliminate extinction learning, we observed the opposite-accelerated extinction learning. Specifically, DART eliminated the naturally occurring perseveration seen in half of control mice. We saw no impact on Pavlovian conditioning, nor on other aspects of VTA DA neural firing. These findings challenge canonical theories, recasting GABA A -mediated VTA DA pauses from presumed facilitators of extinction to drivers of perseveration. More broadly, this study showcases the merits of targeted synaptic pharmacology, while hinting at circuit interventions for pathological perseveration.

Physiological paradigm for assessing reward prediction and extinction using cortical direct current potential responses in rats

Anticipating positive outcomes is a core cognitive function in the process of reward prediction. However, no neurophysiological method objectively assesses reward prediction in basic medical research. In the present study, we established a physiological paradigm using cortical direct current (DC) potential responses in rats to assess reward prediction. This paradigm consisted of five daily 1-h sessions with two tones, wherein the rewarded tone was followed by electrical stimulation of the medial forebrain bundle (MFB) scheduled at 1000 ms later, whereas the unrewarded tone was not. On day 1, both tones induced a negative DC shift immediately after auditory responses, persisting up to MFB stimulation. This negative shift progressively increased and peaked on day 4. Starting from day 3, the negative shift from 600 to 1000 ms was significantly larger following the rewarded tone than that following the unrewarded tone. This negative DC shift was particularly prominent in the frontal cortex, suggesting its crucial role in discriminative reward prediction. During the extinction sessions, the shift diminished significantly on extinction day 1. These findings suggest that cortical DC potential is related to reward prediction and could be a valuable tool for evaluating animal models of depression, providing a testing system for anhedonia.

Using Drift Diffusion and RL Models to Disentangle Effects of Depression On Decision-Making vs. Learning in the Probabilistic Reward Task

The Probabilistic Reward Task (PRT) is widely used to investigate the impact of Major Depressive Disorder (MDD) on reinforcement learning (RL), and recent studies have used it to provide insight into decision-making mechanisms affected by MDD. The current project used PRT data from unmedicated, treatment-seeking adults with MDD to extend these efforts by: (1) providing a more detailed analysis of standard PRT metrics-response bias and discriminability-to better understand how the task is performed; (2) analyzing the data with two computational models and providing psychometric analyses of both; and (3) determining whether response bias, discriminability, or model parameters predicted responses to treatment with placebo or the atypical antidepressant bupropion. Analysis of standard metrics replicated recent work by demonstrating a dependency between response bias and response time (RT), and by showing that reward totals in the PRT are governed by discriminability. Behavior was well-captured by the Hierarchical Drift Diffusion Model (HDDM), which models decision-making processes; the HDDM showed excellent internal consistency and acceptable retest reliability. A separate "belief" model reproduced the evolution of response bias over time better than the HDDM, but its psychometric properties were weaker. Finally, the predictive utility of the PRT was limited by small samples; nevertheless, depressed adults who responded to bupropion showed larger pre-treatment starting point biases in the HDDM than non-responders, indicating greater sensitivity to the PRT's asymmetric reinforcement contingencies. Together, these findings enhance our understanding of reward and decision-making mechanisms that are implicated in MDD and probed by the PRT.

Updating functional brain units: Insights far beyond Luria

This paper reviews Luria's model of the three functional units of the brain. To meet this objective, several issues were reviewed: the theory of functional systems and the contributions of phylogenesis and embryogenesis to the brain's functional organization. This review revealed several facts. In the first place, the relationship/integration of basic homeostatic needs with complex forms of behavior. Secondly, the multi-scale hierarchical and distributed organization of the brain and interactions between cells and systems. Thirdly, the phylogenetic role of exaptation, especially in basal ganglia and cerebellum expansion. Finally, the tripartite embryogenetic organization of the brain: rhinic, limbic/paralimbic, and supralimbic zones. Obviously, these principles of brain organization are in contradiction with attempts to establish separate functional brain units. The proposed new model is made up of two large integrated complexes: a primordial-limbic complex (Luria's Unit I) and a telencephalic-cortical complex (Luria's Units II and III). As a result, five functional units were delineated: Unit I. Primordial or preferential (brainstem), for life-support, behavioral modulation, and waking regulation; Unit II. Limbic and paralimbic systems, for emotions and hedonic evaluation (danger and relevance detection and contribution to reward/motivational processing) and the creation of cognitive maps (contextual memory, navigation, and generativity [imagination]); Unit III. Telencephalic-cortical, for sensorimotor and cognitive processing (gnosis, praxis, language, calculation, etc.), semantic and episodic (contextual) memory processing, and multimodal conscious agency; Unit IV. Basal ganglia systems, for behavior selection and reinforcement (reward-oriented behavior); Unit V. Cerebellar systems, for the prediction/anticipation (orthometric supervision) of the outcome of an action. The proposed brain units are nothing more than abstractions within the brain's simultaneous and distributed physiological processes. As function transcends anatomy, the model necessarily involves transition and overlap between structures. Beyond the classic approaches, this review includes information on recent systemic perspectives on functional brain organization. The limitations of this review are discussed.

PET/CT study of dopamine transporter (DAT) binding with the triple reuptake inhibitor toludesvenlafaxine in rats and humans

PURPOSE

Toludesvenlafaxine is a recently developed antidepressant that belongs to the triple reuptake inhibitor class. Despite the in vitro evidence that toludesvenlafaxine inhibits the reuptake of serotonin (5-HT), norepinephrine (NE) and dopamine (DA), there is no in vivo evidence that toludesvenlafaxine binds to DAT and increases DA level, a mechanism thought to contribute to its favorable clinical performance.

METHODS

Positron emission tomography/computed tomography (PET/CT) was used to examine the DAT binding capacity in healthy rats and human subjects and microdialysis was used to examine the striatal DA level in rats. [18F]FECNT and [11C]CFT were used as PET/CT radioactive tracer for rat and human studies, respectively.

RESULTS

In rats, 9 mg/kg of toludesvenlafaxine hydrochloride (i.v.) followed by an infusion of 3 mg/kg via minipump led to the binding rate to striatum DAT at 3.7 - 32.41% and to hypothalamus DAT at 5.91 - 17.52% during the 45 min scanning period. 32 mg/kg oral administration with toludesvenlafaxine hydrochloride significantly increased the striatal DA level with the AUC0 - 180 min increased by 63.9%. In healthy volunteers, 160 mg daily toludesvenlafaxine hydrochloride sustained-release tablets for 4 days led to an average occupancy rates of DAT at 8.04% ± 7.75% and 8.09% ± 7.00%, respectively, in basal ganglion 6 h and 10 h postdose.

CONCLUSION

These results represent the first to confirm the binding of toludesvenlafaxine to DAT in both rats and humans using PET/CT, and its elevation of brain DA level, which may help understand the unique pharmacological and functional effects of triple reuptake inhibitors such as toludesvenlafaxine.

CLINICALTRIALS

GOV IDENTIFIERS

NCT05905120. Registered 14 June 2023. (retrospectively registered).

Stimulus valence moderates self-learning

Self-relevance has been demonstrated to impair instrumental learning. Compared to unfamiliar symbols associated with a friend, analogous stimuli linked with the self are learned more slowly. What is not yet understood, however, is whether this effect extends beyond arbitrary stimuli to material with intrinsically meaningful properties. Take, for example, stimulus valence an established moderator of self-bias. Does the desirability of to-be-learned material influence self-learning? Here, in conjunction with computational modelling (i.e. Reinforcement Learning Drift Diffusion Model analysis), a probabilistic selection task was used to establish if and how stimulus valence (i.e. desirable/undesirable posters) impacts the acquisition of knowledge relating to object-ownership (i.e. owned-by-self vs. owned-by-friend). Several interesting results were observed. First, undesirable posters were learned more rapidly for self compared to friend, an effect that was reversed for desirable posters. Second, learning rates were accompanied by associated differences in reward sensitivity toward desirable and undesirable choice selections as a function of ownership. Third, decisional caution was greater for self-relevant (vs. friend relevant) responses. Collectively, these findings inform understanding of self-function and how valence and stimulus relevance mutually influence probabilistic learning.

Learning the value of experience

This scientific commentary refers to ‘Impaired value-based decision-making in Parkinson’s disease apathy’ by Gilmour et al. (https://doi.org/10.1093/brain/awae025).

Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories

To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing; VTADA→BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision-making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.

Dopamine transients follow a striatal gradient of reward time horizons

Animals make predictions to guide their behavior and update those predictions through experience. Transient increases in dopamine (DA) are thought to be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales-from seconds or less (for example, if singing a song) to potentially hours or more (for example, if hunting for food). Here we report that DA transients in distinct rat striatal subregions convey prediction errors based on distinct time horizons. DA dynamics systematically accelerated from ventral to dorsomedial to dorsolateral striatum, in the tempo of spontaneous fluctuations, the temporal integration of prior rewards and the discounting of future rewards. This spectrum of timescales for evaluative computations can help achieve efficient learning and adaptive motivation for a broad range of behaviors.

Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration

When facing an unfamiliar environment, animals need to explore to gain new knowledge about which actions provide reward, but also put the newly acquired knowledge to use as quickly as possible. Optimal reinforcement learning strategies should therefore assess the uncertainties of these action-reward associations and utilise them to inform decision making. We propose a novel model whereby direct and indirect striatal pathways act together to estimate both the mean and variance of reward distributions, and mesolimbic dopaminergic neurons provide transient novelty signals, facilitating effective uncertainty-driven exploration. We utilised electrophysiological recording data to verify our model of the basal ganglia, and we fitted exploration strategies derived from the neural model to data from behavioural experiments. We also compared the performance of directed exploration strategies inspired by our basal ganglia model with other exploration algorithms including classic variants of upper confidence bound (UCB) strategy in simulation. The exploration strategies inspired by the basal ganglia model can achieve overall superior performance in simulation, and we found qualitatively similar results in fitting model to behavioural data compared with the fitting of more idealised normative models with less implementation level detail. Overall, our results suggest that transient dopamine levels in the basal ganglia that encode novelty could contribute to an uncertainty representation which efficiently drives exploration in reinforcement learning.

Brain state-dependent responses of midbrain dopaminergic neurons to footshock under urethane anaesthesia

For a long time, it has been assumed that dopaminergic (DA) neurons in both the ventral tegmental area (VTA) and the substantia nigra pars compacta (SNc) uniformly respond to rewarding and aversive stimuli by either increasing or decreasing their activity, respectively. This response was believed to signal information about the perceived stimuli's values. The identification of VTA&SNc DA neurons that are excited by both rewarding and aversive stimuli has led to the categorisation of VTA&SNc DA neurons into two subpopulations: one signalling the value and the other signalling the salience of the stimuli. It has been shown that the general state of the brain can modulate the electrical activity of VTA&SNc DA neurons, but it remains unknown whether this factor may also influence responses to aversive stimuli, such as a footshock (FS). To address this question, we have recorded the responses of VTA&SNc DA neurons to FSs across cortical activation and slow wave activity brain states in urethane-anaesthetised rats. Adding to the knowledge of aversion signalling by midbrain DA neurons, we report that significant proportion of VTA&SNc DA neurons can change their responses to an aversive stimulus in a brain state-dependent manner. The majority of these neurons decreased their activity in response to FS during cortical activation but switched to increasing it during slow wave activity. It can be hypothesised that this subpopulation of DA neurons may be involved in the 'dual signalling' of both the value and the salience of the stimuli, depending on the general state of the brain.

Predictive coding networks for temporal prediction

One of the key problems the brain faces is inferring the state of the world from a sequence of dynamically changing stimuli, and it is not yet clear how the sensory system achieves this task. A well-established computational framework for describing perceptual processes in the brain is provided by the theory of predictive coding. Although the original proposals of predictive coding have discussed temporal prediction, later work developing this theory mostly focused on static stimuli, and key questions on neural implementation and computational properties of temporal predictive coding networks remain open. Here, we address these questions and present a formulation of the temporal predictive coding model that can be naturally implemented in recurrent networks, in which activity dynamics rely only on local inputs to the neurons, and learning only utilises local Hebbian plasticity. Additionally, we show that temporal predictive coding networks can approximate the performance of the Kalman filter in predicting behaviour of linear systems, and behave as a variant of a Kalman filter which does not track its own subjective posterior variance. Importantly, temporal predictive coding networks can achieve similar accuracy as the Kalman filter without performing complex mathematical operations, but just employing simple computations that can be implemented by biological networks. Moreover, when trained with natural dynamic inputs, we found that temporal predictive coding can produce Gabor-like, motion-sensitive receptive fields resembling those observed in real neurons in visual areas. In addition, we demonstrate how the model can be effectively generalized to nonlinear systems. Overall, models presented in this paper show how biologically plausible circuits can predict future stimuli and may guide research on understanding specific neural circuits in brain areas involved in temporal prediction.

Blood pressure response to extended-release naltrexone in heroin and prescription opioid users and its implications for cardiovascular morbidity

BACKGROUND

Consuming opioid agonists is a risk factor for cardiovascular disease particularly in intravenous heroin users. The monthly injectable extended-release opioid antagonist, naltrexone (XR-NTX) is an effective treatment for opioid use disorder. The impact of opioid receptor blockade through XR-NTX on blood pressure, a critical risk factor for cardiovascular morbidity, has not yet been characterized.

METHODS

The study evaluated the change in blood pressure during XR-NTX treatment among 14 patients who predominately used intravenous heroin and 24 patients who used prescription oral opioids, all with opioid use disorder. Blood pressure was measured in each patient immediately before the first XR-NTX injection and ∼two weeks after the first injection. The change in diastolic and systolic pressure was compared between the heroin users and the prescription opioids users using analysis of variance.

RESULTS

XR-NTX treatment was associated with significant decreases in diastolic blood pressure in the heroin group, but not in the prescription opioids group. Systolic blood pressure values in the heroin users showed a decline at trend level only.

CONCLUSIONS

Further research is warranted to replicate our findings and to determine whether XR-NTX effect is relatively specific to blood pressure or generalizes to other components of metabolic syndrome. Distinguishing between heroin and prescription opioid users could shed light on the unique clinical and pharmacological profiles of opioid drugs, particularly regarding their cardiovascular safety. This information can be useful in developing personalized therapeutic strategies based on the route of opioid administration.

Continuous Bump Attractor Networks Require Explicit Error Coding for Gain Recalibration

Representations of continuous variables are crucial to create internal models of the external world. A prevailing model of how the brain maintains these representations is given by continuous bump attractor networks (CBANs) in a broad range of brain functions across different areas, such as spatial navigation in hippocampal/entorhinal circuits and working memory in prefrontal cortex. Through recurrent connections, a CBAN maintains a persistent activity bump, whose peak location can vary along a neural space, corresponding to different values of a continuous variable. To track the value of a continuous variable changing over time, a CBAN updates the location of its activity bump based on inputs that encode the changes in the continuous variable (e.g., movement velocity in the case of spatial navigation)-a process akin to mathematical integration. This integration process is not perfect and accumulates error over time. For error correction, CBANs can use additional inputs providing ground-truth information about the continuous variable's correct value (e.g., visual landmarks for spatial navigation). These inputs enable the network dynamics to automatically correct any representation error. Recent experimental work on hippocampal place cells has shown that, beyond correcting errors, ground-truth inputs also fine-tune the gain of the integration process, a crucial factor that links the change in the continuous variable to the updating of the activity bump's location. However, existing CBAN models lack this plasticity, offering no insights into the neural mechanisms and representations involved in the recalibration of the integration gain. In this paper, we explore this gap by using a ring attractor network, a specific type of CBAN, to model the experimental conditions that demonstrated gain recalibration in hippocampal place cells. Our analysis reveals the necessary conditions for neural mechanisms behind gain recalibration within a CBAN. Unlike error correction, which occurs through network dynamics based on ground-truth inputs, gain recalibration requires an additional neural signal that explicitly encodes the error in the network's representation via a rate code. Finally, we propose a modified ring attractor network as an example CBAN model that verifies our theoretical findings. Combining an error-rate code with Hebbian synaptic plasticity, this model achieves recalibration of integration gain in a CBAN, ensuring accurate representation for continuous variables.

Learning attentional templates for value-based decision-making

Attention filters sensory inputs to enhance task-relevant information. It is guided by an "attentional template" that represents the stimulus features that are currently relevant. To understand how the brain learns and uses templates, we trained monkeys to perform a visual search task that required them to repeatedly learn new attentional templates. Neural recordings found that templates were represented across the prefrontal and parietal cortex in a structured manner, such that perceptually neighboring templates had similar neural representations. When the task changed, a new attentional template was learned by incrementally shifting the template toward rewarded features. Finally, we found that attentional templates transformed stimulus features into a common value representation that allowed the same decision-making mechanisms to deploy attention, regardless of the identity of the template. Altogether, our results provide insight into the neural mechanisms by which the brain learns to control attention and how attention can be flexibly deployed across tasks.

Lateral hypothalamic GABAergic neurons encode alcohol memories

In alcohol use disorder, the alcohol memories persist during abstinence, and exposure to stimuli associated with alcohol use can lead to relapse. This highlights the importance of investigating the neural substrates underlying not only relapse but also encoding and expression of alcohol memories. GABAergic neurons in the lateral hypothalamus (LH-GABA) have been shown to be critical for food-cue memories and motivation; however, the extent to which this role extends to alcohol-cue memories and motivations remains unexplored. In this study, we aimed to describe how alcohol-related memories are encoded and expressed in LH GABAergic neurons. Our first step was to monitor LH-GABA calcium transients during acquisition, extinction, and reinstatement of an alcohol-cue memory using fiber photometry. We trained the rats on a Pavlovian conditioning task, where one conditioned stimulus (CS+) predicted alcohol (20% EtOH) and another conditioned stimulus (CS-) had no outcome. We then extinguished this association through non-reinforced presentations of the CS+ and CS- and finally, in two different groups, we measured relapse under non-primed and alcohol-primed induced reinstatement. Our results show that initially both cues caused increased LH-GABA activity, and after learning only the alcohol cue increased LH-GABA activity. After extinction, this activity decreases, and we found no differences in LH-GABA activity during reinstatement in either group. Next, we inhibited LH-GABA neurons with optogenetics to show that activity of these neurons is necessary for the formation of an alcohol-cue association. These findings suggest that LH-GABA might be involved in attentional processes modulated by learning.

Organization of reward and movement signals in the basal ganglia and cerebellum

The basal ganglia and the cerebellum are major subcortical structures in the motor system. The basal ganglia have been cast as the reward center of the motor system, whereas the cerebellum is thought to be involved in adjusting sensorimotor parameters. Recent findings of reward signals in the cerebellum have challenged this dichotomous view. To compare the basal ganglia and the cerebellum directly, we recorded from oculomotor regions in both structures from the same monkeys. We partitioned the trial-by-trial variability of the neurons into reward and eye-movement signals to compare the coding across structures. Reward expectation and movement signals were the most pronounced in the output structure of the basal ganglia, intermediate in the cerebellum, and the smallest in the input structure of the basal ganglia. These findings suggest that reward and movement information is sharpened through the basal ganglia, resulting in a higher signal-to-noise ratio than in the cerebellum.

Dendritic spines and their role in the pathogenesis of neurodevelopmental and neurological disorders

Since Cajal introduced dendritic spines in the 19th century, they have attained considerable attention, especially in neuropsychiatric and neurologic disorders. Multiple roles of dendritic spine malfunction and pathology in the progression of various diseases have been reported. Thus, it is inevitable to consider these structures as new therapeutic targets for treating neuropsychiatric and neurologic disorders such as autism spectrum disorders, schizophrenia, dementia, Down syndrome, etc. Therefore, we attempted to prepare a narrative review of the literature regarding the role of dendritic spines in the pathogenesis of aforementioned diseases and to shed new light on their pathophysiology.

Proactive Versus Reactive Control Strategies Differentially Mediate Alcohol Drinking in Male Wistars and P Rats

Problematic alcohol consumption is associated with deficits in decision-making and alterations in prefrontal cortex neural activity likely contribute. We hypothesized that the differences in cognitive control would be evident between male Wistars and a model of genetic risk: alcohol-preferring P rats. Cognitive control is split into proactive and reactive components. Proactive control maintains goal-directed behavior independent of a stimulus, whereas reactive control elicits goal-directed behavior at the time of a stimulus. We hypothesized that Wistars would show proactive control over alcohol seeking whereas P rats would show reactive control over alcohol seeking. Neural activity was recorded from the prefrontal cortex during an alcohol seeking task with two session types. On congruent sessions, the conditioned stimulus (CS+) was on the same side as alcohol access. Incongruent sessions presented alcohol opposite the CS+. Wistars, but not P rats, made more incorrect approaches during incongruent sessions, suggesting that Wistars utilized the previously learned rule. This motivated the hypothesis that neural activity reflecting proactive control would be observable in Wistars but not P rats. While P rats showed differences in neural activity at times of alcohol access, Wistars showed differences prior to approaching the sipper. These results support our hypothesis that Wistars are more likely to engage in proactive cognitive control strategies whereas P rats are more likely to engage in reactive cognitive control strategies. Although P rats were bred to prefer alcohol, the differences in cognitive control may reflect a sequela of behaviors that mirror those in humans at risk for an AUD.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

Alterations in type 2 dopamine receptors across neuropsychiatric conditions: A large-scale PET cohort

PURPOSE

Aberrant dopaminergic function is linked with motor, psychotic, and affective symptoms, but studies have typically compared a single patient group with healthy controls.

METHODS

Here, we investigated the variation in striatal (caudate nucleus, nucleus accumbens, and putamen) and thalamic type 2 dopamine receptor (D2R) availability using [11C]raclopride positron emission tomography (PET) data from a large sample of 437 humans including healthy controls, and subjects with Parkinson's disease (PD), antipsychotic-naïve schizophrenia, severe violent behavior, pathological gambling, depression, and overweight. We analyzed regional group differences in D2R availability. We also analyzed the interregional correlation in D2R availability within each group.

RESULTS

Subjects with PD showed the clearest decline in D2R availability. Overall, the groups showed high interregional correlation in D2R availability, while this pattern was weaker in violent offenders. Subjects with schizophrenia, pathological gambling, depression, or overweight did not show clear changes in either the regional receptor availability or the interregional correlation.

CONCLUSION

We conclude that the dopaminergic changes in neuropsychiatric conditions might not only affect the overall receptor availability but also how coupled regions are across people. The region-specific receptor availability more profoundly links to the motor symptoms, while the between-region coupling might be disrupted in violence.

Dopamine D2 receptors in WFS1-neurons regulate food-seeking and avoidance behaviors

The selection and optimization of appropriate adaptive responses depends on interoceptive and exteroceptive stimuli as well as on the animal's ability to switch from one behavioral strategy to another. Although growing evidence indicate that dopamine D2R-mediated signaling events ensure the selection of the appropriate strategy for each specific situation, the underlying neural circuits through which they mediate these effects are poorly characterized. Here, we investigated the role of D2R signaling in a mesolimbic neuronal subpopulation expressing the Wolfram syndrome 1 (Wfs1) gene. This subpopulation is located within the nucleus accumbens, the central amygdala, the bed nucleus of the stria terminalis, and the tail of the striatum, all brain regions critical for the regulation of emotions and motivated behaviors. Using a mouse model carrying a temporally controlled deletion of D2R in WFS1-neurons, we demonstrate that intact D2R signaling in this neuronal population is necessary to regulate homeostasis-dependent food-seeking behaviors in both male and female mice. In addition, we found that reduced D2R signaling in WFS1-neurons impaired active avoidance learning and innate escape responses. Collectively, these findings identify a yet undocumented role for D2R signaling in WFS1-neurons as a novel effector through which dopamine optimizes appetitive behaviors and regulates defensive behaviors.

Medicalization of Neurodivergence and the Embodied Experience of ADHD

Medicalization shapes, and in some cases legitimizes, individuals' embodied experiences even as it molds the landscape of healthcare and treatment. In this essay I provide a layered account that moves between my experiences as a neurodivergent person and academic theorizing to explore how processes of medicalization inform public discourses and personal sensemaking. In the case of ADHD, medicalization has contributed to societal narratives that focus on symptoms of hyperactivity rather than the etiology of dopamine dysregulation. Such narratives fail to fully account for the lived experience of ADHD and inadvertently stigmatize neurodivergent individuals. I urge scholars and practitioners to direct more attention to the communicative dimensions of medicalization including both the rhetorical nature of the diagnostic process and how diagnoses, in turn, are rhetorically framed with varying consequences.

Impaired striatal glutamate/GABA regulation in violent offenders with antisocial personality disorder and psychopathy

Men with antisocial personality disorder (ASPD) with or without psychopathy (+/-P) are responsible for most violent crime in society. Development of effective treatments is hindered by poor understanding of the neurochemical underpinnings of the condition. Men with ASPD with and without psychopathy demonstrate impulsive decision-making, associated with striatal abnormalities in functional neuroimaging studies. However, to date, no study has directly examined the potential neurochemical underpinnings of such abnormalities. We therefore investigated striatal glutamate: GABA ratio using Magnetic Resonance Spectroscopy in 30 violent offenders (16 ASPD-P, 14 ASPD + P) and 21 healthy non-offenders. Men with ASPD +/- P had a significant reduction in striatal glutamate : GABA ratio compared to non-offenders. We report, for the first time, striatal Glutamate/GABA dysregulation in ASPD +/- P, and discuss how this may be related to core behavioral abnormalities in the disorders.

Fast adaptation to rule switching using neuronal surprise

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signal is extracted from an increase in neural activity after an imbalance of excitation and inhibition. The surprise signal modulates synaptic plasticity via a three-factor learning rule which increases plasticity at moments of surprise. The surprise signal remains small when transitions between sensory events follow a previously learned rule but increases immediately after rule switching. In a spiking network with several modules, previously learned rules are protected against overwriting, as long as the number of modules is larger than the total number of rules-making a step towards solving the stability-plasticity dilemma in neuroscience. Our model relates the subjective notion of surprise to specific predictions on the circuit level.

A Systematic Review of Direct Outputs from the Cerebellum to the Brainstem and Diencephalon in Mammals

The cerebellum is involved in many motor, autonomic and cognitive functions, and new tasks that have a cerebellar contribution are discovered on a regular basis. Simultaneously, our insight into the functional compartmentalization of the cerebellum has markedly improved. Additionally, studies on cerebellar output pathways have seen a renaissance due to the development of viral tracing techniques. To create an overview of the current state of our understanding of cerebellar efferents, we undertook a systematic review of all studies on monosynaptic projections from the cerebellum to the brainstem and the diencephalon in mammals. This revealed that important projections from the cerebellum, to the motor nuclei, cerebral cortex, and basal ganglia, are predominantly di- or polysynaptic, rather than monosynaptic. Strikingly, most target areas receive cerebellar input from all three cerebellar nuclei, showing a convergence of cerebellar information at the output level. Overall, there appeared to be a large level of agreement between studies on different species as well as on the use of different types of neural tracers, making the emerging picture of the cerebellar output areas a solid one. Finally, we discuss how this cerebellar output network is affected by a range of diseases and syndromes, with also non-cerebellar diseases having impact on cerebellar output areas.

Dynamic behaviour restructuring mediates dopamine-dependent credit assignment

Animals exhibit a diverse behavioural repertoire when exploring new environments and can learn which actions or action sequences produce positive outcomes. Dopamine release after encountering a reward is critical for reinforcing reward-producing actions1-3. However, it has been challenging to understand how credit is assigned to the exact action that produced the dopamine release during continuous behaviour. Here we investigated this problem in mice using a self-stimulation paradigm in which specific spontaneous movements triggered optogenetic stimulation of dopaminergic neurons. Dopamine self-stimulation rapidly and dynamically changes the structure of the entire behavioural repertoire. Initial stimulations reinforced not only the stimulation-producing target action, but also actions similar to the target action and actions that occurred a few seconds before stimulation. Repeated pairings led to a gradual refinement of the behavioural repertoire to home in on the target action. Reinforcement of action sequences revealed further temporal dependencies of refinement. Action pairs spontaneously separated by long time intervals promoted a stepwise credit assignment, with early refinement of actions most proximal to stimulation and subsequent refinement of more distal actions. Thus, a retrospective reinforcement mechanism promotes not only reinforcement, but also gradual refinement of the entire behavioural repertoire to assign credit to specific actions and action sequences that lead to dopamine release.

Prediction error in dopamine neurons during associative learning

Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine's computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.

Amygdalo-nigral inputs target dopaminergic and GABAergic neurons in the primate: a view from dendrites and soma

The central nucleus (CeN) of the amygdala is an important afferent to the DA system that mediates motivated learning. We previously found that CeN terminals in nonhuman primates primarily overlap the elongated lateral VTA (parabrachial pigmented nucleus, PBP, A10), and retrorubral field(A8) subregion. Here, we examined CeN afferent contacts on cell somata and proximal dendrites of DA and GABA neurons, and distal dendrites of each, using confocal and electron microscopy (EM) methods, respectively. At the soma/proximal dendrites, the proportion of TH+ and GAD1+ cells receiving at least one CeN afferent contact was surprisingly similar (TH = 0.55: GAD1=0.55 in PBP; TH = 0.56; GAD1 =0.51 in A8), with the vast majority of contacted TH+ and GAD1+ soma/proximal dendrites received 1-2 contacts. Similar numbers of tracer-labeled terminals also contacted TH-positive and GAD1-positive small dendrites and/or spines (39% of all contacted dendrites were either TH- or GAD1-labeled). Overall, axon terminals had more symmetric (putative inhibitory) axonal contacts with no difference in the relative distribution in the PBP versus A8, or onto TH+ versus GAD1+ dendrites/spines in either region. The striking uniformity in the amygdalonigral projection across the PBP-A8 terminal field suggests that neither neurotransmitter phenotype nor midbrain location dictates likelihood of a terminal contact. We discuss how this afferent uniformity can play out in recently discovered differences in DA:GABA cell densities between the PBP and A8, and affect specific outputs.

Significance statement

The amygdala's central nucleus (CeN) channels salient cues to influence both appetitive and aversive responses via DA outputs. In higher species, the broad CeN terminal field overlaps the parabrachial pigmented nucleus ('lateral A10') and the retrorubral field (A8). We quantified terminal contacts in each region on DA and GABAergic soma/proximal dendrites and small distal dendrites. There was striking uniformity in contacts on DA and GABAergic cells, regardless of soma and dendritic compartment, in both regions. Most contacts were symmetric (putative inhibitory) with little change in the ratio of inhibitory to excitatory contacts by region.We conclude that post-synaptic shifts in DA-GABA ratios are key to understanding how these relatively uniform inputs can produce diverse effects on outputs.

Altered neural activity in the reward-related circuit associated with anhedonia in mild to moderate Major Depressive Disorder

BACKGROUND

Anhedonia is a significant predictor of disease progression and treatment outcomes in Major Depressive Disorder (MDD), linked to reward network dysfunctions. However, understanding of its underlying neural mechanisms remains limited. This study aimed to investigate the brain functional mechanisms underlying MDD with anhedonia using resting-state functional magnetic resonance imaging (rs-fMRI).

METHODS

The Snaith-Hamilton Pleasure Scale (SHAPS) was used to evaluation MDD with anhedonia (anMDD) and non-anhedonia MDD (non-anMDD). Forty-eight patients with anMDD, Forty-four patients with non-anMDD, and Fifty healthy controls (HCs) were enrolled for the fMRI scans. A seed-based functional connectivity (FC) method was employed to explore reward network abnormalities.

RESULTS

anMDD patients exhibited lower FC values in Ventral Striatum (VS), right lateral Ventral Tegmental Area (VTA_R), left Thalamus (THA_L), and higher FC values in Ventromedial Prefrontal Cortex (vmPFC), left Anterior Insula (AI_L), and Presupplementary Motor Area (Pre-SMA) compared to HCs. Comparing anMDD to non-anMDD, significant differences were observed in FC values of VS, vmPFC, Pre-SMA, and THA_L regions. Correlation analysis revealed positive correlations between FC values of VS_R and NAc_R, as well as THA_L and Cerebellum_Crus1_L, with SHAPS scores. Negative correlations were observed between FC values of Pre-SMA and the right caudate, and between vmPFC and Frontal_Mid_Orb_L, and SHAPS scores.

CONCLUSION

Both anMDD and non-anMDD groups demonstrated abnormal FCs in the reward network. These findings indicate distinct roles of reward-related circuits in the two subtypes, contributing to a refined understanding of depression phenotypes and potential directions for targeted interventions.

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field

Performance monitoring that supports ongoing behavioral adjustments is often examined in the context of either choice confidence for perceptual decisions (i.e., "did I get it right?") or reward expectation for reward-based decisions (i.e., "what reward will I receive?"). However, our understanding of how the brain encodes these distinct evaluative signals remains limited because they are easily conflated, particularly in commonly used two-alternative tasks with symmetric rewards for correct choices. Previously we used a motion-discrimination task with asymmetric rewards to identify neural substrates of forming reward-biased perceptual decisions in the caudate nucleus (part of the striatum in the basal ganglia) and the frontal eye field (FEF, in prefrontal cortex). Here we leveraged this task design to partially decouple estimates of accuracy and reward expectation and examine their impacts on subsequent decisions and their representations in those two brain areas. We identified distinguishable representations of these two evaluative signals in individual caudate and FEF neurons, with regional differences in their distribution patterns and time courses. We observed that well-trained monkeys (both sexes) used both evaluative signals, infrequently but consistently, to adjust their subsequent decisions. We found further that these behavioral adjustments had reliable relationships with the neural representations of both evaluative signals in caudate, but not FEF. These results suggest that the cortico-striatal decision network may use diverse evaluative signals to monitor and adjust decision-making behaviors, adding to our understanding of the different roles that the FEF and caudate nucleus play in a diversity of decision-related computations.

Balancing risk-return decisions by manipulating the mesofrontal circuits in primates

Decision-making is always coupled with some level of risk, with more pathological forms of risk-taking decisions manifesting as gambling disorders. In macaque monkeys trained in a high risk-high return (HH) versus low risk-low return (LL) choice task, we found that the reversible pharmacological inactivation of ventral Brodmann area 6 (area 6V) impaired the risk dependency of decision-making. Selective optogenetic activation of the mesofrontal pathway from the ventral tegmental area (VTA) to the ventral aspect of 6V resulted in stronger preference for HH, whereas activation of the pathway from the VTA to the dorsal aspect of 6V led to LL preference. Finally, computational decoding captured the modulations of behavioral preference. Our results suggest that VTA inputs to area 6V determine the decision balance between HH and LL.

Separation of Channels Subserving Approach and Avoidance/Escape at the Level of the Basal Ganglia and Related Brainstem Structures

The basal ganglia have the key function of directing our behavior in the context of events from our environment and/or our internal state. This function relies on afferents targeting the main input structures of the basal ganglia, entering bids for action selection at the level of the striatum or signals for behavioral interruption at the level of the subthalamic nucleus, with behavioral reselection facilitated by dopamine signaling. Numerous experiments have studied action selection in relation to inputs from the cerebral cortex. However, less is known about the anatomical and functional link between the basal ganglia and the brainstem. In this review, we describe how brainstem structures also project to the main input structures of the basal ganglia, namely the striatum, the subthalamic nucleus and midbrain dopaminergic neurons, in the context of approach and avoidance (including escape from threat), two fundamental, mutually exclusive behavioral choices in an animal's repertoire in which the brainstem is strongly involved. We focus on three particularly well-described loci involved in approach and avoidance, namely the superior colliculus, the parabrachial nucleus and the periaqueductal grey nucleus. We consider what is known about how these structures are related to the basal ganglia, focusing on their projections toward the striatum, dopaminergic neurons and subthalamic nucleus, and explore the functional consequences of those interactions.

Motivational Vigor in Parkinson's Disease Requires the Short and Long Duration Response to Levodopa

BACKGROUND

Impaired movement vigor (bradykinesia) is a cardinal feature of Parkinson's disease (PD) and hypothesized to result from abnormal motivational processes-impaired motivation-vigor coupling. Dopamine replacement therapy (DRT) improves bradykinesia, but the response to DRT is multifaceted, comprising a short-duration response (SDR) and a long-duration response (LDR) only manifesting with chronic treatment. Prior experiments assessing motivation-vigor coupling in PD used chronically treated subjects, obscuring the roles of the SDR and LDR.

METHODS

To disambiguate the SDR and LDR, 11 de novo PD subjects (6 male [M]:5 female [F]; mean age, 67) were studied before treatment, after an acute levodopa (l-dopa) dose, and in both the practical "off" (LDR) and "on" (LDR + SDR) states after chronic stable treatment. At each visit, subjects were characterized with a standard battery including the Movement Disorder Society-Sponsored Revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS) and an incentivized joystick task to assess motor performance in response to varying rewards.

RESULTS

l-Dopa induced a robust SDR and LDR, with further improvement in the combined SDR + LDR state. At baseline, after acute treatment (SDR), and after LDR induction, subjects did not exhibit the normal increase in movement speed with increasing reward. Only in the combined SDR + LDR state was there restoration of motivation-vigor coupling.

CONCLUSIONS

Although consistent with prior results in chronically treated PD subjects, the significant improvement in motor performance observed with the SDR and LDR suggests that bradykinesia is not solely secondary to deficient modulation of motivational processes. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Pathways from the Superior Colliculus to the Basal Ganglia

The present work aims to review the structural organization of the mammalian superior colliculus (SC), the putative pathways connecting the SC and the basal ganglia, and their role in organizing complex behavioral output. First, we review how the complex intrinsic connections between the SC's laminae projections allow for the construction of spatially aligned, visual-multisensory maps of the surrounding environment. Moreover, we present a summary of the sensory-motor inputs of the SC, including a description of the integration of multi-sensory inputs relevant to behavioral control. We further examine the major descending outputs toward the brainstem and spinal cord. As the central piece of this review, we provide a thorough analysis covering the putative interactions between the SC and the basal ganglia. To this end, we explore the diverse thalamic routes by which information from the SC may reach the striatum, including the pathways through the lateral posterior, parafascicular, and rostral intralaminar thalamic nuclei. We also examine the interactions between the SC and subthalamic nucleus, representing an additional pathway for the tectal modulation of the basal ganglia. Moreover, we discuss how information from the SC might also be relayed to the basal ganglia through midbrain tectonigral and tectotegmental projections directed at the substantia nigra compacta and ventrotegmental area, respectively, influencing the dopaminergic outflow to the dorsal and ventral striatum. We highlight the vast interplay between the SC and the basal ganglia and raise several missing points that warrant being addressed in future studies.

Activity-dependent constraints on catecholamine signaling

Catecholamine signaling is thought to modulate cognition in an inverted-U relationship, but the mechanisms are unclear. We measured norepinephrine and dopamine release, postsynaptic calcium responses, and interactions between tonic and phasic firing modes under various stimuli and conditions. High tonic activity in vivo depleted catecholamine stores, desensitized postsynaptic responses, and decreased phasic transmission. Together, these findings provide a more complete understanding of the inverted-U relationship, offering insights into psychiatric disorders and neurodegenerative diseases with impaired catecholamine signaling.

Physical Exercise Promotes Beneficial Changes on Neurotrophic Factors in Mesolimbic Brain Areas After AMPH Relapse: Involvement of the Endogenous Opioid System

Addiction is a serious public health problem, and the current pharmacotherapy is unable to prevent drug use reinstatement. Studies have focused on physical exercise as a promising coadjuvant treatment. Our research group recently showed beneficial neuroadaptations in the dopaminergic system related to amphetamine-relapse prevention involving physical exercise-induced endogenous opioid system activation (EXE-OS activation). In this context, additional mechanisms were explored to understand the exercise benefits on drug addiction. Male rats previously exposed to amphetamine (AMPH, 4.0 mg/kg) for 8 days were submitted to physical exercise for 5 weeks. EXE-OS activation was blocked by naloxone administration (0.3 mg/kg) 5 min before each physical exercise session. After the exercise protocol, the rats were re-exposed to AMPH for 3 days, and in sequence, euthanasia was performed and the VTA and NAc were dissected. In the VTA, our findings showed increased immunocontent of proBDNF, BDNF, and GDNF and decreased levels of AMPH-induced TrkB; therefore, EXE-OS activation increased all these markers and naloxone administration prevented this exercise-induced effect. In the NAc, the same molecular markers were also increased by AMPH and decreased by EXE-OS activation. In this study, we propose a close relation between EXE-OS activation beneficial influence and a consequent neuroadaptation on neurotrophins and dopaminergic system levels in the mesolimbic brain area, preventing the observed AMPH-relapse behavior. Our outcomes bring additional knowledge concerning addiction neurobiology understanding and show that EXE-OS activation may be a potential adjuvant tool in drug addiction therapy.