Plastic Corticostriatal Circuits for Action Learning: What's Dopamine Got to Do with It?

Distinct basal ganglia contributions to learning from implicit and explicit value signals in perceptual decision-making

Metacognitive evaluations of confidence provide an estimate of decision accuracy that could guide learning in the absence of explicit feedback. We examine how humans might learn from this implicit feedback in direct comparison with that of explicit feedback, using simultaneous EEG-fMRI. Participants performed a motion direction discrimination task where stimulus difficulty was increased to maintain performance, with intermixed explicit- and no-feedback trials. We isolate single-trial estimates of post-decision confidence using EEG decoding, and find these neural signatures re-emerge at the time of feedback together with separable signatures of explicit feedback. We identified these signatures of implicit versus explicit feedback along a dorsal-ventral gradient in the striatum, a finding uniquely enabled by an EEG-fMRI fusion. These two signals appear to integrate into an aggregate representation in the external globus pallidus, which could broadcast updates to improve cortical decision processing via the thalamus and insular cortex, irrespective of the source of feedback.

Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain

The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.

Improved dual-color GRAB sensors for monitoring dopaminergic activity in vivo

Dopamine (DA) plays multiple roles in a wide range of physiological and pathological processes via a vast network of dopaminergic projections. To fully dissect the spatiotemporal dynamics of DA release in both dense and sparsely innervated brain regions, we developed a series of green and red fluorescent GPCR activation-based DA (GRABDA) sensors using a variety of DA receptor subtypes. These sensors have high sensitivity, selectivity, and signal-to-noise properties with subsecond response kinetics and the ability to detect a wide range of DA concentrations. We then used these sensors in freely moving mice to measure both optogenetically evoked and behaviorally relevant DA release while measuring neurochemical signaling in the nucleus accumbens, amygdala, and cortex. Using these sensors, we also detected spatially resolved heterogeneous cortical DA release in mice performing various behaviors. These next-generation GRABDA sensors provide a robust set of tools for imaging dopaminergic activity under a variety of physiological and pathological conditions.

Presynaptic cGMP sets synaptic strength in the striatum and is important for motor learning

The striatum is a subcortical brain region responsible for the initiation and termination of voluntary movements. Striatal spiny projection neurons receive major excitatory synaptic input from neocortex and thalamus, and cyclic nucleotides have long been known to play important roles in striatal function. Yet, the precise mechanism of action is unclear. Here, we combine optogenetic stimulation, 2‐photon imaging, and genetically encoded scavengers to dissect the regulation of striatal synapses in mice. Our data show that excitatory striatal inputs are tonically depressed by phosphodiesterases (PDEs), in particular PDE1. Blocking PDE activity boosts presynaptic calcium entry and glutamate release, leading to strongly increased synaptic transmission. Although PDE1 degrades both cAMP and cGMP, we uncover that the concentration of cGMP, not cAMP, controls the gain of striatal inputs. Disturbing this gain control mechanism in vivo impairs motor skill learning in mice. The tight dependence of striatal excitatory synapses on PDE1 and cGMP offers a new perspective on the molecular mechanisms regulating striatal activity.

Differential Dopamine Receptor-Dependent Sensitivity Improves the Switch Between Hard and Soft Selection in a Model of the Basal Ganglia

The problem of selecting one action from a set of different possible actions, simply referred to as the problem of action selection, is a ubiquitous challenge in the animal world. For vertebrates, the basal ganglia (BG) are widely thought to implement the core computation to solve this problem, as its anatomy and physiology are well suited to this end. However, the BG still display physiological features whose role in achieving efficient action selection remains unclear. In particular, it is known that the two types of dopaminergic receptors (D1 and D2) present in the BG give rise to mechanistically different responses. The overall effect will be a difference in sensitivity to dopamine, which may have ramifications for action selection. However, which receptor type leads to a stronger response is unclear due to the complexity of the intracellular mechanisms involved. In this study, we use an existing, high-level computational model of the BG, which assumes that dopamine contributes to action selection by enabling a switch between different selection regimes, to predict which of D1 or D2 has the greater sensitivity. Thus, we ask, Assuming dopamine enables a switch between action selection regimes in the BG, what functional sensitivity values would result in improved action selection computation? To do this, we quantitatively assessed the model's capacity to perform action selection as we parametrically manipulated the sensitivity weights of D1 and D2. We show that differential (rather than equal) D1 and D2 sensitivity to dopaminergic input improves the switch between selection regimes during the action selection computation in our model. Specifically, greater D2 sensitivity compared to D1 led to these improvements.

Behavioral and Neuroanatomical Consequences of Cell-Type Specific Loss of Dopamine D2 Receptors in the Mouse Cerebral Cortex

Developmental dysregulation of dopamine D2 receptors (D2Rs) alters neuronal migration, differentiation, and behavior and contributes to the psychopathology of neurological and psychiatric disorders. The current study is aimed at identifying how cell-specific loss of D2Rs in the cerebral cortex may impact neurobehavioral and cellular development, in order to better understand the roles of this receptor in cortical circuit formation and brain disorders. We deleted D2R from developing cortical GABAergic interneurons (Nkx2.1-Cre) or from developing telencephalic glutamatergic neurons (Emx1-Cre). Conditional knockouts (cKO) from both lines, Drd2^fl/fl, Nkx2.1-Cre⁺ (referred to as GABA-D2R-cKO mice) or Drd2^fl/fl, Emx1-Cre⁺ (referred to as Glu-D2R-cKO mice), exhibited no differences in simple tests of anxiety-related or depression-related behaviors, or spatial or nonspatial working memory. Both GABA-D2R-cKO and Glu-D2R-cKO mice also had normal basal locomotor activity, but GABA-D2R-cKO mice expressed blunted locomotor responses to the psychotomimetic drug MK-801. GABA-D2R-cKO mice exhibited improved motor coordination on a rotarod whereas Glu-D2R-cKO mice were normal. GABA-D2R-cKO mice also exhibited spatial learning deficits without changes in reversal learning on a Barnes maze. At the cellular level, we observed an increase in PV+ cells in the frontal cortex of GABA-D2R-cKO mice and no noticeable changes in Glu-D2R-cKO mice. These data point toward unique and distinct roles for D2Rs within excitatory and inhibitory neurons in the regulation of behavior and interneuron development, and suggest that location-biased D2R pharmacology may be clinically advantageous to achieve higher efficacy and help avoid unwanted effects.

Involvement of Midbrain Dopamine Neuron Activity in Negative Reinforcement Learning in Mice

The activity of the midbrain dopamine system reflects the valence of environmental events and modulates various brain structures to modify an organism's behavior. A series of recent studies reported that the direct and indirect pathways in the striatum are critical for instrumental learning, but the dynamic changes in dopamine neuron activity that occur during negative reinforcement learning are still largely unclear. In the present study, by using a negative reinforcement learning paradigm employing foot shocks as aversive stimuli, bidirectional changes in substantia nigra pars compacta (SNc) dopamine neuron activity in the learning and habituation phases were observed. The results showed that in the learning phase, before mice had mastered the skill of escaping foot shocks, the presence of foot shocks induced a transient reduction in the activity of SNc dopamine neurons; however, in the habituation phase, in which the learned skill was automated, it induced a transient increase. Microinjection of a dopamine D1 receptor (D1R) or D2 receptor (D2R) antagonist into the dorsomedial striatum (DMS) significantly impaired learning behavior, suggesting that the modulatory effects of dopamine on both the direct and indirect pathways are required. Moreover, during the learning phase, excitatory synaptic transmission to DMS D2R-expressing medium spiny neurons (D2-MSNs) was potentiated. However, upon completion of the learning and habituation phases, the synapses onto D1R-expressing medium spiny neurons (D1-MSNs) were potentiated, and those onto D2-MSNs were restored to normal levels. The bidirectional changes in both SNc dopamine neuron activity and DMS synaptic plasticity might be the critical neural correlates for negative reinforcement learning.

Dichotomous dopaminergic and noradrenergic neural states mediate distinct aspects of exploitative behavioral states

The balance between exploiting known actions and exploring alternatives is critical for survival and hypothesized to rely on shifts in neuromodulation. We developed a behavioral paradigm to capture exploitative and exploratory states and imaged calcium dynamics in genetically identified dopaminergic and noradrenergic neurons. During exploitative states, characterized by motivated repetition of the same action choice, dopamine neurons in SNc encoding movement vigor showed sustained elevation of basal activity that lasted many seconds. This sustained activity emerged from longer positive responses, which accumulated during exploitative action-reward bouts, and hysteretic dynamics. Conversely, noradrenergic neurons in LC showed sustained inhibition of basal activity due to the accumulation of longer negative responses in LC. Chemogenetic manipulation of these sustained dynamics revealed that dopaminergic activity mediates action drive, whereas noradrenergic activity modulates choice diversity. These data uncover the emergence of sustained neural states in dopaminergic and noradrenergic networks that mediate dissociable aspects of exploitative bouts.

Single Exposure to Cocaine Impairs Reinforcement Learning by Potentiating the Activity of Neurons in the Direct Striatal Pathway in Mice

Plasticity in the glutamatergic synapses on striatal medium spiny neurons (MSNs) is not only essential for behavioral adaptation but also extremely vulnerable to drugs of abuse. Modulation on these synapses by even a single exposure to an addictive drug may interfere with the plasticity required by behavioral learning and thus produce impairment. In the present work, we found that the negative reinforcement learning, escaping mild foot-shocks by correct nose-poking, was impaired by a single in vivo exposure to 20 mg/kg cocaine 24 h before the learning in mice. Either a single exposure to cocaine or reinforcement learning potentiates the glutamatergic synapses on MSNs expressing the striatal dopamine 1 (D1) receptor (D1-MSNs). However, 24 h after the cocaine exposure, the potentiation required for reinforcement learning was disrupted. Specific manipulation of the activity of striatal D1-MSNs in D1-cre mice demonstrated that activation of these MSNs impaired reinforcement learning in normal D1-cre mice, but inhibition of these neurons reversed the reinforcement learning impairment induced by cocaine. The results suggest that cocaine potentiates the activity of direct pathway neurons in the dorsomedial striatum and this potentiation might disrupt the potentiation produced during and required for reinforcement learning.

Role of the nucleus accumbens in functional recovery from spinal cord injury

Post brain damage depression impedes functional recovery. On the other hand, higher motivation facilitates functional recovery after damage to the central nervous system, but the neural mechanism of psychological effects on functional recovery is unclear. The nucleus accumbens (NAcc), a motivation center, has not been considered directly involved in motor function. Recently, it was demonstrated that the NAcc makes a direct contribution to motor performance after spinal cord injury by facilitating motor cortex activity. In this perspective, we first summarize our investigation of role of NAcc in motor control during the recovery course after spinal cord injury, followed by a discussion of the current knowledge regarding the relationship between the recovery and NAcc after neuronal damage.

Adaptive alterations in the mesoaccumbal network after peripheral nerve injury

ABSTRACT

The nucleus accumbens (NAc) and the ventral tegmental area (VTA) are critical hubs in the brain circuitry controlling chronic pain. Yet, how these 2 regions interact to shape the chronic pain state is poorly understood. Our studies show that in mice, spared nerve injury (SNI) induced alterations in the functional connectome of D2-receptor expressing spiny projection neurons in the core region of the NAc-enhancing connections with prelimbic cortex and weakening them with basolateral amygdala. These changes, which were attributable in part to SNI-induced suppression of VTA dopaminergic signaling, were adaptive because mimicking them chemogenetically alleviated the anxiety and social withdrawal accompanying injury. By contrast, chemogenetic enhancement of activity in VTA dopaminergic neurons projecting to the medial shell of the NAc selectively suppressed tactile allodynia in SNI mice. These results suggest that SNI induces regionally specific alterations in VTA dopaminergic signaling in the NAc to promote environmental reengagement after injury. However, countervailing, homeostatic mechanisms limit these adaptive changes, potentially leading to the chronic pain state.

An Introspective Approach: A Lifetime of Parkinson's Disease Research and Not Much to Show for it Yet?

I feel part of a massive effort to understand what is wrong with motor systems in the brain relating to Parkinson’s disease. Today, the symptoms of the disease can be modified slightly, but dopamine neurons still die; the disease progression continues inexorably. Maybe the next research phase will bring the power of modern genetics to bear on halting, or better, preventing cell death. The arrival of accessible human neuron assemblies in organoids perhaps will provide a better access to the processes underlying neuronal demise.

PET Imaging of Dopamine Neurotransmission During EEG Neurofeedback

Neurofeedback (NFB) is a brain-based training method that enables users to control their own cortical oscillations using real-time feedback from the electroencephalogram (EEG). Importantly, no investigations to date have directly explored the potential impact of NFB on the brain's key neuromodulatory systems. Our study's objective was to assess the capacity of NFB to induce dopamine release as revealed by positron emission tomography (PET). Thirty-two healthy volunteers were randomized to either EEG-neurofeedback (NFB) or EEG-electromyography (EMG), and scanned while performing self-regulation during a single session of dynamic PET brain imaging using the high affinity D2/3 receptor radiotracer, [18F]Fallypride. NFB and EMG groups down-regulated cortical alpha power and facial muscle tone, respectively. Task-induced effects on endogenous dopamine release were estimated in the frontal cortex, anterior cingulate cortex, and thalamus, using the linearized simplified reference region model (LSRRM), which accounts for time-dependent changes in radiotracer binding following task initiation. Contrary to our hypothesis of a differential effect for NFB vs. EMG training, significant dopamine release was observed in both training groups in the frontal and anterior cingulate cortex, but not in thalamus. Interestingly, a significant negative correlation was observed between dopamine release in frontal cortex and pre-to-post NFB change in spontaneous alpha power, suggesting that intra-individual changes in brain state (i.e., alpha power) could partly result from changes in neuromodulatory tone. Overall, our findings constitute the first direct investigation of neurofeedback's effect on the endogenous release of a key neuromodulator, demonstrating its feasibility and paving the way for future studies using this methodology.

The Appetite Suppressant D-norpseudoephedrine (Cathine) Acts via D1/D2-Like Dopamine Receptors in the Nucleus Accumbens Shell

D-norpseudoephedrine (NPE), also known as cathine, is found naturally in the shrub Catha edulis “Khat.” NPE has been widely used as an appetite suppressant for the treatment of obesity. Although it is known that NPE acts on α1-adrenergic receptors, there is little information about the role of dopamine receptors on NPE’s induced anorectic and weight loss effects. Equally untouched is the question of how NPE modulates neuronal activity in the nucleus accumbens shell (NAcSh), a brain reward center, and a pharmacological target for many appetite suppressants. To do this, in rats, we characterized the pharmacological effects induced by NPE on weight loss, food intake, and locomotion. We also determined the involvement of dopamine D1- and D2-like receptors using systemic and intra-NAcSh antagonists, and finally, we recorded single-unit activity in the NAcSh in freely moving rats. We found that NPE decreased 24-h food intake, induced weight loss, and as side effects increased locomotor activity and wakefulness. Also, intraperitoneal and intra-NAcSh administration of D1 and D2 dopamine antagonists partially reversed NPE’s induced weight loss and food intake suppression. Furthermore, the D1 antagonist, SCH-23390, eliminated NPE-induced locomotion, whereas the D2 antagonist, raclopride, only delayed its onset. We also found that NPE evoked a net activation imbalance in NAcSh that propelled the population activity trajectories into a dynamic pharmacological brain state, which correlated with the onset of NPE-induced wakefulness. Together, our data demonstrate that NPE modulates NAcSh spiking activity and that both dopamine D1 and D2 receptors are necessary for NPE’s induced food intake suppression and weight loss.

GPCR-Based Dopamine Sensors-A Detailed Guide to Inform Sensor Choice for In vivo Imaging

Understanding how dopamine (DA) encodes behavior depends on technologies that can reliably monitor DA release in freely-behaving animals. Recently, red and green genetically encoded sensors for DA (dLight, GRAB-DA) were developed and now provide the ability to track release dynamics at a subsecond resolution, with submicromolar affinity and high molecular specificity. Combined with rapid developments in in vivo imaging, these sensors have the potential to transform the field of DA sensing and DA-based drug discovery. When implementing these tools in the laboratory, it is important to consider there is not a 'one-size-fits-all' sensor. Sensor properties, most importantly their affinity and dynamic range, must be carefully chosen to match local DA levels. Molecular specificity, sensor kinetics, spectral properties, brightness, sensor scaffold and pharmacology can further influence sensor choice depending on the experimental question. In this review, we use DA as an example; we briefly summarize old and new techniques to monitor DA release, including DA biosensors. We then outline a map of DA heterogeneity across the brain and provide a guide for optimal sensor choice and implementation based on local DA levels and other experimental parameters. Altogether this review should act as a tool to guide DA sensor choice for end-users.

Neuropilin 2 Signaling Mediates Corticostriatal Transmission, Spine Maintenance, and Goal-Directed Learning in Mice

The striatum represents the main input structure of the basal ganglia, receiving massive excitatory input from the cortex and the thalamus. The development and maintenance of cortical input to the striatum is crucial for all striatal function including many forms of sensorimotor integration, learning, and action control. The molecular mechanisms regulating the development and maintenance of corticostriatal synaptic transmission are unclear. Here we show that the guidance cue, Semaphorin 3F and its receptor Neuropilin 2 (Nrp2), influence dendritic spine maintenance, corticostriatal short-term plasticity, and learning in adult male and female mice. We found that Nrp2 is enriched in adult layer V pyramidal neurons, corticostriatal terminals, and in developing and adult striatal spiny projection neurons (SPNs). Loss of Nrp2 increases SPN excitability and spine number, reduces short-term facilitation at corticostriatal synapses, and impairs goal-directed learning in an instrumental task. Acute deletion of Nrp2 selectively in adult layer V cortical neurons produces a similar increase in the number of dendritic spines and presynaptic modifications at the corticostriatal synapse in the Nrp2 ^-/- mouse, but does not affect the intrinsic excitability of SPNs. Furthermore, conditional loss of Nrp2 impairs sensorimotor learning on the accelerating rotarod without affecting goal-directed instrumental learning. Collectively, our results identify Nrp2 signaling as essential for the development and maintenance of the corticostriatal pathway and may shed novel insights on neurodevelopmental disorders linked to the corticostriatal pathway and Semaphorin signaling.SIGNIFICANCE STATEMENT The corticostriatal pathway controls sensorimotor, learning, and action control behaviors and its dysregulation is linked to neurodevelopmental disorders, such as autism spectrum disorder (ASD). Here we demonstrate that Neuropilin 2 (Nrp2), a receptor for the axon guidance cue semaphorin 3F, has important and previously unappreciated functions in the development and adult maintenance of dendritic spines on striatal spiny projection neurons (SPNs), corticostriatal short-term plasticity, intrinsic physiological properties of SPNs, and learning in mice. Our findings, coupled with the association of Nrp2 with ASD in human populations, suggest that Nrp2 may play an important role in ASD pathophysiology. Overall, our work demonstrates Nrp2 to be a key regulator of corticostriatal development, maintenance, and function, and may lead to better understanding of neurodevelopmental disease mechanisms.

Altered monoamine levels in the dorsal striatum of the rat are associated with alterations in behavioural selection and motivation following peripheral nerve injury and acute stress

Chronic neuropathic pain and psychological stress interact to compromise goal-directed control over behaviour following mild psychological stress. The dorsomedial (DMS) and dorsolateral (DLS) striatum in the rat are crucial for the expression of goal-directed and habitual behaviours, respectively. This study investigated whether changes in monoamine levels in the DMS and DLS following nerve injury and psychological stress reflect these behavioural differences. Neuropathic pain was induced by a chronic constriction injury (CCI) of the sciatic nerve in Sprague-Dawley rats. Acute stress was induced using a 15-min restraint. Behavioural flexibility was assessed using the outcome devaluation paradigm. Noradrenaline, serotonin, dopamine and associated metabolites were measured bilaterally from the DLS and DMS. In uninjured rats, restraint increased dopaminergic markers in the left and serotonergic markers in the right of both the DMS and DLS, indicating a possible left hemisphere-mediated dominance. CCI led to a slightly different lateralised effect, with a larger effect in the DMS than in the DLS. Individual differences in behavioural flexibility following CCI negatively correlated with dopaminergic markers in the right DLS, but positively correlated with these markers in the left DMS. A combination of CCI and restraint reduced behavioural flexibility, which was associated with the loss of the left/DMS dominance. These data suggest that behavioural flexibility following psychological stress or pain is associated with a left hemisphere dominance within the dorsal striatum. The loss of behavioural flexibility following the combined stressors is then associated with a transition from left to right, and DMS to DLS dominance.

Can Neonatal Systemic Inflammation and Hypoxia Yield a Cerebral Palsy-Like Phenotype in Periadolescent Mice?

Cerebral palsy (CP) is one of the most common childhood-onset motor disabilities, attributed to injuries of the immature brain in the foetal or early postnatal period. The underlying mechanisms are poorly understood, rendering prevention and treatment strategies challenging. The aim of the present study was to establish a mouse model of CP for preclinical assessment of new interventions. For this purpose, we explored the impact of a double neonatal insult (i.e. systemic inflammation combined with hypoxia) on behavioural and cellular outcomes relevant to CP during the prepubertal to adolescent period of mice. Pups were subjected to intraperitoneal lipopolysaccharide (LPS) injections from postnatal day (P) 3 to P6 followed by hypoxia at P7. Gene expression analysis at P6 revealed a strong inflammatory response in a brain region-dependent manner. A comprehensive battery of behavioural assessments performed between P24 and P47 showed impaired limb placement and coordination when walking on a horizontal ladder in both males and females. Exposed males also displayed impaired performance on a forelimb skilled reaching task, altered gait pattern and increased exploratory activity. Exposed females showed a reduction in grip strength and traits of anxiety-like behaviour. These behavioural alterations were not associated with gross morphological changes, white matter lesions or chronic inflammation in the brain. Our results indicate that the neonatal double-hit with LPS and hypoxia can induce subtle long-lasting deficits in motor learning and fine motor skills, which partly reflect the symptoms of children with CP who have mild gross and fine motor impairments.

Altered anatomical connections of associative and limbic cortico-basal-ganglia circuits in obsessive-compulsive disorder

BACKGROUND

Current neurocognitive models suppose dysfunctions of associative and limbic cortico-basal ganglia circuits to be at the core of obsessive-compulsive disorder (OCD). As little is known about the state of underlying anatomical connections, we investigated whether these connections were reduced and/or not properly organised in OCD patients compared to control.

METHODS

Diffusion magnetic resonance images were obtained in 37 OCD patients with predominant checking symptoms and 37 matched healthy controls. We developed indices to characterise the quantity (spatial extent and density) and the organisation (topography and segregation) of 24 anatomical connections between associative and limbic cortical (anterior cingulate, dorsolateral prefrontal, orbitofrontal cortices and the frontal pole), and subcortical (caudate nucleus, putamen and thalamus) areas in each hemisphere.

RESULTS

Associative and limbic cortico-basal-ganglia connections were reduced in OCD patients compared to controls: 19/24 connections had a reduced subcortical spatial extent, 9/24 had a reduced density. Moreover, while the general topography was conserved, the different cortical projection fields in the striatum and thalamus were hyper-segregated in OCD patients compared to controls.

CONCLUSION

These quantitative and qualitative differences of anatomical connections go beyond the current model of a reduced cortical control of automatic behaviour stored in the basal ganglia. The hyper-segregation in OCD could also impair the integration of cortical information in the thalamus and striatum and distort the subsequent behavioural selection process. This provides new working hypotheses for functional and behavioural studies on OCD.

Midbrain circuits that set locomotor speed and gait selection

Locomotion is a fundamental motor function common to the animal kingdom. It is executed episodically and adapted to behavioural needs including exploration, requiring slow locomotion, and escaping behaviour, necessitating faster speeds. The control of these functions originates in brainstem structures although the neuronal substrate(s) supporting them are debated. Here, we show in mice that speed/gait selection are controlled by glutamatergic excitatory neurons (GlutNs) segregated in two distinct midbrain nuclei: the Cuneiform Nucleus (CnF) and the Pedunculopontine Nucleus (PPN). GlutNs in each of those two regions are sufficient for controlling slower alternating locomotor behavior but only GlutNs in the CnF are necessary for high-speed synchronous locomotion. Additionally, PPN- and CnF-GlutNs activation dynamics and their input and output connectivity matrices support explorative and escape locomotion, respectively. Our results identify dual regions in the midbrain that act in common to select context dependent locomotor behaviours.

Theta and high-beta networks for feedback processing: a simultaneous EEG-fMRI study in healthy male subjects

The reward system is important in assessing outcomes to guide behavior. To achieve these purposes, its core components interact with several brain areas involved in cognitive and emotional processing. A key mechanism suggested to subserve these interactions is oscillatory activity, with a prominent role of theta and high-beta oscillations. The present study used single-trial coupling of simultaneously recorded electroencephalography and functional magnetic resonance imaging data to investigate networks associated with oscillatory responses to feedback during a two-choice gambling task in healthy male participants (n=19). Differential associations of theta and high-beta oscillations with non-overlapping brain networks were observed: Increase of high-beta power in response to positive feedback was associated with activations in a largely subcortical network encompassing core areas of the reward network. In contrast, theta-band power increase upon loss was associated with activations in a frontoparietal network that included the anterior cingulate cortex. Trait impulsivity correlated significantly with activations in areas of the theta-associated network. Our results suggest that positive and negative feedback is processed by separate brain networks associated with different cognitive functions. Communication within these networks is mediated by oscillations of different frequency, possibly reflecting different modes of dopaminergic signaling.

Focal expression of mutant huntingtin in the songbird basal ganglia disrupts cortico-basal ganglia networks and vocal sequences

The basal ganglia (BG) promote complex sequential movements by helping to select elementary motor gestures appropriate to a given behavioral context. Indeed, Huntington's disease (HD), which causes striatal atrophy in the BG, is characterized by hyperkinesia and chorea. How striatal cell loss alters activity in the BG and downstream motor cortical regions to cause these disorganized movements remains unknown. Here, we show that expressing the genetic mutation that causes HD in a song-related region of the songbird BG destabilizes syllable sequences and increases overall vocal activity, but leave the structure of individual syllables intact. These behavioral changes are paralleled by the selective loss of striatal neurons and reduction of inhibitory synapses on pallidal neurons that serve as the BG output. Chronic recordings in singing birds revealed disrupted temporal patterns of activity in pallidal neurons and downstream cortical neurons. Moreover, reversible inactivation of the cortical neurons rescued the disorganized vocal sequences in transfected birds. These findings shed light on a key role of temporal patterns of cortico-BG activity in the regulation of complex motor sequences and show how a genetic mutation alters cortico-BG networks to cause disorganized movements.

Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry

Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error signaling and addiction can be formulated and tested.

Separate circuitries encode the hedonic and nutritional values of sugar

Sugar exerts its potent reinforcing effects via both gustatory and post-ingestive pathways. It is however unknown if sweetness and nutritional signals engage segregated brain networks to motivate ingestion. We show in mice that separate basal ganglia circuitries mediate the hedonic and nutritional actions of sugar. We found that, during sugar intake, suppressing hedonic value inhibited dopamine release in ventral but not dorsal striatum, whereas suppressing nutritional value inhibited dopamine release in dorsal but not ventral striatum. Consistently, cell-specific ablation of dopamine-excitable cells in dorsal, but not ventral, striatum inhibited sugar’s ability to drive the ingestion of unpalatable solutions. Conversely, optogenetic stimulation of dopamine-excitable cells in dorsal, but not ventral, striatum substituted for sugar in its ability to drive the ingestion of unpalatable solutions. Our data demonstrate that sugar recruits a distributed dopamine-excitable striatal circuitry that acts to prioritize energy seeking over taste quality.

Morphological changes of glutamatergic synapses in animal models of Parkinson's disease

The striatum and the subthalamic nucleus (STN) are the main entry doors for extrinsic inputs to reach the basal ganglia (BG) circuitry. The cerebral cortex, thalamus and brainstem are the key sources of glutamatergic inputs to these nuclei. There is anatomical, functional and neurochemical evidence that glutamatergic neurotransmission is altered in the striatum and STN of animal models of Parkinson’s disease (PD) and that these changes may contribute to aberrant network neuronal activity in the BG-thalamocortical circuitry. Postmortem studies of animal models and PD patients have revealed significant pathology of glutamatergic synapses, dendritic spines and microcircuits in the striatum of parkinsonians. More recent findings have also demonstrated a significant breakdown of the glutamatergic corticosubthalamic system in parkinsonian monkeys. In this review, we will discuss evidence for synaptic glutamatergic dysfunction and pathology of cortical and thalamic inputs to the striatum and STN in models of PD. The potential functional implication of these alterations on synaptic integration, processing and transmission of extrinsic information through the BG circuits will be considered. Finally, the significance of these pathological changes in the pathophysiology of motor and non-motor symptoms in PD will be examined.

Inhibition of presynaptic calcium transients in cortical inputs to the dorsolateral striatum by metabotropic GABA(B) and mGlu2/3 receptors

Cortical inputs to the dorsolateral striatum (DLS) are dynamically regulated during skill learning and habit formation, and are dysregulated in disorders characterized by impaired action control. Therefore, a mechanistic investigation of the processes regulating corticostriatal transmission is key to understanding DLS-associated circuit function, behaviour and pathology. Presynaptic GABA(B) and group II metabotropic glutamate (mGlu2/3) receptors exert marked inhibitory control over corticostriatal glutamate release in the DLS, yet the signalling pathways through which they do so are unclear. We developed a novel approach using the genetically encoded calcium (Ca(2+) ) indicator GCaMP6 to assess presynaptic Ca(2+) in corticostriatal projections to the DLS. Using simultaneous photometric presynaptic Ca(2+) and striatal field potential recordings, we report that relative to P/Q-type Ca(2+) channels, N-type channels preferentially contributed to evoked presynaptic Ca(2+) influx in motor cortex projections to, and excitatory transmission in, the DLS. Activation of GABA(B) or mGlu2/3 receptors inhibited both evoked presynaptic Ca(2+) transients and striatal field potentials. mGlu2/3 receptor-mediated depression did not require functional N-type Ca(2+) channels, but was attenuated by blockade of P/Q-type channels. These findings reveal presynaptic mechanisms of inhibitory modulation of corticostriatal function that probably contribute to the selection and shaping of behavioural repertoires.

Input- and cell-type-specific endocannabinoid-dependent LTD in the striatum

Changes in basal ganglia plasticity at the corticostriatal and thalamostriatal levels are required for motor learning. Endocannabinoid-dependent long-term depression (eCB-LTD) is known to be a dominant form of synaptic plasticity expressed at these glutamatergic inputs; however, whether eCB-LTD can be induced at all inputs on all striatal neurons is still debatable. Using region-specific Cre mouse lines combined with optogenetic techniques, we directly investigated and distinguished between corticostriatal and thalamostriatal projections. We found that eCB-LTD was successfully induced at corticostriatal synapses, independent of postsynaptic striatal spiny projection neuron (SPN) subtype. Conversely, eCB-LTD was only nominally present at thalamostriatal synapses. This dichotomy was attributable to the minimal expression of cannabinoid type 1 (CB1) receptors on thalamostriatal terminals. Furthermore, coactivation of dopamine receptors on SPNs during LTD induction re-established SPN-subtype-dependent eCB-LTD. Altogether, our findings lay the groundwork for understanding corticostriatal and thalamostriatal synaptic plasticity and for striatal eCB-LTD in motor learning.

Regulation of dopamine release by CASK-β modulates locomotor initiation in Drosophila melanogaster

CASK is an evolutionarily conserved scaffolding protein that has roles in many cell types. In Drosophila, loss of the entire CASK gene or just the CASK-β transcript causes a complex set of adult locomotor defects. In this study, we show that the motor initiation component of this phenotype is due to loss of CASK-β in dopaminergic neurons and can be specifically rescued by expression of CASK-β within this subset of neurons. Functional imaging demonstrates that mutation of CASK-β disrupts coupling of neuronal activity to vesicle fusion. Consistent with this, locomotor initiation can be rescued by artificially driving activity in dopaminergic neurons. The molecular mechanism underlying this role of CASK-β in dopaminergic neurons involves interaction with Hsc70-4, a molecular chaperone previously shown to regulate calcium-dependent vesicle fusion. These data suggest that there is a novel CASK-β-dependent regulatory complex in dopaminergic neurons that serves to link activity and neurotransmitter release.

Electrophysiological registration of phonological perception in the subthalamic nucleus of patients with Parkinson's Disease

Phonological processing is usually associated with the activation of cortical areas, especially in the left cerebral hemisphere. This study examined if phonologically elicited evoked potentials can be recorded directly from the subthalamic nucleus in patients with Parkinson's Disease (PD). Seven PD patients who had undergone implantation of deep brain electrodes for the stimulation of the subthalamic nucleus were included. Local field potentials were recorded in a pre-attentive auditory phonological task, an attentive auditory phonological discrimination task, and a word recognition task. Auditory evoked potentials related to phonological, but not lexical processing, could be demonstrated in the subthalamic nucleus for all three tasks. Only minor changes were found after levodopa administration. This study demonstrates that the subthalamic nucleus is involved in early phonological perception, which puts the subthalamic nucleus in a position to modify phonological perception in a larger cortico-subcortical network.

Midbrain dopamine neurons sustain inhibitory transmission using plasma membrane uptake of GABA, not synthesis

Synaptic transmission between midbrain dopamine neurons and target neurons in the striatum is essential for the selection and reinforcement of movements. Recent evidence indicates that nigrostriatal dopamine neurons inhibit striatal projection neurons by releasing a neurotransmitter that activates GABA_A receptors. Here, we demonstrate that this phenomenon extends to mesolimbic afferents, and confirm that the released neurotransmitter is GABA. However, the GABA synthetic enzymes GAD65 and GAD67 are not detected in midbrain dopamine neurons. Instead, these cells express the membrane GABA transporters mGAT1 (Slc6a1) and mGAT4 (Slc6a11) and inhibition of these transporters prevents GABA co-release. These findings therefore indicate that GABA co-release is a general feature of midbrain dopaminergic neurons that relies on GABA uptake from the extracellular milieu as opposed to de novo synthesis. This atypical mechanism may confer dopaminergic neurons the flexibility to differentially control GABAergic transmission in a target-dependent manner across their extensive axonal arbors.

DOI:http://dx.doi.org/10.7554/eLife.01936.001

The electrical signals that are fired along neurons cannot be transmitted across the small gaps, called synapses that are found between neurons. Instead, the neuron sending the signal releases chemicals called neurotransmitters into the synapse. These neurotransmitters bind to receptor proteins on the surface of the second neuron and control how it fires.

A neurotransmitter called dopamine plays a key role in the circuits of the brain that control how we learn certain tasks involving movement. In particular, two populations of neurons from the midbrain that release dopamine target the striatum, an area of the brain that is responsible for motor control. These neurons also release other neurotransmitters, but the identity of these other chemicals is not known, and the details of the interaction between the neurons and the striatum are poorly understood.

Previous research showed that some of the midbrain neurons activate receptors that normally respond to a neurotransmitter called gamma-aminobutyric acid (GABA). However, several different chemicals can trigger this receptor. Using a range of techniques, Tritsch et al. now confirm that dopamine neurons release GABA alongside dopamine, and that this applies to both sets of the dopamine-producing neurons that feed into the striatum.

Some neurons can manufacture GABA from amino acids found in their internal fluid. However, Tritsch et al. could not detect the enzymes needed for this reaction in dopamine-producing neurons. Instead, these neurons contain proteins that can transport GABA across the cell membrane, which suggests that the neurons collect GABA from the extracellular fluid that surrounds them.

DOI:http://dx.doi.org/10.7554/eLife.01936.002

Basal ganglia output to the thalamus: still a paradox

The basal ganglia (BG)-recipient thalamus controls motor output but it remains unclear how its activity is regulated. Several studies report that thalamic activation occurs via disinhibition during pauses in the firing of inhibitory pallidal inputs from the BG. Other studies indicate that thalamic spiking is triggered by pallidal inputs via post-inhibitory 'rebound' calcium spikes. Finally excitatory cortical inputs can drive thalamic activity, which becomes entrained, or time-locked, to pallidal spikes. We present a unifying framework where these seemingly distinct results arise from a continuum of thalamic firing 'modes' controlled by excitatory inputs. We provide a mechanistic explanation for paradoxical pallidothalamic coactivations observed during behavior that raises new questions about what information is integrated in the thalamus to control behavior.

Dopamine D1 sensitivity in the prefrontal cortex predicts general cognitive abilities and is modulated by working memory training

A common source of variance (i.e., “general intelligence”) underlies an individual's performance across diverse tests of cognitive ability, and evidence indicates that the processing efficacy of working memory may serve as one such source of common variance. One component of working memory, selective attention, has been reported to co-vary with general intelligence, and dopamine D1 signaling in prefrontal cortex can modulate attentional abilities. Based on their aggregate performance across five diverse tests of learning, here we characterized the general cognitive ability (GCA) of CD-1 outbred mice. In response to a D1 agonist (SKF82958, 1 mg/kg), we then assessed the relationship between GCA and activation of D1 receptor (D1R)-containing neurons in the prelimbic region of the medial prefrontal cortex, the agranular insular cortex, and the dorsomedial striatum. Increased activation of D1R-containing neurons in the prelimbic cortex (but not the agranular insular cortex or dorsomedial striatum) was observed in animals of high GCA relative to those of low GCA (quantified by c-Fos activation in response to the D1 agonist). However, a Western blot analysis revealed no differences in the density of D1Rs in the prelimbic cortex between animals of high and low GCA. Last, it was observed that working memory training promoted an increase in animals’ GCA and enhanced D1R-mediated neuronal activation in the prelimbic cortex. These results suggest that the sensitivity (but not density) of D1Rs in the prelimbic cortex may both regulate GCA and be a target for working memory training.

Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales

Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty.

The Enemy within: Propagation of Aberrant Corticostriatal Learning to Cortical Function in Parkinson's Disease

Motor dysfunction in Parkinson’s disease is believed to arise primarily from pathophysiology in the dorsal striatum and its related corticostriatal and thalamostriatal circuits during progressive dopamine denervation. One function of these circuits is to provide a filter that selectively facilitates or inhibits cortical activity to optimize cortical processing, making motor responses rapid and efficient. Corticostriatal synaptic plasticity mediates the learning that underlies this performance-optimizing filter. Under dopamine denervation, corticostriatal plasticity is altered, resulting in aberrant learning that induces inappropriate basal ganglia filtering that impedes rather than optimizes cortical processing. Human imaging suggests that increased cortical activity may compensate for striatal dysfunction in PD patients. In this Perspective article, we consider how aberrant learning at corticostriatal synapses may impair cortical processing and learning and undermine potential cortical compensatory mechanisms. Blocking or remediating aberrant corticostriatal plasticity may protect cortical function and support cortical compensatory mechanisms mitigating the functional decline associated with progressive dopamine denervation.

Genetic variation in dopamine-related gene expression influences motor skill learning in mice

Several neurodevelopmental disorders with a strong genetic basis, including attention-deficit/hyperactivity disorder, autism spectrum disorders and developmental coordination disorder, involve deficits in fine motor skills. This phenotype may depend on heritable variation in components of the dopamine (DA) system, which is known to play a critical role in motor skill learning. In this study, we took advantage of two inbred strains of mice (BALB/c and C57BL/6) that differ markedly in the number of midbrain DA neurons in order to investigate the influence of such naturally occurring genetic variation on the acquisition and performance of fine motor skills. Gene expression analysis of midbrain, frontal cortex and striatum showed significant differences in the expression of presynaptic and postsynaptic dopaminergic (DAergic) markers (e.g. tyrosine hydroxylase, DA transporter, DA D4 receptor, DA D5 receptor and DARPP-32) between these two strains. BALB/c mice had lower learning rate and performance scores in a complex skilled reaching task when compared with C57BL/6 mice. A negative correlation was found between the motor learning rate and level of DARPP-32 mRNA expression in the frontal cortex contralateral to the trained forelimb. The rate of motor learning was also negatively correlated with the levels of DARPP-32 and DA D1 receptor mRNAs in the striatum. Our results suggest that genetically driven variation in frontostriatal DAergic neurotransmission is a major contributor to individual differences in motor skill learning. Moreover, these findings implicate the D1R/cAMP/DARPP-32 signaling pathway in those neurodevelopmental disorders that are associated with fine motor skill deficits.

Differential striatal spine pathology in Parkinson's disease and cocaine addiction: a key role of dopamine?

In the striatum, the dendritic tree of the two main populations of projection neurons, called "medium spiny neurons (MSNs)", are covered with spines that receive glutamatergic inputs from the cerebral cortex and thalamus. In Parkinson's disease (PD), striatal MSNs undergo an important loss of dendritic spines, whereas aberrant overgrowth of striatal spines occurs following chronic cocaine exposure. This review examines the possibility that opposite dopamine dysregulation is one of the key factors that underlies these structural changes. In PD, nigrostriatal dopamine degeneration results in a significant loss of dendritic spines in the dorsal striatum, while rodents chronically exposed to cocaine and other psychostimulants, display an increase in the density of "thin and immature" spines in the nucleus accumbens (NAc). In rodent models of PD, there is evidence that D2 dopamine receptor-containing MSNs are preferentially affected, while D1-positive cells are the main targets of increased spine density in models of addiction. However, such specificity remains to be established in primates. Although the link between the extent of striatal spine changes and the behavioral deficits associated with these disorders remains controversial, there is unequivocal evidence that glutamatergic synaptic transmission is significantly altered in both diseased conditions. Recent studies have suggested that opposite calcium-mediated regulation of the transcription factor myocyte enhancer factor 2 (MEF2) function induces these structural defects. In conclusion, there is strong evidence that dopamine is a major, but not the sole, regulator of striatal spine pathology in PD and addiction to psychostimulants. Further studies of the role of glutamate and other genes associated with spine plasticity in mediating these effects are warranted.

Cross-species approaches to pathological gambling: a review targeting sex differences, adolescent vulnerability and ecological validity of research tools

Decision-making plays a pivotal role in daily life as impairments in processes underlying decision-making often lead to an inability to make profitable long-term decisions. As a case in point, pathological gamblers continue gambling despite the fact that this disrupts their personal, professional or financial life. The prevalence of pathological gambling will likely increase in the coming years due to expanding possibilities of on-line gambling through the Internet and increasing liberal attitudes towards gambling. It therefore represents a growing concern for society. Both human and animal studies rapidly advance our knowledge on brain-behaviour processes relevant for understanding normal and pathological gambling behaviour. Here, we review in humans and animals three features of pathological gambling which hitherto have received relatively little attention: (1) sex differences in (the development of) pathological gambling, (2) adolescence as a (putative) sensitive period for (developing) pathological gambling and (3) avenues for improving ecological validity of research tools. Based on these issues we also discuss how research in humans and animals may be brought in line to maximize translational research opportunities.

Molecular and cellular mechanisms of dopamine-mediated behavioral plasticity in the striatum

The striatum is the input structure of the basal ganglia system. By integrating glutamatergic signals from cortical and subcortical regions and dopaminergic signals from mesolimbic nuclei the striatum functions as an important neural substrate for procedural and motor learning as well as for reward-guided behaviors. In addition, striatal activity is significantly altered in pathological conditions in which either a loss of dopamine innervation (Parkinson's disease) or aberrant dopamine-mediated signaling (drug addiction and L-DOPA induced dyskinesia) occurs. Here we discuss cellular mechanisms of striatal synaptic plasticity and aspects of cell signaling underlying striatum-dependent behavior, with a major focus on the neuromodulatory action of the endocannabinoid system and on the role of the Ras-ERK cascade.

Neural changes with tactile learning reflect decision-level reweighting of perceptual readout

Despite considerable work, the neural basis of perceptual learning remains uncertain. For visual learning, although some studies suggested that changes in early sensory representations are responsible, other studies point to decision-level reweighting of perceptual readout. These competing possibilities have not been examined in other sensory systems, investigating which could help resolve the issue. Here we report a study of human tactile microspatial learning in which participants achieved >six-fold decline in acuity threshold after multiple training sessions. Functional magnetic resonance imaging was performed during performance of the tactile microspatial task and a control, tactile temporal task. Effective connectivity between relevant brain regions was estimated using multivariate, autoregressive models of hidden neuronal variables obtained by deconvolution of the hemodynamic response. Training-specific increases in task-selective activation assessed using the task × session interaction and associated changes in effective connectivity primarily involved subcortical and anterior neocortical regions implicated in motor and/or decision processes, rather than somatosensory cortical regions. A control group of participants tested twice, without intervening training, exhibited neither threshold improvement nor increases in task-selective activation. Our observations argue that neuroplasticity mediating perceptual learning occurs at the stage of perceptual readout by decision networks. This is consonant with the growing shift away from strictly modular conceptualization of the brain toward the idea that complex network interactions underlie even simple tasks. The convergence of our findings on tactile learning with recent studies of visual learning reconciles earlier discrepancies in the literature on perceptual learning.

Corticostriatal connectivity and its role in disease

Corticostriatal projections are essential components of forebrain circuits and are widely involved in motivated behaviour. These axonal projections are formed by two distinct classes of cortical neurons, intratelencephalic (IT) and pyramidal tract (PT) neurons. Convergent evidence points to IT versus PT differentiation of the corticostriatal system at all levels of functional organization, from cellular signalling mechanisms to circuit topology. There is also growing evidence for IT/PT imbalance as an aetiological factor in neurodevelopmental, neuropsychiatric and movement disorders - autism, amyotrophic lateral sclerosis, obsessive-compulsive disorder, schizophrenia, Huntington's and Parkinson's diseases and major depression are highlighted here.

Membrane properties of striatal direct and indirect pathway neurons in mouse and rat slices and their modulation by dopamine

D1 and D2 receptor expressing striatal medium spiny neurons (MSNs) are ascribed to striatonigral (“direct”) and striatopallidal (“indirect”) pathways, respectively, that are believed to function antagonistically in motor control. Glutamatergic synaptic transmission onto the two types is differentially affected by Dopamine (DA), however, less is known about the effects on MSN intrinsic electrical properties. Using patch clamp recordings, we comprehensively characterized the two pathways in rats and mice, and investigated their DA modulation. We identified the direct pathway by retrograde labeling in rats, and in mice we used transgenic animals in which EGFP is expressed in D1 MSNs. MSNs were subjected to a series of current injections to pinpoint differences between the populations, and in mice also following bath application of DA. In both animal models, most electrical properties were similar, however, membrane excitability as measured by step and ramp current injections consistently differed, with direct pathway MSNs being less excitable than their counterparts. DA had opposite effects on excitability of D1 and D2 MSNs, counteracting the initial differences. Pronounced changes in AP shape were seen in D2 MSNs. In direct pathway MSNs, excitability increased across experimental conditions and parameters, and also when applying DA or the D1 agonist SKF-81297 in presence of blockers of cholinergic, GABAergic, and glutamatergic receptors. Thus, DA induced changes in excitability were D1 R mediated and intrinsic to direct pathway MSNs, and not a secondary network effect of altered synaptic transmission. DAergic modulation of intrinsic properties therefore acts in a synergistic manner with previously reported effects of DA on afferent synaptic transmission and dendritic processing, supporting the antagonistic model for direct vs. indirect striatal pathway function.

Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence

Adolescence is a crucial developmental period characterized by specific behaviors reflecting the immaturity of decision-making abilities. However, the maturation of precise cognitive processes and their neurobiological correlates at this period remain poorly understood. Here, we investigate whether a differential developmental time course of dopamine (DA) pathways during late adolescence could explain the emergence of particular executive and motivational components of goal-directed behavior. First, using a contingency degradation protocol, we demonstrate that adolescent rats display a specific deficit when the causal relationship between their actions and their consequences is changed. When the rats become adults, this deficit disappears. In contrast, actions of adolescents remain sensitive to outcome devaluation or to the influence of a pavlovian-conditioned stimulus. This aspect of cognitive maturation parallels a delayed development of the DA system, especially the mesocortical pathway involved in action adaptation to rule changes. Unlike in striatal and nucleus accumbens regions, DA fibers and DA tissue content continue to increase in the medial prefrontal cortex from juvenile to adult age. Moreover, a sustained overexpression of DA receptors is observed in the prefrontal region until the end of adolescence. These findings highlight the relationship between the emergence of specific cognitive processes, in particular the adaptation to changes in action consequences, and the delayed maturation of the mesocortical DA pathway. Similar developmental processes in humans could contribute to the adolescent vulnerability to the emergence of several psychiatric disorders characterized by decision-making deficits.

Effects of dopamine depletion on LFP oscillations in striatum are task- and learning-dependent and selectively reversed by L-DOPA

A major physiologic sign in Parkinson disease is the occurrence of abnormal oscillations in cortico-basal ganglia circuits, which can be normalized by L-DOPA therapy. Under normal circumstances, oscillatory activity in these circuits is modulated as behaviors are learned and performed, but how dopamine depletion affects such modulation is not yet known. We here induced unilateral dopamine depletion in the sensorimotor striatum of rats and then recorded local field potential (LFP) activity in the dopamine-depleted region and its contralateral correspondent as we trained the rats on a conditional T-maze task. Unexpectedly, the dopamine depletion had little effect on oscillations recorded in the pretask baseline period. Instead, the depletion amplified oscillations across delta (~3 Hz), theta (~8 Hz), beta (~13 Hz), and low-gamma (~48 Hz) ranges selectively during task performance times when each frequency band was most strongly modulated, and only after extensive training had occurred. High-gamma activity (65-100 Hz), in contrast, was weakened independent of task time or learning stage. The depletion also increased spike-field coupling of fast-spiking interneurons to low-gamma oscillations. L-DOPA therapy normalized all of these effects except those at low gamma. Our findings suggest that the task-related and learning-related dynamics of LFP oscillations are the primary targets of dopamine depletion, resulting in overexpression of behaviorally relevant oscillations. L-DOPA normalizes these dynamics except at low-gamma, linked by spike-field coupling to fast-spiking interneurons, now known to undergo structural changes after dopamine depletion and to lack normalization of spike activity following l-DOPA therapy.

Establishing causality for dopamine in neural function and behavior with optogenetics

Dopamine (DA) is known to play essential roles in neural function and behavior. Accordingly, DA neurons have been the focus of intense experimental investigation that has led to many important advances in our understanding of how DA influences these processes. However, it is becoming increasingly appreciated that delineating the precise contributions of DA neurons to cellular, circuit, and systems-level phenomena will require more sophisticated control over their patterns of activity than conventional techniques can provide. Specifically, the roles played by DA neurons are likely to depend on their afferent and efferent connectivity, the timing and length of their neural activation, and the nature of the behavior under investigation. Recently developed optogenetic tools hold great promise for disentangling these complex issues. Here we discuss the use of light-sensitive microbial opsins in the context of outstanding questions in DA research. A major technical advance offered by these proteins is the ability to bidirectionally modulate DA neuron activity in in vitro and in vivo preparations on a time scale that more closely approximates those of neural, perceptual and behavioral events. In addition, continued advances in rodent genetics and viral-mediated gene delivery have contributed to the ability to selectively target DA neurons or their individual afferent and efferent connections. Further, these tools are suitable for use in experimental subjects engaged in complex behaviors. After reviewing the strengths and limitations of optogenetic methodologies, we conclude by describing early efforts in the application of this valuable new approach that demonstrate its potential to improve our understanding of the neural and behavioral functions of DA. This article is part of a Special Issue entitled Optogenetics (7th BRES).

Modeling borderline personality disorder based on the neurobehavioral foundation of major personality traits

Borderline personality disorder (BPD) is an exceedingly complex behavioral phenomenon that is in need of conceptual clarification within a larger model of personality disorders (PDs). The association of personality traits to BPD is discussed initially as a means of introducing a dimensional personality approach to understanding BPD. While this model suggests that PDs emerge at the extremes of personality dimensions, attempts to demonstrate such an association have been empirically disappointing and conceptually unilluminating. Therefore, in this article, we attempt to extend such models by outlining the neurobehavioral systems that underlie major personality traits, and highlight the evidence that they are subject to experience-dependent modification that can be enduring through effects on genetic expression, mainly through processes known as epigenetics. It is through such processes that risk for personality disorder may be modified by experience at any point in development, but perhaps especially during early critical periods of development. We conclude by presenting a multidimensional model of PDs, in general, and BPD, in particular, that relies on the concepts developed earlier in the article. Our goal is to provide a guide for novel clinical conceptualization and assessment of PDs, as well as research on their psychobiological nature and pharmacological treatment.