Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix

Morning resting hypothalamus-dorsal striatum connectivity predicts individual differences in diurnal sleepiness accumulation

While the significance of obtaining restful sleep at night and maintaining daytime alertness is well recognized for human performance and overall well-being, substantial variations exist in the development of sleepiness during diurnal waking periods. Despite the established roles of the hypothalamus and striatum in sleep-wake regulation, the specific contributions of this neural circuit in regulating individual sleep homeostasis remain elusive. This study utilized resting-state functional magnetic resonance imaging (fMRI) and mathematical modeling to investigate the role of hypothalamus-striatum connectivity in subjective sleepiness variation in a cohort of 71 healthy adults under strictly controlled in-laboratory conditions. Mathematical modeling results revealed remarkable individual differences in subjective sleepiness accumulation patterns measured by the Karolinska Sleepiness Scale (KSS). Brain imaging data demonstrated that morning hypothalamic connectivity to the dorsal striatum significantly predicts the individual accumulation of subjective sleepiness from morning to evening, while no such correlation was observed for the hypothalamus-ventral striatum connectivity. These findings underscore the distinct roles of hypothalamic connectivity to the dorsal and ventral striatum in individual sleep homeostasis, suggesting that hypothalamus-dorsal striatum circuit may be a promising target for interventions mitigating excessive sleepiness and promoting alertness.

Regional heterogeneity in the membrane properties of mouse striatal neurons

The cytoarchitecture of the striatum is remarkably homogeneous, in contrast to the regional variation in striatal functions. Whether differences in the intrinsic membrane properties of striatal neurons contribute to regional heterogeneity has not been addressed systematically. We made recordings throughout the young adult mouse striatum under identical conditions, with synaptic input blocked, from four major striatal neuron types, namely, the two subtypes of spiny projection neurons (SPNs), cholinergic interneurons (ChIs), and fast-spiking GABAergic interneurons (FSIs), sampling at least 100 cells per cell type. Regional variation manifested across all cell types. All cell types in the nucleus accumbens (NAc) shell had higher input impedance and increased excitability. Cells in the NAc core were differentiated from the caudate-putamen (CPu) for both SPN subtypes by smaller action potentials and increased excitability. Similarity between the two SPN subtypes showed regional variation, differing more in the NAc than in the CPu. So, in the Str, both the intrinsic properties of interneurons and projection neurons are regionally heterogeneous, with the greatest difference between the NAc and CPu; greater excitability of NAc shell neurons may make the region more susceptible to activity-dependent plasticity.

Emotional cues reduce Pavlovian interference in feedback-based go and nogo learning

It is easier to execute a response in the promise of a reward and withhold a response in the promise of a punishment than vice versa, due to a conflict between cue-related Pavlovian and outcome-related instrumental action tendencies in the reverse conditions. This robust learning asymmetry in go and nogo learning is referred to as the Pavlovian bias. Interestingly, it is similar to motivational tendencies reported for affective facial expressions, i.e., facilitation of approach to a smile and withdrawal from a frown. The present study investigated whether and how learning from emotional faces instead of abstract stimuli modulates the Pavlovian bias in reinforcement learning. To this end, 137 healthy adult participants performed an orthogonalized Go/Nogo task that fully decoupled action (go/nogo) and outcome valence (win points/avoid losing points). Three groups of participants were tested with either emotional facial cues whose affective valence was either congruent (CON) or incongruent (INC) to the required instrumental response, or with neutral facial cues (NEU). Relative to NEU, the Pavlovian bias was reduced in both CON and INC, though still present under all learning conditions. Importantly, only for CON, the reduction of the Pavlovian bias effect was adaptive by improving learning performance in one of the conflict conditions. In contrast, the reduction of the Pavlovian bias in INC was completely driven by decreased learning performance in non-conflict conditions. These results suggest a potential role of arousal/salience in Pavlovian-instrumental regulation and cue-action congruency in the adaptability of goal-directed behavior. Implications for clinical application are discussed.

Impaired striatal glutamate/GABA regulation in violent offenders with antisocial personality disorder and psychopathy

Men with antisocial personality disorder (ASPD) with or without psychopathy (+/-P) are responsible for most violent crime in society. Development of effective treatments is hindered by poor understanding of the neurochemical underpinnings of the condition. Men with ASPD with and without psychopathy demonstrate impulsive decision-making, associated with striatal abnormalities in functional neuroimaging studies. However, to date, no study has directly examined the potential neurochemical underpinnings of such abnormalities. We therefore investigated striatal glutamate: GABA ratio using Magnetic Resonance Spectroscopy in 30 violent offenders (16 ASPD-P, 14 ASPD + P) and 21 healthy non-offenders. Men with ASPD +/- P had a significant reduction in striatal glutamate : GABA ratio compared to non-offenders. We report, for the first time, striatal Glutamate/GABA dysregulation in ASPD +/- P, and discuss how this may be related to core behavioral abnormalities in the disorders.

Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate

The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.

Spurious Autobiographical Memory of Psychosis: A Mechanistic Hypothesis for the Resolution, Persistence, and Recurrence of Positive Symptoms in Psychotic Disorders

Psychotic disorders are complex disorders with multiple etiologies. While increased dopamine synthesis capacity has been proposed to underlie psychotic episodes, dopamine-independent processes are also involved (less responsive to dopamine receptor-blocking medications). The underlying mechanism(s) of the reduction in antipsychotic responsiveness over time, especially after repeated relapses, remain unclear. Despite the consistent evidence of dopamine overactivity and hippocampal volume loss in schizophrenia, few accounts have been provided based on the interactive effect of dopamine on hippocampal synapse plasticity mediating autobiographical memory processes. The present hypothesis builds upon previous works showing the potential effects of dopamine overactivity on hippocampal-mediated neuroplasticity underlying autobiographical memory, alongside known patterns of autobiographical memory dysfunction in psychosis. We propose that spurious autobiographical memory of psychosis (SAMP) produced during active psychosis may be a key mechanism mediating relapses and treatment non-responsiveness. In a hyperdopaminergic state, SAMP is expected to be generated at an increased rate during active psychosis. Similar to other memories, it will undergo assimilation, accommodation, and extinction processes. However, if SAMP fails to integrate with existing memory, a discontinuity in autobiographical memory may result. Inadequate exposure to normalizing experiences and hyposalience due to overmedication or negative symptoms may also impede the resolution of SAMP. Residual SAMP is hypothesized to increase the propensity for relapse and treatment non-responsiveness. Based on recent findings on the role of dopamine in facilitating hippocampal synapse plasticity and autobiographical memory formation, the SAMP hypothesis is consistent with clinical observations of DUP effects, including the repetition of contents in psychotic relapses as well as the emergence of treatment non-responsiveness after repeated relapses. Clinical implications of the hypothesis highlight the importance of minimizing active psychosis, integrating psychosis memory, avoiding over-medication, and fostering normalizing experiences.

Identifying Neural Signatures of Dopamine Signaling with Machine Learning

The emergence of new tools to image neurotransmitters, neuromodulators, and neuropeptides has transformed our understanding of the role of neurochemistry in brain development and cognition, yet analysis of this new dimension of neurobiological information remains challenging. Here, we image dopamine modulation in striatal brain tissue slices with near-infrared catecholamine nanosensors (nIRCat) and implement machine learning to determine which features of dopamine modulation are unique to changes in stimulation strength, and to different neuroanatomical regions. We trained a support vector machine and a random forest classifier to decide whether the recordings were made from the dorsolateral striatum (DLS) versus the dorsomedial striatum (DMS) and find that machine learning is able to accurately distinguish dopamine release that occurs in DLS from that occurring in DMS in a manner unachievable with canonical statistical analysis. Furthermore, our analysis determines that dopamine modulatory signals including the number of unique dopamine release sites and peak dopamine released per stimulation event are most predictive of neuroanatomy. This is in light of integrated neuromodulator amount being the conventional metric used to monitor neuromodulation in animal studies. Lastly, our study finds that machine learning discrimination of different stimulation strengths or neuroanatomical regions is only possible in adult animals, suggesting a high degree of variability in dopamine modulatory kinetics during animal development. Our study highlights that machine learning could become a broadly utilized tool to differentiate between neuroanatomical regions or between neurotypical and disease states, with features not detectable by conventional statistical analysis.

Identifying Neural Signatures of Dopamine Signaling with Machine Learning

The emergence of new tools to image neurotransmitters, neuromodulators, and neuropeptides has transformed our understanding of the role of neurochemistry in brain development and cognition, yet analysis of this new dimension of neurobiological information remains challenging. Here, we image dopamine modulation in striatal brain tissue slices with near infrared catecholamine nanosensors (nIRCat) and implement machine learning to determine which features of dopamine modulation are unique to changes in stimulation strength, and to different neuroanatomical regions. We trained a support vector machine and a random forest classifier to determine whether recordings were made from the dorsolateral striatum (DLS) versus the dorsomedial striatum (DMS) and find that machine learning is able to accurately distinguish dopamine release that occurs in DLS from that occurring in DMS in a manner unachievable with canonical statistical analysis. Furthermore, our analysis determines that dopamine modulatory signals including the number of unique dopamine release sites and peak dopamine released per stimulation event are most predictive of neuroanatomy yet note that integrated neuromodulator amount is the conventional metric currently used to monitor neuromodulation in animal studies. Lastly, our study finds that machine learning discrimination of different stimulation strengths or neuroanatomical regions is only possible in adult animals, suggesting a high degree of variability in dopamine modulatory kinetics during animal development. Our study highlights that machine learning could become a broadly-utilized tool to differentiate between neuroanatomical regions, or between neurotypical and disease states, with features not detectable by conventional statistical analysis.

Social Enhancement of Adult Neurogenesis in Zebrafish is Not Regulated by Cortisol

In Mammals adult neurogenesis is influenced by environmental conditions, and the glucocorticoid hormones (GC) play a major role in this regulation. In contrast in fish, the study of the effects of cortisol on the regulation of environmental driven adult neurogenesis has produced conflicting results. While in some species elevated cortisol levels impair cell proliferation, in others, it promotes cell proliferation and differentiation. This lack of consistency may be explained by methodological differences across studies, namely in the stimuli and/or cortisol treatments used. Here, we tested the effects of the social environment on adult neurogenesis, considering a positive and a negative social context, and different durations of cortisol exposure. We hypothesise that there is an interaction between the valence of the social environment and cortisol, such that elevated acute cortisol experienced during social interactions only have a detrimental effect on neurogenesis in negative social contexts. Therefore, fish were exposed to a positive (conspecific shoal) or negative (predator) social experience, and the interaction between the valence of the social context and cortisol exposure (acute and chronic) was tested. Our results indicate that adult neurogenesis is modulated by the social environment, with the number of newly generated cells being dependent on the valence of the social information (positive > negative). These effects were independent of cortisol, either for acute or chronic exposure, highlighting the social environment as a key factor in the modulation of cell proliferation in the adult zebrafish brain, and rejecting a role for cortisol in this modulation.

The neural circuits of monogamous behavior

The interest in studying the neural circuits related to mating behavior and mate choice in monogamous species lies in the parallels found between human social structure and sexual behavior and that of other mammals that exhibit social monogamy, potentially expanding our understanding of human neurobiology and its underlying mechanisms. Extensive research has suggested that social monogamy, as opposed to non-monogamy in mammals, is a consequence of the neural encoding of sociosensory information from the sexual partner with an increased reward value. Thus, the reinforced value of the mate outweighs the reward value of mating with any other potential sexual partners. This mechanism reinforces the social relationship of a breeding pair, commonly defined as a pair bond. In addition to accentuated prosocial behaviors toward the partner, other characteristic behaviors may appear, such as territorial and partner guarding, selective aggression toward unfamiliar conspecifics, and biparental care. Concomitantly, social buffering and distress upon partner separation are also observed. The following work intends to overview and compare known neural and functional circuits that are related to mating and sexual behavior in monogamous mammals. We will particularly discuss reports on Cricetid rodents of the Microtus and Peromyscus genus, and New World primates (NWP), such as the Callicebinae subfamily of the titi monkey and the marmoset (Callithrix spp.). In addition, we will mention the main factors that modulate the neural circuits related to social monogamy and how that modulation may reflect phenotypic differences, ultimately creating the widely observed diversity in social behavior.

Motivational learning biases are differentially modulated by genetic determinants of striatal and prefrontal dopamine function

Dopaminergic neurotransmission plays a pivotal role in appetitively motivated behavior in mammals, including humans. Notably, action and valence are not independent in motivated tasks, and it is particularly difficult for humans to learn the inhibition of an action to obtain a reward. We have previously observed that the carriers of the DRD2/ANKK1 TaqIA A1 allele, that has been associated with reduced striatal dopamine D2 receptor expression, showed a diminished learning performance when required to learn response inhibition to obtain rewards, a finding that was replicated in two independent cohorts. With our present study, we followed two aims: first, we aimed to replicate our finding on the DRD2/ANKK1 TaqIA polymorphism in a third independent cohort (N = 99) and to investigate the nature of the genetic effects more closely using trial-by-trial behavioral analysis and computational modeling in the combined dataset (N = 281). Second, we aimed to assess a potentially modulatory role of prefrontal dopamine availability, using the widely studied COMT Val108/158Met polymorphism as a proxy. We first report a replication of the above mentioned finding. Interestingly, after combining all three cohorts, exploratory analyses regarding the COMT Val108/158Met polymorphism suggest that homozygotes for the Met allele, which has been linked to higher prefrontal dopaminergic tone, show a lower learning bias. Our results corroborate the importance of genetic variability of the dopaminergic system in individual learning differences of action-valence interaction and, furthermore, suggest that motivational learning biases are differentially modulated by genetic determinants of striatal and prefrontal dopamine function.

Early-life adversity selectively interrupts the dendritic differentiation of dorsolateral striatal neurons in male mice

The effects of early-life adversity (ELA) on dendritic differentiation of striatal neurons were investigated in the dorsal striatum including the dorsomedial striatum and dorsolateral striatum (DMS and DLS, respectively). An animal model of ELA was created by changing the growth environment of newborn mouse pups by giving limited bedding and nesting materials from postnatal day 2 to day 9 (P2-P9). One week after the stress paradigm (P16), the dendritic branches and spines of striatal spiny neurons as well as the synapses represented by postsynaptic density protein-95 (PSD-95) in DMS and DLS were stereologically analyzed. Adverse experience in early life selectively affected the spiny neurons in DLS, leading to abundant proximal dendritic branches and an increased number of filopodia-like protrusions, but a reduced number of dendritic spines. The selective effects of stress on neurons in DLS were further identified by reduced expression of PSD-95, including a reduced optical density of PSD-95 immunoreactivity and fewer individual PSD-95 immunoreactive synapses in this region. Notably, stress in early life affected either D1 or D2 dopamine receptor-expressing DLS neurons. These findings suggest that adverse early-life experience delayed the maturation of dendritic spines on neurons in the dorsolateral striatum. Altered dendritic differentiation provoked by stress in early life may contribute critically to the formation of proper neuronal circuits in the dorsal striatum and, therefore, affect striatum-dependent habitual behavior and emotional function later in life.

Vulnerability to ethanol sensitization predicts higher intake and motivation to self-administer ethanol: Proof of the incentive salience sensitization theory?

Ethanol-induced behavioral sensitization (EIBS) is thought to play a key role in addiction. However, whether EIBS is linked to an increase in the motivation to self-administerethanol in an operant paradigm has never been demonstrated, and thus, the motivational sensitization theory (increase in drug wanting) has not been yet confirmed. We investigated using the operant ethanol self-administrationparadigm if the motivation to self-administerethanol (breakpoint) is increased in female mice prone to develop EIBS. Outbred female Swiss mice were treated once a day with 2.5-g ethanol per kilogram during 10 days and challenged with the same dose of ethanol 7 days later. EIBS-pronegroup was characterized by a significant increase in locomotion between the challenge day and day 1. When the difference was not significant, mice were considered as the "EIBS-resistant"group. Mice were then trained to nose poke for a 20% ethanol solution reinforcer under a FR1 and then a FR-2schedule of reinforcement. Motivation was assessed more directly with a progressive ratio schedule. Our results show that there is a positive correlation between EIBS and both the level of intake and motivation. Interestingly, acquisition of ethanol self-administrationwas faster in sensitized mice that also display a quick and long-lastingincrease in ethanol intake together with a lack of effect of alcohol challenge on c-Fosexpression restricted to the dorsolateral striatum. These results further support that EIBS vulnerability is crucial in the development of addictive behaviors and suggest a potential link with habit learning processes.

Dynamic control of neurochemical release with ultrasonically-sensitive nanoshell-tethered liposomes

The unique surface plasmon resonance of hollow gold nanoshells can be used to achieve drug release from liposomes upon laser stimulation, and adapted to mimic the intricate dynamics of neurotransmission ex vivo in brain preparations. However, to induce a physiological response in vivo requires the degree of temporal precision afforded by laser stimulation, but with a greater depth of penetration through tissue. Here we report that the attachment of hollow gold nanoshells to the surface of robust liposomes results in a construct that is highly sensitive to ultrasonic stimulation. The resulting construct can be remotely triggered by low intensity, therapeutic ultrasound. To our knowledge, this is the first example of nanoparticle-liposome system that can be activated by both laser and acoustic stimulation. The system is capable of encapsulating the neurochemical dopamine, and repeatedly releasing small amounts on-demand in a circulating environment, allowing for precise spatiotemporal control over the release profile.

Contributions of the basal ganglia to action sequence learning and performance

Animals engage in intricately woven and choreographed action sequences that are constructed from trial-and-error learning. The mechanisms by which the brain links together individual actions which are later recalled as fluid chains of behavior are not fully understood, but there is broad consensus that the basal ganglia play a crucial role in this process. This paper presents a comprehensive review of the role of the basal ganglia in action sequencing, with a focus on whether the computational framework of reinforcement learning can capture key behavioral features of sequencing and the neural mechanisms that underlie them. While a simple neurocomputational model of reinforcement learning can capture key features of action sequence learning, this model is not sufficient to capture goal-directed control of sequences or their hierarchical representation. The hierarchical structure of action sequences, in particular, poses a challenge for building better models of action sequencing, and it is in this regard that further investigations into basal ganglia information processing may be informative.

Dopamine signals related to appetitive and aversive events in paradigms that manipulate reward and avoidability

Using environmental cues to acquire good and avoid harmful things is critical for survival. Rewarding and aversive outcomes both drive behavior through reinforcement learning and sometimes occur together in the environment, but it remains unclear how these signals are encoded within the brain and if signals for positive and negative reinforcement are encoded similarly. Recent studies demonstrate that the dopaminergic system and interconnected brain regions process both positive and negative reinforcement necessary for approach and avoidance behaviors, respectively. Here, we review these data with a special focus on behavioral paradigms that manipulate both expected reward and the avoidability of aversive events to reveal neural correlates related to value, prediction error encoding, motivation, and salience.

Gene expression in the social behavior network of the wire-tailed manakin (Pipra filicauda) brain

The vertebrate basal forebrain and midbrain contain a set of interconnected nuclei that control social behavior. Conserved anatomical structures and functions of these nuclei have now been documented among fish, amphibians, reptiles, birds and mammals, and these brain regions have come to be known as the vertebrate social behavior network (SBN). While it is known that nuclei (nodes) of the SBN are rich in steroid and neuropeptide activity linked to behavior, simultaneous variation in the expression of neuroendocrine genes among several SBN nuclei has not yet been described in detail. In this study, we use RNA-seq to profile gene expression across seven brain regions representing five nodes of the vertebrate SBN in a passerine bird, the wire-tailed manakin Pipra filicauda. Using weighted gene co-expression network analysis, we reconstructed sets of coregulated genes, showing striking patterns of variation in neuroendocrine gene expression across the SBN. We describe regional variation in gene networks comprising a broad set of hormone receptors, neuropeptides, steroidogenic enzymes, catecholamines and other neuroendocrine signaling molecules. Our findings show heterogeneous patterns of brain gene expression across nodes of the avian SBN and provide a foundation for future analyses of how the regulation of gene networks may mediate social behavior. These results highlight the importance of region-specific sampling in studies of the mechanisms of behavior.

Increase in Glutamatergic Terminals in the Striatum Following Dopamine Depletion in a Rat Model of Parkinson's Disease

Dopaminergic neuron degeneration is known to give rise to dendrite injury and spine loss of striatal neurons, however, changes of intrastriatal glutamatergic terminals and their synapses after 6-hydroxydopamine (6OHDA)-induced dopamine (DA)-depletion remains controversial. To confirm the effect of striatal DA-depletion on the morphology and protein levels of corticostriatal and thalamostriatal glutamatergic terminals and synapses, immunohistochemistry, immuno-electron microscope (EM), western blotting techniques were performed on Parkinson's disease rat models in this study. The experimental results of this study showed that: (1) 6OHDA-induced DA-depletion resulted in a remarkable increase of Vesicular glutamate transporter 1 (VGlut1) + and Vesicular glutamate transporter 2 (VGlut2)+ terminal densities at both the light microscope (LM) and EM levels, and VGlut1+ and VGlut2+ terminal sizes were shown to be enlarged by immuno-EM; (2) Striatal DA-depletion resulted in a decrease in both the total and axospinous terminal fractions of VGlut1+ terminals, but the axodendritic terminal fraction was not significantly different from the control group. However, total, axospinous and axodendritic terminal fractions for VGlut2+ terminals declined significantly after striatal DA-depletion. (3) Western blotting data showed that striatal DA-depletion up-regulated the expression levels of the VGlut1 and VGlut2 proteins. These results suggest that 6OHDA-induced DA-depletion affects corticostriatal and thalamostriatal glutamatergic synaptic inputs, which are involved in the pathological process of striatal neuron injury induced by DA-depletion.

Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning

The brain’s dopaminergic pathways are crucially important for adaptive behavior. They are thought to enable us to approach rewards and stay away from punishments. During learning, dopaminergic reward prediction errors are thought to reinforce previously rewarded actions, so they become easier to repeat. This dopaminergic activity could lead to a systematic bias by which rewarded actions are more readily learned than rewarded inactions. We present two findings. First, dopamine receptors in cortex, dorsal striatum, and nucleus accumbens provide distinct sources of variance in the human brain. Second, the boost in an individual’s learning rate from previously rewarded actions is dependent on the dopamine receptor density in dorsal striatum, a central structure in the dopaminergic circuit.

Learning to act to obtain reward and inhibit to avoid punishment is easier compared with learning the opposite contingencies. This coupling of action and valence is often thought of as a Pavlovian bias, although recent research has shown it may also emerge through instrumental mechanisms. We measured this learning bias with a rewarded go/no-go task in 60 adults of different ages. Using computational modeling, we characterized the bias as being instrumental. To assess the role of endogenous dopamine (DA) in the expression of this bias, we quantified DA D1 receptor availability using positron emission tomography (PET) with the radioligand [¹¹C]SCH23390. Using principal-component analysis on the binding potentials in a number of cortical and striatal regions of interest, we demonstrated that cortical, dorsal striatal, and ventral striatal areas provide independent sources of variance in DA D1 receptor availability. Interindividual variation in the dorsal striatal component was related to the strength of the instrumental bias during learning. These data suggest at least three anatomical sources of variance in DA D1 receptor availability separable using PET in humans, and we provide evidence that human dorsal striatal DA D1 receptors are involved in the modulation of instrumental learning biases.

SLC6A3 Polymorphism Predisposes to Dopamine Overdose in Parkinson's Disease

In Parkinson's disease (PD), cognitive functions mediated by brain regions innervated by ventral tegmental area (VTA) worsen with dopamine replacement therapy, whereas processes relying on regions innervated by the substantia nigra pars compacta (SNc) improve. The SLC6A3 gene encodes the dopamine transporter (DAT). The common 9R polymorphism produces higher DAT concentrations and consequently lower baseline dopamine than SLC6A3 wildtype. Whether SLC6A3 genotype modulates the effect of dopaminergic therapy on cognition in PD is not known. We investigated the effect of dopaminergic therapy and SLC6A3 genotype on encoding and recall of abstract images using the Aggie Figures Learning Test in PD patients. Encoding depends upon brain regions innervated by the VTA, whereas recall is mediated by widespread brain regions, a number innervated by the SNc. We found that dopaminergic therapy worsened encoding of abstract images in 9R carriers only. In contrast, dopaminergic therapy improved recall of abstract images in all PD patients, irrespective of SLC6A3 genotype. Our findings suggest that 9R-carrier PD patients are more predisposed to dopamine overdose and medication-induced impairment of cognitive functions mediated by VTA-innervated brain regions. Interestingly, PD patients without the 9R polymorphism did not show such an impairment. SLC6A3 genotype does not modulate the dopaminergic therapy-induced improvement of functions mediated by SNc-innervated regions in PD patients.

A subcortical circuit linking the cerebellum to the basal ganglia engaged in vocal learning

Speech is a complex sensorimotor skill, and vocal learning involves both the basal ganglia and the cerebellum. These subcortical structures interact indirectly through their respective loops with thalamo-cortical and brainstem networks, and directly via subcortical pathways, but the role of their interaction during sensorimotor learning remains undetermined. While songbirds and their song-dedicated basal ganglia-thalamo-cortical circuitry offer a unique opportunity to study subcortical circuits involved in vocal learning, the cerebellar contribution to avian song learning remains unknown. We demonstrate that the cerebellum provides a strong input to the song-related basal ganglia nucleus in zebra finches. Cerebellar signals are transmitted to the basal ganglia via a disynaptic connection through the thalamus and then conveyed to their cortical target and to the premotor nucleus controlling song production. Finally, cerebellar lesions impair juvenile song learning, opening new opportunities to investigate how subcortical interactions between the cerebellum and basal ganglia contribute to sensorimotor learning.

Independent effects of age and levodopa on reversal learning in healthy volunteers

The dopamine overdose hypothesis has provided an important theoretical framework for understanding cognition in Parkinson's disease. It posits that effects of dopaminergic therapy on cognition in Parkinson's disease depend on baseline dopamine levels in brain regions that support different functions. Although functions performed by more severely dopamine-depleted brain regions improve with medication, those associated with less dopamine deficient areas are actually worsened. It is presumed that medication-related worsening of cognition owes to dopamine overdose. We investigated whether age-related changes in baseline dopamine levels would modulate effects of dopaminergic therapy on reward learning in healthy volunteers. In a double-blind, crossover design, healthy younger and older adults completed a probabilistic reversal learning task after treatment with 100/25 mg of levodopa/carbidopa versus placebo. Older adults learned more poorly than younger adults at baseline, being more likely to shift responses after misleading punishment. Levodopa worsened stimulus-reward learning relative to placebo to the same extent in both groups, irrespective of differences in baseline performance and expected dopamine levels. When order effects were eliminated, levodopa induced response shifts after reward more often than placebo. Our results reveal independent deleterious effects of age group and exogenous dopamine on reward learning, suggesting a more complex scenario than predicted by the dopamine overdose hypothesis.

Effect of traumatic brain injury on nicotine-induced modulation of dopamine release in the striatum and nucleus accumbens shell

Background

Traumatic brain injury is associated with substantial alterations in reward processing, but underlying mechanisms are controversial.

Objective

A better understanding of alterations in dopamine (DA) release patterns from the dorsal striatum and nucleus accumbens shell (NAc) may provide insights into posttraumatic reward pathology.

Materials and Methods

The patterns of DA release with or without exposure to nicotine in brain slices with striatum and NAc, isolated from Sprague-Dawley rats with 6 psi fluid percussion (FPI) or sham injury were analysis by using fast-scan cyclic voltammetry. Tonic and phasic DA releases were assessed using single pulse and 10 pulses at 25 Hz, respectively. DA release relative to stimulation intensity, frequency, number of pulses, and paired-pulse facilitation was evaluated to determine release probability and response to bursting.

Results

There was a profound suppression in tonic DA release after nicotine desensitization after FPI, and the input/output curve for the DA release based on stimulation intensity was shifted to the right. FPI was associated with a significant decrease in frequency-dependent DA release augmentation, DA release induced by high frequency stimulation trains, and DA release in response to paired-pulse facilitation. The effect of nicotine desensitization was similar in FPI and sham-injured animals, although significantly smaller after FPI. Nicotine desensitization–induced differences between phasic and tonic release concentrations that contrasted with the reward-related signals then became less prominent in NAc after FPI.

Conclusions

TBI blunts DA release from mesolimbic reward centers, and more intense stimuli are required to produce context-dependent DA release sufficient to have a physiological effect.

Implications

The nicotine desensitization-related suppression in tonic DA release was profound with right-ward shift of the input/output curve for DA release after FPI. FPI was associated with a significant decrease in frequency-dependent DA release augmentation, DA release induced by high frequency stimulation trains, and DA release in response to paired-pulse facilitation. Nicotine desensitization–induced differences between phasic and tonic release concentrations that contrasted with the reward-related signals then became less prominent in NAc after FPI. TBI thus blunts DA release from mesolimbic reward centers, and more intense stimuli are required to produce context-dependent DA release sufficient to have a physiological effect.

The Neurobiology of Mutualistic Behavior: The Cleanerfish Swims into the Spotlight

One of the most notorious examples of cooperation between different species happens in the cleaner-client fish mutualism. The best known cleaner fish species, the bluestreak Indo-Pacific cleaner wrasse Labroides dimidiatus has been a model system to study the evolution of cooperation between unrelated animals and between distinct species during the last couple of decades. Given that the cleanerfish mutualism is well-established for behavioral studies of cooperation, it offered an outstanding opportunity to identify the link between cooperation, social cognition, and to undertake proximate studies, which were severely in need. This review surveys the current achievements of several recent studies, pointing towards the potential of the cleanerfish mutualism as a relevant model system for future accomplishments in neuroendocrine research.

Navigating Monogamy: Nonapeptide Sensitivity in a Memory Neural Circuit May Shape Social Behavior and Mating Decisions

The role of memory in mating systems is often neglected despite the fact that most mating systems are defined in part by how animals use space. Monogamy, for example, is usually characterized by affiliative (e.g., pairbonding) and defensive (e.g., mate guarding) behaviors, but a high degree of spatial overlap in home range use is the easiest defining feature of monogamous animals in the wild. The nonapeptides vasopressin and oxytocin have been the focus of much attention for their importance in modulating social behavior, however this work has largely overshadowed their roles in learning and memory. To date, the understanding of memory systems and mechanisms governing social behavior have progressed relatively independently. Bridging these two areas will provide a deeper appreciation for understanding behavior, and in particular the mechanisms that mediate reproductive decision-making. Here, I argue that the ability to mate effectively as monogamous individuals is linked to the ability to track conspecifics in space. I discuss the connectivity across some well-known social and spatial memory nuclei, and propose that the nonapeptide receptors within these structures form a putative “socio-spatial memory neural circuit.” This purported circuit may function to integrate social and spatial information to shape mating decisions in a context-dependent fashion. The lateral septum and/or the nucleus accumbens, and neuromodulation therein, may act as an intermediary to relate socio-spatial information with social behavior. Identifying mechanisms responsible for relating information about the social world with mechanisms mediating mating tactics is crucial to fully appreciate the suite of factors driving reproductive decisions and social decision-making.

NMDAR dependent intracellular responses associated with cocaine conditioned place preference behavior

The aim of this study was to investigate the intracellular responses associated with the acquisition and expression of cocaine-context associations. ERK (extracellular regulated kinase), CREB (cAMP responsive element binding protein), FosB and ΔFosB proteins were of particular interest due to their involvement in cocaine reward and in synaptic plasticity underlying learning and memory. We used the conditioned place preference (CPP) paradigm, which employs a Pavlovian conditioning procedure to establish an association between a drug-paired environment and the drug's rewarding effects, to study the role of these signaling pathways in cocaine-context associations. N-methyl-D-aspartate receptor (NMDAR) antagonism prior to cocaine administration during conditioning blocked the acquisition of cocaine CPP and reduced Nucleus Accumbens (NAc) phosphorylated-ERK (pERK) and phosphorylated CREB (pCREB) levels following the CPP test (drug-free). We also show that cocaine-induced increases in Caudate Putamen (CPu) FosB and ΔFosB levels are decreased after MK-801 pre-treatment during conditioning. In addition, our results provide evidence for the involvement of striatal SIRT (Silent Information Regulator of Transcription) proteins in cocaine-CPP. These results will aid in the advancement of general knowledge about the molecular formation and retrieval of cocaine-associated memories that can be used in the future when designing treatments for cocaine addiction that target both prevention and relapse.

Stimulation of dopamine D₁ receptor improves learning capacity in cooperating cleaner fish

Accurate contextual decision-making strategies are important in social environments. Specific areas in the brain are tasked to process these complex interactions and generate correct follow-up responses. The dorsolateral and dorsomedial parts of the telencephalon in the teleost fish brain are neural substrates modulated by the neurotransmitter dopamine (DA), and are part of an important neural circuitry that drives animal behaviour from the most basic actions such as learning to search for food, to properly choosing partners and managing decisions based on context. The Indo-Pacific cleaner wrasse Labroides dimidiatus is a highly social teleost fish species with a complex network of interactions with its 'client' reef fish. We asked if changes in DA signalling would affect individual learning ability by presenting cleaner fish two ecologically different tasks that simulated a natural situation requiring accurate decision-making. We demonstrate that there is an involvement of the DA system and D1 receptor pathways on cleaners' natural abilities to learn both tasks. Our results add significantly to the growing literature on the physiological mechanisms that underlie and facilitate the expression of cooperative abilities.

Deficits in context-dependent adaptive coding of reward in schizophrenia

Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precise representation of rewards and could have detrimental effects for an organism’s ability to optimally engage with its environment. In schizophrenia, reward processing is known to be impaired and has been linked to different symptom dimensions. However, despite the fundamental significance of coding reward adaptively, no study has elucidated whether adaptive reward processing is impaired in schizophrenia. We therefore studied patients with schizophrenia (n=27) and healthy controls (n=25), using functional magnetic resonance imaging in combination with a variant of the monetary incentive delay task. Compared with healthy controls, patients with schizophrenia showed less efficient neural adaptation to the current reward context, which leads to imprecise neural representation of reward. Importantly, the deficit correlated with total symptom severity. Our results suggest that some of the deficits in reward processing in schizophrenia might be due to inefficient neural adaptation to the current reward context. Furthermore, because adaptive coding is a ubiquitous feature of the brain, we believe that our findings provide an avenue in defining a general impairment in neural information processing underlying this debilitating disorder.

Catecholaminergic based therapies for functional recovery after TBI

Among the many pathophysiologic consequences of traumatic brain injury are changes in catecholamines, including dopamine, epinephrine, and norepinephrine. In the context of TBI, dopamine is the one most extensively studied, though some research exploring epinephrine and norepinephrine have also been published. The purpose of this review is to summarize the evidence surrounding use of drugs that target the catecholaminergic system on pathophysiological and functional outcomes of TBI using published evidence from pre-clinical and clinical brain injury studies. Evidence of the effects of specific drugs that target catecholamines as agonists or antagonists will be discussed. Taken together, available evidence suggests that therapies targeting the catecholaminergic system may attenuate functional deficits after TBI. Notably, it is fairly common for TBI patients to be treated with catecholamine agonists for either physiological symptoms of TBI (e.g. altered cerebral perfusion pressures) or a co-occuring condition (e.g. shock), or cognitive symptoms (e.g. attentional and arousal deficits). Previous clinical trials are limited by methodological limitations, failure to replicate findings, challenges translating therapies to clinical practice, the complexity or lack of specificity of catecholamine receptors, as well as potentially counfounding effects of personal and genetic factors. Overall, there is a need for additional research evidence, along with a need for systematic dissemination of important study details and results as outlined in the common data elements published by the National Institute of Neurological Diseases and Stroke. Ultimately, a better understanding of catecholamines in the context of TBI may lead to therapeutic advancements. This article is part of a Special Issue entitled SI:Brain injury and recovery.

Morphological changes of glutamatergic synapses in animal models of Parkinson's disease

The striatum and the subthalamic nucleus (STN) are the main entry doors for extrinsic inputs to reach the basal ganglia (BG) circuitry. The cerebral cortex, thalamus and brainstem are the key sources of glutamatergic inputs to these nuclei. There is anatomical, functional and neurochemical evidence that glutamatergic neurotransmission is altered in the striatum and STN of animal models of Parkinson’s disease (PD) and that these changes may contribute to aberrant network neuronal activity in the BG-thalamocortical circuitry. Postmortem studies of animal models and PD patients have revealed significant pathology of glutamatergic synapses, dendritic spines and microcircuits in the striatum of parkinsonians. More recent findings have also demonstrated a significant breakdown of the glutamatergic corticosubthalamic system in parkinsonian monkeys. In this review, we will discuss evidence for synaptic glutamatergic dysfunction and pathology of cortical and thalamic inputs to the striatum and STN in models of PD. The potential functional implication of these alterations on synaptic integration, processing and transmission of extrinsic information through the BG circuits will be considered. Finally, the significance of these pathological changes in the pathophysiology of motor and non-motor symptoms in PD will be examined.

Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning

There are two prevailing notions regarding the involvement of the corticobasal ganglia system in value‐based learning: (i) the direct and indirect pathways of the basal ganglia are crucial for appetitive and aversive learning, respectively, and (ii) the activity of midbrain dopamine neurons represents reward‐prediction error. Although (ii) constitutes a critical assumption of (i), it remains elusive how (ii) holds given (i), with the basal‐ganglia influence on the dopamine neurons. Here we present a computational neural‐circuit model that potentially resolves this issue. Based on the latest analyses of the heterogeneous corticostriatal neurons and connections, our model posits that the direct and indirect pathways, respectively, represent the values of upcoming and previous actions, and up‐regulate and down‐regulate the dopamine neurons via the basal‐ganglia output nuclei. This explains how the difference between the upcoming and previous values, which constitutes the core of reward‐prediction error, is calculated. Simultaneously, it predicts that blockade of the direct/indirect pathway causes a negative/positive shift of reward‐prediction error and thereby impairs learning from positive/negative error, i.e. appetitive/aversive learning. Through simulation of reward‐reversal learning and punishment‐avoidance learning, we show that our model could indeed account for the experimentally observed features that are suggested to support notion (i) and could also provide predictions on neural activity. We also present a behavioral prediction of our model, through simulation of inter‐temporal choice, on how the balance between the two pathways relates to the subject's time preference. These results indicate that our model, incorporating the heterogeneity of the cortical influence on the basal ganglia, is expected to provide a closed‐circuit mechanistic understanding of appetitive/aversive learning.

Striatal Hypersensitivity During Stress in Remitted Individuals with Recurrent Depression

BACKGROUND

Increased sensitivity to stress and dysfunctional reward processing are two primary characteristics of major depressive disorder (MDD) that may persist after remission. Preclinical work has established the pivotal role of the striatum in mediating both stress and reward responses. Human neuroimaging studies have corroborated these preclinical findings and highlighted striatal dysfunction in MDD in response to reward but have yet to investigate striatal function during stress, in particular in individuals with recurrent depression.

METHODS

A validated mild psychological stress task involving viewing of negative stimuli during functional magnetic resonance imaging was conducted in 33 remitted individuals with a history of recurrent major depressive disorder (rMDD) and 35 matched healthy control subjects. Cortisol and anxiety levels were assessed throughout scanning. Stress-related activation was investigated in three striatal regions: caudate, nucleus accumbens, and putamen. Psychophysiologic interaction analyses probed connectivity of regions with central structures of the neural stress circuitry, such as the amygdala and hippocampus.

RESULTS

The task increased cortisol and anxiety levels, although to a greater extent in rMDD individuals than healthy control subjects. In response to the negative stimuli, rMDD individuals, but not controls, also exhibited significantly potentiated caudate, nucleus accumbens, and putamen activations and increased caudate-amygdala and caudate-hippocampus connectivity.

CONCLUSIONS

The findings highlight striatal hypersensitivity in response to a mild psychological stress in rMDD, as manifested by hyperactivation and hyperconnectivity with the amygdala and hippocampus. Striatal hypersensitivity during stress might thus constitute a trait mark of depression, providing a potential neural substrate for the interaction between stress and reward dysfunction in MDD.

Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks

The striatum is a major input site of the basal ganglia, which play an essential role in decision making. Previous studies have suggested that subareas of the striatum have distinct roles: the dorsolateral striatum (DLS) functions in habitual action, the dorsomedial striatum (DMS) in goal-directed actions, and the ventral striatum (VS) in motivation. To elucidate distinctive functions of subregions of the striatum in decision making, we systematically investigated information represented by phasically active neurons in DLS, DMS, and VS. Rats performed two types of choice tasks: fixed- and free-choice tasks. In both tasks, rats were required to perform nose poking to either the left or right hole after cue-tone presentation. A food pellet was delivered probabilistically depending on the presented cue and the selected action. The reward probability was fixed in fixed-choice task and varied in a block-wise manner in free-choice task. We found the following: (1) when rats began the tasks, a majority of VS neurons increased their firing rates and information regarding task type and state value was most strongly represented in VS; (2) during action selection, information of action and action values was most strongly represented in DMS; (3) action-command information (action representation before action selection) was stronger in the fixed-choice task than in the free-choice task in both DLS and DMS; and (4) action-command information was strongest in DLS, particularly when the same choice was repeated. We propose a hypothesis of hierarchical reinforcement learning in the basal ganglia to coherently explain these results.

A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface

A computational model yields new insights into the bewildering complexity of cortico-striatal plasticity and its rationale for supporting operant learning.

Operant learning requires that reinforcement signals interact with action representations at a suitable neural interface. Much evidence suggests that this occurs when phasic dopamine, acting as a reinforcement prediction error, gates plasticity at cortico-striatal synapses, and thereby changes the future likelihood of selecting the action(s) coded by striatal neurons. But this hypothesis faces serious challenges. First, cortico-striatal plasticity is inexplicably complex, depending on spike timing, dopamine level, and dopamine receptor type. Second, there is a credit assignment problem—action selection signals occur long before the consequent dopamine reinforcement signal. Third, the two types of striatal output neuron have apparently opposite effects on action selection. Whether these factors rule out the interface hypothesis and how they interact to produce reinforcement learning is unknown. We present a computational framework that addresses these challenges. We first predict the expected activity changes over an operant task for both types of action-coding striatal neuron, and show they co-operate to promote action selection in learning and compete to promote action suppression in extinction. Separately, we derive a complete model of dopamine and spike-timing dependent cortico-striatal plasticity from in vitro data. We then show this model produces the predicted activity changes necessary for learning and extinction in an operant task, a remarkable convergence of a bottom-up data-driven plasticity model with the top-down behavioural requirements of learning theory. Moreover, we show the complex dependencies of cortico-striatal plasticity are not only sufficient but necessary for learning and extinction. Validating the model, we show it can account for behavioural data describing extinction, renewal, and reacquisition, and replicate in vitro experimental data on cortico-striatal plasticity. By bridging the levels between the single synapse and behaviour, our model shows how striatum acts as the action-reinforcement interface.

A key component of survival is the ability to learn which actions, in what contexts, yield useful and rewarding outcomes. Actions are encoded in the brain in the cortex but, as many actions are possible at any one time, there needs to be a mechanism to select which one is to be performed. This problem of action selection is mediated by a set of nuclei known as the basal ganglia, which receive convergent “action requests” from all over the cortex and select the one that is currently most important. Working out which is most important is determined by the strength of the input from each action request: the stronger the connection, the more important that action. Understanding learning thus requires understanding how that strength is changed by the outcome of each action. We built a computational model that demonstrates how the brain's internal signal for outcome (carried by the neurotransmitter dopamine) changes the strength of these cortical connections to learn the selection of rewarded actions, and the suppression of unrewarded ones. Our model shows how several known signals in the brain work together to shape the influence of cortical inputs to the basal ganglia at the interface between our actions and their outcomes.

Region and context-specific intracellular responses associated with cocaine-induced conditioned place preference expression

The development and maintenance of cocaine addiction depend heavily on learned reward-environment associations that can induce drug-seeking behavior and relapse. Understanding the mechanisms underlying these cue-induced conditioned responses is important for relapse prevention. To test whether intracellular responses measured after cocaine conditioned place preference (CPP) expression are context-dependent, we re-exposed cocaine-treated rats (drug-free) to an environment previously paired with cocaine or saline, 24h after the CPP test. After 8 days of cocaine CPP training with one of two cocaine doses (5mg/kg or 20mg/kg, i.p.), CPP was expressed only after conditioning with the higher cocaine dose. In CPP expressing rats, locomotor responses after re-exposure to the cocaine-chamber were greater than in rats re-exposed to the saline-paired chamber. Nucleus Accumbens (NAc) phosphorylated ERK (pERK) levels were increased after re-exposure to the cocaine-paired, but not the saline-paired chamber, regardless of whether or not CPP behavior was expressed. Caudate Putamen (CPu) pERK and FosB protein levels increased after re-exposure to the cocaine chamber only after conditioning with the higher cocaine dose. Conversely, the higher cocaine dose, independent of environment, resulted in increased NAc FosB, ΔFosB and phosphorylated CREB (pCREB) protein levels compared to those conditioned with 5mg/kg cocaine (non-CPP-expressing). Our results suggest that NAc ERK phosphorylation may be involved with retrieving the contextual information of a cocaine-association, without necessarily motivating the expression of CPP behavior. Additionally, we show distinct patterns of intracellular responses in the NAc and CPu indicating a region-specific role for pERK/pCREB/FosB intracellular signaling in the retrieval of cocaine-context associations.

Positive and negative affective processing exhibit dissociable functional hubs during the viewing of affective pictures

Recent resting-state functional magnetic resonance imaging (fMRI) studies using graph theory metrics have revealed that the functional network of the human brain possesses small-world characteristics and comprises several functional hub regions. However, it is unclear how the affective functional network is organized in the brain during the processing of affective information. In this study, the fMRI data were collected from 25 healthy college students as they viewed a total of 81 positive, neutral, and negative pictures. The results indicated that affective functional networks exhibit weaker small-worldness properties with higher local efficiency, implying that local connections increase during viewing affective pictures. Moreover, positive and negative emotional processing exhibit dissociable functional hubs, emerging mainly in task-positive regions. These functional hubs, which are the centers of information processing, have nodal betweenness centrality values that are at least 1.5 times larger than the average betweenness centrality of the network. Positive affect scores correlated with the betweenness values of the right orbital frontal cortex (OFC) and the right putamen in the positive emotional network; negative affect scores correlated with the betweenness values of the left OFC and the left amygdala in the negative emotional network. The local efficiencies in the left superior and inferior parietal lobe correlated with subsequent arousal ratings of positive and negative pictures, respectively. These observations provide important evidence for the organizational principles of the human brain functional connectome during the processing of affective information.

Valenced action/inhibition learning in humans is modulated by a genetic variant linked to dopamine D2 receptor expression

Motivational salience plays an important role in shaping human behavior, but recent studies demonstrate that human performance is not uniformly improved by motivation. Instead, action has been shown to dominate valence in motivated tasks, and it is particularly difficult for humans to learn the inhibition of an action to obtain a reward, but the neural mechanism behind this behavioral specificity is yet unclear. In all mammals, including humans, the monoamine neurotransmitter dopamine is particularly important in the neural manifestation of appetitively motivated behavior, and the human dopamine system is subject to considerable genetic variability. The well-studied TaqIA restriction fragment length polymorphism (rs1800497) has previously been shown to affect striatal dopamine metabolism. In this study we investigated a potential effect of this genetic variation on motivated action/inhibition learning. Two independent cohorts consisting of 87 and 95 healthy participants, respectively, were tested using the previously described valenced go/no-go learning paradigm in which participants learned the reward-associated no-go condition significantly worse than all other conditions. This effect was modulated by the TaqIA polymorphism, with carriers of the A1 allele showing a diminished learning-related performance enhancement in the rewarded no-go condition compared to the A2 homozygotes. This result highlights a modulatory role for genetic variability of the dopaminergic system in individual learning differences of action-valence interaction.

Impact of P-glycoprotein at the blood-brain barrier on the uptake of heroin and its main metabolites: behavioral effects and consequences on the transcriptional responses and reinforcing properties

RATIONALE

Transport across the BBB is a determinant of the rate and extent of drug distribution in the brain. Heroin exerts its effects through its principal metabolites 6-monoacetyl-morphine (6-MAM) and morphine. Morphine is a known substrate of P-glycoprotein (P-gp) at the blood-brain-barrier (BBB) however, little is known about the interaction of heroin and 6-MAM with P-gp.

OBJECTIVE

The objective of this paper is to study the role of the P-gp-mediated efflux at the BBB in the behavioral and molecular effects of heroin and morphine.

METHODS

The transport rates of heroin and its main metabolites, at the BBB, were measured in mice by in situ brain perfusion. We then examined the effect of inhibition of P-gp on the acute nociception, locomotor activity, and gene expression modulations induced by heroin and morphine. The effect of P-gp inhibition during the acquisition of morphine-induced place preference was also studied.

RESULTS

Inhibition of P-gp significantly increased the uptake of morphine but not that of heroin nor 6-MAM. Inhibition of P-gp significantly increased morphine-induced acute analgesia and locomotor activity but did not affect the behavioral effects of heroin; in addition, acute transcriptional responses to morphine were selectively modulated in the nucleus accumbens. Increasing morphine uptake by the brain significantly increased its reinforcing properties in the place preference paradigm.

CONCLUSIONS

The present study demonstrated that acute inhibition of P-gp not only modulates morphine-induced behavioral effects but also its transcriptional effects and reinforcing properties. This suggests that, in the case of morphine, transport across the BBB is critical for the development of dependence.

Mimicking subsecond neurotransmitter dynamics with femtosecond laser stimulated nanosystems

Existing nanoscale chemical delivery systems target diseased cells over long, sustained periods of time, typically through one-time, destructive triggering. Future directions lie in the development of fast and robust techniques capable of reproducing the pulsatile chemical activity of living organisms, thereby allowing us to mimic biofunctionality. Here, we demonstrate that by applying programmed femtosecond laser pulses to robust, nanoscale liposome structures containing dopamine, we achieve sub-second, controlled release of dopamine – a key neurotransmitter of the central nervous system – thereby replicating its release profile in the brain. The fast delivery system provides a powerful new interface with neural circuits, and to the larger range of biological functions that operate on this short timescale.

Examining dorsal striatum in cognitive effort using Parkinson's disease and fMRI

OBJECTIVE

Understanding cognition mediated by the striatum can clarify cognitive deficits in Parkinson's disease (PD). Previously, we claimed that dorsal striatum (DS) mediates cognitive flexibility. To refute the possibility that variation in cognitive effort confounded our observations, we reexamined our data to dissociate cognitive flexibility from effort. PD provides a model for exploring DS-mediated functions. In PD, dopamine-producing cells supplying DS are significantly degenerated. DS-mediated functions are impaired off and improved on dopamine replacement medication. Functional magnetic resonance imaging (fMRI) can confirm striatum-mediated functions.

METHODS

Twenty-two PD patients, off-on dopaminergic medication, and 22 healthy age-matched controls performed a number selection task. Numerical distance between number pairs varied systematically. Selecting between two numbers that are closer versus distant in magnitude is more effortful: the symbolic distance effect. However, selecting between closer versus distant number pairs is equivalent in the need to alter attention or response strategies (i.e., cognitive flexibility). In Experiment 2, 28 healthy participants performed the same task with simultaneous measurement of brain activity with fMRI.

RESULTS

The symbolic distance effect was equivalent for PD versus control participants and across medication sessions. Furthermore, symbolic distance did not correlate with DS activation using fMRI. In this dataset, we showed previously that integrating conflicting influences on decision making is (1) impaired in PD and improved by dopaminergic therapy and (2) associated with preferential DS activation using fMRI.

INTERPRETATION

These findings support the notion that DS mediates cognitive flexibility specifically, not merely cognitive effort, accounting for some cognitive deficits in PD and informing treatment.

Easy rider: monkeys learn to drive a wheelchair to navigate through a complex maze

The neurological bases of spatial navigation are mainly investigated in rodents and seldom in primates. The few studies led on spatial navigation in both human and non-human primates are performed in virtual, not in real environments. This is mostly because of methodological difficulties inherent in conducting research on freely-moving monkeys in real world environments. There is some incertitude, however, regarding the extrapolation of rodent spatial navigation strategies to primates. Here we present an entirely new platform for investigating real spatial navigation in rhesus monkeys. We showed that monkeys can learn a pathway by using different strategies. In these experiments three monkeys learned to drive the wheelchair and to follow a specified route through a real maze. After learning the route, probe tests revealed that animals successively use three distinct navigation strategies based on i) the place of the reward, ii) the direction taken to obtain reward or iii) a cue indicating reward location. The strategy used depended of the options proposed and the duration of learning. This study reveals that monkeys, like rodents and humans, switch between different spatial navigation strategies with extended practice, implying well-conserved brain learning systems across different species. This new task with freely driving monkeys provides a good support for the electrophysiological and pharmacological investigation of spatial navigation in the real world by making possible electrophysiological and pharmacological investigations.

Subcortical regional morphology correlates with fluid and spatial intelligence

Neuroimaging studies have revealed associations between intelligence and brain morphology. However, researchers have focused primarily on the anatomical features of the cerebral cortex, whereas subcortical structures, such as the basal ganglia (BG), have often been neglected despite extensive functional evidence on their relation with higher-order cognition. Here we performed shape analyses to understand how individual differences in BG local morphology account for variability in cognitive performance. Structural MRI was acquired in 104 young adults (45 men, 59 women, mean age = 19.83, SD = 1.64), and the outer surface of striatal structures (caudate, nucleus accumbens, and putamen), globus pallidus, and thalamus was estimated for each subject and hemisphere. Further, nine cognitive tests were used to measure fluid (Gf), crystallized (Gc), and spatial intelligence (Gv). Latent scores for these factors were computed by means of confirmatory factor analysis and regressed vertex-wise against subcortical shape (local displacements of vertex position), controlling for age, sex, and adjusted for brain size. Significant results (FDR < 5%) were found for Gf and Gv, but not Gc, for the right striatal structures and thalamus. The main results show a relative enlargement of the rostral putamen, which is functionally connected to the right dorsolateral prefrontal cortex and other intelligence-related prefrontal areas.

Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment

RATIONALE

Decision-making involves two fundamental axes of control namely valence, spanning reward and punishment, and action, spanning invigoration and inhibition. We recently exploited a go/no-go task whose contingencies explicitly decouple valence and action to show that these axes are inextricably coupled during learning. This results in a disadvantage in learning to go to avoid punishment and in learning to no-go to obtain a reward. The neuromodulators dopamine and serotonin are likely to play a role in these asymmetries: Dopamine signals anticipation of future rewards and is also involved in an invigoration of motor responses leading to reward, but it also arbitrates between different forms of control. Conversely, serotonin is implicated in motor inhibition and punishment processing.

OBJECTIVE

To investigate the role of dopamine and serotonin in the interaction between action and valence during learning.Methods We combined computational modeling with pharmacological manipulation in 90 healthy human volunteers, using levodopa and citalopram to affect dopamine and serotonin, respectively.

RESULTS

We found that, after administration of levodopa,action learning was less affected by outcome valence when compared with the placebo and citalopram groups. This highlights in this context a predominant effect of levodopa in controlling the balance between different forms of control.Citalopram had distinct effects, increasing participants'tendency to perform active responses independent of outcome valence, consistent with a role in decreasing motor inhibition.

CONCLUSIONS

Our findings highlight the rich complexities of the roles played by dopamine and serotonin during instrumental learning.