Striatal dopamine release in the rat during a cued lever-press task for food reward and the development of changes over time measured using high-speed voltammetry

Role of the striatal dopamine, GABA and opioid systems in mediating feeding and fat intake

Food intake, which is a highly reinforcing behavior, provides nutrients required for survival in all animals. However, when fat and sugar consumption goes beyond the daily needs, it can favor obesity. The prevalence and severity of this health problem has been increasing with time. Besides covering nutrient and energy needs, food and in particular its highly palatable components, such as fats, also induce feelings of joy and pleasure. Experimental evidence supports a role of the striatal complex and of the mesolimbic dopamine system in both feeding and food-related reward processing, with the nucleus accumbens as a key target for reward or reinforcing-associated signaling during food intake behavior. In this review, we provide insights concerning the impact of feeding, including fat intake, on different types of receptors and neurotransmitters present in the striatal complex. Reciprocally, we also cover the evidence for a modulation of palatable food intake by different neurochemical systems in the striatal complex and in particular the nucleus accumbens, with a focus on dopamine, GABA and the opioid system.

Nucleus Accumbens Functional Connectivity with the Frontoparietal Network Predicts Subsequent Change in Body Mass Index for American Children

Background: Nucleus accumbens (NAc) is a brain structure with a well-established role in the brain reward processing system. Altered function of the NAc is shown to have a role in the development of food addiction and obesity. However, less is known about sex differences in the role of NAc function as a predictor of children’s change in body mass index (BMI) over time. Aim: We used the Adolescent Brain Cognitive Development data (version 2.01) to investigate sex differences in the predictive role of the NAc functional connectivity with the frontoparietal network on children’s BMI change over a one-year follow-up period. Methods: This 1-year longitudinal study successfully followed 3784 9–10-year-old children. Regression models were used to analyze the data. The predictor variable was NAc functional connectivity with the frontoparietal network measured using resting-state functional magnetic resonance imaging (fMRI). The primary outcome was BMI at the end of the 1-year follow up. Covariates included race, ethnicity, age, socioeconomic factors, and baseline BMI. Sex was the effect modifier. Results: NAc functional connectivity with the frontoparietal network was predictive of BMI changes over time. This association remained significant above and beyond all covariates. The above association, however, was only significant in female, not male children. Conclusion: The epidemiological observation that NAc functional connectivity is associated with BMI changes in children is an extension of well-controlled laboratory studies that have established the role of the NAc in the brain reward processing. More research is needed on sex differences in the brain regions that contribute to childhood obesity.

Parental Education and Nucleus Accumbens Response to Reward Anticipation: Minorities' Diminished Returns

Background

Considerable research has documented the effects of race and socioeconomic status (SES) on reward-seeking behaviors; however, less is known about the multiplicative effects of race and family SES on brain response to reward anticipation. Marginalization-related Diminished Returns (MDRs) suggest that family SES would show weaker effects on brain development of children in non-White families than in White families.

Objective

To test race by SES variation in Nucleus Accumbens (NAcc) response to reward anticipation (NAcc-RA) among American children.

Methods

For this cross-sectional analysis, data came from the Adolescent Brain Cognitive Development (ABCD) study which included 6,419, 9-10 year old children. The independent variable was parental education. The moderator was race. The primary outcome was the right NAcc-RA. Age, sex, ethnicity, household income, and family structure were the covariates. We used mixed effects regression models that adjusted for the nested nature of the ABCD data.

Results

While high parental education was associated with a higher amount of right NAcc-RA, this effect was stronger for White than non-White children. This finding was evident in the observed interactions between race and parental education on the right NAcc-RA.

Discussion

For American children, NAcc-RA is not shaped by race or family SES, but by their intersection. As a result of the interaction between race and SES (diminished return of SES for non-Whites), middle-class racial minority children may remain susceptible to high-risk behaviors. Disparities in high-risk behaviors in children should not be reduced to economic disparities. Structural inequalities may reduce the return of SES resources for non-White families.

Dual-mode dopamine increases mediated by 5-HT1B and 5-HT2C receptors inhibition, inducing impulsive behavior in trained rats

Patients with eating disorders exhibit problems with appetitive impulse control. Interactions between dopamine and serotonin (5-HT) neuron in this setting are poorly characterized. Here we examined 5-HT receptor-mediated changes in extracellular dopamine during impulsive appetitive behavior in rats. Rats were trained to perform a cued lever-press (LP) task for a food reward such that they stopped experiencing associated dopamine increases. Trained rats were administered the mixed 5-HT1B/2C-receptor antagonist metergoline, the 5-HT2A/2C-receptor antagonist ketanserin, and p-chlorophenylalanine (PCPA). We measured dopamine changes in the ventral striatum using voltammetry and examined the number of premature LPs, reaction time (RT), and reward acquisition rate (RAR). Compared with controls, metergoline increased premature LPs and shortened RT significantly; ketanserin decreased premature LPs and lengthened RT significantly; and PCPA decreased premature LPs, lengthened RT, and decreased RAR significantly. Following metergoline administration, rats exhibited a fast phasic dopamine increase for 0.25-0.75 s after a correct LP, but only during LP for an incorrect LP. No dopamine increases were detected with ketanserin or PCPA, or in controls. After LP task completion, metergoline also caused dopamine to increase slowly and remain elevated; in contrast, ketanserin caused dopamine to increase slowly and decrease rapidly. No slow dopamine increase occurred with PCPA. Inhibition of 5-HT1B- and 5-HT2C-receptors apparently induced dual modes of extracellular dopamine increase: fast phasic, and slow long-lasting. These increases may be associated with the suppression of acquired prediction learning and retention of high motivation for reward, leading to impulsive excessive premature LPs.

Endocannabinoid-dependent modulation of phasic dopamine signaling encodes external and internal reward-predictive cues

The mesolimbic dopamine (DA) system plays an integral role in incentive motivation and reward seeking and a growing body of evidence identifies signal transduction at cannabinoid receptors as a critical modulator of this system. Indeed, administration of exogenous cannabinoids results in burst firing of DA neurons of the ventral tegmental area and increases extracellular DA in the nucleus accumbens (NAcc). Implementation of fast-scan cyclic voltammetry (FSCV) confirms the ability of cannabinoids to augment DA within the NAcc on a subsecond timescale. The use of FSCV along with newly developed highly selective pharmacological compounds advances our understanding of how cannabinoids influence DA transmission and highlights a role for endocannabinoid-modulated subsecond DAergic activation in the incentive motivational properties of not only external, but also internal reward-predictive cues. For example, our laboratory has recently demonstrated that in mice responding under a fixed-interval (FI) schedule for food reinforcement, fluctuations in NAcc DA signal the principal cue predictive of reinforcer availability - time. That is, as the interval progresses, NAcc DA levels decline leading to accelerated food seeking and the resulting characteristic FI scallop pattern of responding. Importantly, administration of WIN 55,212-2, a synthetic cannabinoid agonist, or JZL184, an indirect cannabinoid agonist, increases DA levels during the interval and disrupts this pattern of responding. Along with a wealth of other reports, these results illustrate the role of cannabinoid receptor activation in the regulation of DA transmission and the control of temporally guided reward seeking. The current review will explore the striatal beat frequency model of interval timing as it pertains to cannabinoid signaling and propose a neurocircuitry through which this system modulates interoceptive time cues.

Reinforcement, dopamine and rodent models in drug development for ADHD

Attention deficit hyperactivity disorder (ADHD) presents special challenges for drug development. Current treatment with psychostimulants and nonstimulants is effective, but their mechanism of action beyond the cellular level is incompletely understood. We review evidence suggesting that altered reinforcement mechanisms are a fundamental characteristic of ADHD. We show that a deficit in the transfer of dopamine signals from established positive reinforcers to cues that predict such reinforcers may underlie these altered reinforcement mechanisms, and in turn explain key symptoms of ADHD. We argue that the neural substrates controlling the excitation and inhibition of dopamine neurons during the transfer process are a promising target for future drug development. There is a need to develop animal models and behavioral paradigms that can be used to experimentally investigate these mechanisms and their effects on sensitivity to reinforcement. More specific and selective targeting of drug development may be possible through this approach.

Momentary reward induce changes in excitability of primary motor cortex

OBJECTIVE

To investigate the human primary motor cortex (M1) excitability changes induced by momentary reward.

METHODS

To test the changes in excitatory and inhibitory functions of M1, motor-evoked potentials (MEPs), short-interval intracortical inhibition (SICI) and short-latency afferent inhibition (SAI) were tested in the abductor pollicis brevis (APB) muscle of non-dominant hand in 14 healthy volunteers by transcranial magnetic stimulation (TMS) during a behavioral task in which subjects were pseudorandomly received either reward target or non-target stimuli in response to a cue. To control sensorimotor and attention effects, a sensorimotor control task was done replacing the reward target with non-reward target.

RESULTS

The SICI was increased, and the SAI was decreased significantly during the presentation of the reward target stimuli. Those changes were not evident during non-reward target stimuli in the sensorimotor control task, indicating that this change is specific to momentary reward.

CONCLUSIONS

Momentary rewarding is associated with change in intracortical inhibitory circuits of M1.

SIGNIFICANCE

TMS may be a useful probe to study the reward system in health and in many diseases in which its dysfunction is suspected.

Towards a comprehensive model of stereotypy: integrating operant and neurobiological interpretations

The predominant models on the emergence and maintenance of stereotypy in individuals with developmental disabilities are based on operant and neurobiological interpretations of the behavior. Although the proponents of the two models maintain largely independent lines of research, operant and neurobiological interpretations of stereotypy are not mutually exclusive. The paper reviews the two models of stereotypy and proposes an integrated model using recent findings on the neurobiology of reinforcement. The dopaminergic system and the basal ganglia are both involved in stereotypy and in reinforcement, which provides a potential link between the models. Implications of the integrated model for future research are discussed in terms of improving the assessment and treatment of stereotypy in individuals with developmental disabilities.

Systematic analysis of dopamine receptor genes (DRD1-DRD5) in antipsychotic-induced weight gain

Antipsychotic-induced weight gain has emerged as a serious complication in the treatment of patients with most antipsychotics. We have conducted the first in-depth examination of dopamine receptor genes in antipsychotic-induced weight gain. A total of 206 patients (139 of European descent and 56 African Americans) who underwent treatment for chronic schizophrenia or schizoaffective disorder were evaluated after on average over 6 weeks of treatment. Thirty-six tag single nucleotide polymorphisms (SNPs) and one variable-number tandem repeat, spanning the five dopamine receptor genes (DRD1-DRD5) were analyzed. In the total sample, we found a nominally significant association between the DRD2 rs1079598 marker and weight change using a cutoff of 7% gain (P=0.03). When stratifying the sample according to ethnicity and antipsychotics with highest risk for weight gain, we found significant associations in three DRD2 SNPs: rs6277 (C957T), rs1079598 and rs1800497 (TaqIA). The other genes were primarily negative. We provide evidence that dopamine receptor DRD2 gene variants might be associated with antipsychotic-induced weight gain in chronic schizophrenia patients.

Decreased dopamine type 2 receptor availability after bariatric surgery: preliminary findings

BACKGROUND

Diminished dopaminergic neurotransmission contributes to decreased reward and negative eating behaviors in obesity. Bariatric surgery is the most effective therapy for obesity and rapidly reduces hunger and improves satiety through unknown mechanisms. We hypothesized that dopaminergic neurotransmission would be enhanced after Roux-en-Y-Gastric Bypass (RYGB) and Vertical Sleeve Gastrectomy (VSG) surgery and that these changes would influence eating behaviors and contribute to the positive outcomes from bariatric surgery.

METHODS

Five females with obesity were studied preoperatively and at approximately 7 weeks after RYGB or VSG surgery. Subjects underwent positron emission tomography (PET) imaging with a dopamine type 2 (DA D2) receptor radioligand whose binding is sensitive to competition with endogenous dopamine. Regions of interest (ROI) relevant to eating behaviors were delineated. Fasting enteroendocrine hormones were quantified at each time point.

RESULTS

Body weight decreased as expected after surgery. DA D2 receptor availability decreased after surgery. Regional decreases (mean+/-SEM) were caudate 10+/-3%, putamen 9+/-4%, ventral striatum 8+/-4%, hypothalamus 9+/-3%, substantia nigra 10+/-2%, medial thalamus 8+/-2%, and amygdala 9+/-3%. These were accompanied by significant decreases in plasma insulin (62%) and leptin (41%).

CONCLUSION

The decreases in DA D2 receptor availability after RYGB and VSG most likely reflect increases in extracellular dopamine levels. Enhanced dopaminergic neurotransmission may contribute to improved eating behavior (e.g. reduced hunger and improved satiety) following these bariatric procedures.

Neurobiology of ADHD

Attention-deficit hyperactivity disorder (ADHD) is a prevalent and debilitating disorder diagnosed on the basis of persistent and developmentally-inappropriate levels of overactivity, inattention and impulsivity. The etiology and pathophysiology of ADHD is incompletely understood. There is evidence of a genetic basis for ADHD but it is likely to involve many genes of small individual effect. Differences in the dimensions of the frontal lobes, caudate nucleus, and cerebellar vermis have been demonstrated. Neuropsychological testing has revealed a number of well documented differences between children with and without ADHD. These occur in two main domains: executive function and motivation although neither of these is specific to ADHD. In view of the recent advances in the neurobiology of reinforcement, we concentrate in this review on altered reinforcement mechanisms. Among the motivational differences, many pieces of evidence indicate that an altered response to reinforcement may play a central role in the symptoms of ADHD. In particular, sensitivity to delay of reinforcement appears to be a reliable finding. We review neurobiological mechanisms of reinforcement and discuss how these may be altered in ADHD, with particular focus on the neurotransmitter dopamine and its actions at the cellular and systems level. We describe how dopamine cell firing activity is normally associated with reinforcing events, and transfers to earlier time-points in the behavioural sequence as reinforcement becomes more predictable. We discuss how a failure of this transfer may give rise to many symptoms of ADHD, and propose that methylphenidate might act to compensate for the proposed dopamine transfer deficit.

Synaptic plasticity in the basal ganglia

Activity-dependent synaptic plasticity occurs in several parts of the basal ganglia. Increasing evidence supports the hypothesis that activity-dependent plasticity underlies the acquisition, maintenance, and extinction of certain types of learning in the basal ganglia. This review focuses on synaptic plasticity in the corticostriatal pathway. As in other systems, both long-term potentiation and long-term depression have been described, and intracellular calcium signalling plays an important role in the induction of plasticity. However, intracellular calcium levels do not appear to be the dominating control factor. Dopamine, via intracellular signalling cascades, also plays a crucial role in determining the magnitude and direction of plasticity, and in modulating the requirements for induction. Endocannabinoids also play an important role in mediating presynaptic expression of synaptic depression. Recent studies have highlighted spike-timing dependent plasticity phenomena, which also involve dopamine and endocannabinoid signalling. Despite significant progress in recent years, many important questions remain unanswered, especially in relation to long-term potentiation. Of particular interest is the question of how to link the molecular and cellular mechanisms of synaptic plasticity to learning operations at the systems level, which are expressed behaviourally as reinforcement-related learning.

Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD

This review considers the hypothesis that changes in dopamine signalling might account for altered sensitivity to positive reinforcement in children with ADHD. The existing evidence regarding dopamine cell activity in relation to positive reinforcement is reviewed. We focus on the anticipatory firing of dopamine cells brought about by a transfer of dopamine cell responses to cues that precede reinforcers. It is proposed that in children with ADHD there is diminished anticipatory dopamine cell firing, which we call the dopamine transfer deficit (DTD). The DTD theory leads to specific and testable predictions for human and animal research. The extent to which DTD explains symptoms of ADHD and effects of pharmacological interventions is discussed. We conclude by considering the neural changes underlying the etiology of DTD.

Wireless voltammetry recording in unanesthetised behaving rats

In vivo voltammetry is a valuable technique for rapid measurement of dopamine in the brain of freely behaving rats. Using a conventional voltammetry system, however, behavioural freedom is restricted by cables connecting the head assembly to the measurement system. To overcome these difficulties, we developed a wireless voltammetry system utilizing radio waves. This system consisted of a potentiostat and transmitter system that was mounted on the back of the rat, and a receiver and analysis system. A single-step pulse (100-250 mV) was applied at 4 Hz after an activation pulse to a carbon fibre recording electrode (diameter: 7 microm). Measurement of dopamine (detection limit: 2.7 x 10(-7)M) was demonstrated in vitro. In vivo experiment was performed at least 1 week after the recording electrode was implanted in the rat striatum. Administration of 2-phenylethylamine to rats increased dopamine signal current, which was consistent with the result in the microdialysis measurement. During a resident-intruder test, dopamine signal current in a resident rat increased upon introduction of an intruder rat. These results show that the present wireless system is useful for a long-term measurement of dopamine in behaving rats.

Food reward-induced neurotransmitter changes in cognitive brain regions

Recent evidence indicates that mechanisms involved in reward and mechanisms involved in learning interact, in that reward includes learning processes and learning includes reward processes. In spite of such interactions, reward and learning represent distinct functions. In the present study, as part of an examination of the differences in learning and reward mechanisms, it was assumed that food principally affects reward mechanisms. After a brief period of fasting, we assayed the release of three neurotransmitters and their associated metabolites in eight brain areas associated with learning and memory as a response to feeding. Using microdialysis for the assay, we found changes in the hippocampus, cortex, amygdala, and the thalamic nucleus, (considered cognitive areas), in addition to those in the nucleus accumbens and ventral tegmental area (considered reward areas). Extracellular dopamine levels increased in the nucleus accumbens, ventral tegmental area, amygdala, and thalamic nucleus, while they decreased in the hippocampus and prefrontal cortex. Dopamine metabolites increased in all areas tested (except the dorsal hippocampus); changes in norepinephrine varied with decreases in the accumbens, dorsal hippocampus, amygdala, and thalamic nucleus, and increases in the prefrontal cortex; serotonin levels decreased in all the areas tested; although its metabolite 5HIAA increased in two regions (the medial temporal cortex, and thalamic nucleus). Our assays indicate that in reward activities such as feeding, in addition to areas usually associated with reward such as the mesolimbic dopamine system, other areas associated with cognition also participate. Results also indicate that several transmitter systems play a part, with several neurotransmitters and several receptors involved in the response to food in a number of brain structures, and the changes in transmitter levels may be affected by metabolism and transport in addition to changes in release in a regionally heterogeneous manner. Food reward represents a complex pattern of changes in the brain that involve cognitive processes. Although food reward elements overlap with other reward systems sharing some neurotransmitter compounds, it significantly differs indicating a specific reward to process for food consumption. Like in other rewards, both learning and cognitive areas play a significant part in food reward.

Maze exploration and learning in C. elegans

The soil dwelling nematode, Caenorhabditis (C.) elegans, is a popular model system for studying behavioral plasticity. Noticeably absent from the C. elegans literature, however, are studies evaluating worm behavior in mazes. Here, we report the use of microfluidic mazes to investigate exploration and learning behaviors in wild-type C. elegans, as well as in the dopamine-poor mutant, cat-2. The key research findings include: (1)C. elegans worms are motivated to explore complex spatial environments with or without the presence of food/reward, (2) wild-type worms exhibit a greater tendency to explore relative to mutant worms, (3) both wild-type and mutant worms can learn to make unconditioned responses to food/reward, and (4) wild-type worms are significantly more likely to learn to make conditioned responses linking reward to location than mutant worms. These results introduce microfluidic mazes as a valuable new tool for biological behavioral analysis.

Sham feeding corn oil increases accumbens dopamine in the rat

Both real and sham feeding of sucrose increase dopamine (DA) overflow in the nucleus accumbens (NAc). Fat is another constituent of foods that is inherently preferred by humans and rodents. We examined the affect of sham feeding corn oil in rats that were food and water deprived overnight. Rats were implanted with guide cannulas aimed at the NAc, as well as gastric fistulas. On alternate days, they were trained to sham lick 100% corn oil or distilled water (dH2O) for 20 min in the morning. Twenty-minute microdialysis samples were taken before, during, and after sham licking. DA and monoamines were analyzed by reverse-phase HPLC with coulometric detection. The results show that DA release in the NAc was significantly increased during sham licking of corn oil compared with the prior baseline (157.5 ± 18.8%, n = 12). During sham licking of dH2O, DA release in the NAc was not changed (93.0 ± 4.0%, n = 15). This experiment demonstrates that sham feeding of corn oil releases accumbens DA in a manner similar to ingestion of sucrose. Although both stimuli may have an olfactory component, sucrose is a gustatory, and 100% corn oil appears to be a trigeminal stimulus. Thus these data support the hypothesis that different sensory modalities produce reward using the same or closely related substrates in the forebrain.

Individual differences in sucrose intake and preference in the rat: Circadian variation and association with dopamine D2 receptor function in striatum and nucleus accumbens

Measurement of sucrose intake or preference is currently in widespread use in preclinical psychopharmacology, and used for predicting sensitivity to rewards, but limited information is available about the consistency of individual sucrose intake or preference. In the present study, individual differences in sucrose intake and preference in free-feeding rats were studied during the dark and light phases, and associations of these measures with the function of D(2) receptors in the striatum and nucleus accumbens were characterized. Altogether eight two-bottle tests were carried out intermittently during light and dark phase. Ten days after the last test, animals were sacrificed. Intake, and to a lesser degree preference of sucrose during the dark phase were higher as compared to the light phase, and sucrose intake, but not preference was individually very consistent across different tests, especially during the dark phase. The average dark phase sucrose intake and preference correlated positively with dopamine-dependent [(35)S]GTPgammaS binding in nucleus accumbens. Dopamine-dependent [(35)S]GTPgammaS binding in striatum correlated negatively with sucrose preference in the first test. This study has demonstrated that sucrose intake is an individually stable trait, especially when measured during the dark phase, and persistent individual differences in sucrose consumption and possibly reward sensitivity in general are related to dopamine D(2) receptor function in the nucleus accumbens. Individual differences in D(2) receptor function in the striatum may influence behaviour of rats in novel situations.