Dopaminergic enhancement of local food-seeking is under global homeostatic control

The Thermodynamic Consequences of Parkinson's Disease

Several lines of evidence point to a pervasive disturbance of energy balance in Parkinson's disease (PD). Weight loss, common and multifactorial, is the most observable sign of this. Bradykinesia may be best understood as an underinvestment of energy in voluntary movement. This accords with rodent experiments that emphasise the importance of dopamine in allocating motor energy expenditure. Oxygen consumption studies in PD suggest that, when activities are standardised for work performed, these inappropriate energy thrift settings are actually wasteful. That the dopaminergic deficit of PD creates a problem with energy efficiency highlights the role played by the basal ganglia, and by dopamine, in thermodynamic governance. This involves more than balancing energy, since living things maintain their internal order by controlling transformations of energy, resisting probabilistic trends to more random states. This review will also look at recent research in PD on the analysis of entropy-an information theory metric of predictability in a message-in recordings from the basal ganglia. Close relationships between energy and information converge around the concept of entropy. This is especially relevant to the motor system, which regulates energy exchange with the outside world through its flow of information. The malignant syndrome in PD, a counterpart of neuroleptic malignant syndrome, demonstrates how much thermodynamic disruption can result from breakdown of motor signalling in an extreme hypodopaminergic state. The macroenergetic disturbances of PD are consistent with a unifying hypothesis of dopamine's neurotransmitter actions-to adapt energy expenditure to prevailing economic circumstances.

ErbB4 Null Mice Display Altered Mesocorticolimbic and Nigrostriatal Dopamine Levels as well as Deficits in Cognitive and Motivational Behaviors

Natural genetic variants of Neuregulin1 (NRG1) and its cognate receptor ErbB4 are associated with a risk for schizophrenia. Whereas most studies on NRG1-ErbB4 signaling have focused on GABAergic interneurons, ErbB4 is also expressed by midbrain dopaminergic neurons where it modulates extracellular dopamine (DA) levels. Here, we report that extracellular steady-state levels of DA are reduced in the medial prefrontal cortex (mPFC; −65%), hippocampus (−53%) and nucleus accumbens (NAc; −35%), but are elevated in the dorsal striatum (+25%) of ErbB4 knock-out mice (ErbB4 KOs) relative to wild-type controls. This pattern of DA imbalance recapitulates the reported prefrontal cortical reduction and striatal increase of DA levels in schizophrenia patients. Next, we report on a battery of behavioral tasks used to evaluate locomotor, cognitive and motivational behaviors in ErbB4 KOs relative to controls. We found that ErbB4 KOs are hyperactive in a novel open field but not in their familiar home cage, are more sensitive to amphetamine, perform poorly in the T-maze and novel object recognition (NOR) tasks, exhibit reduced spatial learning and memory on the Barnes maze, and perform markedly worse in conditioned place preference (CPP) tasks when associating cued-reward palatable food with location. However, we found that the poor performance of ErbB4 KOs in CPP are likely due to deficits in spatial memory, instead of reward seeking, as ErbB4 KOs are more motivated to work for palatable food rewards. Our findings indicate that ErbB4 signaling affects tonic DA levels and modulates a wide array of behavioral deficits relevant to psychiatric disorders, including schizophrenia.

Striatal Dopamine D2 Receptors Regulate Cost Sensitivity and Behavioral Thrift

The role of the dopamine D2 receptor (D2R) in regulating appetitive behavior continues to be controversial. Earlier literature suggests that reduced D2R signaling diminishes motivated behavior while more recent theories suggest that reduced D2R, as has been putatively observed in obesity, facilitates compulsive appetitive behavior and promotes overeating. Using a homecage foraging paradigm with mice, we revisit classic neuroleptic pharmacological studies from the 1970s that led to the 'extinction mimicry' hypothesis: that dopamine blockade reduces reinforcement leading to an extinction-like reduction in a learned, motivated behavior. We complement this with a selective genetic deletion of D2R in indirect pathway medium spiny neurons (iMSNs). Administration of haloperidol shifts foraging strategy toward less effortful, more thrifty pursuit of food without altering consumption or bodyweight. D2R deletion in iMSNs also reduces effort and energy expended toward food pursuit, but without a compensatory shift in foraging strategy, resulting in loss of body weight, an effect more pronounced under conditions of escalating costs as the knockouts fail to adequately increase effort. The selective knockouts exhibit no change in sucrose preference or sucrose reinforcement. These data suggest that striatal D2R regulates effort in response to costs, mediating cost sensitivity and behavioral thrift. In the context of obesity, these data suggest that reduced D2R is more likely to diminish effort and behavioral energy expenditure rather than increase appetitive motivation and consumption, possibly contributing to reduced physical activity commonly observed in obesity.

Exploring time-dependent changes in conditioned place preference for food reward and associated changes in the nucleus accumbens

The conditioned place preference (CPP) procedure has been used to study the incubation of craving phenomenon with rewarding drugs such as cocaine and methamphetamine. The present study examined whether rats trained in a CPP behavioral design would display an incubation of craving response for chocolate-flavored pellets or milk chocolate chips at the behavioral and neural levels. Rats were conditioned using an unbiased CPP design then underwent abstinence from food reward for 24 hs, 7, 14, or 28 days at which point they were tested for CPP. Brains underwent immunohistochemical staining for c-Fos and FosB as well as Golgi staining to assess dendritic spine density in the nucleus accumbens (NAc). A time-dependent increase in CPP and entries into the previously paired compartment was observed in the chocolate-flavored pellet group but not the milk chocolate group. Time-dependent neural changes were not directly associated with behavioral outcomes but c-Fos labelling was higher in the chocolate pellet group than controls at the 7-day abstinence period. The behavioral results show that chocolate pellets are rewarding and are associated with long-term behavioral changes but, as evidenced by limited neural changes, these food rewards do not have the same effects on the NAc as drugs of abuse.

Pro-dopamine regulator, KB220Z, attenuates hoarding and shopping behavior in a female, diagnosed with SUD and ADHD

Background Addictive-like behaviors (e.g., hoarding and shopping) may be the result of the cumulative effects of dopaminergic and other neurotransmitter genetic variants as well as elevated stress levels. We, therefore, propose that dopamine homeostasis may be the preferred goal in combating such challenging and unwanted behaviors, when simple dopaminergic activation through potent agonists may not provide any resolution. Case presentation C.J. is a 38-year-old, single, female, living with her mother. She has a history of substance use disorder as well as attention deficit hyperactivity disorder, inattentive type. She had been stable on buprenorphine/naloxone combination and amphetamine, dextroamphetamine mixed salts for many years when unexpectedly she lost her job for oversleeping and not calling into work. KB200z (a pro-dopamine compound) was added to her regimen for complaints of low drive and motivation. After taking this nutraceutical for 4 weeks, she noticed a marked improvement in her mental status and many behaviors. She noted that her shopping and hoarding addictions had appreciably decreased. Furthermore, her lifelong history of terrifying lucid dreams was eliminated. Finally, she felt more in control; her locus of control shifted from external to more internal. Discussion The hypothesis is that C.J.'s reported, behavioral, and psychological benefits resulted from the pro-dopamine-regulating effect of KB220Z across the brain reward system. Conclusions This effect, we surmise, could be the result of a new dopamine balance, across C.J.'s brain reward system. Dopamine homeostasis is an effect of KB220Z seen in both animal and human placebo-controlled fMRI experiments.

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity

Five years ago, we introduced the thrift hypothesis of dopamine (DA), suggesting that the primary role of DA in adaptive behavior is regulating behavioral energy expenditure to match the prevailing economic conditions of the environment. Here we elaborate that hypothesis with several new ideas. First, we introduce the concept of affordability, suggesting that costs must necessarily be evaluated with respect to the availability of resources to the organism, which computes a value not only for the potential reward opportunity, but also the value of resources expended. Placing both costs and benefits within the context of the larger economy in which the animal is functioning requires consideration of the different timescales against which to compute resource availability, or average reward rate. Appropriate windows of computation for tracking resources requires corresponding neural substrates that operate on these different timescales. In discussing temporal patterns of DA signaling, we focus on a neglected form of DA plasticity and adaptation, changes in the physical substrate of the DA system itself, such as up- and down-regulation of receptors or release probability. We argue that changes in the DA substrate itself fundamentally alter its computational function, which we propose mediates adaptations to longer temporal horizons and economic conditions. In developing our hypothesis, we focus on DA D2 receptors (D2R), arguing that D2R implements a form of “cost control” in response to the environmental economy, serving as the “brain’s comptroller”. We propose that the balance between the direct and indirect pathway, regulated by relative expression of D1 and D2 DA receptors, implements affordability. Finally, as we review data, we discuss limitations in current approaches that impede fully investigating the proposed hypothesis and highlight alternative, more semi-naturalistic strategies more conducive to neuroeconomic investigations on the role of DA in adaptive behavior.

Research Domain Criteria versus DSM V: How does this debate affect attempts to model corticostriatal dysfunction in animals?

For decades, the nosology of mental illness has been based largely upon the descriptions in the Diagnostic and Statistical Manual of the American Psychiatric Association (DSM). A recent challenge to the DSM approach to psychiatric nosology from the National Institute on Mental Health (USA) defines Research Domain Criteria (RDoC) as an alternative. For RDoC, psychiatric illnesses are not defined as discrete categories, but instead as specific behavioral dysfunctions irrespective of DSM diagnostic categories. This approach was driven by two primary weaknesses noted in the DSM: (1) the same symptoms occur in very different disease states; and (2) DSM criteria lack grounding in the underlying biological causes of mental illness. RDoC intends to ground psychiatric nosology in those underlying mechanisms. This review addresses the suitability of RDoC vs. DSM from the view of modeling mental illness in animals. A consideration of all types of psychiatric dysfunction is beyond the scope of this review, which will focus on models of conditions associated with frontostriatal dysfunction.

Brain dopamine and serotonin transporter binding are associated with visual attention bias for food in lean men

BACKGROUND

In rodents, the striatal dopamine (DA) system and the (hypo)thalamic serotonin (5-HT) system are involved in the regulation of feeding behavior. In lean humans, little is known about the relationship between these brain neurotransmitter systems and feeding. We studied the relationship between striatal DA transporters (DAT) and diencephalic 5-HT transporters (SERT), behavioral tasks and questionnaires, and food intake.

METHOD

We measured striatal DAT and diencephalic SERT binding with [123I]FP-CIT SPECT in 36 lean male subjects. Visual attention bias for food (detection speed and distraction time) and degree of impulsivity were measured using response-latency-based computer tasks. Craving and emotional eating were assessed with questionnaires and ratings of hunger by means of VAS scores. Food intake was assessed through a self-reported online diet journal.

RESULTS

Striatal DAT and diencephalic SERT binding negatively correlated with food detection speed (p = 0.008, r = -0.50 and p = 0.002, r = -0.57, respectively), but not with food distraction time, ratings of hunger, craving or impulsivity. Striatal DAT and diencephalic SERT binding did not correlate with free choice food intake, whereas food detection speed positively correlated with total caloric intake (p = 0.001, r = 0.60), protein intake (p = 0.01, r = 0.44), carbohydrate intake (p = 0.03, r = 0.39) and fat intake (p = 0.06, r = 0.35).

CONCLUSIONS

These results indicate a role for the central 5-HT and DA system in the regulation of visual attention bias for food, which contributes to the motivation to eat, in non-obese, healthy humans. In addition, this study confirms that food detection speed, measured with the latency-based computer task, positively correlates with total food and macronutrient intake.

Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m(2) ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a 'wanting' and 'liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity.

Neural Mechanisms for Evaluating Environmental Variability in Caenorhabditis elegans

The ability to evaluate variability in the environment is vital for making optimal behavioral decisions. Here we show that Caenorhabditis elegans evaluates variability in its food environment and modifies its future behavior accordingly. We derive a behavioral model that reveals a critical period over which information about the food environment is acquired and predicts future search behavior. We also identify a pair of high-threshold sensory neurons that encode variability in food concentration and the downstream dopamine-dependent circuit that generates appropriate search behavior upon removal from food. Further, we show that CREB is required in a subset of interneurons and determines the timescale over which the variability is integrated. Interestingly, the variability circuit is a subset of a larger circuit driving search behavior, showing that learning directly modifies the very same neurons driving behavior. Our study reveals how a neural circuit decodes environmental variability to generate contextually appropriate decisions.

The VMAT-2 inhibitor tetrabenazine affects effort-related decision making in a progressive ratio/chow feeding choice task: reversal with antidepressant drugs

Behavioral activation is a fundamental feature of motivation, and organisms frequently make effort-related decisions based upon evaluations of reinforcement value and response costs. Furthermore, people with major depression and other disorders often show anergia, psychomotor retardation, fatigue, and alterations in effort-related decision making. Tasks measuring effort-based decision making can be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine induces depressive symptoms in humans, and also preferentially depletes dopamine (DA). Rats were assessed using a concurrent progressive ratio (PROG)/chow feeding task, in which they can either lever press on a PROG schedule for preferred high-carbohydrate food, or approach and consume a less-preferred lab chow that is freely available in the chamber. Previous work has shown that the DA antagonist haloperidol reduced PROG work output on this task, but did not reduce chow intake, effects that differed substantially from those of reinforcer devaluation or appetite suppressant drugs. The present work demonstrated that tetrabenazine produced an effort-related shift in responding on the PROG/chow procedure, reducing lever presses, highest ratio achieved and time spent responding, but not reducing chow intake. Similar effects were produced by administration of the subtype selective DA antagonists ecopipam (D1) and eticlopride (D2), but not by the cannabinoid CB1 receptor neutral antagonist and putative appetite suppressant AM 4413, which suppressed both lever pressing and chow intake. The adenosine A_2A antagonist MSX-3, the antidepressant and catecholamine uptake inhibitor bupropion, and the MAO-B inhibitor deprenyl, all reversed the impairments induced by tetrabenazine. This work demonstrates the potential utility of the PROG/chow procedure as a rodent model of the effort-related deficits observed in depressed patients.

Mice expressing markedly reduced striatal dopamine transporters exhibit increased locomotor activity, dopamine uptake turnover rate, and cocaine responsiveness

Variations in the expression levels of the dopamine transporter (DAT) can influence responsiveness to psychostimulant drugs like cocaine. To better understand this relationship, we studied a new DAT-low expresser (DAT-LE) mouse model and performed behavioral and biochemical studies with it. Immunoblotting and [(3) H]WIN 35,428 binding analyses revealed that these mice express ∼35% of wildtype (WT) mouse striatal DAT levels. Compared to WT mice, DAT-LE mice were hyperactive in a novel open-field environment. Despite their higher basal locomotor activity, cocaine (10 or 20 mg/kg, i.p.) induced greater locomotor activation in DAT-LE mice than in WT mice. The maximal velocity (Vmax ) of DAT-mediated [(3) H]DA uptake into striatal synaptosomes was reduced by 46% in DAT-LE mice, as compared to WT. Overall, considering the reduced number of DAT binding sites (Bmax ) along with the reduced Vmax in DAT-LE mice, a 2-fold increase in DA uptake turnover rate (Vmax /Bmax ) was found, relative to WT mice. This suggests that neuroadaptive changes have occurred in the DAT-LE mice that would help to compensate for their low DAT numbers. Interestingly, these changes do not include a reduction in tyrosine hydroxylase levels, as was previously reported in DAT knockout homozygous and heterozygous animals. Further, these changes are not sufficient to prevent elevated novelty- and cocaine-induced locomotor activity. Hence, these mice represent a unique model for studying changes of in vivo DAT function and regulation that result from markedly reduced levels of DAT expression.

Dopaminergic modulation of effort-related choice behavior as assessed by a progressive ratio chow feeding choice task: pharmacological studies and the role of individual differences

Mesolimbic dopamine (DA) is involved in behavioral activation and effort-related processes. Rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. In the present study, the effects of several drug treatments were assessed using a progressive ratio (PROG)/chow feeding concurrent choice task. With this task, rats can lever press on a PROG schedule reinforced by a preferred high-carbohydrate food pellet, or alternatively approach and consume the less-preferred but concurrently available laboratory chow. Rats pass through each ratio level 15 times, after which the ratio requirement is incremented by one additional response. The DA D₂ antagonist haloperidol (0.025–0.1 mg/kg) reduced number of lever presses and highest ratio achieved but did not reduce chow intake. In contrast, the adenosine A_2A antagonist MSX-3 increased lever presses and highest ratio achieved, but decreased chow consumption. The cannabinoid CB1 inverse agonist and putative appetite suppressant AM251 decreased lever presses, highest ratio achieved, and chow intake; this effect was similar to that produced by pre-feeding. Furthermore, DA-related signal transduction activity (pDARPP-32(Thr34) expression) was greater in nucleus accumbens core of high responders (rats with high lever pressing output) compared to low responders. Thus, the effects of DA antagonism differed greatly from those produced by pre-feeding or reduced CB1 transmission, and it appears unlikely that haloperidol reduces PROG responding because of a general reduction in primary food motivation or the unconditioned reinforcing properties of food. Furthermore, accumbens core signal transduction activity is related to individual differences in work output.

Thorndike's Law 2.0: Dopamine and the Regulation of Thrift

Dopamine is widely associated with reward, motivation, and reinforcement learning. Research on dopamine has emphasized its contribution to compulsive behaviors, such as addiction and overeating, with less examination of its potential role in behavioral flexibility in normal, non-pathological states. In the study reviewed here, we investigated the effect of increased tonic dopamine in a two-lever homecage operant paradigm where the relative value of the levers was dynamic, requiring the mice to constantly monitor reward outcome and adapt their behavior. The data were fit to a temporal difference learning model that showed that mice with elevated dopamine exhibited less coupling between reward history and behavioral choice. This work suggests a way to integrate motivational and learning theories of dopamine into a single formal model where tonic dopamine regulates the expression of prior reward learning by controlling the degree to which learned reward values bias behavioral choice. Here I place these results in a broader context of dopamine's role in instrumental learning and suggest a novel hypothesis that tonic dopamine regulates thrift, the degree to which an animal needs to exploit its prior reward learning to maximize return on energy expenditure. Our data suggest that increased dopamine decreases thriftiness, facilitating energy expenditure, and permitting greater exploration. Conversely, this implies that decreased dopamine increases thriftiness, favoring the exploitation of prior reward learning, and diminishing exploration. This perspective provides a different window onto the role dopamine may play in behavioral flexibility and its failure, compulsive behavior.

Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources

Accumulating evidence indicates integration of dopamine function with metabolic signals, highlighting a potential role for dopamine in energy balance, frequently construed as modulating reward in response to homeostatic state. Though its precise role remains controversial, the reward perspective of dopamine has dominated investigation of motivational disorders, including obesity. In the hypothesis outlined here, we suggest instead that the primary role of dopamine in behavior is to modulate activity to adapt behavioral energy expenditure to the prevailing environmental energy conditions, with the role of dopamine in reward and motivated behaviors derived from its primary role in energy balance. Dopamine has long been known to modulate activity, exemplified by psychostimulants that act via dopamine. More recently, there has been nascent investigation into the role of dopamine in modulating voluntary activity, with some investigators suggesting that dopamine may serve as a final common pathway that couples energy sensing to regulated voluntary energy expenditure. We suggest that interposed between input from both the internal and external world, dopamine modulates behavioral energy expenditure along two axes: a conserve-expend axis that regulates generalized activity and an explore-exploit axes that regulates the degree to which reward value biases the distribution of activity. In this view, increased dopamine does not promote consumption of tasty food. Instead increased dopamine promotes energy expenditure and exploration while decreased dopamine favors energy conservation and exploitation. This hypothesis provides a mechanistic interpretation to an apparent paradox: the well-established role of dopamine in food seeking and the findings that low dopaminergic functions are associated with obesity. Our hypothesis provides an alternative perspective on the role of dopamine in obesity and reinterprets the "reward deficiency hypothesis" as a perceived energy deficit. We propose that dopamine, by facilitating energy expenditure, should be protective against obesity. We suggest the apparent failure of this protective mechanism in Western societies with high prevalence of obesity arises as a consequence of sedentary lifestyles that thwart energy expenditure.

Taste uncoupled from nutrition fails to sustain the reinforcing properties of food

Recent findings suggest the reward system encodes metabolic value independent of taste, provoking speculation that the hedonic value of taste could be derived from nutritional value as a secondary appetitive property. We therefore dissociated and compared the impact of nutrition and taste on appetitive behavior in several paradigms. Though taste alone induces preference and increased consumption, in the absence of nutritional value its reinforcing properties are greatly diminished and it does not, like sucrose, induce increased responding over time. In agreement with behavioral data, saccharin-evoked (but not sucrose-evoked) dopamine release is greatly attenuated following pre-exposure, suggesting that nutritional value is critical for dopamine-mediated reward and reinforcement. Further supporting the primacy of nutrition over taste, genetically increased dopaminergic tone enhances incentive associated with nutritional value with minimal impact on taste-based, hedonic incentive. Overall, we suggest that the sensory-hedonic incentive value associated with taste functions as a conditioned stimulus that requires nutritional value to sustainably organize appetitive behavior.

Transient activation of specific neurons in mice by selective expression of the capsaicin receptor

The ability to control the electrical activity of a neuronal subtype is a valuable tool in deciphering the role of discreet cell populations in complex neural circuits. Recent techniques that allow remote control of neurons are either labor intensive and invasive or indirectly coupled to neural electrical potential with low temporal resolution. Here we show the rapid, reversible and direct activation of genetically identified neuronal subpopulations by generating two inducible transgenic mouse models. Confined expression of the capsaicin receptor, TRPV1, allows cell-specific activation after peripheral or oral delivery of ligand in freely moving mice. Capsaicin-induced activation of dopaminergic or serotonergic neurons reversibly alters both physiological and behavioural responses within minutes, and lasts ~10 min. These models showcase a robust and remotely controllable genetic tool that modulates a distinct cell population without the need for invasive and labour-intensive approaches.