Involvement of dopamine and opioids in the motivation to eat: influence of palatability, homeostatic state, and behavioral paradigms

Pharmacological investigations of effort-based decision-making in humans: Naltrexone and nicotine

Many mental health disorders are characterized by an impaired ability, or willingness, to exert effort to obtain rewards. This impairment is modeled in effort-based decision tasks, and neuropharmacological studies implicate dopamine in this process. However, other transmitter systems such as opioidergic and cholinergic systems have received less attention. Here, in two separate studies we tested the acute effects of naltrexone and nicotine on effort-based decision-making in healthy adults. In Study 1, we compared naltrexone (50mg and 25mg) to placebo, and in Study 2, a pilot study, we compared nicotine (7mg) to placebo. In both studies, participants completed the Effort Expenditure for Rewards Task (EEfRT), which measured effort-based decision-making related to monetary rewards. Although subjects expended greater effort for larger reward magnitude and when there was a higher probability of receiving the reward, neither naltrexone nor nicotine affected willingness to exert effort for monetary rewards. Although the drugs produced significant and typical drug effects on measures of mood and behavior, they did not alter effort-based decision-making. This has implications both for the clinical use of these drugs, as well as for understanding the neuropharmacology of effort-related behavior.

Dopaminergic and opioidergic regulation during anticipation and consumption of social and nonsocial rewards

The observation of animal orofacial and behavioral reactions has played a fundamental role in research on reward but is seldom assessed in humans. Healthy volunteers (N = 131) received 400 mg of the dopaminergic antagonist amisulpride, 50 mg of the opioidergic antagonist naltrexone, or placebo. Subjective ratings, physical effort, and facial reactions to matched primary social (affective touch) and nonsocial (food) rewards were assessed. Both drugs resulted in lower physical effort and greater negative facial reactions during reward anticipation, especially of food rewards. Only opioidergic manipulation through naltrexone led to a reduction in positive facial reactions to liked rewards during reward consumption. Subjective ratings of wanting and liking were not modulated by either drug. Results suggest that facial reactions during anticipated and experienced pleasure rely on partly different neurochemical systems, and also that the neurochemical bases for food and touch rewards are not identical.

Sigma-1 receptor antagonist, PD144418, selectively reduces female motivation for food during negative energy balance

Sigma-1 (σ1) receptors have been investigated for their involvement in learning, rewarding and motivational processes. PD144418, a σ1 receptor antagonist, has been found to produce a dose-dependent attenuation of locomotor activity induced by cocaine, and by itself, does not suppress basal locomotor activity in mice. Moreover, PD144418 decreases the motivational effort of a food-reinforced behavior in male rats, without altering appetite or food palatability. It remains unknown whether the PD144418 can alter the motivational effort of a food-reinforced behavior in response to altered energy homeostasis, as is the case under 24 -h food deprivation. Additionally, while the previous experiments indicate effects in male rats, there has been no research examining the effects of PD144418, or any other σ1 receptor antagonist, on motivational aspects of feeding in females. The present study examined the effects of PD144418 on motivational aspects of feeding in male and female rats using an operant task under sated or food deprived conditions. Results indicated that when animals are sated, at the highest dose (10 μmol/kg), under a progressive ratio (PR) reinforcement schedule, PD144418 significantly attenuated the breakpoint and the number of active lever responses for sucrose pellets in both males and females. When animals are in a state of energy deficit, as is the case following 24-hr food deprivation, PD144418 does not alter motivationally driven operant responding as measured by the breakpoint in either sex but does alter the number of earned reinforcers responses in females.

Endogenous opioid modulation of food intake and body weight: Implications for opioid influences upon motivation and addiction

This review is part of a special issue dedicated to Opioid addiction, and examines the influential role of opioid peptides, opioid receptors and opiate drugs in mediating food intake and body weight control in rodents. This review postulates that opioid mediation of food intake was an example of "positive addictive" properties that provide motivational drives to maintain opioid-seeking behavior and that are not subject to the "negative addictive" properties associated with tolerance, dependence and withdrawal. Data demonstrate that opiate and opioid peptide agonists stimulate food intake through homeostatic activation of sensory, metabolic and energy-related In contrast, general, and particularly mu-selective, opioid receptor antagonists typically block these homeostatically-driven ingestive behaviors. Intake of palatable and hedonic food stimuli is inhibited by general, and particularly mu-selective, opioid receptor antagonists. The selectivity of specific opioid agonists to elicit food intake was confirmed through the use of opioid receptor antagonists and molecular knockdown (antisense) techniques incapacitating specific exons of opioid receptor genes. Further extensive evidence demonstrated that homeostatic and hedonic ingestive situations correspondingly altered the levels and expression of opioid peptides and opioid receptors. Opioid mediation of food intake was controlled by a distributed brain network intimately related to both the appetitive-consummatory sites implicated in food intake as well as sites intimately involved in reward and reinforcement. This emergent system appears to sustain the "positive addictive" properties providing motivational drives to maintain opioid-seeking behavior.

Dopamine blockade impairs the exploration-exploitation trade-off in rats

In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade-off, specifically that the higher the level of tonic dopamine, the more exploitation is favored. We demonstrate here that there is a formal relationship between the rescaling of dopamine positive reward prediction errors and the exploration-exploitation trade-off in simple non-stationary multi-armed bandit tasks. We further show in rats performing such a task that systemically antagonizing dopamine receptors greatly increases the number of random choices without affecting learning capacities. Simulations and comparison of a set of different computational models (an extended Q-learning model, a directed exploration model, and a meta-learning model) fitted on each individual confirm that, independently of the model, decreasing dopaminergic activity does not affect learning rate but is equivalent to an increase in random exploration rate. This study shows that dopamine could adapt the exploration-exploitation trade-off in decision-making when facing changing environmental contingencies.

Sex differences in hedonic and homeostatic aspects of palatable food motivation

Feeding behaviors can be modified via homeostatic and hedonic mechanisms. Homeostasis, while primarily concerned with maintaining energy balance via food consumption and energy expenditure, can alter food reward and motivation in response to food deprivation. Alternatively, reward and motivation of food is also driven by its palatability or hedonic nature, and this process can be augmented by opioid receptor activation. The present study examined sex differences in the motivational properties of sucrose pellets through manipulation of homeostatic and hedonic processes via acute food deprivation and acute systemic administration of morphine, respectively. The results showed that regardless of sex, systemic injections of morphine did not alter the motivation to obtain a sucrose pellet on a progressive ratio schedule of reinforcement but does significantly increase consumption of sucrose pellets when freely available. Male and female rats demonstrated similar increased consumption of sucrose pellets under free feeding conditions following acute (24-hours) food deprivation, compared to the non-deprived conditions. Overall, the findings from these experiments indicate that female rats work harder in order to obtain a sucrose pellet (under a Progressive Ratio (PR) schedule of reinforcement) and consume more sucrose pellets than males. However, while acute morphine administration causes similar increases on feeding in males and females, it does not alter motivation as measured by breakpoint on a PR schedule of reinforcement.

Opioid modulation of social play reward in juvenile rats

Social play behaviour is a vigorous form of social interaction abundant during the juvenile and adolescent phases of life in many mammalian species, including rats and humans. Social play is thought to be important for social, emotional and cognitive development. Being a rewarding activity, the expression of social play depends on its pleasurable and motivational properties. Since opioids have been widely implicated in reward processes, in the present study we investigated the role of opioids in the pleasurable and motivational properties of social play behaviour in rats. To assess social play motivation, an operant conditioning setup was used in which rats responded for social play under a progressive ratio schedule of reinforcement. Treatment with the opioid receptor agonist morphine reduced responding for social play at the highest dose tested, likely due to its rate-limiting effects. Morphine treatment increased the expression of social play behaviour during reinforced periods. The acquisition of social play-induced conditioned place preference (CPP) in a subeffective conditioning protocol was enhanced by treatment with morphine. Morphine treatment alone also induced CPP. In contrast, antagonizing opioid receptors with naloxone reduced responding for social play, the expression of social play and blocked the development of social play-induced CPP. These data implicate opioid neurotransmission in both the pleasurable and the motivational aspects of social play behaviour in rats. This article is part of the Special Issue entitled 'The neuropharmacology of social behavior: from bench to bedside'.

Endocannabinoid Regulation of Reward and Reinforcement through Interaction with Dopamine and Endogenous Opioid Signaling

The endocannabinoid system (eCB) is implicated in the mediation of both reward and reinforcement. This is evidenced by the ability of exogenous cannabinoid drugs to produce hedonia and maintain self-administration in both human and animal subjects. eCBs similarly facilitate behaviors motivated by reward through interaction with the mesolimbic dopamine (DA) and endogenous opioid systems. Indeed, eCB signaling in the ventral tegmental area stimulates activation of midbrain DA cells and promotes DA release in terminal regions such as the nucleus accumbens (NAc). DA transmission mediates several aspects of reinforced behavior, such as motivation, incentive salience, and cost-benefit calculations. However, much research suggests that endogenous opioid signaling underlies the hedonic aspects of reward. eCBs and their receptors functionally interact with opioid systems within the NAc to support reward, most likely through augmenting DA release. This review explores the interaction of these systems as it relates to reward and reinforcement and examines current literature regarding their role in food reward.

Dissociating the role of endocannabinoids in the pleasurable and motivational properties of social play behaviour in rats

Social play behaviour is a vigorous form of social interaction, abundant during the juvenile and adolescent phases of life in many mammalian species, including humans. Social play is highly rewarding and it is important for social and cognitive development. Being a rewarding activity, social play can be dissociated in its pleasurable and motivational components. We have previously shown that endocannabinoids modulate the expression of social play behaviour in rats. In the present study, we investigated whether endocannabinoids modulate the motivational and pleasurable properties of social play behaviour, using operant and place conditioning paradigms, respectively. Treatment with the anandamide hydrolysis inhibitor URB597 did not affect operant responding or social play-induced conditioned place preference (CPP) when administered at a dose (0.1mg/kg) known to increase the expression of social play behaviour, while it modestly reduced operant responding at a higher dose (0.2mg/kg). The cannabinoid-1 (CB1) receptor antagonist rimonabant reduced operant responding when administered at a dose (1mg/kg) known to decrease the expression of social play behaviour, although this effect may be secondary to concurrent drug-induced stereotypic behaviours (i.e., grooming and scratching). These data demonstrate that enhancing endocannabinoid levels does not differentially affect the motivational and pleasurable aspects of social play behaviour, whereas CB1 receptor blockade reduces the motivational aspects of social play behaviour, possibly due to response competition. Thus, endocannabinoids likely drive the expression of social play behaviour as a whole, without differentially affecting its motivational or pleasurable properties.

Low protein diet during gestation and lactation increases food reward seeking but does not modify sucrose taste reactivity in adult female rats

INTRODUCTION

Nutritional deficiencies during neural development may lead to irreversible changes, even after nutritional rehabilitation, promoting morphological and functional adaptations of structures involved with various behaviours including feeding behaviour. However, the ability of the exposure low protein diet during gestation and lactation to affect the hedonic component of food intake is still poorly understood, especially in females.

METHODS

Wistar rats were divided into two groups according to the diet offered to the dams during pregnancy and lactation: control female (CF; diet with 17% protein, n=7) and low protein female (LPF; diet with 8% protein, n=7). The following parameters were evaluated: (a) body weight during weaning, 30, 45, 60, 75, 90 days of life; (b) standard diet intake from 110 to 132 days of life; (c) fat diet and consumption of simple carbohydrates (HFHS) for 1h at 145 days of life; (d) incentive runway task 60 days after 82 days of life; (e) taste reactivity at 90 days of life; and (f) neuronal activation in the caudate putamen, amygdala, paraventricular nucleus of the hypothalamus under stimulus HFHS at 145 days of life.

RESULTS

The exposure, a low protein diet during gestation and lactation, decreased the body weight throughout the study period from weaning to 90 days of life. However, there was no significant change in the body weight of low protein females from 110 to 132 days of life compared with the control females. There was an increase in the rate of the search for reward and reduced the latency of the perception of bitter taste. The exposure, a low protein diet during gestation and lactation, also promoted hypophagy in adult females compared with control animals. The low protein female had increased HFHS diet consumption compared with the control. Undernutrition increased neuronal activation in response to HFHS diet consumption compared with female controls in the amygdala and in the caudate putamen.

CONCLUSION

Females subjected to the exposure, a low protein diet during gestation and lactation, exhibit hypophagy on a standard diet but a higher consumption of a diet rich in lipids and simple carbohydrates. And also were more motivated by the pursuit of reward and reduced latency of the bitter taste reactivity, and increased the number of immunoreactive cells c-fos protein activated in the caudate putamen, amygdala and paraventricular nucleus.

Endogenous opioids and feeding behavior: A decade of further progress (2004-2014). A Festschrift to Dr. Abba Kastin

Functional elucidation of the endogenous opioid system temporally paralleled the creation and growth of the journal, Peptides, under the leadership of its founding editor, Dr. Abba Kastin. He was prescient in publishing annual and uninterrupted reviews on Endogenous Opiates and Behavior that served as a microcosm for the journal under his stewardship. This author published a 2004 review, "Endogenous opioids and feeding behavior: a thirty-year historical perspective", summarizing research in this field between 1974 and 2003. The present review "closes the circle" by reviewing the last 10 years (2004-2014) of research examining the role of endogenous opioids and feeding behavior. The review summarizes effects upon ingestive behavior following administration of opioid receptor agonists, in opioid receptor knockout animals, following administration of general opioid receptor antagonists, following administration of selective mu, delta, kappa and ORL-1 receptor antagonists, and evaluating opioid peptide and opioid receptor changes in different food intake models.

Homeostatic reinforcement learning for integrating reward collection and physiological stability

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

DOI:http://dx.doi.org/10.7554/eLife.04811.001

Our survival depends on our ability to maintain internal states, such as body temperature and blood sugar levels, within narrowly defined ranges, despite being subject to constantly changing external forces. This process, which is known as homeostasis, requires humans and other animals to carry out specific behaviors—such as seeking out warmth or food—to compensate for changes in their environment. Animals must also learn to prevent the potential impact of changes that can be anticipated.

A network that includes different regions of the brain allows animals to perform the behaviors that are needed to maintain homeostasis. However, this network is distinct from the network that supports the learning of new behaviors in general. These two systems must, therefore, interact so that animals can learn novel strategies to support their physiological stability, but it is not clear how animals do this.

Keramati and Gutkin have now devised a mathematical model that explains the nature of this interaction, and that can account for many behaviors seen among animals, even those that might otherwise appear irrational. There are two assumptions at the heart of the model. First, it is assumed that animals are capable of guessing the impact of the outcome of their behaviors on their internal state. Second, it is assumed that animals find a behavior rewarding if they believe that the predicted impact of its outcome will reduce the difference between a particular internal state and its ideal value. For example, a form of behavior for a human might be going to the kitchen, and an outcome might be eating chocolate.

Based on these two assumptions, the model shows that animals stabilize their internal state around its ideal value by simply learning to perform behaviors that lead to rewarding outcomes (such as going into the kitchen and eating chocolate). Their theory also explains the physiological importance of a type of behavior known as ‘delay discounting’. Animals displaying this form of behavior regard a positive outcome as less rewarding the longer they have to wait for it. The model proves mathematically that delay discounting is a logical way to optimize homeostasis.

In addition to making a number of predictions that could be tested in experiments, Keramati and Gutkin argue that their model can account for the failure of homeostasis to limit food consumption whenever foods loaded with salt, sugar or fat are freely available.

DOI:http://dx.doi.org/10.7554/eLife.04811.002

Counterregulation of insulin by leptin as key component of autonomic regulation of body weight

A re-examination of the mechanism controlling eating, locomotion, and metabolism prompts formulation of a new explanatory model containing five features: a coordinating joint role of the (1) autonomic nervous system (ANS); (2) the suprachiasmatic (SCN) master clock in counterbalancing parasympathetic digestive and absorptive functions and feeding with sympathetic locomotor and thermogenic energy expenditure within a circadian framework; (3) interaction of the ANS/SCN command with brain substrates of reward encompassing dopaminergic projections to ventral striatum and limbic and cortical forebrain. These drive the nonhomeostatic feeding and locomotor motivated behaviors in interaction with circulating ghrelin and lateral hypothalamic neurons signaling through melanin concentrating hormone and orexin-hypocretin peptides; (4) counterregulation of insulin by leptin of both gastric and adipose tissue origin through: potentiation by leptin of cholecystokinin-mediated satiation, inhibition of insulin secretion, suppression of insulin lipogenesis by leptin lipolysis, and modulation of peripheral tissue and brain sensitivity to insulin action. Thus weight-loss induced hypoleptimia raises insulin sensitivity and promotes its parasympathetic anabolic actions while obesity-induced hyperleptinemia supresses insulin lipogenic action; and (5) inhibition by leptin of bone mineral accrual suggesting that leptin may contribute to the maintenance of stability of skeletal, lean-body, as well as adipose tissue masses.

Incretins and amylin: neuroendocrine communication between the gut, pancreas, and brain in control of food intake and blood glucose

Arguably the most fundamental physiological systems for all eukaryotic life are those governing energy balance. Without sufficient energy, an individual is unable to survive and reproduce. Thus, an ever-growing appreciation is that mammalian physiology developed a redundant set of neuroendocrine signals that regulate energy intake and expenditure, which maintains sufficient circulating energy, predominantly in the form of glucose, to ensure that energy needs are met throughout the body. This orchestrated control requires cross talk between the gastrointestinal tract, which senses the incoming meal; the pancreas, which produces glycemic counterregulatory hormones; and the brain, which controls autonomic and behavioral processes regulating energy balance. Therefore, this review highlights the physiological, pharmacological, and pathophysiological effects of the incretin hormones glucagon-like peptide-1 and gastric inhibitory polypeptide, as well as the pancreatic hormone amylin, on energy balance and glycemic control.

Overlapping striatal sites mediate scopolamine-induced feeding suppression and mu-opioid-mediated hyperphagia in the rat

RATIONALE

Intra-striatal infusions of the muscarinic antagonist, scopolamine, markedly suppress feeding; however, the underlying mechanisms are unclear. Recent findings suggest that scopolamine influences opioid-dependent mechanisms of feeding modulation. Robust mu-opioid-mediated feeding responses are obtained in anterior, ventral sectors of the striatum with progressively weaker effects posteriorly and dorsally. One might therefore expect the effects of scopolamine to conform to similar boundaries, but a systematic mapping of scopolamine-induced feeding suppression has not yet been undertaken.

OBJECTIVE

This study aimed to assess the overlap between the striatal sites mediating scopolamine-induced feeding suppression and mu-opioid-induced hyperphagia.

METHODS

Dose-effect functions for scopolamine (0, 1, 5, and 10 μg) were obtained in the nucleus accumbens (Acb), anterior dorsal striatum (ADS), and posterior dorsal striatum (PDS) in three different groups of rats. In the same subjects, the mu-opioid receptor agonist (D-Ala2-N-MePhe4, Glyol)-enkephalin (DAMGO; 0.25 μg) was infused on a separate test day. The dependent variables were food and water intake, ambulation, and rearing.

RESULTS

The greatest dose sensitivity for scopolamine-induced feeding suppression was observed in the Acb. Only the highest dose was effective in the ADS, and no effects were seen in the PDS. Water intake and general motor activity were not altered by scopolamine in any site. DAMGO infusions produced hyperphagia only in the Acb.

CONCLUSIONS

These results support a model in which the behavioral effects of muscarinic blockade are limited by the same anatomical constraints that govern mu-opioid receptor-mediated control of feeding. These constraints are likely imposed by the topographic arrangement of feeding-related afferent inputs and efferent projections of the striatum.

Dopamine D1 and μ-opioid receptor antagonism blocks anticipatory 50 kHz ultrasonic vocalizations induced by palatable food cues in Wistar rats

RATIONALE

Fifty kilohertz ultrasonic vocalizations (USVs) have been sometimes shown to reflect positive affective-like states in rats. Rewarding events, such as access to palatable food or drugs of abuse, increase the number of anticipatory 50-kHz USVs. However, little is known about the predictability of USVs, subtypes of USVs involved, and underlying neurobiological mechanisms.

OBJECTIVES

We examined whether cue-induced anticipatory 50-kHz USVs predict palatable food intake and tested the effects of dopamine D1 and μ-opioid receptor antagonism on anticipatory USVs.

MATERIALS

Food-restricted rats received repeated sessions of a 2-min cue light immediately followed by a 5-min access to palatable food. Ultrasonic vocalizations were recorded during cue presentation. After 24 pairing sessions, the rats were pretreated with the D1 receptor antagonist SCH 23390 (5, 10, and 20 μg/kg) and μ-opioid receptor antagonist naltrexone (0.03, 0.06, 0.13, 0.25, 0.5, and 1 mg/kg) in a Latin-square design, and USVs were recorded during cue presentation.

RESULTS

Rats emitted 50-kHz USVs during cue presentation, and the number of USVs increased across sessions with robust and stable interindividual differences. Escalation in USVs was subtype-dependent, with nontrill calls significantly increasing over time. Palatable food intake was positively correlated with anticipatory 50-kHz USVs. Moreover, anticipatory USVs were dose-dependently prevented by antagonism of D1 and μ-opioid receptors.

CONCLUSIONS

These findings demonstrate that anticipatory 50-kHz USVs represent a stable phenotype of increased motivation for food, and dopamine and opioid systems appear to mediate anticipatory 50-kHz USVs.

The food intake-suppressive effects of glucagon-like peptide-1 receptor signaling in the ventral tegmental area are mediated by AMPA/kainate receptors

Glucagon-like peptide-1 receptor (GLP-1R) activation in the ventral tegmental area (VTA) is physiologically relevant for the control of palatable food intake. Here, we tested whether the food intake-suppressive effects of VTA GLP-1R activation are mediated by glutamatergic signaling within the VTA. Intra-VTA injections of the GLP-1R agonist exendin-4 (Ex-4) reduced palatable high-fat food intake in rats primarily by reducing meal size; these effects were mediated in part via glutamatergic AMPA/kainate but not NMDA receptor signaling. Additional behavioral data indicated that GLP-1R expressed specifically within the VTA can partially mediate the intake- and body weight-suppressive effects of systemically administered Ex-4, offering the intriguing possibility that this receptor population may be clinically relevant for food intake control. Intra-VTA Ex-4 rapidly increased tyrosine hydroxylase levels within the VTA, suggesting that GLP-1R activation modulates VTA dopaminergic signaling. Further evidence for this hypothesis was provided by electrophysiological data showing that Ex-4 increased the frequency of AMPA-mediated currents and reduced the paired/pulse ratio in VTA dopamine neurons. Together, these data provide novel mechanisms by which GLP-1R agonists in the mesolimbic reward system control for palatable food intake.

Decreased consumption of sweet fluids in μ opioid receptor knockout mice: a microstructural analysis of licking behavior

RATIONALE

Evidence suggests that the palatability of food (i.e., the hedonic impact produced by its sensory features) can promote feeding and may underlie compulsive eating, leading to obesity. Pharmacological studies implicate opioid transmission in the hedonic control of feeding, though these studies often rely on agents lacking specificity for particular opioid receptors.

OBJECTIVES

Here, we investigated the role of mu opioid receptors (MORs) specifically in determining hedonic responses to palatable sweet stimuli.

METHODS

In Experiment 1, licking microstructure when consuming sucrose solution (2 to 20 %) was compared in MOR knockout and wildtype mice as a function of sucrose concentration and level of food deprivation. In Experiment 2, a similar examination was conducted using the palatable but calorie-free stimulus sucralose (0.001 to 1 %), allowing study of licking behavior independent of homeostatic variables.

RESULTS

In Experiment 1, MOR knockout mice exhibited several alterations in sucrose licking. Although wildtype mice exhibited a twofold increase in the burst length when food deprived, relative to the nondeprived test, this aspect of sucrose licking was generally insensitive to manipulations of food deprivation for MOR knockout mice. Furthermore, during concentration testing, their rate of sucrose licking was less than half that of wildtype mice. During sucralose testing (Experiment 2), MOR knockout mice licked at approximately half the wildtype rate, providing more direct evidence that MOR knockout mice were impaired in processing stimulus palatability.

CONCLUSIONS

These results suggest that transmission through MORs mediates hedonic responses to palatable stimuli, and therefore likely contributes to normal and pathological eating.

The role of melanocortins and Neuropeptide Y in food reward

The Neuropeptide Y and the melanocortin peptides are two well-described hypothalamic feeding peptides regulating energy balance. Predominantly expressed within the arcuate nucleus, these neurons project to different brain areas and modulate various aspects of feeding. Hedonic feeding, where one overindulges in palatable food consumption beyond one's nutritional necessities, is one such aspect regulated by NPY/melanocortin signaling. Research suggests that NPY/melanocortin regulate hedonic aspects of feeding through its projections to the brain reward circuitry (ventral tegmental area, lateral hypothalamus, nucleus accumbens etc.), however, exact target areas have not yet been identified. The current work explores literature to provide a mechanistic explanation for the effects of these peptides on food reward.

Perinatal undernutrition stimulates seeking food reward

Experiments in animals have revealed that perinatal nutritional restriction, which manifests in adulthood, increases food intake and preference for palatable foods. Considering this, we aimed to evaluate the effects of perinatal malnutrition on hedonic control of feeding behavior. In this study, we divided Wistar rats into two groups according to the diet provided to their mothers during pregnancy and lactation: the control group (diet with 17% casein) and low-protein group (diet with 8% casein). We assessed the animals' motivational behavior in adulthood by giving them a stimulus of food reward. We also assessed their neuronal activation triggered by the stimulus of palatable food using FOS protein labeling of neurons activated in the caudate putamen, paraventricular, dorsomedial, ventromedial, and lateral hypothalamic nuclei and amygdala. Evaluation of body weight in malnourished animals showed reduction from the 6th day of life until adulthood. Analysis of feeding behavior revealed that these animals were more motivated by food reward, but they had delays during learning of the task. This finding correlated with the number of c-FOS-immunoreactive neurons, which indicated that malnourished animals had an increase in the number of neurons activated in response to the palatable diet, especially in the amygdala and caudate putamen. The study therefore confirmed our hypothesis that early nutritional insults promote changes in encephalic control mechanisms, especially those related to food intake and search for reward.

Dopamine or opioid stimulation of nucleus accumbens similarly amplify cue-triggered 'wanting' for reward: entire core and medial shell mapped as substrates for PIT enhancement

Pavlovian cues [conditioned stimulus (CS+)] often trigger intense motivation to pursue and consume related reward [unconditioned stimulus (UCS)]. But cues do not always trigger the same intensity of motivation. Encountering a reward cue can be more tempting on some occasions than on others. What makes the same cue trigger more intense motivation to pursue reward on a particular encounter? The answer may be the level of incentive salience ('wanting') that is dynamically generated by mesocorticolimbic brain systems, influenced especially by dopamine and opioid neurotransmission in the nucleus accumbens (NAc) at that moment. We tested the ability of dopamine stimulation (by amphetamine microinjection) vs. mu opioid stimulation [by d-Ala, nMe-Phe, Glyol-enkephalin (DAMGO) microinjection] of either the core or shell of the NAc to amplify cue-triggered levels of motivation to pursue sucrose reward, measured with a Pavlovian-Instrumental Transfer (PIT) procedure, a relatively pure assay of incentive salience. Cue-triggered 'wanting' in PIT was enhanced by amphetamine or DAMGO microinjections equally, and also equally at nearly all sites throughout the entire core and medial shell (except for a small far-rostral strip of shell). NAc dopamine/opioid stimulations specifically enhanced CS+ ability to trigger phasic peaks of 'wanting' to obtain UCS, without altering baseline efforts when CS+ was absent. We conclude that dopamine/opioid stimulation throughout nearly the entire NAc can causally amplify the reactivity of mesocorticolimbic circuits, and so magnify incentive salience or phasic UCS 'wanting' peaks triggered by a CS+. Mesolimbic amplification of incentive salience may explain why a particular cue encounter can become irresistibly tempting, even when previous encounters were successfully resisted before.

Central manipulation of dopamine receptors attenuates the orexigenic action of ghrelin

OBJECTIVE

Recent evidence suggests that ghrelin, a peptidic hormone stimulating food intake, interacts with the dopamine signaling. This interaction has been demonstrated to modulate several effects of ghrelin, such as locomotor activity, memory, and food intake. Ghrelin increases dopamine levels in the shell of the nucleus accumbens stimulating food intake, while ablation of the ghrelin receptor attenuates the hypophagia caused by the activation of dopamine receptor 2. However, it is not known whether the orexigenic action of ghrelin is due to changes in central dopamine receptors.

MATERIALS AND METHODS

We used Sprague-Dawley rats injected with different dopamine receptor agonists, antagonists, and ghrelin.

RESULTS

We demonstrate that the specific central blockade of dopamine receptor 1, 2, and 3 (D1, D2, and D3, respectively) reduces the orexigenic action of ghrelin. Similarly, specific central stimulation, either singly of dopamine receptor 1 or dopamine receptors 2 and 3 simultaneously, causes a significant decrease in ghrelin-induced food intake. Co-stimulation of all three receptors (D1, D2, and D3) also led to a marked attenuation in ghrelin-induced food intake. Importantly, the reduction in ghrelin-induced feeding was not caused by malaise or any type of behavioral alteration.

CONCLUSION

Taken together, these data indicate that dopamine receptors play an important role in acute stimulation of feeding behavior induced by central injection of ghrelin.

Environments predicting intermittent shortening access reduce operant performance but not home cage binge size in rats

When non-food-deprived rats are given brief access to vegetable shortening (a semi-solid fat used in baked products) on an intermittent basis (Monday, Wednesday, Friday), they consume significantly more and emit more operant responses for shortening than a separate group of rats given brief access to shortening every day. Since both groups are traditionally housed in the same room, it is possible that the environmental cues associated with placing shortening in the cages (e.g., investigator in room, cages opening and closing, etc.) provide predictable cues to the daily group, but unpredictable cues to the intermittent group. The present study examined the effects of providing predictable environmental cues to an isolated intermittent group in order to examine the independent contributions of intermittency and predictability on intake and operant performance. Two groups of rats were housed in the same room, with one group provided 30-min intermittent (INT) access and the second group provided 30-min daily access (D) to shortening. A third group (ISO) of rats was housed in a room by themselves in which all environmental cues associated with intermittent shortening availability were highly predictable. After five weeks of home cage shortening access, all rats were then exposed to several different operant schedules of reinforcement. The INT and ISO groups consumed significantly more shortening in the home cage than the D group. In contrast, the INT group earned significantly more reinforcers than both the ISO and D groups under all but one of the reinforcement schedules, while ISO and D did not differ. These data indicate that intermittent access will generate binge-type eating in the home cage independent of cue predictability. However, predictable cues in the home cage reduce operant responding independent of intermittent access.

Principles of motivation revealed by the diverse functions of neuropharmacological and neuroanatomical substrates underlying feeding behavior

Circuits that participate in specific subcomponents of feeding (e.g., gustatory perception, peripheral feedback relevant to satiety and energy balance, reward coding, etc.) are found at all levels of the neural axis. Further complexity is conferred by the wide variety of feeding-modulatory neurotransmitters and neuropeptides that act within these circuits. An ongoing challenge has been to refine the understanding of the functional specificity of these neurotransmitters and circuits, and there have been exciting advances in recent years. We focus here on foundational work of Dr. Ann Kelley that identified distinguishable actions of striatal opioid peptide modulation and dopamine transmission in subcomponents of reward processing. We also discuss her work in overlaying these neuropharmacological effects upon anatomical pathways that link the telencephalon (cortex and basal ganglia) with feeding-control circuits in the hypothalamus. Using these seminal contributions as a starting point, we will discuss new findings that expand our understanding of (1) the specific, differentiable motivational processes that are governed by central dopamine and opioid transmission, (2) the manner in which other striatal neuromodulators, specifically acetylcholine, endocannabinoids and adenosine, modulate these motivational processes (including via interactions with opioid systems), and (3) the organization of the cortical-subcortical network that subserves opioid-driven feeding. The findings discussed here strengthen the view that incentive-motivational properties of food are coded by substrates and neural circuits that are distinguishable from those that mediate the acute hedonic experience of food reward. Striatal opioid transmission modulates reward processing by engaging frontotemporal circuits, possibly via a hypothalamic-thalamic axis, that ultimately impinges upon hypothalamic modules dedicated to autonomic function and motor pattern control. We will conclude by discussing implications for understanding disorders of "non-homeostatic" feeding.

The mysterious motivational functions of mesolimbic dopamine

Nucleus accumbens dopamine is known to play a role in motivational processes, and dysfunctions of mesolimbic dopamine may contribute to motivational symptoms of depression and other disorders, as well as features of substance abuse. Although it has become traditional to label dopamine neurons as "reward" neurons, this is an overgeneralization, and it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. For example, accumbens dopamine does not mediate primary food motivation or appetite, but is involved in appetitive and aversive motivational processes including behavioral activation, exertion of effort, approach behavior, sustained task engagement, Pavlovian processes, and instrumental learning. In this review, we discuss the complex roles of dopamine in behavioral functions related to motivation.

The endocannabinoid system modulates the valence of the emotion associated to food ingestion

Endocannabinoids (eCBs) are mediators of the homeostatic and hedonic systems that modulate food ingestion. Hence, eCBs, by regulating the hedonic system, may be modulating the valence of the emotion associated to food ingestion (positive: pleasant or negative: unpleasant). Our first goal was to demonstrate that palatable food induces conditioned place preference (CPP), hence a positive-valence emotion. Additionally, we analyzed if this CPP is blocked by AM251, inducing a negative valence emotion, meaning avoiding the otherwise pursued compartment. The second goal was to demonstrate that CPP induced by regular food would be strengthened by the simultaneous administration of anandamide or oleamide, and if such, CPP is blocked by AM251. Finally, we tested the capacity of eCBs (without food) to induce CPP. Our results indicate that rats readily developed CPP to palatable food, which was blocked by AM251. The CPP induced by regular food was strengthened by eCBs and blocked by AM251. Finally, oleamide, unlike anandamide, induced CPP. These results showed that eCBs mediate the positive valence (CPP) of the emotion associated to food ingestion. It was also observed that the blockade of the CB1 receptor causes a loss of correlation between food and CPP (negative valence: avoidance). These data further support the role of eCBs as regulators of the hedonic value of food.

Opioid receptor modulation of hedonic taste preference and food intake: a single-dose safety, pharmacokinetic, and pharmacodynamic investigation with GSK1521498, a novel μ-opioid receptor inverse agonist

Endogenous opioids and µ-opioid receptors have been linked to hedonic and rewarding aspects of palatable food intake. The authors examined the safety, pharmacokinetic, and pharmacodynamic profile of GSK1521498, a µ-opioid receptor inverse agonist that is being investigated primarily for the treatment of overeating behavior in obesity. In healthy participants, GSK1521498 oral solution and capsule formulations were well tolerated up to a dose of 100 mg. After single doses (10-150 mg), the maximum concentration (C(max)) and area under the curve (AUC) in plasma increased in a dose-proportional manner. GSK1521498 selectively reduced sensory hedonic ratings of high-sugar and high-fat dairy products and caloric intake of high-fat/high-sucrose snack foods. These findings provide encouraging data in support of the development of GSK1521498 for the treatment of disorders of maladaptive ingestive behavior or compulsive consumption.

Assessing motivation in children using a progressive ratio task

The association of age and sex on the performance of a progressive ratio task was studied in 847 children, ages 4-14 years. Variations of this task have been used extensively with animals and to a lesser extent with humans to study factors that affect aspects of motivation. The participants in this study were required to press a response lever for nickel reinforcers during a 10 min period. One response was required to earn the first nickel and each subsequent nickel required an additional 10 more responses. Older children had a significantly higher breakpoint than younger children. This appeared to be mostly the result of older children having significantly shorter inter-response times than younger children. In addition, boys had significantly higher breakpoints than girls, especially at older ages. The results of this study illustrate that both age and sex influence the performance of this task and thus suggest that age and sex influence aspects of motivation in children. Further, characterization of performance of this task by humans facilitates comparisons with animal models and, thus, enhances its translational utility.

Opiates, overeating and obesity: a psychogenetic analysis

OBJECTIVE

This study provides an original perspective on the associations among endogenous opiates, overeating and obesity. The aim was to assess whether variability in the OPRM1 gene, as assessed by seven single-nucleotide polymorphisms, relates to individual differences in the preference for sweet and fatty foods. We also anticipated that these food preferences would be positively associated with binge eating, hedonic eating and emotionally driven eating-patterns of overeating that would, in turn, predict higher body mass index (BMI).

DESIGN

Analysis of variance procedures examined genotype differences in food preferences; bivariate correlation coefficients examined the relationships among food preferences and the overeating variables; and a regression analysis tested the combined influences of the overeating variables on BMI. DNA was extracted from whole blood for the genotyping, and measures of food preferences and eating behaviours were obtained from well-validated self-report questionnaires.

SUBJECTS

Participants were 300 healthy adult men and women recruited from the community.

RESULTS

All the predicted associations were supported by statistically significant results. In particular, the G/G genotype group of the functional A118G marker of the OPRM1 gene reported higher preferences for sweet and fatty foods compared with the other two groups. Food preferences were also related to all overeating measures, which in turn accounted for a substantial proportion of the variance in BMI.

CONCLUSIONS

Our findings suggest that some of the diversity in the preference for highly palatable foods can be explained by genotypic differences in the regulation of mu opioid receptors. The associations reported in this paper are important from a public-health perspective because of the abuse potential of sweet-fat foods and their strong relationship with obesity.

Weight gain, schizophrenia and antipsychotics: new findings from animal model and pharmacogenomic studies

Excess body weight is one of the most common physical health problems among patients with schizophrenia that increases the risk for many medical problems, including type 2 diabetes mellitus, coronary heart disease, osteoarthritis, and hypertension, and accounts in part for 20% shorter life expectancy than in general population. Among patients with severe mental illness, obesity can be attributed to an unhealthy lifestyle, personal genetic profile, as well as the effects of psychotropic medications, above all antipsychotic drugs. Novel "atypical" antipsychotic drugs represent a substantial improvement on older "typical" drugs. However, clinical experience has shown that some, but not all, of these drugs can induce substantial weight gain. Animal models of antipsychotic-related weight gain and animal transgenic models of knockout or overexpressed genes of antipsychotic receptors have been largely evaluated by scientific community for changes in obesity-related gene expression or phenotypes. Moreover, pharmacogenomic approaches have allowed to detect more than 300 possible candidate genes for antipsychotics-induced body weight gain. In this paper, we summarize current thinking on: (1) the role of polymorphisms in several candidate genes, (2) the possible roles of various neurotransmitters and neuropeptides in this adverse drug reaction, and (3) the state of development of animal models in this matter. We also outline major areas for future research.

Endogenous opiates and behavior: 2009

This paper is the 32nd consecutive installment of the annual review of research concerning the endogenous opioid system. It summarizes papers published during 2009 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (Section 2), and the roles of these opioid peptides and receptors in pain and analgesia (Section 3); stress and social status (Section 4); tolerance and dependence (Section 5); learning and memory (Section 6); eating and drinking (Section 7); alcohol and drugs of abuse (Section 8); sexual activity and hormones, pregnancy, development and endocrinology (Section 9); mental illness and mood (Section 10); seizures and neurologic disorders (Section 11); electrical-related activity and neurophysiology (Section 12); general activity and locomotion (Section 13); gastrointestinal, renal and hepatic functions (Section 14); cardiovascular responses (Section 15); respiration and thermoregulation (Section 16); and immunological responses (Section 17).

Demand for sucrose in the genetically obese Zucker (fa/fa) rat

Obese Zucker rats (fa/fa) eat more food than lean controls in free-feeding conditions, which strongly influences their phenotypic expression. Few studies, however, characterize their food consumption in environments that are more representative of foraging conditions, e.g., how effort plays a role in food procurement. This study examined the reinforcing efficacy of sucrose in obese Zucker rats by varying the responses required to obtain single sucrose pellets. Male Zucker rats (15 lean, 14 obese) lever-pressed under eight fixed ratio (FR) schedules of sucrose reinforcement, in which the number of lever-presses required to gain access to a single sucrose pellet varied from 1 to 300. Linear and exponential demand equations, which characterize the value of a reinforcer by its sensitivity to price (FR), were fit to the number of food reinforcers and responses made. Free food consumption was also examined. Obese Zuckers, compared to leans, consumed more food under free-feeding conditions. Moreover, they had higher levels of consumption and response output, but only at low FR values. Both groups were equally sensitive to price increases at higher FR values. This suggests that environmental conditions may interact with genes in the expression of food reinforcer efficacy.

Genetic and pharmacological evidence that 5-HT2C receptor activation, but not inhibition, affects motivation to feed under a progressive ratio schedule of reinforcement

Previous work showed that 5-HT(2C) receptor agonists reduce cocaine self-administration on a progressive ratio (PR) schedule of reinforcement, whereas a 5-HT(2C) receptor antagonist enhances responding for cocaine. The present experiments examined the effects of Ro60-0175 (5-HT(2C) agonist) and SB242084 (5-HT(2C) receptor antagonist) in rats on responding for food on a PR schedule; responding was also determined in mice lacking functional 5-HT(2C) receptors. In food-restricted rats, lever pressing reinforced by regular food pellets or sucrose pellets was reduced by Ro60-0175. This effect was blocked by SB242084, and was absent in mice lacking functional 5-HT(2C) receptors. A number of studies examined the effects of SB242084 on responding for food under a variety of conditions. These included manipulation of food type (regular pellets versus sucrose pellets), nutritional status of the animals (food restriction versus no restriction), and rate of progression of the increase in ratio requirements on the PR schedule. In all cases there was no evidence of enhanced responding for food by SB242084. Mice lacking functional 5-HT(2C) receptors did not differ from wildtype mice in responding for food in either food-restricted or non-restricted states. The effects of Ro60-0175 are consistent with its effects on food consumption and motivation to self-administer cocaine. Unlike their effects on cocaine self-administration, pharmacological blockade of 5-HT(2C) receptors, and genetic disruption of 5-HT(2C) receptor function do not alter the motivation to respond for food. Because the 5-HT(2C) receptor exerts a modulatory effect on dopamine function, the differential effects of reduced 5-HT(2C) receptor mediated transmission on responding for food versus cocaine may relate to a differential role of this neurotransmitter in mediating these two behaviours.

Intra-accumbens infusion of a muscarinic antagonist reduces food intake without altering the incentive properties of food-associated cues

Previous work has implicated the cholinergic system in modulating feeding behavior; however, its specific function remains unclear. This work aims to characterize potential dissociations between the central cholinergic modulation of the incentive properties of food and food-associated cues, and consummatory behaviors. Three separate experiments demonstrated that intra-accumbens infusion of the muscarinic antagonist scopolamine 3 hr before the testing session significantly decreased food intake. General motor activity in anticipation of food was not diminished. Experiments also showed that scopolamine did not impair operant responding for a food-associated conditioned reinforcer (CR), nor was d-amphetamine potentiation of CR responding altered by scopolamine pretreatment. This study contributes to the growing evidence that goal-seeking behaviors are mediated by a set of neural processes distinct from those governing food reward.

Detailed analysis of food-reinforced operant lever pressing distinguishes effects of a cannabinoid CB1 inverse agonist and dopamine D1 and D2 antagonists

Overt similarities exist between the effects of systemic cannabinoid CB1 inverse agonists and dopamine (DA) antagonists on appetitive behavior. The present set of studies was undertaken to apply a fine-grained analysis of food-reinforced operant lever pressing in rats in order to compare the pattern of effects produced by administration of the CB1 inverse agonist AM 251 and those induced by the DA D1 antagonist SKF 83566, and the D2 antagonist raclopride. Three groups of rats were trained on a fixed-ratio 5 (FR5) schedule and administered these compounds over a range of doses expected to suppress responding. All three drugs produced a dose-related suppression of total lever pressing. In addition to main effects of dose, regression analyses were performed to determine which of several response timing- and rate-related variables correlated most strongly with overall responding in each group. It was found that total session time spent pausing from responding was significantly better at predicting responding in the AM 251 group, while both DA antagonists produced significantly stronger regression coefficients (versus AM 251) from fast responding measures. These results suggest that, while several similarities exist, CB1, D1, and D2 antagonists are not identical in their pattern of suppression of food-maintained lever pressing.

Reducing the desire for cocaine with subthalamic nucleus deep brain stimulation

Deep brain stimulation (DBS) is a reversible technique that is currently used for the treatment of Parkinson disease and may be suitable for the treatment of psychiatric disorders. Whether DBS inactivates the target structure is still a matter of debate. Here, from findings obtained in rats, we propose DBS of the subthalamic nucleus (STN) as a possible treatment for cocaine addiction to be further tested in human studies. We show that STN DBS reversibly reduces the motivation to work for an i.v. injection of cocaine, and it increases motivation to work for sucrose pellets. These opposite effects may result from STN DBS effect on the positive affective properties of these rewards. Indeed, we further show that STN DBS reduces the preference for a place previously associated with the rewarding properties of cocaine, and it increases the preference for a place associated with food. Because these findings are consistent with those observed after STN lesions [Baunez C, Dias C, Cador M, Amalric M (2005) Nat Neurosci 8:484-489], they suggest that STN DBS mimics an inactivation of the STN on motivational processes. Furthermore, given that one of the major challenges for cocaine addiction is to find a treatment that reduces the craving for the drug without diminishing the motivation for naturally rewarding activities, our findings validate STN as a good target and DBS as the appropriate technique for a promising therapeutic strategy in the treatment of cocaine addiction.

Appetite and reward

The tendency to engage in or maintain feeding behaviour is potently influenced by the rewarding properties of food. Affective and goal-directed behavioural responses for food have been assessed in response to various physiological, pharmacological and genetic manipulations to provide much insight into the neural mechanisms regulating motivation for food. In addition, several lines of evidence tie the actions of metabolic signals, neuropeptides and neurotransmitters to the modulation of the reward-relevant circuitry including midbrain dopamine neurons and corticolimbic nuclei that encode emotional and cognitive aspects of feeding. Along these lines, this review pulls together research describing the peripheral and central signalling molecules that modulate the rewarding effects of food and the underlying neural pathways.

The hypocretin-orexin system regulates cocaine self-administration via actions on the mesolimbic dopamine system

Recent evidence suggests that the hypocretin-orexin system participates in the regulation of reinforcement processes. The current studies examined the extent to which hypocretin neurotransmission regulates behavioral and neurochemical responses to cocaine, and behavioral responses to food reinforcement. These studies used a combination of fixed ratio, discrete trials, progressive ratio and threshold self-administration procedures to assess whether the hypocretin 1 receptor antagonist, SB-334867, reduces cocaine self-administration in rats. Progressive ratio sucrose self-administration procedures were also used to assess the extent to which SB-334867 reduces responding to a natural reinforcer in food-restricted and food-sated rats. Additionally, these studies used microdialysis and in vivo voltammetry in rats to examine whether SB-334867 attenuates the effects of cocaine on dopamine signaling within the nucleus accumbens core. Furthermore, in vitro voltammetry was used to examine whether hypocretin knockout mice display attenuated dopamine responses to cocaine. Results indicate that when SB-334867 was administered peripherally or within the ventral tegmental area, it reduced the motivation to self-administer cocaine and attenuated cocaine-induced enhancement of dopamine signaling. SB-334867 also reduced the motivation to self-administer sucrose in food-sated but not food-restricted rats. Finally, hypocretin knockout mice displayed altered baseline dopamine signaling and reduced dopamine responses to cocaine. Combined, these studies suggest that hypocretin neurotransmission participates in reinforcement processes, likely through modulation of the mesolimbic dopamine system. Additionally, the current observations suggest that the hypocretin system may provide a target for pharmacotherapies to treat cocaine addiction.