Cannabinoid receptor blockade reduces the opportunity cost at which rats maintain operant performance for rewarding brain stimulation

Endocannabinoid system as a therapeutic target for psychostimulants relapse: A systematic review of preclinical studies

The mechanism behind the reinstament of psychostimulant, as a major obstacle in addiction treatment is not fully understood. Controversial data are available in the literature concerning the role of the endocannabinoid (eCB) system in regulating the relapse to psychostimulant addiction in preclinical studies. The current systematic review aims to evaluate eCB modulators' effect in the reinstatement of commonly abused psychostimulants, including cocaine, amphetamine, methamphetamine, and 3,4-methylenedioxymethamphetamine. By searching the PubMed, Web of Science, and Scopus databases, studies were selected. Then the studies^, quality was evaluated by the SYRCLE risk of bias tool. The results have still been limited to preclinical studies. Thirty-nine articles that employed self-administration and CPP as the most prevalent animal models of addiction were selected. This data indicates that cannabinoid receptor 1 antagonists and some cannabinoid receptor 2 agonists could suppress the reinstatement of cocaine and methamphetamine addiction in a dose-dependent manner. However, only AM251 was efficient to block the reinstatement of 3,4-methylenedioxymethamphetamine. In conclusion, cannabinoid receptor 1 antagonists and some cannabinoid receptor 2 agonists may have curative potential in the relapse of psychostimulant abuse. However, time, dose, and route of administration are crucial factors in their inhibitory impacts.

Comparison of progressive hold and progressive response schedules of reinforcement

Progressive ratio (PR) schedules have been widely used to study motivation to work for a reinforcer. After a post-reinforcer pause, subjects engage in pressing a lever until a reinforcer is obtained. However, the discrete nature of lever presses allows alternative behaviors during inter-response time and has led to several behavioral explanations of pauses and work time. A progressive hold-down (PH) is incompatible with alternative responses and may allow a precise estimation of work time. Performance of rats trained in both PR and PH that received sucrose or intracranial self-stimulation (ICSS) as reinforcer were compared. We observed that rats mastered the PR and PH schedules. Post-reinforcer pauses (PS^RP), work time and inter-reinforcer time increased as a function of the response or hold requirement. However, rats' performance suggested that the PH progression may be experienced by the rats as easier that the PR progression. Elimination of consummatory behavior with ICSS reduced post-reinforcer pause in accordance with predictions of explanatory models of fixed and variable schedules of reinforcement. In the case of PH performance, pauses showed little variation across intermediate requirements but increased rapidly on later requirements; since rats controlled their pause length and work time was close to the hold requirement, time allocation between PR and PH schedules diverged. Finally, the Mathematical Principles of Reinforcement model of Bradshaw and Killeen (Psychopharmacology 2012, 222: 549) rendered a good description of the performance in both PR and PH schedules.

Dopamine and Beyond: Implications of Psychophysical Studies of Intracranial Self-Stimulation for the Treatment of Depression

Major depressive disorder is a leading cause of disability and suicide worldwide. Consecutive rounds of conventional interventions are ineffective in a significant sub-group of patients whose disorder is classified as treatment-resistant depression. Significant progress in managing this severe form of depression has been achieved through the use of deep brain stimulation of the medial forebrain bundle (MFB). The beneficial effect of such stimulation appears strong, safe, and enduring. The proposed neural substrate for this promising clinical finding includes midbrain dopamine neurons and a subset of their cortical afferents. Here, we aim to broaden the discussion of the candidate circuitry by exploring potential implications of a new “convergence” model of brain reward circuitry in rodents. We chart the evolution of the new model from its predecessors, which held that midbrain dopamine neurons constituted an obligatory stage of the final common path for reward seeking. In contrast, the new model includes a directly activated, non-dopaminergic pathway whose output ultimately converges with that of the dopaminergic neurons. On the basis of the new model and the relative ineffectiveness of dopamine agonists in the treatment of depression, we ask whether non-dopaminergic circuitry may contribute to the clinical efficacy of deep brain stimulation of the MFB.

The Convergence Model of Brain Reward Circuitry: Implications for Relief of Treatment-Resistant Depression by Deep-Brain Stimulation of the Medial Forebrain Bundle

Deep-brain stimulation of the medial forebrain bundle (MFB) can provide effective, enduring relief of treatment-resistant depression. Panksepp provided an explanatory framework: the MFB constitutes the core of the neural circuitry subserving the anticipation and pursuit of rewards: the “SEEKING” system. On that view, the SEEKING system is hypoactive in depressed individuals; background electrical stimulation of the MFB alleviates symptoms by normalizing activity. Panksepp attributed intracranial self-stimulation to excitation of the SEEKING system in which the ascending projections of midbrain dopamine neurons are an essential component. In parallel with Panksepp’s qualitative work, intracranial self-stimulation has long been studied quantitatively by psychophysical means. That work argues that the predominant directly stimulated substrate for MFB self-stimulation are myelinated, non-dopaminergic fibers, more readily excited by brief electrical current pulses than the thin, unmyelinated axons of the midbrain dopamine neurons. The series-circuit hypothesis reconciles this view with the evidence implicating dopamine in MFB self-stimulation as follows: direct activation of myelinated MFB fibers is rewarding due to their trans-synaptic activation of midbrain dopamine neurons. A recent study in which rats worked for optogenetic stimulation of midbrain dopamine neurons challenges the series-circuit hypothesis and provides a new model of intracranial self-stimulation in which the myelinated non-dopaminergic neurons and the midbrain dopamine projections access the behavioral final common path for reward seeking via separate, converging routes. We explore the potential implications of this convergence model for the interpretation of the antidepressant effect of MFB stimulation. We also discuss the consistent finding that psychomotor stimulants, which boost dopaminergic neurotransmission, fail to provide a monotherapy for depression. We propose that non-dopaminergic MFB components may contribute to the therapeutic effect in parallel to, in synergy with, or even instead of, a dopaminergic component.

On the Similarity Between the Reinforcing and the Discriminative Properties of Intracranial Self-Stimulation

Rats work very hard for intracranial self-stimulation (ICSS) and tradeoff effort or time allocation for intensity and frequency parameters producing a sigmoidal function of the subjective reward magnitude of ICSS. Previous studies using electrical intracranial stimuli (ICS) as a discriminative cue focused on estimating detection thresholds or on the discrimination between intensities. To our knowledge, there is no direct comparison of the reinforcer tradeoff functions with the discriminative functions. Rats were trained to press and hold the lever for ICSS using the maximum reinforcing intensity below motor alterations or avoidance behavior. First, rats were trained to hold the lever for 1 s; after stability, they undergo trials where intensity or frequency was decreased on 0.1 log step. Thereafter, they undergo further training with a hold of 2 and later of 4 s to determine tradeoff with intensity or frequency. The same rats were trained on a discrimination task where the previously used ICSS signaled a lever where a 1 s hold response was followed by a reinforcing ICSS; on randomly alternating trials, a −0.6 log ICS signaled an alternate lever where a similar hold response led to a reinforcer. After mastering discrimination, generalization tests were carried out with varying intensity or frequency. Rats completed training with 2 and later 4 s hold response. After the completion of each task, the rats had different doses of a pimozide challenge while their intensity and hold-down requirement were varied. With regards to the rats’ tradeoff response time allocation as a function of intensity or frequency, sigmoid functions were displaced to the right when long responses were required. Rats that learned the discrimination task attained a discrimination index of 90–98%. Discrimination accuracy decreased slightly with the increase of hold requirement, but generalization gradients were not displaced to the right as a function of the response requirement. Pimozide induced a dose-dependent displacement of the time-allocation gradients, but it did not affect the generalization gradients. It is concluded that rats integrate response requirements as part of the reinforcement tradeoff function, but the response cost is not integrated into the discriminative function of ICSS.

Chronic cannabinoid exposure produces tolerance to the dopamine releasing effects of WIN 55,212-2 and heroin in adult male rats

Synthetic cannabinoids were introduced into recreational drug culture in 2008 and quickly became one of the most commonly abused drugs in the United States. The neurobiological consequences resulting from synthetic cannabinoid repeated exposure remain poorly understood. It is possible that a blunted dopamine (DA) response may lead drug users to consume larger quantities to compensate for this form of neurochemical tolerance. Because the endogenous cannabinoid and opioid systems exhibit considerable cross-talk and cross-tolerance frequently develops following repeated exposure to either opioids or cannabinoids, there is interest in investigating whether a history of synthetic cannabinoid exposure influences the ability of heroin to increase DA release. To test the effects of chronic cannabinoid exposure on cannabinoid- and heroin-evoked DA release, male adult rats were treated with either vehicle or a synthetic cannabinoid (WIN55-212-2; WIN) using an intravenous (IV) dose escalation regimen (0.2-0.8 mg/kg IV over 9 treatments). As predicted, WIN-treated rats showed a rightward shift in the dose-response relationship across all behavioral/physiological measures when compared to vehicle-treated controls. Then, using fast-scan cyclic voltammetry to measure changes in the frequency of transient DA events in the nucleus accumbens shell of awake and freely-moving rats, it was observed that the DA releasing effects of both WIN and heroin were significantly reduced in male rats with a pharmacological history of cannabinoid exposure. These results demonstrate that repeated exposure to the synthetic cannabinoid WIN can produce tolerance to its DA releasing effects and cross-tolerance to the DA releasing effects of heroin.

Dissociating the effects of dopamine D2 receptors on effort-based versus value-based decision making using a novel behavioral approach

Cost-benefit decision making is essential for organisms to adapt to their ever-changing environment. Most studies of cost-benefit decision making involve choice conditions in which effort and value are varied simultaneously. This prevents identification of the aspects of cost-benefit decision making that are affected by experimental manipulations. We developed operant assays to isolate the individual impacts of effort and value manipulations on cost-benefit decision making. In the concurrent effort choice (CEC) task, mice choose between exerting two distinct types of effort: the number of responses and the duration of a response, to earn the same reward. By parametrically varying response cost, psychometric functions are obtained that reflect how the two types of effort scale against one another. Direct manipulations of effort shift the functions. Because reward value is held constant in this task, differences in scaling of the two response types must be related to the effort manipulations. In the concurrent value choice (CVC) task, mice make the same type of response to earn rewards of different value (e.g., pellets vs. sucrose solutions). Here the effort required to earn one reward type is parametrically varied to obtain the psychometric function that scales the value of the two rewards into the number of responses subjects will pay to earn one reward over the other. Direct value manipulations shift these functions. We tested the effect of the dopamine D2 receptor antagonist, haloperidol, on performance in the CEC and CVC assays and found that D2R signaling is important for effort-based, but not value-based decision making. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Dopamine neurons do not constitute an obligatory stage in the final common path for the evaluation and pursuit of brain stimulation reward

The neurobiological study of reward was launched by the discovery of intracranial self-stimulation (ICSS). Subsequent investigation of this phenomenon provided the initial link between reward-seeking behavior and dopaminergic neurotransmission. We re-evaluated this relationship by psychophysical, pharmacological, optogenetic, and computational means. In rats working for direct, optical activation of midbrain dopamine neurons, we varied the strength and opportunity cost of the stimulation and measured time allocation, the proportion of trial time devoted to reward pursuit. We found that the dependence of time allocation on the strength and cost of stimulation was similar formally to that observed when electrical stimulation of the medial forebrain bundle served as the reward. When the stimulation is strong and cheap, the rats devote almost all their time to reward pursuit; time allocation falls off as stimulation strength is decreased and/or its opportunity cost is increased. A 3D plot of time allocation versus stimulation strength and cost produces a surface resembling the corner of a plateau (the “reward mountain”). We show that dopamine-transporter blockade shifts the mountain along both the strength and cost axes in rats working for optical activation of midbrain dopamine neurons. In contrast, the same drug shifted the mountain uniquely along the opportunity-cost axis when rats worked for electrical MFB stimulation in a prior study. Dopamine neurons are an obligatory stage in the dominant model of ICSS, which positions them at a key nexus in the final common path for reward seeking. This model fails to provide a cogent account for the differential effect of dopamine transporter blockade on the reward mountain. Instead, we propose that midbrain dopamine neurons and neurons with non-dopaminergic, MFB axons constitute parallel limbs of brain-reward circuitry that ultimately converge on the final-common path for the evaluation and pursuit of rewards.

Valuation of opportunity costs by rats working for rewarding electrical brain stimulation

Pursuit of one goal typically precludes simultaneous pursuit of another. Thus, each exclusive activity entails an “opportunity cost:” the forgone benefits from the next-best activity eschewed. The present experiment estimates, in laboratory rats, the function that maps objective opportunity costs into subjective ones. In an operant chamber, rewarding electrical brain stimulation was delivered when the cumulative time a lever had been depressed reached a criterion duration. The value of the activities forgone during this duration is the opportunity cost of the electrical reward. We determined which of four functions best describes how objective opportunity costs, expressed as the required duration of lever depression, are translated into their subjective equivalents. The simplest account is the identity function, which equates subjective and objective opportunity costs. A variant of this function called the “sigmoidal-slope function,” converges on the identity function at longer durations but deviates from it at shorter durations. The sigmoidal-slope function has the form of a hockey stick. The flat “blade” denotes a range over which opportunity costs are subjectively equivalent; these durations are too short to allow substitution of more beneficial activities. The blade extends into an upward-curving portion over which costs become discriminable and finally into the straight “handle,” over which objective and subjective costs match. The two remaining functions are based on hyperbolic and exponential temporal discounting, respectively. The results are best described by the sigmoidal-slope function. That this is so suggests that different principles of intertemporal choice are involved in the evaluation of time spent working for a reward or waiting for its delivery. The subjective opportunity-cost function plays a key role in the evaluation and selection of goals. An accurate description of its form and parameters is essential to successful modeling and prediction of instrumental performance and reward-related decision making.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making

Decision-making is an ethologically adaptive construct that is impaired in multiple psychiatric disorders. Activity within the mesocorticolimbic dopamine system has been traditionally associated with decision-making. The endocannabinoid system through its actions on inhibitory and excitatory synapses modulates dopamine activity and decision-making. The aim of this brief review is to present a synopsis of available data obtained when the endocannabinoid system is manipulated and dopamine activity recorded. To this end, we review research using different behavioral paradigms to provide further insight into how this ubiquitous signaling system biases dopamine-related behaviors to regulate decision-making.

Psychophysical inference of frequency-following fidelity in the neural substrate for brain stimulation reward

The rewarding effect of electrical brain stimulation has been studied extensively for 60 years, yet the identity of the underlying neural circuitry remains unknown. Previous experiments have characterized the directly stimulated ("first-stage") neurons implicated in self-stimulation of the medial forebrain bundle. Their properties are consistent with those of fine, myelinated axons, at least some of which project rostro-caudally. These properties do not match those of dopaminergic neurons. The present psychophysical experiment estimates an additional first-stage characteristic: maximum firing frequency. We test a frequency-following model that maps the experimenter-set pulse frequency into the frequency of firing induced in the directly stimulated neurons. As pulse frequency is increased, firing frequency initially increases at the same rate, then becomes probabilistic, and finally levels off. The frequency-following function is based on the counter model which holds that the rewarding effect of a pulse train is determined by the aggregate spike rate triggered in first-stage neurons during a given interval. In 7 self-stimulating rats, we measured current- vs. pulse-frequency trade-off functions. The trade-off data were well described by the frequency-following model, and its upper asymptote was approached at a median value of 360 Hz (IQR = 46 Hz). This value implies a highly excitable, non-dopaminergic population of first-stage neurons. Incorporating the frequency-following function and parameters in Shizgal's 3-dimensional reward-mountain model improves its accuracy and predictive power.

Some work and some play: microscopic and macroscopic approaches to labor and leisure

Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other. Traditional accounts of partial allocation have characterised behavior on a macroscopic timescale, reporting and studying the mean times spent in work or leisure. However, averaging over the more microscopic processes that govern choices is known to pose tricky theoretical problems, and also eschews any possibility of direct contact with the neural computations involved. We develop a microscopic framework, formalized as a semi-Markov decision process with possibly stochastic choices, in which subjects approximately maximise their expected returns by making momentary commitments to one or other activity. We show macroscopic utilities that arise from microscopic ones, and demonstrate how facets such as imperfect substitutability can arise in a more straightforward microscopic manner.

Dividing limited time between work and leisure when both are attractive is a common everyday decision. Rather than doing one exclusively, humans and other animals distribute their time between both. Traditional explanations of this phenomenon have studied the macroscopic average times spent in both. By contrast, we develop a microscopic framework in which we can model the real-time decisions that underpin these averages. In the framework, subjects' choices are approximately optimal, according to a natural, microscopic, utility function. We show that the assumptions of previous theories are not necessary for partial allocation to be optimal, and show possibilities and limits to the integration of macroscopic and microscopic views. Our approach opens new vistas onto the real-time processes underlying cost-benefit decision-making.

The effect of probability discounting on reward seeking: a three-dimensional perspective

Rats will work for electrical stimulation of the medial forebrain bundle. The rewarding effect arises from the volleys of action potentials fired by the stimulation and subsequent spatio-temporal integration of their post-synpatic impact. The proportion of time allocated to self-stimulation depends on the intensity of the rewarding effect as well as on other key determinants of decision-making, such as subjective opportunity costs and reward probability. We have proposed that a 3D model relating time allocation to the intensity and cost of reward can distinguish manipulations acting prior to the output of the spatio-temporal integrator from those acting at or beyond it. Here, we test this proposition by varying reward probability, a variable that influences the computation of payoff in the 3D model downstream from the output of the integrator. On riskless trials, reward was delivered on every occasion that the rat held down the lever for a cumulative duration called the “price,” whereas on risky trials, reward was delivered with probability 0.75 or 0.50. According to the model, the 3D structure relating time allocation to reward intensity and price is shifted leftward along the price axis by reductions in reward probability; the magnitude of the shift estimates the change in subjective probability. The predictions were borne out: reducing reward probability shifted the 3D structure systematically along the price axis while producing only small, inconsistent displacements along the pulse-frequency axis. The results confirm that the model can accurately distinguish manipulations acting at or beyond the spatio-temporal integrator and strengthen the conclusions of previous studies showing similar shifts following dopaminergic manipulations. Subjective and objective reward probabilities appeared indistinguishable over the range of 0.5 ≤ p ≤ 1.0.

Optimal indolence: a normative microscopic approach to work and leisure

Dividing limited time between work and leisure when both have their attractions is a common everyday decision. We provide a normative control-theoretic treatment of this decision that bridges economic and psychological accounts. We show how our framework applies to free-operant behavioural experiments in which subjects are required to work (depressing a lever) for sufficient total time (called the price) to receive a reward. When the microscopic benefit-of-leisure increases nonlinearly with duration, the model generates behaviour that qualitatively matches various microfeatures of subjects' choices, including the distribution of leisure bout durations as a function of the pay-off. We relate our model to traditional accounts by deriving macroscopic, molar, quantities from microscopic choices.

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

A new view of the effect of dopamine receptor antagonism on operant performance for rewarding brain stimulation in the rat

RATIONALE

Previous studies of neuroleptic challenges to intracranial self-stimulation (ICSS) employed two-dimensional (2D) measurements (curve shifts). Results so obtained are ambiguous with regard to the stage of neural processing at which the drug produces its performance-altering effect. We substituted a three-dimensional (3D) method that measures reward-seeking as a function of both the strength and cost of reward. This method reveals whether changes in reward seeking are due to drug action prior to the output of the circuitry that performs spatiotemporal integration of the stimulation-induced neural activity.

OBJECTIVES

The aim of this study was to obtain new information about the stage of neural processing at which pimozide acts to alter pursuit of brain stimulation reward (BSR).

METHODS

Following treatment with pimozide (0.1 mg/kg) or its vehicle, the proportion of trial time allocated to working for BSR was measured as a function of pulse frequency and opportunity cost. A surface defined by Shizgal's reward-mountain model was fitted to the drug and vehicle data.

RESULTS

Pimozide lowered the cost required to decrease performance for a maximal BSR to half its maximal level but did not alter the pulse-frequency required to produce a reward of half-maximal intensity.

CONCLUSIONS

Like indirect dopamine agonists, pimozide does not alter the sensitivity of brain reward circuity but changes reward-system gain, subjective effort costs, and/or the value of activities that compete with ICSS. The 3D method is more sensitive and informative than the 2D methods employed previously.

Validation and extension of the reward-mountain model

The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: (1) altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and (2) this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

Cannabidiol inhibits the reward-facilitating effect of morphine: involvement of 5-HT1A receptors in the dorsal raphe nucleus

Cannabidiol is a non-psychotomimetic constituent of Cannabis sativa, which induces central effects in rodents. It has been shown that cannabidiol attenuates cue-induced reinstatement of heroin seeking. However, to the best of our knowledge, its effects on brain stimulation reward and the reward-facilitating effects of drugs of abuse have not yet been examined. Therefore, we investigated the effects of cannabidiol on brain reward function and on the reward-facilitating effect of morphine and cocaine using the intracranial self-stimulation (ICSS) paradigm. Rats were prepared with a stimulating electrode into the medial forebrain bundle (MFB), and a guide cannula into the dorsal raphe (microinjection experiments), and were trained to respond for electrical brain stimulation. A low dose of cannabidiol did not affect the reinforcing efficacy of brain stimulation, whereas higher doses significantly elevated the threshold frequency required for MFB ICSS. Both cocaine and morphine lowered ICSS thresholds. Cannabidiol inhibited the reward-facilitating effect of morphine, but not cocaine. This effect was reversed by pre-treatment with an intra-dorsal raphe injection of the selective 5-HT1A receptor antagonist WAY-100635. The present findings indicate that cannabidiol does not exhibit reinforcing properties in the ICSS paradigm at any of the doses tested, while it decreases the reward-facilitating effects of morphine. These effects were mediated by activation of 5-HT1A receptors in the dorsal raphe. Our results suggest that cannabidiol interferes with brain reward mechanisms responsible for the expression of the acute reinforcing properties of opioids, thus indicating that cannabidiol may be clinically useful in attenuating the rewarding effects of opioids.

Effect of CB1 receptor blockade on food-reinforced responding and associated nucleus accumbens neuronal activity in rats

Studies have shown that disruption of cannabinoid receptor signaling reduces operant responses for rewards; yet it is unknown whether changes in neural activity at dopamine terminal regions such as the nucleus accumbens (NAc) underlie these behavioral effects. To study the neural correlates that accompany the disruption of endogenous cannabinoid (eCB) signaling in a food-motivated task, we recorded the neural activity and local field potentials (LFPs) from the NAc. A within-subject design was used for recordings as rats engaged in lever-pressing behavior for sucrose chocolate-flavored pellets delivered during responding in a progressive ratio (PR) schedule of reinforcement. Rats were food restricted to 85 ± 5% of their free body weight and trained under a PR until a stable breakpoint was observed (12 sessions ± 3). Once performance was stable, recordings were made under baseline, vehicle, and following administration of the cannabinoid inverse agonist rimonabant (150 μg/kg, i.v). NAc neurons encoded reward-predictive cues as well as food reward delivery. Rimonabant administration robustly reduced breakpoints in all rats tested, as previously reported. We found that this reduction is accompanied by a profound attenuation in the strength and coordination of specific event-related spiking activity. Moreover, rimonabant decreased LFP gamma power at 80 Hz (high gamma) at reward delivery and gamma power at 50 Hz (low gamma) at cue onset. Together the present results indicate that the eCB system sculpts neural activity patterns that accompany PR performance and reward consumption.

Role of dopamine tone in the pursuit of brain stimulation reward

Dopaminergic neurons contribute to intracranial self-stimulation (ICSS) and other reward-seeking behaviors, but it is not yet known where dopaminergic neurons intervene in the neural circuitry underlying reward pursuit or which psychological processes are involved. In rats working for electrical stimulation of the medial forebrain bundle, we assessed the effect of GBR-12909 (1-[2-[bis(4-fluorophenyl)-methoxy]ethyl]-4-[3- phenylpropyl]piperazine), a specific blocker of the dopamine transporter. Operant performance was measured as a function of the strength and cost of electrical stimulation. GBR-12909 increased the opportunity cost most subjects were willing to pay for a reward of a given intensity. However, this effect was smaller than that produced by a regimen of cocaine administration that drove similar increases in nucleus accumbens (NAc) dopamine levels in unstimulated rats. Delivery of rewarding stimulation to drug-treated rats caused an additional increase in dopamine concentration in the NAc shell in cocaine-treated, but not GBR-12909-treated, rats. These behavioral and neurochemical differences may reflect blockade of the norepinephrine transporter by cocaine but not by GBR-12909. Whereas the effect of psychomotor stimulants on ICSS has long been attributed to dopaminergic action at early stages of the reward pathway, the results reported here imply that increased dopamine tone boosts reward pursuit by acting at or beyond the output of the circuitry that temporally and spatially summates the output of the directly stimulated neurons underlying ICSS. The observed enhancement of reward seeking could be attributable to a decrease in the value of competing behaviors, a decrease in subjective effort costs, or an increase in reward-system gain.

The endocannabinoid system and the brain

The psychoactive constituent in cannabis, Δ(9)-tetrahydrocannabinol (THC), was isolated in the mid-1960s, but the cannabinoid receptors, CB1 and CB2, and the major endogenous cannabinoids (anandamide and 2-arachidonoyl glycerol) were identified only 20 to 25 years later. The cannabinoid system affects both central nervous system (CNS) and peripheral processes. In this review, we have tried to summarize research--with an emphasis on recent publications--on the actions of the endocannabinoid system on anxiety, depression, neurogenesis, reward, cognition, learning, and memory. The effects are at times biphasic--lower doses causing effects opposite to those seen at high doses. Recently, numerous endocannabinoid-like compounds have been identified in the brain. Only a few have been investigated for their CNS activity, and future investigations on their action may throw light on a wide spectrum of brain functions.

Scarce means with alternative uses: robbins' definition of economics and its extension to the behavioral and neurobiological study of animal decision making

Almost 80 years ago, Lionel Robbins proposed a highly influential definition of the subject matter of economics: the allocation of scarce means that have alternative ends. Robbins confined his definition to human behavior, and he strove to separate economics from the natural sciences in general and from psychology in particular. Nonetheless, I extend his definition to the behavior of non-human animals, rooting my account in psychological processes and their neural underpinnings. Some historical developments are reviewed that render such a view more plausible today than would have been the case in Robbins’ time. To illustrate a neuroeconomic perspective on decision making in non-human animals, I discuss research on the rewarding effect of electrical brain stimulation. Central to this discussion is an empirically based, functional/computational model of how the subjective intensity of the electrical reward is computed and combined with subjective costs so as to determine the allocation of time to the pursuit of reward. Some successes achieved by applying the model are discussed, along with limitations, and evidence is presented regarding the roles played by several different neural populations in processes posited by the model. I present a rationale for marshaling convergent experimental methods to ground psychological and computational processes in the activity of identified neural populations, and I discuss the strengths, weaknesses, and complementarity of the individual approaches. I then sketch some recent developments that hold great promise for advancing our understanding of structure–function relationships in neuroscience in general and in the neuroeconomic study of decision making in particular.

Methamphetamine-induced dopamine terminal deficits in the nucleus accumbens are exacerbated by reward-associated cues and attenuated by CB1 receptor antagonism

Methamphetamine (METH) exposure is primarily associated with deleterious effects to dopaminergic neurons. While several studies have implicated the endocannabinoid system in METH's locomotor, rewarding and neurochemical effects, a role for this signaling system in METH's effects on dopamine terminal dynamics has not been elucidated. Given that CB1 receptor blockade reduces the acute potentiation of phasic extracellular dopamine release from other psychomotor stimulant drugs and that the degree of acute METH-induced increases in extracellular dopamine levels is related to the severity of dopamine depletion, we predicted that pretreatment with the CB1 receptor antagonist rimonabant would reduce METH-induced alterations at dopamine terminals. Furthermore, we hypothesized that administration of METH in environments where reward associated-cues were present would potentiate METH's acute effects on dopamine release in the nucleus accumbens and exacerbate changes in dopamine terminal activity. Fast-scan cyclic voltammetry was used to measure electrically-evoked dopamine release in the nucleus accumbens and revealed markers of compromised dopamine terminal integrity nine days after a single dose of METH. These were exacerbated in animals that received METH in the presence of reward-associated cues, and attenuated in rimonabant-pretreated animals. While these deficits in dopamine dynamics were associated with reduced operant responding on days following METH administration in animals treated with only METH, rimonabant-pretreated animals exhibited levels of operant responding comparable to control. Moreover, dopamine release correlated significantly with changes in lever pressing behavior that occurred on days following METH administration. Together these data suggest that the endocannabinoid system is involved in the subsecond dopaminergic response to METH.

Contrasting Effects of Lithium Chloride and CB1 Receptor Blockade on Enduring Changes in the Valuation of Reward

When an organism responds for a reward, its learned behavior can be characterized as goal-directed or habitual based on whether or not it is susceptible to reward devaluation. Here, we evaluated whether instrumental responding for brain stimulation reward (BSR) can be devalued using a paradigm traditionally used for natural rewards. Rats were trained to lever press for BSR; afterward, BSR was paired with either lithium chloride (LiCl, 5 mg/kg, i.p.), a pro-emetic, or AM251, a CB1 receptor antagonist (3 mg/kg, i.p.) or the vehicle of these compounds. Pairings of BSR with these compounds and their vehicles were performed in a novel environment so that only unconditional effects of BSR would be affected by the pharmacological manipulations. Subsequently, in a probe test, all rats were returned in the drug-free state to the boxes where they had received training and instrumental responding was reassessed in the absence of BSR delivery. When compared to control, LiCl produced a significant decrease in the number of responses during the test session, whereas AM251 did not. These results show that instrumental responding for BSR is susceptible to devaluation, in accord with the proposal that this behavior is supported at least in part by associations between the response and the rewarding outcome. Further, they suggest that reward modulation observed in studies involving the use of CB1 receptor antagonists arises from changes in the organism’s motivation rather than drug-induced changes in the intrinsic value of reward.