The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding

Striatal Dopamine D2 Receptors Regulate Cost Sensitivity and Behavioral Thrift

The role of the dopamine D2 receptor (D2R) in regulating appetitive behavior continues to be controversial. Earlier literature suggests that reduced D2R signaling diminishes motivated behavior while more recent theories suggest that reduced D2R, as has been putatively observed in obesity, facilitates compulsive appetitive behavior and promotes overeating. Using a homecage foraging paradigm with mice, we revisit classic neuroleptic pharmacological studies from the 1970s that led to the 'extinction mimicry' hypothesis: that dopamine blockade reduces reinforcement leading to an extinction-like reduction in a learned, motivated behavior. We complement this with a selective genetic deletion of D2R in indirect pathway medium spiny neurons (iMSNs). Administration of haloperidol shifts foraging strategy toward less effortful, more thrifty pursuit of food without altering consumption or bodyweight. D2R deletion in iMSNs also reduces effort and energy expended toward food pursuit, but without a compensatory shift in foraging strategy, resulting in loss of body weight, an effect more pronounced under conditions of escalating costs as the knockouts fail to adequately increase effort. The selective knockouts exhibit no change in sucrose preference or sucrose reinforcement. These data suggest that striatal D2R regulates effort in response to costs, mediating cost sensitivity and behavioral thrift. In the context of obesity, these data suggest that reduced D2R is more likely to diminish effort and behavioral energy expenditure rather than increase appetitive motivation and consumption, possibly contributing to reduced physical activity commonly observed in obesity.

Affective biases and their interaction with other reward-related deficits in rodent models of psychiatric disorders

Major depressive disorder (MDD) is one of the leading global causes of disability. Symptoms of MDD can vary person to person, and current treatments often fail to alleviate the poor quality of life that patients experience. One of the two core diagnostic criteria for MDD is the loss of interest in previously pleasurable activities, which suggests a link between the disease aetiology and reward processing. Cognitive impairments are also common in patients with MDD, and more recently, emotional processing deficits known as affective biases have been recognised as a key feature of the disorder. Studies in animals have found similar affective biases related to reward. In this review we consider these affective biases in the context of other reward-related deficits and examine how affective biases associated with learning and memory may interact with the wider behavioural symptoms seen in MDD. We discuss recent developments in how analogues of affective biases and other aspects of reward processing can be assessed in rodents, as well as how these behaviours are influenced in models of MDD. We subsequently discuss evidence for the neurobiological mechanisms contributing to one or more reward-related deficits in preclinical models of MDD, identified using these behavioural assays. We consider how the relationships between these selective behavioural assays and the neurobiological mechanisms for affective bias and reward processing could be used to identify potential treatment strategies.

Quantity versus quality: Convergent findings in effort-based choice tasks

Organisms must frequently make cost-benefit decisions based on time, risk, and effort in choosing rewards to pursue. Various tasks have been developed to assess effort-based choice in rats, and experimenters have found largely similar results across tasks and brain regions. In this review, we focus primarily on the convergence of different effort-based choice tasks where quality or quantity of reward are manipulated. In the former, the rat is typically presented with the option to work for a preferred reward or select a less preferred, but freely-available reward. In such paradigms, the rewards are of different identities but are confirmed to differ qualitatively in value by a food preference task when both are freely-available. In the latter task type, rats are required to select between higher magnitude versus lower magnitudes of the same reward, but each with a similar effort requirement. We discuss the strengths/limitations of these paradigms, and describe brain regions that have been probed that result in converging or equivocal findings. Results are also reviewed with reference to a need for future work, and the broader impacts and implications of studies probing the mechanisms of effort.

Botulinum Neurotoxin-A Injected Intrastriatally into Hemiparkinsonian Rats Improves the Initiation Time for Left and Right Forelimbs in Both Forehand and Backhand Directions

Forelimb stepping is a widely used test for the assessment of forelimb akinesia in hemiparkinsonian (hemi-PD) rats. The initiation time (IT) is considered the most sensitive parameter in the stepping test procedure. Here we propose a novel, reliable, and simple method for the measurement of IT of both forelimbs in both forehand and backhand directions in rats. Evaluating the same videos taken for quantifying adjusting steps, IT measurements were done without additional experiments. This is in contrast to the classical approach introduced by Olsson et al. (1995), in which separate experiments are necessary. We successfully applied our approach to hemi-PD rats intrastriatally treated with botulinum neurotoxin-A (BoNT-A). In naïve rats, an IT of about 0.62 s was found, and in right-sided hemi-PD rats the IT of the left forepaw increased to about 3.62 s. These hemi-PD rats showed, however, reduced ITs of the impaired left forepaws 1 month and the second time 7 months after induction of hemi-PD via the injection of 1 ng BoNT-A into the ipsilateral striatum, depending on post BoNT-A survival time. The method described offers the possibility of a precise and animal-friendly evaluation of IT in rats, including the beneficial effect of BoNT-A treatment in hemi-PD rats.

Age as a factor in the responsiveness of the organism to the disruption of cognitive performance by exposure to HZE particles differing in linear energy transfer

Exposure to particles of high energy and charge (HZE particles) can produce decrements in cognitive performance. A series of experiments exposing rats to different HZE particles was run to evaluate whether the performance decrement was dependent on the age of the subject at the time of irradiation. Fischer 344 rats that were 2-, 11- and 15/16-months of age were exposed to ¹⁶O, ⁴⁸Ti, or ⁴He particles at the NASA Space Radiation Laboratory at Brookhaven National Laboratory. As previously observed following exposure to ⁵⁶Fe particles, exposure to the higher LET ⁴⁸Ti particles produced a disruption of cognitive performance at a lower dose in the older subjects compared to the dose needed to disrupt performance in the younger subjects. There were no age related changes in the dose needed to produce a disruption of cognitive performance following exposure to lower LET ¹⁶O or ⁴He particles. The threshold for the rats exposed to either ¹⁶O or ⁴He particles was similar at all ages. Because the 11- and 15-month old rats are more representative of the age of astronauts (45-55 years old) the present results indicate that particle LET may be a critical factor in estimating the risk of developing a cognitive deficit following exposure to space radiation on exploratory class missions.

Botulinum Neurotoxin A Injected Ipsilaterally or Contralaterally into the Striatum in the Rat 6-OHDA Model of Unilateral Parkinson's Disease Differently Affects Behavior

Parkinson's disease (PD) is one of the most frequent neurodegenerative disorders. The loss of dopaminergic neurons in the substantia nigra leads to a disinhibition of cholinergic interneurons in the striatum. Pharmacotherapeutical strategies of PD-related hypercholinism have numerous adverse side effects. We previously showed that ipsilateral intrastriatal injections of 1 ng in unilaterally 6-hydroxydopamine (6-OHDA)-lesioned rats inhibit apomorphine-induced rotation behavior significantly up to 6 months. In this study, we extended the behavioral testing of ipsilateral botulinum neurotoxin A (BoNT-A)-injection and additionally investigated the impact of intrastriatal BoNT-A-injections contralateral to the 6-OHDA-lesioned hemisphere on the basal ganglia circuity and motor functions. We hypothesized that the interhemispheric differences of acetylcholine (ACh) concentration seen in unilateral hemi-PD should be differentially and temporally influenced by the ipsilateral or contralateral injection of BoNT-A. Hemi-PD rats were injected with 1 ng BoNT-A or vehicle substance into either the ipsilateral or contralateral striatum 6 weeks after 6-OHDA-lesion and various behaviors were tested. In hemi-PD rats intrastriatal ipsilateral BoNT-A-injections significantly reduced apomorphine-induced rotations and increased amphetamine-induced rotations, but showed no significant improvement of forelimb usage and akinesia, lateralized sensorimotor integration and also no effect on spontaneous locomotor activity. However, intrastriatal BoNT-A-injections contralateral to the lesion led to a significant increase of the apomorphine-induced turning rate only 2 weeks after the treatment. The apomorphine-induced rotation rate decreases thereafter to a value below the initial rotation rate. Amphetamine-induced rotations were not significantly changed after BoNT-A-application in comparison to sham-treated animals. Forelimb usage was temporally improved by contralateral BoNT-A-injection at 2 weeks after BoNT-A. Akinesia and lateralized sensorimotor integration were also improved, but contralateral BoNT-A-injection had no significant effect on spontaneous locomotor activity. These long-ranging and different effects suggest that intrastriatally applied BoNT-A acts not only as an inhibitor of ACh release but also has long-lasting impact on transmitter expression and thereby on the basal ganglia circuitry. Evaluation of changes of transmitter receptors is subject of ongoing studies of our group.

Reassessing wanting and liking in the study of mesolimbic influence on food intake

Humans and animals such as rats and mice tend to overconsume calorie-dense foods, a phenomenon that likely contributes to obesity. One often-advanced explanation for why we preferentially consume sweet and fatty foods is that they are more "rewarding" than low-calorie foods. "Reward" has been subdivided into three interdependent psychological processes: hedonia (liking a food), reinforcement (formation of associations among stimuli, actions, and/or the food), and motivation (wanting the food). Research into these processes has focused on the mesolimbic system, which comprises both dopamine neurons in the ventral tegmental area and neurons in their major projection target, the nucleus accumbens. The mesolimbic system and closely connected structures are commonly referred to as the brain's "reward circuit." Implicit in this title is the assumption that "rewarding" experiences are generally the result of activity in this circuit. In this review, I argue that food intake and the preference for calorie-dense foods can be explained without reference to subjective emotions. Furthermore, the contribution of mesolimbic dopamine to food intake and preference may not be a general one of promoting or coordinating behaviors that result in the most reward or caloric intake but may instead be limited to the facilitation of a specific form of neural computation that results in conditioned approach behavior. Studies on the neural mechanisms of caloric intake regulation must address how sensory information about calorie intake affects not just the mesolimbic system but also many other forms of computation that govern other types of food-seeking and food-oriented behaviors.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Intermittent-access binge consumption of sweet high-fat liquid does not require opioid or dopamine receptors in the nucleus accumbens

Binge eating disorders are characterized by episodes of intense consumption of high-calorie food. In recently developed animal models of binge eating, rats given intermittent access to such food escalate their consumption over time. Consumption of calorie-dense food is associated with neurochemical changes in the nucleus accumbens, including dopamine release and alterations in dopamine and opioid receptor expression. Therefore, we hypothesized that binge-like consumption on intermittent access schedules is dependent on opioid and/or dopamine neurotransmission in the accumbens. To test this hypothesis, we asked whether injection of dopamine and opioid receptor antagonists into the core and shell of the accumbens reduced consumption of a sweet high-fat liquid in rats with and without a history of intermittent binge access to the liquid. Although injection of a μ opioid agonist increased consumption, none of the antagonists (including μ opioid, δ opioid, κ opioid, D1 dopamine and D2 dopamine receptor antagonists, as well as the broad-spectrum opioid receptor antagonist naltrexone) reduced consumption, and this was the case whether or not the animals had a prior history of intermittent access. These results suggest that consumption of sweet, fatty food does not require opioid or dopamine receptor activation in the accumbens even under intermittent access conditions that resemble human binge episodes.

Dissociable effects of dopamine on learning and performance within sensorimotor striatum

Striatal dopamine is an important modulator of current behavior, as seen in the rapid and dramatic effects of dopamine replacement therapy in Parkinson Disease (PD). Yet there is also extensive evidence that dopamine acts as a learning signal, modulating synaptic plasticity within striatum to affect future behavior. Disentangling these "performance" and "learning" functions is important for designing effective, long-term PD treatments. We conducted a series of unilateral drug manipulations and dopamine terminal lesions in the dorsolateral striatum of rats highly-trained to perform brief instructed head/neck movements (two-alternative forced choice task). Reaction times and accuracy were measured longitudinally to determine if task behavior changed immediately, progressed over time, and/or persisted after drug withdrawal. Enhanced dopamine signaling with amphetamine caused an immediate, nonprogressive, and bilateral decrease in reaction times (RT). The altered RT distributions were consistent with reduced distance to threshold in the linear approach to threshold with ergodic rate (LATER) model of decision-making. Conversely, the dopamine antagonist flupenthixol caused experience-dependent, persistent changes in RT and accuracy indicative of a "learning" effect. These RT distributions were consistent with a slowed rate of approach to decision threshold. Our results show that dopaminergic signaling makes dissociable contributions to current and future behavior even within a single striatal subregion, and provide important clues for both models of normal decision-making and the design of novel drug therapies in PD.

Nucleus accumbens neurotransmission and effort-related choice behavior in food motivation: effects of drugs acting on dopamine, adenosine, and muscarinic acetylcholine receptors

Mesolimbic dopamine (DA) is a critical component of the brain circuitry regulating behavioral activation and effort-related processes. Although nucleus accumbens (NAc) DA depletions or antagonism leave aspects of appetite and primary food motivation intact, rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. Previous work showed that adenosine A2A antagonists can reverse the effects of DA D2 antagonists on effort-related choice, and that stimulation of adenosine A2A receptors produces behavioral effects that are similar to those induced by DA antagonism. The present review summarizes the literature on the role of NAc DA and adenosine in effort-related processes, and also presents original data on the effects of local stimulation of muscarinic acetylcholine receptors in NAc core. Local injections of the muscarinic agonist pilocarpine directly into NAc core produces shifts in effort-related choice behavior similar to those induced by DA antagonism or A2A receptor stimulation, decreasing lever pressing but increasing chow intake in rats responding on a concurrent fixed ratio/chow feeding choice task. In contrast, injections into a neostriatal control site dorsal to the NAc were ineffective. The actions of pilocarpine on this task were attenuated by co-administration of the muscarinic antagonist scopolamine. Thus, drugs that act on DA, adenosine A2A, and muscarinic receptors regulate effort-related choice behavior, which may have implications for the treatment of psychiatric symptoms such as psychomotor slowing, fatigue or anergia that can be observed in depression and other disorders.

Relative response cost determines the sensitivity of instrumental reward seeking to dopamine receptor blockade

Dopamine is a critical mediator of instrumental reward seeking behavior and appears to have a particularly important role in motivating actions that require considerable effort. As with rewards, response costs can be evaluated in both absolute and relative terms. The current study investigated whether the extent to which instrumental performance is dependent on dopamine transmission is influenced by relative or absolute response cost. Three groups of rats were rewarded for lever pressing on different fixed ratio (FR) schedules that required 1 (FR-1), 10 (FR-10), or 20 (FR-20) presses for each food reward. Rats were then injected systemically with flupentixol, a dopamine receptor antagonist, or vehicle before testing all groups on an intermediate-cost (FR-10) schedule, such that only the relative cost of responding differed across groups. Rats experiencing an upshift in cost (group FR-1/FR-10) showed greater response suppression following flupentixol administration than rats experiencing no shift in cost (group FR-10/FR-10), whereas flupentixol treatment had no effect on rats experiencing a downshift in cost (group FR-20/FR-10). A second round of flupentixol tests was conducted using the rats' maintenance schedules, such that only absolute response costs differed across groups. Here, the pattern was reversed among the groups, in line with previous reports. Specifically, flupentixol had a stronger suppressive effect in group FR-20/FR-20 than in group FR-10/FR-10, and had no detectable effect in group FR-1/FR-1. These findings suggest that response costs are evaluated in both absolute and relative terms and that dopamine has a role in overcoming both kinds of cost.

The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond

For many years, it has been suggested that drugs that interfere with dopamine (DA) transmission alter the "rewarding" impact of primary reinforcers such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in effort-related choice behavior. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA-depleted rats show a heightened sensitivity to response costs, especially ratio requirements. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and show increased selection of low reinforcement/low cost options. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as symptoms such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.

Testing the contributions of striatal dopamine loss to the genesis of parkinsonian signs

The diverse and independently-varying signs of Parkinson's disease (PD) are often attributed to one simple mechanism: degeneration of the dopaminergic innervation of the posterolateral striatum. However, growing recognition of the dopamine (DA) loss and other pathology in extra-striatal brain regions has led to uncertainty whether loss of DA in the striatum is sufficient to cause parkinsonian signs. We tested this hypothesis by infusing cis-flupenthixol (cis-flu; a broad-spectrum D1/D2 receptor antagonist) into different regions of the macaque putamen (3 hemispheres of 2 monkeys) while the animal performed a visually-cued choice reaction time task in which visual cues indicated the arm to reach with and the peripheral target to contact to obtain food reward. Following reward delivery, the animal was required to self-initiate release of the peripheral target and return of the chosen hand to its home position (i.e., without the benefit of external sensory cues or immediate rewards). Infusions of cis-flu at 15 of 26 sites induced prolongations of reaction time (9 of 15 cases), movement duration (6 cases), and/or dwell time of the hand at the peripheral target (8 cases). Dwell times were affected more severely (+95%) than visually-triggered reaction times or movement durations (+25% and +15%, respectively). Specifically, the animal's hand often 'froze' at the peripheral target for up to 25-s, similar to the akinetic freezing episodes observed in PD patients. Across injections, slowing of self-initiation did not correlate in severity with prolongations of visually-triggered reaction time or movement duration, although the latter two were correlated with each other. Episodes of slowed self-initiation appeared primarily in the arm contralateral to the injected hemisphere and were not associated with increased muscle co-contraction or global alterations in behavioral state (i.e., inattention or reduced motivation), consistent with the idea that these episodes reflected a fundamental impairment of movement initiation. We found no evidence for an anatomic topography within the putamen for the effects elicited. We conclude that acute focal blockade of DA transmission in the putamen is sufficient to induce marked akinesia-like impairments. Furthermore, different classes of impairments can be induced independently, suggesting that specific parkinsonian signs have unique pathophysiologic substrates.

Motivational states influence effort-based decision making in rats: the role of dopamine in the nucleus accumbens

Decision-making policies are subject to modulation by changing motivational states. However, so far, little is known about the neurochemical mechanisms that bridge motivational states with decision making. Here we examined whether dopamine (DA) in the nucleus accumbens core (AcbC) modulates the effects of motivational states on effort-based decision making. Using a cost-benefit T-maze task in rats, we examined the effects of AcbC DA depletions on effort-based decision making, in particular on the sensitivity of effort-based decision making to a shift from a hungry to a sated state. The results demonstrated that, relative to sham controls, rats with AcbC DA depletion in a hungry as well as in a sated state had a reduced preference for effortful but large-reward action. This finding provides further support for the notion that AcbC DA regulates how much effort to invest for rewards. Importantly, our results further revealed that effort-based decision making in lesioned rats, as in sham controls, was still sensitive to a shift from a hungry to a sated state; that is, their preferences for effortful large-reward actions became lower after a shift from a restricted to a free-feeding regimen. These finding indicate that AcbC DA is not necessarily involved in mediating the effects of a shift in motivational state on decision-making policies.

Dorsal and ventral striatal protein synthesis inhibition affect reinforcer valuation but not the consolidation of instrumental learning

The evidence for a role of the striatum in the acquisition of uncued instrumental responding is ambiguous. It has been shown that post-session infusions of anisomycin into the core of the nucleus accumbens (NAcc) impaired instrumental acquisition, but pre-training lesions of the NAcc suggest that it is not necessary. Recently, we demonstrated that the infusion of anisomycin into the anterior cingulate cortex impaired instrumental acquisition indirectly through a taste aversion. Thus, we hypothesized that post-session anisomycin infusions into the NAcc affected instrumental acquisition through an effect on reinforcer valuation. For the dorsal striatum, both post-session infusions of anisomycin and pre-training lesion studies suggest that neither the dorsolateral nor the dorsomedial striatum is necessary for the acquisition of instrumental responding. However, it has not been attempted to block plasticity in both regions concurrently, and we hypothesized that both regions independently contribute to acquisition through goal-directed and habitual learning. In the current experiments, we first replicated the effect of unprotected post-session anisomycin infusions into the NAcc on instrumental acquisition. Subsequently, we investigated the effect of protein synthesis inhibition in the NAcc and dorsomedial and dorsolateral striatum concurrently on instrumental acquisition, critically controlling for effects on reinforcer valuation. The anisomycin infusions induced an aversive state, but did not affect instrumental acquisition.

Pharmacological and physiological characterization of the tremulous jaw movement model of parkinsonian tremor: potential insights into the pathophysiology of tremor

Tremor is a cardinal symptom of parkinsonism, occurring early on in the disease course and affecting more than 70% of patients. Parkinsonian resting tremor occurs in a frequency range of 3-7 Hz and can be resistant to available pharmacotherapy. Despite its prevalence, and the significant decrease in quality of life associated with it, the pathophysiology of parkinsonian tremor is poorly understood. The tremulous jaw movement (TJM) model is an extensively validated rodent model of tremor. TJMs are induced by conditions that also lead to parkinsonism in humans (i.e., striatal DA depletion, DA antagonism, and cholinomimetic activity) and reversed by several antiparkinsonian drugs (i.e., DA precursors, DA agonists, anticholinergics, and adenosine A(2A) antagonists). TJMs occur in the same 3-7 Hz frequency range seen in parkinsonian resting tremor, a range distinct from that of dyskinesia (1-2 Hz), and postural tremor (8-14 Hz). Overall, these drug-induced TJMs share many characteristics with human parkinsonian tremor, but do not closely resemble tardive dyskinesia. The current review discusses recent advances in the validation of the TJM model, and illustrates how this model is being used to develop novel therapeutic strategies, both surgical and pharmacological, for the treatment of parkinsonian resting tremor.

Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning

Tonic dopamine (DA) signaling is widely regarded as playing a central role in effort-based decision making and in the motivational control of instrumental performance. The current study used microdialysis to monitor changes in extracellular DA levels across subregions of the nucleus accumbens and dorsal striatum of rats as they lever pressed for food reward on a probabilistic schedule of reinforcement, a procedure that ensured they would experience variation in the amount of effort needed to earn rewards across tests. Each rat was given three tests. Rats were hungry for the first and last test, but were sated on food before the middle test, allowing us to assess the effects of a downshift in motivational state on task performance and conditioning-induced DA efflux. During hungry tests, DA levels rose in both the shell and core of the accumbens and, to a lesser degree, in both the medial and lateral divisions of the dorsal striatum. Interestingly, changes in DA efflux across hungry tests in the accumbens core were negatively correlated with changes in the effort required to obtain rewards. We also found that--across regions--the DA response to instrumental conditioning was attenuated when rats were sated before testing. Furthermore, the effect of satiety on DA efflux in the accumbens shell was positively correlated with its effect on task performance. Together, the results indicate that tonic DA contributes to the control of instrumental performance by conveying information about the costs and benefits of responding to different striatal subregions.

The role of dopamine in the dorsomedial striatum in general and outcome-selective Pavlovian-instrumental transfer

Pavlovian stimuli predictive of appetitive outcomes can influence the selection and initiation of instrumental behaviour. For instance, Pavlovian stimuli can act to enhance those actions with which they share an outcome, but not others with which they do not share an outcome, a phenomenon termed outcome-selective Pavlovian-instrumental transfer (PIT). Furthermore, Pavlovian stimuli can invigorate an action by inducing a general appetitive arousal that elevates instrumental responding, a phenomenon termed general PIT. The dorsomedial striatum has been implicated in outcome-selective, but not general PIT. However, the role of dopamine (DA) signals in this subregion in mediating PIT is unknown. Here we examined in rats the effects of a 6-hydroxydopamine-induced DA depletion of the anterior (aDMS) or posterior (pDMS) subregion of the dorsomedial striatum on outcome-selective and general PIT as well as on instrumental performance on a FR-5 schedule (five lever presses earned one pellet). Results demonstrate that aDMS and pDMS DA depletions compromised the rate of responding on a FR-5 schedule, suggesting that DA signals in the dorsomedial striatum are necessary to maintain high rates of instrumental responding. By contrast, aDMS and pDMS DA depletions did not affect general PIT, suggesting that DA signals in the dorsomedial striatum do not mediate general activating effects of reward-predictive stimuli to invigorate instrumental responding. Furthermore, aDMS DA depletions did not impair outcome-selective PIT, while pDMS DA depletions had no or only minor effects. Thus, DA signals in the DMS may not be involved in mediating the specific cueing effects of reward-predictive stimuli.

Lever pressing responses under a fixed-ratio schedule of mice with 6-hydroxydopamine-induced dopamine depletion in the nucleus accumbens

In order to investigate the relationship between dopamine transmission in the nucleus accumbens and operant behavior in mice, mice with 6-hydroxydopamine (6-OHDA)-induced dopamine depletion in the nucleus accumbens were tested for their performance in lever pressing tasks under FR schedules with 8 ratios from FR5 to FR120. The mice were given one 20-mg food pellet per completed FR schedule in FR5, FR10, and FR20; they were given 2 pellets in FR40, and one more cumulatively in the rest of the schedules. Before the 6-OHDA injection surgery, all mice were trained to press a lever under all FR schedules. Then, 6-OHDA or ascorbate was injected into the nucleus accumbens. Postoperatively, the mice were tested under each FR schedule, with 3 sessions per schedule. 6-OHDA-treated mice exhibited an increase in lever pressing latency, i.e., the time interval between the last presentation of the reward and the next lever press, and a decrease in inter-response intervals, i.e., the time interval between 2 lever presses excluding lever pressing latency, irrespective of the FR ratios. Furthermore, in these 6-OHDA-treated mice, the number of lever presses during the first 300s of the session decreased under FR schedules with low ratios (5, 10, and 20). Open field activity, food motivation, and the amount of food consumed were not affected by dopamine depletion in the nucleus accumbens. These results suggest that the dopamine system in the nucleus accumbens had an important role in the control of lever pressing latency and inter-response intervals under FR reinforcement schedules.

Detailed analysis of food-reinforced operant lever pressing distinguishes effects of a cannabinoid CB1 inverse agonist and dopamine D1 and D2 antagonists

Overt similarities exist between the effects of systemic cannabinoid CB1 inverse agonists and dopamine (DA) antagonists on appetitive behavior. The present set of studies was undertaken to apply a fine-grained analysis of food-reinforced operant lever pressing in rats in order to compare the pattern of effects produced by administration of the CB1 inverse agonist AM 251 and those induced by the DA D1 antagonist SKF 83566, and the D2 antagonist raclopride. Three groups of rats were trained on a fixed-ratio 5 (FR5) schedule and administered these compounds over a range of doses expected to suppress responding. All three drugs produced a dose-related suppression of total lever pressing. In addition to main effects of dose, regression analyses were performed to determine which of several response timing- and rate-related variables correlated most strongly with overall responding in each group. It was found that total session time spent pausing from responding was significantly better at predicting responding in the AM 251 group, while both DA antagonists produced significantly stronger regression coefficients (versus AM 251) from fast responding measures. These results suggest that, while several similarities exist, CB1, D1, and D2 antagonists are not identical in their pattern of suppression of food-maintained lever pressing.

Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors

Nucleus accumbens dopamine (DA) is a critical component of the brain circuitry regulating work output in reinforcement-seeking behavior and effort-related choice behavior. Moreover, there is evidence of an interaction between DA D(2) and adenosine A(2A) receptor function. Systemic administration of adenosine A(2A) antagonists reverses the effects of D(2) antagonists on tasks that assess effort related choice. The present experiments were conducted to determine if nucleus accumbens is a brain locus at which adenosine A(2A) and DA D(2) antagonists interact to regulate effort-related choice behavior. A concurrent fixed ratio 5 (FR5)/chow feeding procedure was used; with this procedure, rats can choose between completing an FR5 lever-pressing requirement for a preferred food (i.e., high carbohydrate operant pellets) or approaching and consuming a freely available food (i.e., standard rodent chow). Rats trained with this procedure spend most of their time pressing the lever for the preferred food, and eat very little of the concurrently available chow. Intracranial injections of the selective DA D(2) receptor antagonist eticlopride (1.0, 2.0, 4.0 microg) into nucleus accumbens core, but not a dorsal control site, suppressed FR5 lever-pressing and increased consumption of freely available chow. Either systemic or intra-accumbens injections of the adenosine A(2A) receptor antagonist MSX-3 reversed these effects of eticlopride on effort-related choice. Intra-accumbens injections of eticlopride also increased local expression of c-Fos immunoreactivity, and this effect was attenuated by co-administration of MSX-3. Adenosine and DA systems interact to regulate instrumental behavior and effort-related processes, and nucleus accumbens is an important locus for this interaction. These findings may have implications for the treatment of psychiatric symptoms such as psychomotor slowing, anergia and fatigue.

Dopamine, behavioral economics, and effort

There are numerous problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in behavioral activation and effort-related processes. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food-reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA depleted rats are more sensitive to increases in response costs (i.e., ratio requirements). Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead these rats select a less-effortful type of food-seeking behavior. Nucleus accumbens DA and adenosine interact in the regulation of effort-related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.

Dopamine/adenosine interactions involved in effort-related aspects of food motivation

Nucleus accumbens dopamine (DA) is involved in effort-related aspects of food motivation. Accumbens DA depletions reduce the tendency of rats to work for food, and alter effort-related choice, but leave other aspects of food motivation and appetite intact. DA and adenosine receptors interact to regulate effort-related processes. Adenosine A(2A) antagonists can reverse the effects of DA D(2) antagonists on effort-related choice, and intra-accumbens injections of a adenosine A(2A) agonist produce effects that are similar to those produced by accumbens DA depletion or antagonism. These studies have implications for understanding the neurochemical interactions that underlie activational aspects of motivation.

Modeling operant behavior in the Parkinsonian rat

Mathematical principles of reinforcement (MPR; Killeen, 1994) is a quantitative model of operant behavior that contains three parameters representing motor capacity (delta), motivation (a), and short term memory (lambda). The present study applied MPR to characterize the effects of bilateral infusions of 6-OHDA into the substantia nigra pars compacta in the rat, a model of Parkinson's disease. Rats were trained to lever press under a 5-component fixed-ratio (5, 15, 30, 60, and 100) schedule of food reinforcement. Rats were tested for 15 days prior to dopamine lesions and again for 15 days post-lesion. To characterize functional loss relative to lesion size, rats were grouped according to the extent and the degree of lateralization of their dopamine loss. Response rates decreased as a function of dopamine depletion, primarily at intermediate ratios. MPR accounted for 98% of variance in pre- and post-lesion response rates. Consistent with reported disruptions in motor behavior induced by dopaminergic lesions, estimates of delta increased when dopamine was severely depleted. There was no support for different estimates of a based on pre- and post-lesion performance of any lesion group, suggesting that dopamine loss has negligible effects on incentive motivation. The present study demonstrates the usefulness of combining operant techniques with a theoretical model to better understand the effects of a neurochemical manipulation.

Dopamine/adenosine interactions related to locomotion and tremor in animal models: possible relevance to parkinsonism

Adenosine A(2A) antagonists can exert antiparkinsonian effects in animal models. Recent experiments studied the ability of MSX-3 (an adenosine A(2A) antagonist) to reverse the locomotor suppression and tremor produced by dopamine antagonists in rats. MSX-3 reversed haloperidol-induced suppression of locomotion, and reduced the tremulous jaw movements induced by haloperidol, pimozide, and reserpine. Infusions of MSX-3 into the nucleus accumbens core increased locomotion in haloperidol-treated rats, but there were no effects of infusions into the accumbens shell or ventrolateral neostriatum. In contrast, MSX-3 injected into the ventrolateral neostriatum reduced pimozide-induced tremulous jaw movements. Dopamine/adenosine interactions in different striatal subregions are involved in distinct aspects of motor function.

Systemic administration of the adenosine A(2A) agonist CGS 21680 induces sedation at doses that suppress lever pressing and food intake

Adenosine A(2A) receptors are involved in the regulation of several behavioral functions. Adenosine A(2A) antagonists exert antiparkinsonian effects in animal models, and adenosine A(2A) agonists suppress locomotion and impair various aspects of motor control. The present experiments were conducted to study the effects of low doses of the adenosine A(2A) agonist CGS 21680 on lever pressing, specific parameters of food intake, and sedation. In the first experiment, the effects of CGS 21680 on fixed ratio 5 lever pressing were assessed. In the second experiment, rats were tested in 30 min feeding sessions, and also were observed for drug-induced sedation using a sedation rating scale. CGS 21680 (0.025, 0.05, 0.1 mg/kg IP) produced a dose related suppression of lever pressing, and also reduced the amount of food consumed. The feeding effect was largely dependent upon a slowing of the rate of feeding, and there was only a modest suppression of time spent feeding. Doses of CGS 21680 that suppressed lever pressing and feeding also were associated with sedation/drowsiness. In conjunction with other studies, the present results suggest that sedative effects may play an important role in some of the behavioral effects produced by systemic administration of adenosine A(2A) agonists.

Central vs. peripheral administration of ethanol, acetaldehyde and acetate in rats: effects on lever pressing and response initiation

The metabolites of ethanol, acetaldehyde and acetate, are biologically active, and different effects may be produced depending upon the particular metabolite and the route of administration. These studies characterized the effects of intraperitoneal (IP) vs. intraventricular (ICV) administration of ethanol, acetaldehyde, and acetate administered to male Sprague-Dawley rats. Operant behavior was assessed by conducting a detailed temporal analysis of lever pressing with rats responding on a fixed ratio 5 schedule of food reinforcement. IP administration of all three drugs produced a rate-decreasing effect on the total number of responses. Acetaldehyde and acetate were much more potent than ethanol at reducing lever pressing. The interresponse time (IRT) distribution also was more potently altered by IP administration of ethanol metabolites than by ethanol itself. The total lever pressing and IRT distributions of ethanol- and acetaldehyde- treated rats were not significantly affected when these drugs were administered ICV, while acetate produced a marked suppression of fast responses and an increase in pausing. The metabolites of ethanol are more potent than ethanol itself in terms of altering patterns of lever pressing. Thus, the effects of ethanol administration could in part be due to the actions of its biologically active metabolites.

Adenosine A(2A) receptor antagonism reverses the effects of dopamine receptor antagonism on instrumental output and effort-related choice in the rat: implications for studies of psychomotor slowing

RATIONALE

Organisms frequently make effort-related decisions based upon assessments of motivational value and response costs. Energy-related dysfunctions such as psychomotor slowing and apathy are critically involved in some clinical syndromes. Dopamine (DA), particularly in the nucleus accumbens, regulates effort-related processes. Dopamine antagonism and accumbens dopamine depletions cause rats performing on choice tasks to reallocate their behavior away from food-reinforced tasks that have high response requirements.

OBJECTIVE

There is evidence of a functional interaction between DA and adenosine A(2A) receptors in the neostriatum and nucleus accumbens. The present experiments were conducted to determine if adenosine A(2A) receptor antagonism could reverse the effects of dopamine receptor antagonism on instrumental behavior and effort-related choice.

MATERIALS AND METHODS

The adenosine A(2A) receptor antagonist MSX-3 was investigated for its ability to reverse the effects of the dopamine receptor antagonist haloperidol (0.1 mg/kg) on fixed ratio 5 instrumental lever-pressing and on response allocation using a concurrent lever-pressing/chow-feeding choice task.

RESULTS

Haloperidol significantly suppressed fixed ratio 5 responding, and with rats responding on the concurrent choice task, it altered choice behavior, significantly reducing lever-pressing for food and increasing chow intake. Injections of MSX-3 (0.5-2.0 mg/kg) produced a dose-related attenuation of the effects of 0.1 mg/kg haloperidol on both tasks. The high dose of MSX-3, when administered in the absence of haloperidol, did not significantly affect responding on either task.

CONCLUSIONS

Adenosine and dopamine systems interact to regulate instrumental behavior and effort-related processes, which may have implications for the treatment of psychiatric symptoms such as psychomotor slowing or anergia.

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits

BACKGROUND

Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation.

OBJECTIVE

The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry.

RESULTS

The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior.

CONCLUSIONS

Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression.

Injections of the selective adenosine A2A antagonist MSX-3 into the nucleus accumbens core attenuate the locomotor suppression induced by haloperidol in rats

There is considerable evidence of interactions between adenosine A2A receptors and dopamine D2 receptors in striatal areas, and antagonists of the A2A receptor have been shown to reverse the motor effects of DA antagonists in animal models. The D2 antagonist haloperidol produces parkinsonism in humans, and also induces motor effects in rats, such as suppression of locomotion. The present experiments were conducted to study the ability of the adenosine A2A antagonist MSX-3 to reverse the locomotor effects of acute or subchronic administration of haloperidol in rats. Systemic (i.p.) injections of MSX-3 (2.5-10.0 mg/kg) were capable of attenuating the suppression of locomotion induced by either acute or repeated (i.e., 14 day) administration of 0.5 mg/kg haloperidol. Bilateral infusions of MSX-3 directly into the nucleus accumbens core (2.5 microg or 5.0 microg in 0.5 microl per side) produced a dose-related increase in locomotor activity in rats treated with 0.5 mg/kg haloperidol either acutely or repeatedly. There were no overall significant effects of MSX-3 infused directly into the dorsomedial nucleus accumbens shell or the ventrolateral neostriatum. These results indicate that antagonism of adenosine A2A receptors can attenuate the locomotor suppression produced by DA antagonism, and that this effect may be at least partially mediated by A2A receptors in the nucleus accumbens core. These studies suggest that adenosine and dopamine systems interact to modulate the locomotor and behavioral activation functions of nucleus accumbens core.

Striatal dopamine transporters correlate with simple reaction time in elderly subjects

The decline in motor performance that accompanies advanced age has unclear neurobiological substrates but may relate, in part, to degeneration of the nigrostriatal dopamine system. This research tested the hypothesis that striatal dopamine transporter (DAT) availability in healthy elderly individuals was related to measures of motor performance. Thirty-six healthy volunteers (18 male, 18 female) who ranged in age from 68 to 88 (75.4+/-4.9 years) received a neuropsychological evaluation that included two primary motor measures (tested with dominant hand): (1) simple reaction time (SRT); and (2) finger tapping (FT). Subjects underwent SPECT scanning with [(123)I]2beta-carbomethoxy-3beta-(4-iodophenyl)tropane ([(123)I]beta-CIT) for measurement of striatal DAT availability. A ratio of specific to nondisplaceable brain uptake (i.e., radical V3 =[striatal-occipital]/occipital), a measure proportional to the binding potential (B(max)/K(D)), was derived. SRT was significantly correlated with striatal DAT availability with or without controlling for the contribution of age. However, contrary to hypothesis, FT was not correlated with striatal DAT availability. Comparison measures, including episodic memory and general intelligence, were also unrelated to striatal DAT availability. These results demonstrate that a loss of nigrostriatal dopaminergic function likely contributes to slowing of reaction speed with advancing age.

Use of the narrow beam test in the rat, 6-hydroxydopamine model of Parkinson's disease

Batteries of behavioural tests provide a method by which researchers may examine specific functional pathways. The narrow beam test examines the ability of a rat to cross a narrow, elevated beam of wood or other material. In order to determine the utility of the narrow beam test in the study of Parkinsonism, it was of interest to characterise the performance of animals at this task. Rats were placed at one end of a 105 cm long, elevated beam and both the time it took to begin crossing the beam, as well as the total time taken to cross the beam, were measured. The effects of training, time of day and 6-hydroxydopamine lesion on beam performance were examined. Rats reached maximal performance at the task within a single test session and time of day had no effect on beam performance. Parkinsonian rats demonstrated a four-fold increase in both the latency to initiate the task and the total time to cross the beam (p < 0.05).

Comparison between multiple behavioral effects of peripheral ethanol administration in rats: Sedation, ataxia, and bradykinesia

Although low doses of systemic ethanol stimulate locomotion in mice, in rats the typical response to peripheral ethanol administration is a dose-dependent suppression of motor activity. In the present study, male rats received acute doses of ethanol IP (0.0, 0.25, 0.5, 1.0 or 2.0 g/kg) and were tested on several behavioral tasks related to the motor suppressive or sedative effects of the drug. This research design allowed for comparisons between the effects of ethanol on different behavioral tasks in order to determine which tasks were most sensitive to the drug (i.e., which tasks would yield deficits that appear at lower doses). In the first two experiments, rats were evaluated on a sedation rating scale, and ataxia/motor incoordination was assessed using the rotarod apparatus. Administration of 2.0 g/kg ethanol produced sedation as measured by the sedation scale, and also impaired performance on the rotarod. In a third experiment, ethanol reduced locomotion in the stabilimeter at several doses and times after IP injection, with 0.25 g/kg being the lowest dose that produced a significant decrease in locomotion. Finally, experiment four studied the effects of ethanol on operant lever pressing reinforced on a fixed ratio 5 (FR5) schedule for food reinforcement. Data showed suppressive effects on lever pressing at doses of 1.0, and 2.0 g/kg ethanol. Analysis of the interresponse time distribution showed that ethanol produced a modest slowing of operant responding, as well as fragmentation of the temporal pattern of responding and increases in pausing. Taken together, these results indicate that rats can demonstrate reduced locomotion and slowing of operant responding at doses lower than those that result in sedation or ataxia as measured by the rotarod. The detection of subtle changes in different motor test across a broad range of ethanol doses is important for understanding ethanol effects in other cognitive, motivational or sensory processes.

A Longitudinal Study of Operant Responding in RatsIrradiated when 2 Months Old

Two-month-old rats were exposed to 56Fe particles (1, 1.5, 2 Gy; 1 GeV/nucleon). They were tested on the performance of an ascending fixed-ratio operant task (bar pressing for food reward) at 7, 11 and 15 months after irradiation. Previous research had shown that for the same rats tested at 3 months after exposure, only the rats exposed to 2 Gy of 56Fe particles showed a significant disruption of performance compared to control (0 Gy) rats. When these rats were tested 7, 11 and 15 months after exposure, all irradiated groups showed significantly poorer performance than the controls. These results suggest that there is an interaction between irradiation and age such that 56Fe-particle-induced performance deficits can develop several months after exposure.

Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions

Accumbens dopamine (DA) depletions produce deficits that are related to the ratio requirement of the operant schedule; however, it is also possible that time without reinforcement is a factor. The present study examined the effects of accumbens DA depletions in rats using variable interval (VI) schedules with additional fixed ratio (FR) requirements. Four VI schedules were used (VI 60/FR 1, VI 120/FR 1, VI 60/FR 10, VI 120/FR 10). Attachment of the additional work requirement increased response rates under control conditions. After surgery, there was no interaction between interval level (i.e. 60 vs. 120 s) and DA depletion, but there was a significant interaction between ratio requirement (i.e. 1 vs. 10) and DA depletion within the first week after surgery. DA depletions substantially impaired performance on the schedules with added FR 10 requirements, an effect that was largely dependent upon a reduction in fast responses (i.e. inter-response times less than 1.0 s). There was little effect of DA depletion on overall responding on VI 60/FR 1 and VI 120/FR 1 schedules. DA depletions also increased the tendency to take long pauses in responding (i.e. > 20.0 s), and this effect was evident across all schedules tested. Thus, accumbens DA depletions interact with work requirements and blunt the rate-enhancing effects of moderate size ratios, and also enhance the tendency to pause. Attachment of ratio requirements to interval schedules is a work-related response cost that provides a challenge to the organism, and DA in nucleus accumbens appears to be necessary for adapting to this challenge.

Effects of age and diet on the heavy particle-induced disruption of operant responding produced by a ground-based model for exposure to cosmic rays

On missions to other planets, astronauts will be exposed to galactic cosmic rays which are composed of heavy particles (such as 56Fe) and protons. Exposure to these particles can affect the ability of rats to perform a variety of tasks, indicating that there is the possibility that the performance capabilities of astronauts may be affected. Previous research has shown that diets containing blueberry or strawberry extract can ameliorate the deficits produced by irradiation using a ground-based analog for exposure to cosmic rays. Rats were placed on diets containing 2% blueberry or strawberry extract for 2 months prior to exposure to 1.5 Gy of 1 GeV/n 56Fe particles. There were no effects on performance of any group of animals when tested on an ascending fixed-ratio operant task 6 months following exposure. When tested 12 months after exposure, the performance of the radiated animals given blueberry extract did not differ from the radiated animals fed the control diet. Both groups performed significantly poorer than the non-irradiated controls. There were no differences between the non-irradiated animals fed control diet and the radiated animals fed the strawberry diet and their performance was significantly better than of the radiated rats fed the blueberry or control diets. The results indicate that diets containing strawberry extract may provide a significant level of radiation protection on exploratory class missions.

A Computational Model of the Functional Role of the Ventral-Striatal D2 Receptor in the Expression of Previously Acquired Behaviors

The functional role of dopamine has attracted a great deal of interest ever since it was empirically discovered that dopamine-blocking drugs could be used to treat psychosis. Specifically, the D2 receptor and its expression in the ventral striatum have emerged as pivotal in our understanding of the complex role of the neuromodulator in schizophrenia, reward, and motivation. Our departure from the ubiquitous temporal difference (TD) model of dopamine neuron firing allows us to account for a range of experimental evidence suggesting that ventral striatal dopamine D2 receptor manipulation selectively modulates motivated behavior for distal versus proximal outcomes. Whether an internal model or the TD approach (or a mixture) is better suited to a comprehensive exposition of tonic and phasic dopamine will have important implications for our understanding of reward, motivation, schizophrenia, and impulsivity. We also use the model to help unite some of the leading cognitive hypotheses of dopamine function under a computational umbrella. We have used the model ourselves to stimulate and focus new rounds of experimental research.

Effects of quinpirole on operant conditioning: perseveration of behavioral components

Quinpirole (QNP) is reported to elicit repetitive spontaneous behaviors as well as reduce extinction of operant responses. To determine whether these effects represent perseveration of learned behaviors, behavioral components were examined during the acquisition and extinction of operant responses. Rats, receiving either 0, 0.08, or 0.60 mg/kg QNP were trained to nose poke to receive water. The lower dose interfered with acquisition, but once learned, behavioral characteristics were normal. The higher dose produced excessive time in the drinking well when water was delivered. When water was withheld, the control and 0.08 mg/kg dose groups altered their behavior by initially increasing nose poke duration, followed by a progressive extinction of the operant response. The higher dose group, however, did not modify the characteristics of their behaviors, but continued to perform the behavioral sequence in the absence of reward. These effects are not ascribable to generalized locomotor activation in that response rates during reinforced responses, as well as at the beginning of the extinction phase, did not differ significantly across treatment groups. These results indicate that perseveration effects of QNP are not accountable by general behavioral arousal, nor are specific to extinction. Instead, these effects appear to reflect reduced adaptability of learned behavioral patterns to changes in reinforcement contingencies.

Locomotion induced by non-contingent intracranial stimulation: comparison to psychomotor stimulant

Non-contingent experimenter-applied stimulation (nEAS) to the ventral mesencephalon, unlike contingent intracranial self-stimulation (ICSS), elicits high rates of general locomotion. This locomotion may be due to the nature of the presentation of stimulation, in that nEAS is non-contingent, while ICSS depends on a specific and focused response (e.g., bar pressing). Psychomotor stimulants also elicit high amounts of general locomotion, with the locomotion attributed to increased dopamine release. Interestingly, dopamine release decreases or is absent with repeated ICSS, but not nEAS. This suggests that the locomotion elicited by nEAS may be the result of DA release similar to that observed with psychomotor stimulants. To determine the relationship between locomotion induced by nEAS and psychomotor stimulants, locomotion elicited by nEAS was directly compared to that produced by cocaine, a psychomotor stimulant and indirect DA agonist. Six groups of rats were examined: (1) DA+ group: rats were implanted with a stimulating electrode in the ventral mesencephalon and activation of DA neurons was verified during surgery by monitoring DA release in the striatum; (2) DA- group: rats were also implanted with stimulating electrodes, but the location in the ventral mesencephalon did not elicit DA release; (3) 10-mg/kg cocaine group: rats were exposed to a low dose (10 mg/kg) of cocaine; (4) 40-mg/kg cocaine group: rats were exposed to a high dose (40 mg/kg) of cocaine; (5) saline group: rats were injected with saline; and (6) naive group: rats received no treatment. The topography of behavior was assessed in all rats during four periods: a pre-treatment baseline, treatment, early post-treatment, and a late post-treatment end point. The results suggest that locomotion elicited by nEAS was stereotypic, dependent upon DA release and similar, but not identical, to psychomotor stimulant-induced locomotion.

A model of antipsychotic action in conditioned avoidance: a computational approach

The selective ability of antipsychotic drugs (APDs) to attenuate conditioned avoidance responding (CAR) has been recognized for over 50 years. However, most efforts to account for this finding have been either neurochemically oriented (focusing on the neuromodulator dopamine) or behavioral, with little effort invested in uniting the two within a computational model. In this paper we propose a computational model, based on concepts from formal reinforcement learning theory, which accounts for the basic finding that noncataleptic doses of APDs disrupt avoidance without disrupting escape. The model formally separates out sensory, motor, and reward processes, and makes novel predictions pertaining to the dose- and time-dependent effects of APDs on response latencies--predictions which we verified in experimental studies using four different APDs (haloperidol, chlorpromazine, risperidone, and clozapine). The APD action in this model is most consistent with an effect on 'expected future reward'--an idea closely linked to motivational drives and consistent with several leading theories of dopamine action.

Selective deficits in appetitive conditioning as a consequence of ethanol withdrawal

The acquisition of a conditioned response to a cue associated with a fearful event has been shown to be impaired in animals that had been repeatedly withdrawn from ethanol, but not in animals with the same chronic ethanol treatment but only a single withdrawal episode [D. N. Stephens et al. (2001) Eur. J. Neurosci., 14, 2023-2031]. Lesion studies have shown that the amygdala plays a vital role in this type of conditioning process. Here we investigate aspects of conditioning for appetitive reinforcers in operant tasks, also shown to rely on amygdala processing, in rats following repeated withdrawal from ethanol. Rats were chronically treated with either an ethanol-containing liquid diet for 24 days continuously (single withdrawal) or interspersed with 2 x 3-day withdrawal periods (repeated withdrawal), or with a control diet (control). Two weeks after the final withdrawal, operant training began. In tasks that are impaired by lesions of the basolateral amygdala, conditioned reinforcement and reinforcer devaluation, there was no effect of chronic ethanol treatment or withdrawal on acquisition or performance. However, in a task that is dependent upon functioning of the central nucleus of the amygdala, Pavlovian-to-instrumental transfer, the single and repeated withdrawal groups were significantly impaired. Therefore, chronic ethanol treatment and withdrawal resulted in deficits in behavioural tasks that are sensitive to central but not to basolateral amygdala lesions, and may reflect different sensitivities of these areas to ethanol.

Behavioral effects of inhibition of cannabinoid metabolism: The amidase inhibitor AM374 enhances the suppression of lever pressing produced by exogenously administered anandamide

Biochemical investigations have identified putative enzymatic pathways for the synthesis and metabolism of endogenous cannabinoids. Anandamide amidase is an enzyme that metabolizes anandamide into arachadonic acid and ethanolamine. Using in vitro methods, various inhibitors of amidase have been identified. The present studies were undertaken to determine if the amidase inhibitor AM 374 could enhance the effects of intraperitoneal (IP) injections of anandamide. Three studies were conducted to investigate the effects of various drug treatments on fixed ratio 5 operant lever pressing for food reinforcement. In the first study, the effects of different doses of anandamide were assessed, and it was demonstrated that 5.0 and 10.0 mg/kg anandamide IP significantly suppressed lever pressing, while 2.5 mg/kg produced very little effect. The second study tested the effects of intraventricular (ICV) injections of AM 374, and it was observed that doses up to 10.0, 20.0 and 40 microg AM 374 had no significant effect upon lever pressing. The third study investigated the combined effect of AM374 with a low dose of anandamide. Rats received two drug injections: one ICV and one IP. Four different drug treatments were assessed: 1) ICV vehicle + IP vehicle, 2) ICV vehicle + 2.5 mg/kg anandamide IP, 3) ICV 20.0 microg AM 374 + IP vehicle, and 4) ICV 20 microg AM 374 + 2.5 mg/kg anandamide IP. Combined administration of AM 374 plus anandamide led to a significant decrease in lever pressing compared to either AM374 or anandamide administered alone. Observations of the animals treated with the combination of AM374 plus anandamide indicated that the drug combination resulted in motor slowing, which is consistent with the notion that stimulation of cannabinoid receptors produced a motor deficit that interfered with lever pressing. Although AM374 produced no effect on its own, this amidase inhibitor did enhance the behavioral effect of a low dose of anandamide. These results are consistent with the notion that AM 374 inhibited the enzymatic breakdown of exogenously injected anandamide. This type of procedure can be used to assess a variety of different compounds for their ability to inhibit cannabinoid metabolism.

Consequences of Multiple Withdrawals From Alcohol

This article represents the proceedings of a symposium at the 2003 annual meeting of the Research Society on Alcoholism in Fort Lauderdale, FL, organized by Theodora Duka and chaired by Dai Stephens. The purpose of the symposium was to examine the effects of multiple experiences of withdrawal from alcohol in animals made dependent on alcohol and in humans who are alcohol dependent. Parallels were drawn to the effects of repeated short-lived high-content alcohol exposures in animals and in humans who are social drinkers but indulge in binge drinking. The presentations were (1) Multiple detoxifications and risk of relapse in abstinent alcoholics, by John Gentry and Robert Malcolm; (2) Emotional and cognitive impairments after long-term use of alcohol: relationship to multiple detoxifications and binge drinking, by Theodora Duka; (3) The effect of repeated withdrawal from ethanol on conditioning to appetitive stimuli, by Tamzin Ripley, Gilyanna Borlikova, and Dai Stephens; (4) Alcohol withdrawal kindling: electrographic measures in a murine model of behavioral seizure sensitization, by Lynn Veatch and Howard Becker; and (5) Binge drinking induced changes in CNS, by Fulton Crews.

Long-lasting functional disabilities in middle-aged rats with small cerebral infarcts

Recommendations from experts and recently established guidelines on how to improve the face and predictive validity of animal models of stroke have stressed the importance of using older animals and long-term behavioral-functional endpoints rather than relying almost exclusively on acute measures of infarct volume in young animals. The objective of the present study was to determine whether we could produce occlusions in older rats with an acceptable mortality rate and then detect reliable, long-lasting functional deficits. A reversible intraluminar suture middle cerebral artery occlusion (MCAO) procedure was used to produce small infarcts in middle-aged rats. This resulted in an acceptable mortality rate, and robust disabilities were detected in functional assays, although the degree of total tissue loss measured 90 d after MCAO was quite modest. Infarcted animals were functionally impaired relative to sham control animals even 90 d after the occlusions, and when animals were subgrouped based on amount of tissue loss, MCAO animals with only 4% tissue loss exhibited enduring neurological-behavioral impairments relative to sham-operated controls, and the functional impairments in the group with the largest infarcts (20% tissue loss) were more severe than the functional impairments in the rats with 4% tissue loss. These results suggest that this model, using reversible MCAO to produce small infarcts and long-lasting functional-behavioral deficits in older rats, may represent an advance in the relatively higher-throughput modeling of stroke and its recovery in rodents and may be useful in the development and characterization of future stroke therapies.