Effects of quinpirole on behavioral extinction

Long-lasting behavioral effects of quinpirole exposure on zebrafish

The human brain matures into a complex structure, and to reach its complete development, connections must occur along exact paths. If at any stage, the processes are altered, interrupted, or inhibited, the consequences can be permanent. Dopaminergic signaling participates in the control of physiological functions and behavioral processes, and alterations in this signaling pathway are related to the pathogenesis of several neurological disorders. For this reason, the use of pharmacological agents able to interact with the dopaminergic signaling may elucidate the biological bases of such disorders. We investigated the long-lasting behavioral effects on adult zebrafish after quinpirole (a dopamine D2/D3 receptor agonist) exposure during early life stages of development (24 h exposure at 5 days post-fertilization, dpf) to better understand the mechanisms underlying neurological disorders related to the dopaminergic system. Quinpirole exposure at the early life stages of zebrafish led to late behavioral alterations. When evaluated at 120 dpf, zebrafish presented increased anxiety-like behaviors. At the open tank test, fish remained longer at the bottom of the tank, indicating anxiety-like behavior. Furthermore, quinpirole-treated fish exhibited increased absolute turn angle, likely an indication of elevated erratic movements and a sign of increased fear or anxiety. Quinpirole-treated fish also showed altered swimming patterns, characterized by stereotypic swimming. During the open tank test, exposed zebrafish swims from corner to corner in a repetitive manner at the bottom of the tank. Moreover, quinpirole exposure led to memory impairment compared to control fish. However, quinpirole administration had no effects on social and aggressive behavior. These findings demonstrate that dopaminergic signaling altered by quinpirole administration in the early life stages of development led to late alterations in behavioral parameters of adult zebrafish.

A Free-Operant Reward-Tracking Paradigm to Study Neural Mechanisms and Neurochemical Modulation of Adaptive Behavior in Rats

The ability to respond flexibly to changing environmental circumstances is a hallmark of goal-directed behavior, and compromised flexibility is associated with a wide range of psychiatric conditions in humans, such as addiction and stress-related disorders. To identify neural circuits and transmitter systems implicated in the provision of cognitive flexibility, suitable animal paradigms are needed. Ideally, such models should be easy to implement, allow for rapid task acquisition, provide multiple behavioral readouts, and permit combination with physiological and pharmacological testing and manipulation. Here, we describe a paradigm meeting these requirements and employ it to investigate the neural substrates and neurochemical modulation of adaptive behavior. Water-restricted rats learned to emit operant responses for positive reinforcement (water reward) within minutes in a free-operant conditioning environment. Without further training, animals were able to track changes in the reward schedule. Given prior evidence that the medial prefrontal cortex (mPFC) and the dopaminergic system are required for flexible behavior, we aimed to assess both in more detail. Silencing of mPFC compromised flexible behavior when avoidance of punishment was required. Systemic injections of the D2-receptor agonist quinpirole and the D2-receptor antagonist eticlopride had complex, differential impacts on reward seeking and adaptive behavior.

Mesocorticolimbic dopamine functioning in primary psychopathy: A source of within-group heterogeneity

Despite similar emotional deficiencies, primary psychopathic individuals can be situated on a continuum that spans from controlled to disinhibited. The constructs on which primary psychopaths are found to diverge, such as self-control, cognitive flexibility, and executive functioning, are crucially regulated by dopamine (DA). As such, the goal of this review is to examine which specific alterations in the meso-cortico-limbic DA system and corresponding genes (e.g., TH, DAT, COMT, DRD2, DRD4) might bias development towards a more controlled or disinhibited expression of primary psychopathy. Based on empirical data, it is argued that primary psychopathy is generally related to a higher tonic and population activity of striatal DA neurons and lower levels of D2-type DA receptors in meso-cortico-limbic projections, which may boost motivational drive towards incentive-laden goals, dampen punishment sensitivity, and increase future reward-expectancy. However, increasingly higher levels of DA activity in the striatum (moderate versus pathological elevations), lower levels of DA functionality in the prefrontal cortex, and higher D1-to-D2-type receptor ratios in meso-cortico-limbic projections may lead to increasingly disinhibited and impetuous phenotypes of primary psychopathy. Finally, in order to provide a more coherent view on etiological mechanisms, we discuss interactions between DA and serotonin that are relevant for primary psychopathy.

Stress induced risk-aversion is reverted by D2/D3 agonist in the rat

Stress exposure triggers cognitive and behavioral impairments that influence decision-making processes. Decisions under a context of uncertainty require complex reward-prediction processes that are known to be mediated by the mesocorticolimbic dopamine (DA) system in brain areas sensitive to the deleterious effects of chronic stress, in particular the orbitofrontal cortex (OFC). Using a decision-making task, we show that chronic stress biases risk-based decision-making to safer behaviors. This decision-making pattern is associated with an increased activation of the lateral part of the OFC and with morphological changes in pyramidal neurons specifically recruited by this task. Additionally, stress exposure induces a hypodopaminergic status accompanied by increased mRNA levels of the dopamine receptor type 2 (Drd2) in the OFC; importantly, treatment with a D2/D3 agonist quinpirole reverts the shift to safer behaviors induced by stress on risky decision-making. These results suggest that the brain mechanisms related to risk-based decision-making are altered after chronic stress, but can be modulated by manipulation of dopaminergic transmission.

Effects of pramipexole on the acquisition of responding with opioid-conditioned reinforcement in the rat

RATIONALE

Dopamine D3 receptor-preferring ligands may be able to modify the conditioned reinforcing effects of drug-associated stimuli. In evaluating the effects of these compounds, it is important to clarify the extent to which responding depends on (1) conditioned reinforcement vs. other behavioral mechanisms and (2) dopamine D3 vs. D2 receptor activity.

OBJECTIVES

To use behaviorally stringent new-response acquisition procedures to characterize the effects of the D3-preferring agonist, pramipexole, on the conditioned reinforcing effects of a stimulus paired with the opioid agonist, remifentanil.

METHODS

First, in Pavlovian conditioning (PAV) sessions, rats received response-independent IV injections of remifentanil and presentations of a light-noise stimulus. In separate groups, injections and stimuli either always co-occurred ("paired PAV") or occurred with no consistent relationship ("random PAV" control). Next, in instrumental acquisition (ACQ) sessions, all animals could respond in two nose-poke manipulanda: an active nose-poke, which produced the stimulus alone, or an inactive nose-poke. Pramipexole was injected SC prior to ACQ sessions with or without pretreatments of the D3-preferring antagonist, SB-277011A, or the D2-preferring antagonist, L-741,626.

RESULTS

After paired PAV, but not random PAV, rats acquired nose-poke responding during ACQ (i.e., active > inactive). Pramipexole dose-dependently increased active responding without changing inactive responding. Pramipexole-induced increases in responding were blocked by pretreatment with L-741,626, but not SB-277011A.

CONCLUSIONS

Pramipexole specifically enhanced remifentanil-conditioned reinforcement: active responding was selectively increased only after the stimulus was paired with remifentanil. Although pramipexole is D3-preferring, the antagonist effects obtained presently suggest an important role for the D2 receptor in opioid-conditioned reinforcement.

Functional implications of dopamine D1 vs. D2 receptors: A 'prepare and select' model of the striatal direct vs. indirect pathways

The functions of the D1- and D2-dopamine receptors in the basal ganglia have remained somewhat enigmatic, with a number of competing theories relating to the interactions of the 'direct' and 'indirect pathways'. Computational models have been good at simulating properties of the system, but are typically divorced from the underlying neural architecture. In this article we propose a new model which re-addresses response selection at the level of the basal ganglia. At the core of this response selection system the D1 DA receptor-expressing striatal pathways 'prepare' the set of possible appropriate responses. The D2DR-expressing striatal pathways then shape and 'select' from this initial response set framework. This article is part of a Special Issue entitled: Ventral Tegmentum & Dopamine.

A novel risk-based decision-making paradigm

This paper presents a novel rodent decision-making task that explores uncertainty, independently of expectation and predictability. Using a 5-hole operating box, adult male Wistar rats were given choices between a small certain (safe) food reward and a large uncertain (risk) food reward. We found that animals strongly preferred the safe option when it had a fixed position or was cued with a light in a random placement scheme, but had no preference for safe or risk options when the latter were associated with light. Importantly, when the reward was manipulated animals could perceive alterations in the outcome value and biased their choice pattern to the most profitable option. In addition, we found that the D2/D3 agonist quinpirole biased all decisions toward risk in this paradigm. Finally, a c-fos analysis revealed that several brain areas known to be involved in decision-making mechanisms, including the medial prefrontal cortex, the orbitofrontal cortex, the nucleus accumbens and the striatum, were activated by the task. In summary, this paradigm is a useful and highly reliable tool to explore decision-making processes in contexts of uncertainty.

Comparison of the MK-801-induced increase in non-rewarded appetitive responding with dopamine agonists and locomotor activity in rats

Systemic administration of the noncompetitive N-methyl-D-aspartate (NMDA)- receptor antagonist, MK-801, has been proposed to model cognitive deficits similar to those seen in patients with schizophrenia. Evidence has shown that MK-801 increases the probability of operant responding during extinction, possibly modeling perseveration, as would be seen in patients with schizophrenia. This MK-801-induced behavioral perseveration is reversed by dopamine receptor antagonism. To further explore the role of dopamine in this behavioral change, the current study sought to determine if the MK-801-induced increase in non-rewarded operant responding could be mimicked by dopamine agonism and determine how it was related to locomotor activity. Male Long Evans rats were treated systemically with MK-801, cocaine, GBR12909 or apomorphine (APO) and given a single trial operant extinction session, followed by a separate assessment of locomotor activity. Both MK-801 (0.05 mg/kg) and cocaine (10 mg/kg) significantly increased responding during the extinction session and both increased horizontal locomotor activity. No dose of GBR-12909 (5, 10 or 20 mg/kg) was found to effect non-rewarded operant responding or locomotor activity. APO (0.05, 0.5, 2 or 5 mg/kg) treatment produced a dose-dependent decrease in both operant responding and locomotor activity. These results suggest the possibility that, rather than a primary influence of increased dopamine concentration on elevating bar-pressing responses during extinction, other neurotransmitter systems may be involved.

Evaluation of animal models of obsessive-compulsive disorder: correlation with phasic dopamine neuron activity

Obsessive compulsive disorder (OCD) is a psychiatric condition defined by intrusive thoughts (obsessions) associated with compensatory and repetitive behaviour (compulsions). However, advancement in our understanding of this disorder has been hampered by the absence of effective animal models and correspondingly analysis of the physiological changes that may be present in these models. To address this, we have evaluated two current rodent models of OCD; repeated injection of dopamine D2 agonist quinpirole and repeated adolescent injection of the tricyclic agent clomipramine in combination with a behavioural paradigm designed to produce compulsive lever pressing. These results were then compared with their relative impact on the state of activity of the mesolimbic dopaminergic system using extracellular recoding of spontaneously active dopamine neurons in the ventral tegmental area (VTA). The clomipramine model failed to exacerbate compulsive lever pressing and VTA dopamine neurons in clomipramine-treated rats had mildly diminished bursting activity. In contrast, quinpirole-treated animals showed significant increases in compulsive lever pressing, which was concurrent with a substantial diminution of bursting activity of VTA dopamine neurons. Therefore, VTA dopamine activity correlated with the behavioural response in these models. Taken together, these data support the view that compulsive behaviours likely reflect, at least in part, a disruption of the dopaminergic system, more specifically by a decrease in baseline phasic dopamine signalling mediated by burst firing of dopamine neurons.

Effects of pramipexole on the reinforcing effectiveness of stimuli that were previously paired with cocaine reinforcement in rats

RATIONALE

Dopamine D(2)-like agonists maintain responding when substituted for cocaine in laboratory animals. However, these effects appear to be mediated by an interaction with stimuli that were previously paired with cocaine reinforcement (CS).

OBJECTIVES

To evaluate the extent to which the pramipexole-maintained and pramipexole-induced responding are influenced by cocaine-paired stimuli.

METHODS

Rats were trained to nosepoke for cocaine under fixed ratio 1 (FR1) or progressive ratio (PR) schedules of reinforcement. In FR1-trained rats, pramipexole was substituted for cocaine with injections either paired with CSs, or delivered in their absence. The capacity of experimenter-administered pramipexole to induce FR1 and PR responding for CS presentation was evaluated. The effects of altering stimulus conditions, as well as pretreatments with D(2)- (L: -741,626) and D(3)-preferring (PG01037) antagonists on pramipexole-induced PR responding were also evaluated.

RESULTS

When substituted for cocaine, pramipexole maintained responding at high rates when injections were paired with CSs, but low rates when CSs were omitted. Similarly, experimenter-administered pramipexole induced dose-dependent increases in FR1 or PR responding, with high rates of responding observed when the CS was presented, and low rates of responding when CS presentation was omitted. D(2) and D(3) antagonists differentially affected pramipexole-induced PR responding, with L: -741,626 and PG01037 producing rightward, and downward shifts in the dose-response curve for CS-maintained responding, respectively.

CONCLUSIONS

These data indicate that pramipexole is capable of enhancing the reinforcing effectiveness of conditioned stimuli, and raise the possibility that similar mechanisms are responsible for the increased occurrence of impulse control disorders in patients being treated with pramipexole.

Dopamine agonists increase perseverative instrumental responses but do not restore habit formation in a rat model of Parkinsonism

Dopamine (DA) deafferentation of the dorsolateral striatum has been shown to prevent habit development, leaving instrumental behavior under action-outcome control that is persistently sensitive to modification of the motivational value of the reward. The present experiment further explored the basis of this dysfunction by examining the ability of intrastriatal DA agonist injections (D1 SKF 38393 or D2/D3 Quinpirole) during overtraining of a signaled instrumental task to restore habit formation in rats subjected to bilateral 6-hydroxydopamine (6-OHDA) lesions of the nigrostriatal dopaminergic pathway. Overtraining was followed by a test of goal sensitivity by satiety-specific devaluation of the reward. The results confirmed the impaired shift in performance from action to habit in control lesioned rats. However, lesioned rats repeatedly injected with quinpirole D2/D3 agonist showed an increase in non-rewarded instrumental responses (intertrials periods) during overtraining, suggesting the development of perseverative behavior. Following the procedure of devaluation, quinpirole D2/D3 agonist treatment, and to a lesser extent SKF 38393 D1 agonist, caused the persistence of sensitivity to reward devaluation, indicating clear goal-directed behavior despite extended training. This absence of restoration of habit formation by DA agonist treatment is discussed in the light of DA agonist effects in Parkinson patients.

Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats

D2-like agonists, such as quinpirole, maintain responding in monkeys, rats, and mice when they are substituted for cocaine. This study examined the influence of operant history and cocaine-paired stimuli (CS) on quinpirole-maintained responding in rats trained to nose poke for cocaine. Upon acquisition of responding for cocaine, substitutions were performed in the presence or absence of injection-CS pairings. Although cocaine maintained responding regardless of whether injections were accompanied by CS, quinpirole maintained responding only when CS were paired with injections. To assess the influence of operant history, injections of cocaine, quinpirole, remifentanil, nicotine, or saline were made available on a previously inactive lever, while nose pokes continued to result in CS presentation. Although responding was reallocated from the nose poke to the lever when cocaine or remifentanil was available, lever presses remained low, and nose poking persisted when quinpirole or nicotine was made contingent upon lever presses. Finally, quinpirole pretreatments resulted in high rates of nose poking when nose pokes resulted in CS presentation alone, but failed to maintain nose poking when the CS was omitted. Taken together, these results suggest that the response-maintaining effects of quinpirole are primarily mediated by an enhancement of the conditioned reinforcing effects of earlier CS, rather than by a reinforcing effect of quinpirole.

Dopamine D2/D3 receptor agonist quinpirole impairs spatial reversal learning in rats: investigation of D3 receptor involvement in persistent behavior

RATIONALE

Dopamine is strongly implicated in the ability to shift behavior in response to changing stimulus-reward contingencies.

OBJECTIVES

We investigated the effects of systemic administration of the D2/D3 receptor agonist quinpirole (0.1, 0.3 mg/kg), the D2/D3 receptor antagonist raclopride (0.1, 0.3 mg/kg), the selective D3 antagonist nafadotride (0.3, 1.0 mg/kg), and combined administration of raclopride (0.1 mg/kg) or nafadotride (1.0 mg/kg) with quinpirole (0.3 mg/kg) on spatial discrimination and reversal learning.

MATERIALS AND METHODS

Rats were trained on an instrumental two-lever spatial discrimination and reversal learning task. Both levers were presented, only one of which was reinforced. The rat was required to respond on the reinforced lever under a fixed ratio 3 schedule of reinforcement. Following attainment of criterion, a reversal was introduced.

RESULTS

None of the drugs altered performance during retention of the previously reinforced contingencies. Quinpirole (0.3 mg/kg) significantly impaired reversal learning by increasing both trials and incorrect responses to criterion in reversal phase, a pattern of behavior manifested as increased perseverative responding on the previously reinforced lever. In contrast, neither raclopride nor nafadotride when administered alone altered reversal performance. However, raclopride blocked the quinpirole-induced reversal deficit, whereas combined administration of nafadotride and quinpirole affected not only performance during the reversal but also the retention phase. The reversal impairment resulting from co-administration of nafadotride and quinpirole was associated with both perseverative and learning errors.

CONCLUSIONS

Our data indicate distinct roles for D2 and D3 receptors in the capacity to modify behavior flexibly in the face of environmental change.

Differential contributions of dopamine and serotonin to orbitofrontal cortex function in the marmoset

We have shown previously that the inhibitory control functions of the orbitofrontal cortex (OFC) are disrupted by serotonin, but not dopamine depletions. However, both dopamine and serotonin terminals and receptors are present within the OFC and thus the aim of the present study was to determine the differential contributions of these neurotransmitters to orbitofrontal function. OFC and dopamine are involved in the process by which neutral stimuli take on reinforcing properties, by virtue of their prior association with reward, and guide behavior. Thus, we compared the performance of marmosets with dopaminergic or serotoninergic OFC depletions on a test of conditioned reinforcement. To further our understanding of serotonin in behavioral flexibility, the effect of these depletions was also compared on the extinction of a visual discrimination. Monkeys with serotonin depletions of the OFC displayed stimulus-bound responding on both tests of conditioned reinforcement and discrimination extinction suggesting that orbitofrontal serotonin plays a specific role in preventing competing, task irrelevant, salient stimuli from biasing responding. In contrast, monkeys with dopamine depletion were insensitive to conditioned reinforcers and displayed persistent responding in the absence of reward in extinction, a pattern of deficits that may reflect basic deficits in the associative processing of reward.

Drug and reinforcement history as determinants of the response-maintaining effects of quinpirole in the rat

The present study examined the effect of drug and reinforcement history on quinpirole-maintained responding in rats. Quinpirole (0.01, 0.032, or 0.1 mg/kg per injection) was assessed as a reinforcer in experimentally naive rats, as well as in rats trained to self-administer cocaine, remifentanil, ketamine, or food under a fixed ratio 1 schedule of reinforcement. Quinpirole failed to maintain responding in experimentally naive rats, or in ketamine- or food-trained rats. However, robust responding was maintained in rats with a history of cocaine reinforcement, and modest levels of responding were observed in rats with a history of responding for remifentanil. In a second set of studies, the effects of protracted drug histories on quinpirole-maintained responding in food-trained rats were assessed. Rats were maintained with food reinforcement, and different groups of rats were then allowed to respond for saline, quinpirole, and response-contingent cocaine or were administered noncontingent cocaine; all rats were subsequently allowed to respond for quinpirole. Only rats that previously responded for cocaine showed quinpirole-maintained responding; all other conditions failed to establish quinpirole-maintained responding. Although the high levels of quinpirole-maintained responding observed when quinpirole was substituted for cocaine are suggestive of positive reinforcing effects, these response-maintaining effects were highly dependent upon both drug and reinforcement history, suggesting that quinpirole may only function as a reinforcer under very specific conditions. The behavioral effects of quinpirole under these situations represent a novel constellation of actions relative to other drug reinforcers, and they suggest that the direct effects of self-administered quinpirole may be important in establishing the response-maintaining effects.

Amphetamine exposure enhances habit formation

Performance of instrumental actions in rats is initially sensitive to postconditioning changes in reward value, but after more extended training, behavior comes to be controlled by stimulus-response (S-R) habits that are no longer goal directed. To examine whether sensitization of dopaminergic systems leads to a more rapid transition from action-outcome processes to S-R habits, we examined performance of amphetamine-sensitized rats in an instrumental devaluation task. Animals were either sensitized (7 d, 2 mg/kg/d) before training (experiment 1) or sensitized between training and testing (experiment 2). Rats were trained to press a lever for a reward (three sessions) and were then given a test of goal sensitivity by devaluation of the instrumental outcome before testing in extinction. Control animals showed selective sensitivity to devaluation of the instrumental outcome. However, amphetamine sensitization administered before training caused the animals' responding to persist despite the changed value of the reinforcer. This deficit resulted from an inability to use representations of the outcome to guide behavior, because a reacquisition test confirmed that all of the animals had acquired an aversion to the reinforcer. In experiment 2, post-training sensitization did not disrupt normal goal-directed behavior. These findings indicate that amphetamine sensitization leads to a rapid progression from goal-directed to habit-based responding but does not affect the performance of established goal-directed actions.

Effects of quinpirole on operant conditioning: perseveration of behavioral components

Quinpirole (QNP) is reported to elicit repetitive spontaneous behaviors as well as reduce extinction of operant responses. To determine whether these effects represent perseveration of learned behaviors, behavioral components were examined during the acquisition and extinction of operant responses. Rats, receiving either 0, 0.08, or 0.60 mg/kg QNP were trained to nose poke to receive water. The lower dose interfered with acquisition, but once learned, behavioral characteristics were normal. The higher dose produced excessive time in the drinking well when water was delivered. When water was withheld, the control and 0.08 mg/kg dose groups altered their behavior by initially increasing nose poke duration, followed by a progressive extinction of the operant response. The higher dose group, however, did not modify the characteristics of their behaviors, but continued to perform the behavioral sequence in the absence of reward. These effects are not ascribable to generalized locomotor activation in that response rates during reinforced responses, as well as at the beginning of the extinction phase, did not differ significantly across treatment groups. These results indicate that perseveration effects of QNP are not accountable by general behavioral arousal, nor are specific to extinction. Instead, these effects appear to reflect reduced adaptability of learned behavioral patterns to changes in reinforcement contingencies.