Facilitated acquisition but not persistence of responding for a cocaine-paired conditioned reinforcer following sensitization with cocaine

Differential brain responses to alcohol-related and natural rewards are associated with alcohol use and problems: Evidence for reward dysregulation

Multiple theoretical perspectives posit that drug use leads to biased valuation of drug-related reward, at the expense of naturally occurring rewarding activities (i.e., reward dysregulation). Recent research suggests that the comparative balance of drug-related and nondrug-related reward valuation is a powerful determinant of substance misuse and addiction. We examined differential neurophysiological responses-indexed with the P3 component of the event-related potential (ERP)-elicited by visual alcohol cues and cues depicting natural reward as a neurobiological indicator of problematic drinking. Nondependent, young adult drinkers (N = 143, aged 18-30 years) completed questionnaire measures assessing alcohol use and problems, and viewed alcohol cues (pictures of alcoholic beverages), high-arousing natural reward cues (erotica, adventure scenes), nonalcoholic beverage cues, and neutral scenes (e.g., household items) while ERPs were recorded. When examined separately, associations of P3-ERP reactivity to alcohol cues and natural reward cues with alcohol use and problems were weak. However, differential P3 response to the two types of cues (i.e., reward dysregulation P3) showed consistent and robust associations with all indices of alcohol use and problems and differentiated high-risk from lower-risk drinkers. The current results support the idea that the differential incentive-motivational value of alcohol, relative to naturally rewarding activities, is associated with increased risk for substance misuse and dependence, and highlight a novel neurophysiological indicator-the reward dysregulation P3-of this differential reward valuation.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

21st century neurobehavioral theories of decision making in addiction: Review and evaluation

This review critically examines neurobehavioral theoretical developments in decision making in addiction in the 21st century. We specifically compare each theory reviewed to seven benchmarks of theoretical robustness, based on their ability to address: why some commodities are addictive; developmental trends in addiction; addiction-related anhedonia; self-defeating patterns of behavior in addiction; why addiction co-occurs with other unhealthy behaviors; and, finally, means for the repair of addiction. We have included only self-contained theories or hypotheses which have been developed or extended in the 21st century to address decision making in addiction. We thus review seven distinct theories of decision making in addiction: learning theories, incentive-sensitization theory, dopamine imbalance and systems models, opponent process theory, strength models of self-control failure, the competing neurobehavioral decision systems theory, and the triadic systems theory of addiction. Finally, we have directly compared the performance of each of these theories based on the aforementioned benchmarks, and highlighted key points at which several theories have coalesced.

Role of cues and contexts on drug-seeking behaviour

Environmental stimuli are powerful mediators of craving and relapse in substance-abuse disorders. This review examined how animal models have been used to investigate the cognitive mechanisms through which cues are able to affect drug-seeking behaviour. We address how animal models can describe the way drug-associated cues come to facilitate the development and persistence of drug taking, as well as how these cues are critical to the tendency to relapse that characterizes substance-abuse disorders. Drug-associated cues acquire properties of conditioned reinforcement, incentive motivation and discriminative control, which allow them to influence drug-seeking behaviour. Using these models, researchers have been able to investigate the pharmacology subserving the behavioural impact of environmental stimuli, some of which we highlight. Subsequently, we examine whether the impact of drug-associated stimuli can be attenuated via a process of extinction, and how this question is addressed in the laboratory. We discuss how preclinical research has been translated into behavioural therapies targeting substance abuse, as well as highlight potential developments to therapies that might produce more enduring changes in behaviour.

Transition from 'model-based' to 'model-free' behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum

Cocaine addiction is a complex and multidimensional process involving a number of behavioral and neural forms of plasticity. The behavioral transition from voluntary drug use to compulsive drug taking may be explained at the neural level by drug-induced changes in function or interaction between a flexible planning system, associated with prefrontal cortical regions, and a rigid habit system, associated with the striatum. The dichotomy between these two systems is operationalized in computational theory by positing model-based and model-free learning mechanisms, the former relying on an "internal model" of the environment and the latter on pre-computed or cached values to control behavior. In this review, we will suggest that model-free and model-based learning mechanisms appear to be differentially affected, at least in the case of psychostimulants such as cocaine, with the former being enhanced while the latter are disrupted. As a result, the behavior of long-term drug users becomes less flexible and responsive to the desirability of expected outcomes and more habitual, based on the long history of reinforcement. To support our specific proposal, we will review recent neural and behavioral evidence on the effect of psychostimulant exposure on orbitofrontal and dorsolateral striatum structure and function. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Acquisition of responding with a remifentanil-associated conditioned reinforcer in the rat

RATIONALE

Drug-associated environmental stimuli may serve as conditioned reinforcers to enhance drug self-administration behaviors in humans and laboratory animals. However, it can be difficult to distinguish experimentally the conditioned reinforcing effects of a stimulus from other behavioral processes that can change rates of responding.

OBJECTIVES

To characterize the conditioned reinforcing effects of a stimulus paired with the μ-opioid agonist, remifentanil, using a new-response acquisition procedure in the rat.

METHODS

First, in Pavlovian conditioning (PAV) sessions, rats received response-independent IV injections of remifentanil and presentations of a light-noise compound stimulus. In paired PAV groups, injections and stimulus presentations always co-occurred. In random PAV control groups, injections and stimulus presentations occurred with no consistent relationship. Second, in instrumental acquisition (ACQ) sessions, all animals could respond in an active nose-poke that produced the stimulus alone or in an inactive nose-poke that had no scheduled consequences.

RESULTS

During ACQ, rats made significantly more active nose-pokes than inactive nose-pokes after paired PAV, but not after random PAV. Between groups, rats also made more active nose-pokes after paired PAV than after random PAV. After paired PAV, increased active responding was obtained under different schedules of reinforcement, persisted across multiple ACQ sessions, and depended on the number of PAV sessions conducted.

CONCLUSIONS

The remifentanil-paired stimulus served as a conditioned reinforcer for nose-poking: responding depended on both the contingency between the stimulus and remifentanil and the contingency between the nose-poke and the stimulus. Generally, new-response acquisition procedures may provide valid, flexible models for studying opioid-based conditioned reinforcement.

Fronto-striatal dysregulation in drug addiction and pathological gambling: Consistent inconsistencies?

Alterations in appetitive processing are central to the major psychological theories of addiction, with differential predictions made by the reward deficiency, incentive salience, and impulsivity hypotheses. Functional MRI has become the chief means of testing these predictions, with experiments reliably highlighting disturbances at the level of the striatum, medial prefrontal cortex, and affiliated regions. However, demonstrations of hypo-reactivity and hyper-reactivity of this circuitry in drug addicted groups are reported in approximately equal measure. Similar findings are echoed in the emergent neuroimaging literature on pathological gambling, which has recently witnessed a coming of age. The first aim of this article is to consider some of the methodological aspects of these experiments that could influence the observed direction of group-level effects, including the baseline condition, trial structure and timing, and the nature of the appetitive cues (drug-related, monetary, or primary rewards). The second aim is to highlight the conceptual traction that is offered by pathological gambling, as a model of a ‘toxicity free’ addiction and an illness where tasks of monetary reinforcement afford a more direct mapping to the abused commodity. Our conclusion is that relatively subtle decisions in task design appear capable of driving group differences in fronto-striatal circuitry in entirely opposing directions, even with tasks and task variants that look ostensibly similar. Differentiation between the psychological theories of addiction will require a greater breadth of experimental designs, with more research needed on processing of primary appetitive cues, aversive processing, and in vulnerable/at-risk groups.

•

We outline the current psychological theories of addiction and their predictions.

•

We review recent fMRI literature of substance addictions and appetitive processing.

•

Reasons for opposing results (hyper- vs hypo-active reward regions) are discussed.

•

Recent fMRI findings of appetitive processing in pathological gambling are reviewed.

•

Pathological gambling is suggested as a prototypical addiction for imaging research.

Multiple roles for orexin/hypocretin in addiction

Orexins/hypocretins are hypothalamic peptides involved in arousal and wakefulness, but also play a critical role in drug addiction and reward-related behaviors. Here, we review the roles played by orexins in a variety of animal models of drug addiction, emphasizing both commonalities and differences for orexin's involvement in seeking of the major classes of abused drugs, as well as food. One common theme that emerges is an involvement of orexins in drug seeking triggered by external stimuli (e.g., cues, contexts or stressors). We also discuss the functional neuronal circuits in which orexins are embedded, and how these circuits mediate addiction-related behaviors, with particular focus on the role of orexin and glutamate interactions within the ventral tegmental area. Finally, we attempt to contextualize the role of orexins in reward by discussing ways in which these peptides, expressed in only a few thousand neurons in the brain, can have such wide-ranging effects on behavior.

Cues paired with either rapid or slower self-administered cocaine injections acquire similar conditioned rewarding properties

The faster drugs of abuse reach the brain, the more addictive they can be. It is not known why this is. Environmental stimuli associated with drugs can promote the development and persistence of addiction by invigorating and precipitating drug-seeking behaviour. We determined, therefore, whether cues associated with the self-administration of rapidly delivered cocaine (injected intravenously over 5 versus 90 seconds) would acquire greater conditioned rewarding properties, as assessed by the performance of an operant response reinforced solely by the cues. Rats nose-poked for intravenous cocaine infusions delivered either over 5 or 90 seconds. Discrete visual cues accompanied each infusion. The rats could then press a lever to obtain the cues—now a conditioned reward—or an inactive lever. Rats in both the 5- and 90-second groups pressed more on the active versus inactive lever following extensive (24 sessions) but not following limited (3 sessions) self-administration training. There were no group differences in this behaviour. Following withdrawal from cocaine self-administration, lever discrimination progressively abated in both groups and was lost by withdrawal day 30. However, the rewarding properties of the cues were not “forgotten” because on withdrawal days 32–33, amphetamine selectively enhanced active-lever pressing, and did so to a similar extent in both groups. Thus, cues paired with rapid or slower cocaine delivery acquire similar conditioned rewarding properties. We conclude, therefore, that the rapid delivery of cocaine to the brain promotes addiction by mechanisms that might not involve a greater ability of drug cues to control behaviour.

Selective breeding for magnitude of methamphetamine-induced sensitization alters methamphetamine consumption

RATIONALE

Genetically determined differences in susceptibility to drug-induced sensitization could be related to risk for drug consumption.

OBJECTIVES

Studies were performed to determine whether selective breeding could be used to create lines of mice with different magnitudes of locomotor sensitization to methamphetamine (MA). MA sensitization (MASENS) lines were also examined for genetically correlated responses to MA.

METHODS

Beginning with the F2 cross of C57BL/6J and DBA/2J strains, mice were tested for locomotor sensitization to repeated injections of 1 mg/kg MA and bred based on magnitude of sensitization. Five selected offspring generations were tested. All generations were also tested for MA consumption, and some were tested for dose-dependent locomotor-stimulant responses to MA, consumption of saccharin, quinine, and potassium chloride as a measure of taste sensitivity, and MA clearance after acute and repeated MA.

RESULTS

Selective breeding resulted in creation of two lines [MA high sensitization (MAHSENS) and MA low sensitization (MALSENS)] that differed in magnitude of MA-induced sensitization. Initially, greater MA consumption in MAHSENS mice reversed over the course of selection so that MALSENS mice consumed more MA. MAHSENS mice exhibited greater sensitivity to the acute stimulant effects of MA, but there were no significant differences between the lines in MA clearance from blood.

CONCLUSIONS

Genetic factors influence magnitude of MA-induced locomotor sensitization and some of the genes involved in magnitude of this response also influence MA sensitivity and consumption. Genetic factors leading to greater MA-induced sensitization may serve a protective role against high levels of MA consumption.

Which cue to "want?" Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue

The central nucleus of the amygdala (CeA) helps translate learning into motivation, and here, we show that opioid stimulation of CeA magnifies and focuses learned incentive salience onto a specific reward cue (pavlovian conditioned stimulus, or CS). This motivation enhancement makes that cue more attractive, noticeable, and liable to elicit appetitive and consummatory behaviors. To reveal the focusing of incentive salience, we exploited individual differences in an autoshaping paradigm in which a rat prefers to approach, nibble, and sniff one of two reward-associated stimuli (its prepotent stimulus). The individually prepotent cue is either a predictive CS+ that signals reward (8 s metal lever insertion) or instead the metal cup that delivers sucrose pellets (the reward source). Results indicated that CeA opioid activation by microinjection of the mu agonist DAMGO (0.1 microg) selectively and reversibly enhanced the attractiveness of whichever reward CS was that rat's prepotent cue. CeA DAMGO microinjections made rats more vigorously approach their particular prepotent CS and to energetically sniff and nibble it in a nearly frenzied consummatory manner. Only the prepotent cue was enhanced as an incentive target, and alternative cues were not enhanced. Conversely, inactivation of CeA by muscimol microinjection (0.25 microg) suppressed approach, nibbles, and sniffs of the prepotent CS. Confirming modulation of incentive salience, unconditioned food intake was similarly increased by DAMGO microinjection and decreased by muscimol in CeA. We conclude that opioid neurotransmission in CeA helps determine which environmental stimuli become most "wanted," and how "wanted" they become. This may powerfully guide reward-seeking behavior.

A role for calmodulin-stimulated adenylyl cyclases in cocaine sensitization

Cocaine sensitization is produced by repeated exposure to the drug and is thought to reflect neuroadaptations that contribute to addiction. Here, we identify the Ca(2+)/calmodulin-stimulated adenylyl cyclases, type 1 (AC1) and type 8 (AC8), as novel regulators of this behavioral plasticity. We show that, whereas AC1 and AC8 single knock-out mice (AC1(-/-) and AC8(-/-)) exhibit Ca(2+)-stimulated adenylyl cyclase activity in striatal membrane fractions, AC1/8 double-knock-out (DKO) mice do not. Furthermore, DKO mice are acutely supersensitive to low doses of cocaine and fail to display locomotor sensitization after chronic cocaine treatment. Because of the known role for the extracellular signal-regulated kinase (ERK)/mitogen-activated protein kinase signaling pathway in cocaine-induced behavioral plasticity and its coupling to calcium-stimulated cAMP signaling in the hippocampus, we measured phosphorylated ERK (pERK) levels in the striatum. Under basal conditions, pERK is upregulated in choline acetyltransferase-positive interneurons in DKO mice relative to wild-type (WT) controls. After acute cocaine treatment, pERK signaling is significantly suppressed in medium spiny neurons (MSNs) of DKO mice relative to WT mice. In addition to the lack of striatal ERK activation by acute cocaine, signaling machinery downstream of ERK is uncoupled in DKO mice. We demonstrate that AC1 and AC8 are necessary for the phosphorylation of mitogen and stress-activated kinase-1 (pMSK1) at Ser376 and Thr581 and cAMP response element-binding protein (pCREB) at Ser133 after acute cocaine treatment. Our results demonstrate that the Ca(2+)-stimulated adenylyl cyclases regulate long-lasting cocaine-induced behavioral plasticity via activation of the ERK/MSK1/CREB signaling pathway in striatonigral MSNs.

Review. The incentive sensitization theory of addiction: some current issues

We present a brief overview of the incentive sensitization theory of addiction. This posits that addiction is caused primarily by drug-induced sensitization in the brain mesocorticolimbic systems that attribute incentive salience to reward-associated stimuli. If rendered hypersensitive, these systems cause pathological incentive motivation ('wanting') for drugs. We address some current questions including: what is the role of learning in incentive sensitization and addiction? Does incentive sensitization occur in human addicts? Is the development of addiction-like behaviour in animals associated with sensitization? What is the best way to model addiction symptoms using animal models? And, finally, what are the roles of affective pleasure or withdrawal in addiction?