The behavioral economics of concurrent drug reinforcers: a review and reanalysis of drug self-administration research

Is melioration the addiction theory of choice?

Heyman makes a convincing case that a melioration choice strategy is sufficient to produce addictive behavior. But given a plethora of addiction theories, the question is whether melioration theory is superior to rivals more sophisticated than a simple disease model or operant conditioning account. Heyman offers little direct evidence that melioration actually causes the addictions we observe.

A scientific fix for the classical account of addiction

Heyman's two crucial theses are that people over-value immediate rewards, and that addictive substances “subvert the value of competing commodities.” These perennial ideas were discussed by Plato. Whereas Heyman provides scientific clarification and support for the first, the second remains problematic. I outline how this deficiency might be remedied via evolutionary considerations.

Control versus causation of addiction

Heyman explains useful ways to bring addictive drug use under environmental control. We doubt that relapse is explained by drug features such as immediate reinforcement, clouding of judgment, and so forth. Relapse may require explanation in terms of enduring sensitization of incentive neural substrates, but even if its causal assumptions are wrong, Heyman's model makes useful predictions for behavioral control.

Self-control and impulsiveness: Resolution of apparent contradictions in choice behavior

Choosing the smaller, less delayed reinforcers of drug abuse (including cessation of withdrawal) over the larger, more delayed reinforcers of a healthy life can be described as impulsiveness (the opposite of self-control). Examination of drug abuse using a self-control/impulsiveness framework can help explain many of the puzzles about this behavior, while tying drug abuse into a large research database.

Who is at risk for addiction?

Numerous individual differences determine the effectiveness of the multiple external reinforcement contingencies that control drug seeking behavior. Differences in the capacity to frame reinforcement and also the toxic effects of drugs modulate susceptibility to addiction. As a result, not all individuals are at the same degree of risk for addiction.

The behavioral economics of drug dependence: towards the consilience of economics and behavioral neuroscience

In this chapter, we review the research in this growing field by first discussing the concepts related to price and consumption (demand), its applications to the study of drug consumption and drug seeking, and the impact of other commodities on drug consumption. We then review the discounting of future commodities and events among the addicted, review the most recent research examining the neural correlates of discounting, and describe and review the new theory of addiction that results from that research. We conclude by addressing the next research steps that these advances engender.

The uncertainty processing theory of motivation

Most theories describe motivation using basic terminology (drive, 'wanting', goal, pleasure, etc.) that fails to inform well about the psychological mechanisms controlling its expression. This leads to a conception of motivation as a mere psychological state 'emerging' from neurophysiological substrates. However, the involvement of motivation in a large number of behavioural parameters (triggering, intensity, duration, and directedness) and cognitive abilities (learning, memory, decision, etc.) suggest that it should be viewed as an information processing system. The uncertainty processing theory (UPT) presented here suggests that motivation is the set of cognitive processes allowing organisms to extract information from the environment by reducing uncertainty about the occurrence of psychologically significant events. This processing of information is shown to naturally result in the highlighting of specific stimuli. The UPT attempts to solve three major problems: (i) how motivations can affect behaviour and cognition so widely, (ii) how motivational specificity for objects and events can result from nonspecific neuropharmacological causal factors (such as mesolimbic dopamine), and (iii) how motivational interactions can be conceived in psychological terms, irrespective of their biological correlates. The UPT is in keeping with the conceptual tradition of the incentive salience hypothesis while trying to overcome the shortcomings inherent to this view.

Token reinforcement: a review and analysis

Token reinforcement procedures and concepts are reviewed and discussed in relation to general principles of behavior. The paper is divided into four main parts. Part I reviews and discusses previous research on token systems in relation to common behavioral functions--reinforcement, temporal organization, antecedent stimulus functions, and aversive control--emphasizing both the continuities with other contingencies and the distinctive features of token systems. Part II describes the role of token procedures in the symmetrical law of effect, the view that reinforcers (gains) and punishers (losses) can be measured in conceptually analogous terms. Part III considers the utility of token reinforcement procedures in cross-species analysis of behavior more generally, showing how token procedures can be used to bridge the methodological gulf separating research with humans from that with other animals. Part IV discusses the relevance of token systems to the field of behavioral economics. Token systems have the potential to significantly advance research and theory in behavioral economics, permitting both a more refined analysis of the costs and benefits underlying standard economic models, and a common currency more akin to human monetary systems. Some implications for applied research and for broader theoretical integration across disciplines will also be considered.

Abuse liability assessment of tobacco products including potential reduced exposure products

The harm produced by tobacco products is a result of frequent use of a highly toxic product. Reducing the adverse public health impact of tobacco products might be most effectively achieved by reducing the likelihood of their use and the toxicity of the products. Products that retain some characteristics of cigarettes but have been altered with the intention of reducing toxicity have been referred to as modified risk tobacco products or potential reduced exposure products (MRTP/PREP). Evaluation of their content, emission, and toxicity is discussed in other articles in this special issue. Here, we discuss the methodology that has been used to examine the likelihood of abuse or addiction. Abuse liability assessment (ALA) methodology has been used by the Food and Drug Administration (FDA) and other drug regulatory agencies world-wide for decades to assess the risks posed by a wide variety of pharmacologically active substances. ALA is routinely required among other evaluations of safety during the pre-market assessment of new drugs, and is continually adapted to meet the challenges posed by new drug classes and drug formulations. In the 2009 law giving FDA regulation over tobacco products, FDA is now required to evaluate new tobacco products including MRTP/PREPs to determine their risk for abuse and toxicity at the population level. This article describes the traditional tools and methods of ALA that can be used to evaluate new tobacco and nicotine products including MRTP/PREPs. Such ALA data could contribute to the scientific foundation on which future public policy decisions are based.

Settings and functions related to simultaneous use of alcohol with marijuana or cocaine among clients in treatment for substance abuse

OBJECTIVES

The paper identifies the central theoretical components for developing a typology of alcohol use with other substances. The settings and functions related to the simultaneous use of alcohol with marijuana or cocaine are examined using a dataset from a study of treatment clients in Ontario, Canada (data collected between the years 2003 and 2005).

METHODS

A cross-sectional design was used where patients 18 years or older completed a self-administered questionnaire upon admission to various treatment programs. Clients who reported using marijuana (n = 499) or cocaine (n = 375) in the past year were asked how often they use these substances in combination with alcohol.

FINDINGS

Simultaneous use is very common among treatment clients, with differences in the settings and functions associated with alcohol used in combination with cocaine or marijuana, and by various sociodemographic characteristics. The study's limitations are noted.

Supply of a nondrug substitute reduces escalated heroin consumption

Escalation of drug consumption-a hallmark of addiction-has been hypothesized to be associated with a relative devaluation of alternative nondrug rewards and thus with a decrease in their ability to compete with or to substitute for the drug. In a behavioral economic framework, decreased substitutability of nondrug rewards for drug would explain why drug consumption is behaviorally dominant and relatively resistant to change (eg price-inelastic) in drug-addicted individuals. The goal of the present study was to test this hypothesis using a validated rat model of heroin intake escalation. Escalation was precipitated by long (6 h, long access (LgA)), but not short (1 h, short access (ShA)), daily access to i.v. heroin self-administration. After escalation, the effects of price (ie fixed-ratio value) on heroin consumption were assessed under two alternative reward conditions: in the presence or absence of a nondrug substitute for heroin (ie four freely available chow pellets). As expected, escalated heroin consumption by LgA rats was less sensitive to price than heroin consumption by ShA rats, showing that heroin had acquired greater reinforcing strength during escalation. However, supplying a substitute during access to heroin was sufficient to reverse this post-escalation increase in the reinforcing effectiveness of heroin. Thus, escalated heroin consumption is not associated with a decreased sensitivity to competing nondrug rewards. Escalated drug use may therefore persist, not so much because of a relative devaluation of nondrug substitutes, but because of a loss or reduction of their availability.

Wheel running, voluntary ethanol consumption, and hedonic substitution

Few studies have examined the relationship between naturally rewarding behaviors and ethanol drinking behaviors in mice. Although natural and drug reinforcers activate similar brain circuitry, there is behavioral evidence suggesting food and drug rewards differ in perceived value. The primary goal of the present study was to investigate the relationships between naturally reinforcing stimuli and consumption of ethanol in ethanol preferring C57BL/6J mice. Mouse behaviors were observed after the following environmental manipulations: standard or enhanced environment, accessible or inaccessible wheel, and presence or absence of ethanol. Using a high-resolution volumetric drinking monitor and wheel running monitor, we evaluated whether alternating access to wheel running modified ethanol-related behaviors and whether alternating access to ethanol modified wheel running or subsequent ethanol-related behaviors. We found that ethanol consumption remains stable with alternating periods of wheel running. Wheel running increases in the absence of ethanol and decreases upon reintroduction of ethanol. Upon reintroduction of ethanol, an alcohol deprivation effect was seen. Collectively, the results support theories of hedonic substitution and suggest that female C57BL/6J mice express ethanol seeking and craving under these specific conditions.

Bridging the gap between science and drug policy: From “what” and “how” to “whom” and “when”

For all its problems, the microeconomic “rational addiction” theory had the appeal of making clear predictions about the effects of various drug policies. The emerging picture of the “what” and “how” of addiction is far more complex. Addiction scientists might help bridge the science–policy gap by devoting more attention to the “whom” and “when” of addiction.

Economic principles motivating social attention in humans

We know little about the processes by which we evaluate the opportunity to look at another person. We propose that behavioural economics provides a powerful approach to understanding this basic aspect of social attention. We hypothesized that the decision process culminating in attention to another person follows the same economic principles that govern choices about rewards such as food, drinks and money. Specifically, such rewards are discounted as a function of time, are tradable for other rewards, and reinforce work. Behavioural and neurobiological evidence suggests that looking at other people can also be described as rewarding, but to what extent these economic principles apply to social orienting remains unknown. Here, we show that the opportunity to view pictures of the opposite sex is discounted by delay to viewing, substitutes for money and reinforces work. The reward value of photos of the opposite sex varied with physical attractiveness and was greater in men, suggesting differential utility of acquiring visual information about the opposite sex in men and women. Together, these results demonstrate that choosing whom to look at follows a general set of economic principles, implicating shared neural mechanisms in both social and non-social decision making.

A behavioral economic analysis of cocaine and remifentanil self-administration in rhesus monkeys

RATIONALE

Behavioral economics can be used to evaluate the relative reinforcing effectiveness of drugs and the economic interaction between drugs, information which may help to explain patterns of polydrug abuse in humans.

OBJECTIVES

In phase 1, the reinforcing effectiveness of the opiate remifentanil and the stimulant cocaine was compared using a demand-curve analysis. In phase 2, the economic relation between these drugs was determined.

MATERIALS AND METHODS

Rhesus monkeys pressed levers according to fixed-ratio schedules for intravenous drug infusions. A demand-curve analysis was conducted (phase 1) in which drug consumption was measured as the response requirement, or price, was increased, and the rate at which consumption decreased with increases in price (demand elasticity) provided an index of the reinforcing effectiveness of each drug. Cocaine and remifentanil were then available concurrently (phase 2), and the price of one drug was increased (the manipulated-price alternative) while the price of the other drug was held constant (the fixed-price alternative). Consumption of the fixed-price alternative was measured as a function of increases in the price of the manipulated-price alternative, and demand for the manipulated-price alternative was assessed.

RESULTS

The reinforcing effectiveness of cocaine and remifentanil did not significantly differ, and these drugs functioned as economic substitutes. As the price of the manipulated-price alternative increased, consumption of the fixed-price alternative increased. In addition, demand for the manipulated-price alternative became more elastic with the concurrent availability of the fixed-price alternative.

CONCLUSION

Polydrug use involving stimulants and opiates may occur because these drugs are highly substitutable.

Translational research in medication development for nicotine dependence

A major obstacle to the development of medications for nicotine dependence is the lack of animal and human laboratory models with sufficient predictive clinical validity to support the translation of knowledge from laboratory studies to clinical research. This Review describes the animal and human laboratory paradigms commonly used to investigate the pathophysiology of nicotine dependence, and proposes how their predictive validity might be determined and improved, thereby enhancing the development of new medications.

A novel set-shifting modification of the iowa gambling task: flexible emotion-based learning in schizophrenia

Although it might seem that people with schizophrenia would perform poorly on measures of emotion-based learning, several studies have shown normal levels of performance on the Iowa Gambling Task (IGT; C. E. Y. Evans, C. H. Bowman, & O. H. Turnbull, 2005; L. M. Ritter, J. H. Meador-Woodruff, & G. W. Dalack, 2004; B. Shurman, W. P. Horan, & K. H. Nuechterlein, 2005; K. E. Wilder, D. R. Weinberger, & T. E. Goldberg, 1998). The present article describes a newly developed modification of the IGT involving initial familiarization with the basic contingency pattern then 3 periods of contingency shift. Control participants showed substantial gains during the later trials of each shift period. Analyzed in terms of positive symptoms, those with schizophrenia were little different from control participants. Those high in negative symptoms could perform the basic task but showed remarkably poor performances (no better than chance) in the shift phases, retaining a preference for decks that had previously been "good," even when they experienced substantial losses.

Alcohol-related and alcohol-free activity participation and enjoyment among college students: a behavioral theories of choice analysis

College student alcohol abuse remains a significant public health problem, and there is a need for theory-driven and empirically based models to guide prevention efforts. Behavioral theories of choice assume that the decision to consume alcohol is influenced by the relative value of alcohol versus other available activities. In the present study, a sample of college student drinkers (N=108; 56% female, 44% male) who had previously completed a mandatory alcohol intervention completed a measure of alcohol-related and alcohol-free activity participation and enjoyment. The goals of the study were to examine the influence of drinking quantity and contextual variables on activity enjoyment and to identify enjoyable alcohol-free activities that take place on evenings when students might otherwise be drinking. Overall, students found alcohol-related activities more enjoyable than alcohol-free activities, and drinking quantity was positively related to enjoyment. However, alcohol-free activities such as watching movies, going to the theater or museums, going to bars or parties, hanging out with friends, eating at restaurants, and engaging in creative activity were generally as enjoyable as drinking. Alcohol-free activities that included peers or dates were more enjoyable than solitary activities. Men were less likely to engage in alcohol-free activities that included peers and reported less enjoyment related to alcohol-free activities than did women. Further research is required to identify procedures for increasing participation in alcohol-free activities and to determine whether increased alcohol-free activity participation results in decreased alcohol consumption.

Research design strategies to evaluate the impact of formulations on abuse liability

Scheduling of a chemical drug substance under the Controlled Substances Act (CSA) includes an evaluation of preclinical and clinical safety, and experimental abuse liability studies, as well as information on diversion and overdose. Formulations that mitigate abuse liability, dependence potential and public health risks (e.g., altered absorption rate and tamperability, long half-life, pro-drugs and combination products) are amenable to preclinical and clinical studies to compare their abuse potential to reference compounds. For new formulations (NF) as marketed agents, direct comparison to the immediate release (IR) formulation of the reference compound is typically needed across the full range of potential studies. While the public health advantage of formulation changes in the marketplace can be conceptualized in behavioral economic terms, generating persuasive data is challenging. Study complexity increases because of additional conditions (e.g., placebo, 2-3 doses of the IR formulation, 2-3 doses of the new formulation, and 2-3 doses of the unscheduled or negative control drug), larger sample sizes (study power driven by the comparison of the new formulation versus the IR or placebo), and associated increases in study duration. However, the use of single maximal doses of well-characterized controls can reduce the number of study arms, and using incomplete block designs can reduce study duration. Less typical experimental approaches may also be useful, such as human choice or discrimination procedures, or pre-marketing consumer studies among experienced drug tamperers. New formulations that demonstrate a substantial difference from marketed or reference products have a potential marketing advantage and should require less onerous risk management. Post-marketing epidemiological data demonstrating the lack of abuse will carry the most weight from a public health and physician perspective.

Relative reinforcing efficacy of alcohol among college student drinkers

The construct of relative reinforcing efficacy (RRE) is central to many laboratory and theoretical models of drug abuse, but it has not been widely measured in applied clinical research contexts. The authors used a simulated alcohol purchase task to measure RRE in a sample of 267 college student drinkers. Participants reported their alcohol consumption across a range of prices, and their responses were well-described by a regression equation that has been used to construct demand curves in drug self-administration studies. Several measures of relative reinforcing efficacy were generated, including breakpoint, intensity of demand, elasticity, P-sub(max) (price at which response output is maximized), and O-sub(max) (maximum alcohol expenditures). Demand for alcohol was inelastic across the initial range of prices but became elastic as price increased. Students who reported recent heavy drinking reported significantly greater intensity of demand, O-sub(max), and breakpoint. These results provide initial support for the validity of the RRE indices generated with the alcohol purchase task. These results also provide empirical support for programs that attempt to reduce alcohol abuse by eliminating low-cost access to alcohol.

Replacing relative reinforcing efficacy with behavioral economic demand curves

Relative reinforcing efficacy refers to the behavior-strengthening or maintaining property of a reinforcer when compared to that of another reinforcer. Traditional measures of relative reinforcing efficacy sometimes have led to discordant results across and within studies. By contrast, previous investigations have found traditional measures to be congruent with behavioral economic measures, which provide a framework for integrating the discordant results. This study tested whether the previously demonstrated congruence between traditional relative reinforcing efficacy measures and behavioral economic demand curve measures is sufficiently robust to persist when demand for one reinforcer is altered. Cigarette smokers pulled plungers for cigarettes or two magnitudes of money on progressive-ratio schedules that increased the response requirement across sessions. Demand for the two different reinforcers was assessed in single-schedule and concurrent-schedule sessions. Demand curve measures Pmax and Omax correlated significantly with traditional measures of breakpoint and peak response rate, respectively. Relative locations of demand curves for money and cigarettes under single schedules predicted preference in concurrent schedules in most cases. Although measures of relative reinforcing efficacy for money changed with money magnitude, the congruence between traditional and behavioral economic measures remained intact. This robust congruence supports the proposal that demand curves should replace measures of relative reinforcing efficacy. The demand curve analysis illustrates why concordance between traditional measures is expected under some experimental conditions but not others.

Physical activity as a substitute for sedentary behavior in youth

BACKGROUND

Youth may choose to be sedentary rather than physically active.

PURPOSE

The purpose of this study was to use behavioral economics methods to investigate how experimental changes in the amount of sedentary behaviors influenced physical activity.

METHODS

Fifty-eight 8- to 16-year-old youth were studied in a within-subject crossover design with three 3-week phases: baseline, increasing, and decreasing targeted sedentary behaviors by 25% to 50%.

RESULTS

At baseline, boys were more active than girls (518.9 vs. 401.2 accelerometer counts/min, p = .02), and obese youth more sedentary than nonobese youth (240.5 vs. 174.4 min/day, p = .003). During the increase sedentary behavior phase, targeted sedentary behaviors increased by 52.1%, with girls increasing sedentary behaviors more than boys (114.7 vs. 79.8 min/day, p = .04). Physical activity decreased (-48.3 counts/min, p < .01) when sedentary behaviors increased, with obese youth decreasing total and moderate to vigorous physical activity (MVPA) more than nonobese youth (-110.4 vs. 8.9 counts/min, p < .001; -3.3 vs. -.03 % MVPA, p = .013). During the decrease sedentary behavior phase, targeted sedentary behaviors decreased by 55.6% from baseline as nonobese youth increased physical activity, whereas obese youth decreased physical activity (55.8 vs. -48.0 counts/min, p = .042; 1.1 vs. -2.1% MVPA, p = .021). Youth who substituted physical activity when sedentary behaviors were increased had greater standardized body mass index (z-body mass index = 1.4 vs. 0.4, p = .018), whereas youth who substituted physical activity when sedentary behaviors were decreased were less active at baseline (396.1 vs. 513.7 counts/min, p = .035).

CONCLUSIONS

Behavioral economics provides a methodology to understand changes in physical activity when sedentary behaviors are modified and to identify factors associated with substitution of physically active for sedentary behaviors.

Effects of punishment on choice between cocaine and food in rhesus monkeys

RATIONALE

Punishment is widely used in an effort to control drug-taking behavior; however, only a few preclinical studies have investigated the effects of punishment on drug self-administration. Such studies may contribute to more rational use of punishment to control drug use.

OBJECTIVES

To evaluate the effects of punishment on choice between cocaine and food in rhesus monkeys.

METHODS

Rhesus monkeys were trained under a concurrent-choice schedule of food delivery (1 g pellets, fixed-ratio 100 schedule) or cocaine injections (0-0.1 mg/kg per injection, fixed-ratio 10 schedule). Full cocaine choice dose-effect curves were determined under baseline conditions and under test conditions in which a putative punisher (intravenous histamine injection; 0.0032-0.032 mg/kg per injection) was paired with either food or cocaine delivery.

RESULTS

Under baseline conditions, cocaine produced a dose-dependent increase in cocaine choice. Histamine functioned as a punisher of both food- and cocaine-maintained responding. Pairing histamine with food delivery reduced food choice, increased cocaine choice, and produced left shifts in the cocaine choice dose-effect curve. Conversely, pairing histamine with cocaine decreased cocaine choice, increased food choice, and produced right shifts in the cocaine choice dose-effect curve. The magnitude of histamine's punishing effects was directly related to histamine dose and probability of histamine delivery, and inversely related to the magnitude of the reinforcer.

CONCLUSIONS

These results demonstrate that a primary effect of punishment in the context of food vs cocaine choice is not only a decrease in the behavior being punished, but also an increase in the unpunished alternative behavior.

Preserved complex emotion-based learning in amnesia

An important role for emotion in decision-making has recently been highlighted by disruptions in problem solving abilities after lesion to the frontal lobes. Such complex decision-making skills appear to be based on a class of memory ability (emotion-based learning) that may be anatomically independent of hippocampally mediated episodic memory systems. There have long been reports of intact emotion-based learning in amnesia, arguably dating back to the classic report of Claparede. However, all such accounts relate to relatively simple patterns of emotional valence learning, rather than the more complex contingency patterns of emotional experience, which characterise everyday life. A patient, SL, who had a profound anterograde amnesia following posterior cerebral artery infarction, performed a measure of complex emotion-based learning (the Iowa Gambling Task) on three separate occasions. Despite his severe episodic memory impairment, he showed normal levels of performance on the Gambling Task, at levels comparable or better than controls-including learning that persisted across substantial periods of time (weeks). Thus, emotion-based learning systems appear able to encode, and sustain, more sophisticated patterns of valence learning than have previously been reported.

Interactions between the reinforcing effects of cocaine and heroin in a drug-vs-food choice procedure in rhesus monkeys: a dose-addition analysis

RATIONALE

Concurrent abuse of cocaine and heroin is a common form of polydrug abuse, but the interactions between the reinforcing effects of cocaine and heroin are poorly understood. Dose-addition analysis is a tool for the quantitative assessment of drug interactions, but this analysis has not been applied to evaluation of the reinforcing effects of cocaine and heroin.

OBJECTIVES

To evaluate interactions between the reinforcing effects of cocaine and heroin using dose-addition analysis.

METHODS

Rhesus monkeys were trained under a concurrent-choice schedule of food delivery (1 gm pellets) and drug injections (cocaine or heroin, 0-0.1 mg kg(-1) injection(-1)). Full dose-effect curves were determined for cocaine alone and heroin alone. Subsequently, full dose-effect curves were determined for three fixed-proportion mixtures of cocaine and heroin (fixed proportions of 1:3.2, 1:1 and 3.2:1 cocaine/heroin). Dose-addition analysis was used to assess whether cocaine/heroin interactions were super-additive, additive, or sub-additive.

RESULTS

Cocaine, heroin, and all cocaine/heroin mixtures maintained dose-dependent and monotonic increases in drug choice and dose-dependent decreases in response rates. Choice dose-effect curves for cocaine/heroin mixtures were shifted to the left of dose-effect curves for cocaine or heroin alone, and dose-addition analysis indicated that cocaine/heroin interactions on drug choice were sub-additive or additive. Cocaine/heroin interactions on response-rate measures were also sub-additive or additive.

CONCLUSIONS

These results confirm that mixtures of cocaine and heroin produce reinforcing effects in rhesus monkeys; however, cocaine/heroin interactions were only or sub-additive or additive. Thus, these results do not support the hypothesis that simultaneously delivered cocaine and heroin produces super-additive reinforcing effects.

Methadone and nicotine self-administration in humans: a behavioral economic analysis

RATIONALE

Prior research has revealed inconsistencies in the behavioral relations between nicotine and opiates among methadone-maintained patients.

OBJECTIVES

The current study examined whether the drug reinforcers cigarette puffs and methadone were economic complements or substitutes.

METHODS

Five methadone-maintained, nicotine-dependent participants were trained to self-administer methadone, cigarette puffs, or concurrently available methadone and puffs. Following training, the fixed ratio (FR) value ("price") was increased across sessions (FR 32, 64, 128, 256, and 512), first for methadone and then for puffs. Subsequently, methadone and puffs were concurrently available, and the price of each drug was increased independently, while the price of the alternative (puffs or methadone) remained constant at FR 32.

RESULTS

Demand for methadone and cigarette puffs decreased as a function of increases in methadone and cigarette puff prices, respectively. When methadone and puffs were concurrently available, an increase in methadone's price decreased puff consumption, and demand for methadone was less elastic than when puffs were not concurrently available. An increase in puff price decreased puff and methadone demand, but the elasticity of puff demand was unaffected. The concurrent presence of methadone had no effect on the elasticity of demand for cigarette puffs.

CONCLUSIONS

Methadone and cigarette puffs appear to be asymmetric economic complements.

Dose and schedule determinants of cocaine choice under concurrent variable-interval schedules in rhesus monkeys

RATIONALE

Drug abuse can be characterized as a condition in which the choice to self-administer a drug is excessive, even exclusive of the choice of other reinforcers. Under concurrent interval schedules of reinforcement, subjects typically distribute behavior to match reinforcement allocation. However, research has shown that when behavior is maintained by different doses of cocaine under concurrent variable-interval (conc VI) schedules, exclusive choice of the higher dose is the rule.

OBJECTIVE

The present study was designed to examine the generality of this finding to other behavioral conditions.

METHODS

Rhesus monkeys ( n=5) lever pressed under a conc VI 60-s VI 60-s or a conc VI 600-s VI 600-s schedule of cocaine (i.v.) presentation. Doses differing by 4-fold (0.025 versus 0.1, 0.05 versus 0.2 mg/kg per injection) were available for lever pressing.

RESULTS

Monkeys responded more on the lever associated with the higher dose when saline or a lower dose was the alternative. The distribution of responses was well predicted by relative drug intake, but with consistent undermatching. Exclusive high-dose responding was seen in about half of the individual session intervals under the shorter schedule, rarely under the longer schedule, and was not seen over the session.

CONCLUSION

Under conc VI schedules, behavior was apportioned between two different doses in a manner that favored the higher dose but undermatched relative intake. Exclusive high-dose choice may occur when cocaine is frequently available but is not an invariable outcome of the choice between a low and a high dose of cocaine.

Unit price and choice in a token-reinforcement context

Pigeons were exposed to multiple and concurrent second-order schedules of token reinforcement, with stimulus lights serving as token reinforcers. Tokens were produced and exchanged for food according to various fixed-ratio schedules, yielding equal and unequal unit prices (responses per unit food delivery). On one schedule (termed the standard schedule), the unit price was held constant across conditions. On a second schedule (the alternative schedule), the unit price was either the same or different from the standard. Under conditions with unequal unit prices, near-exclusive preference for the lower unit price was obtained. Under conditions with equal unit prices, the direction and degree of preference depended on ratio size (number of responses per exchange period). When this ratio differed, strong preferences for the smaller ratio were observed. When this ratio was equal, preferences were nearer indifference. Response rates on the multiple schedule were generally consistent with the preference data in showing sensitivity to ratio size. Results are discussed in terms of a unit-price model that includes handling and reinforcer immediacy as additional costs. On the whole, results show that preferences were determined primarily by delay to the exchange period.

The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage

Most theories of choice assume that decisions derive from an assessment of the future outcomes of various options and alternatives through some type of cost-benefit analyses. The influence of emotions on decision-making is largely ignored. The studies of decision-making in neurological patients who can no longer process emotional information normally suggest that people make judgments not only by evaluating the consequences and their probability of occurring, but also and even sometimes primarily at a gut or emotional level. Lesions of the ventromedial (which includes the orbitofrontal) sector of the prefrontal cortex interfere with the normal processing of "somatic" or emotional signals, while sparing most basic cognitive functions. Such damage leads to impairments in the decision-making process, which seriously compromise the quality of decisions in daily life. The aim of this paper is to review evidence in support of "The Somatic Marker Hypothesis," which provides a systems-level neuroanatomical and cognitive framework for decision-making and suggests that the process of decision-making depends in many important ways on neural substrates that regulate homeostasis, emotion, and feeling. The implications of this theoretical framework for the normal and abnormal development of the orbitofrontal cortex are also discussed.

Substitutes for tobacco smoking: a behavioral economic analysis of nicotine gum, denicotinized cigarettes, and nicotine-containing cigarettes

Both pharmacological and nonpharmacological stimuli may be responsible for the reinforcement and maintenance of tobacco smoking. The present study examined the self-administration of nicotine gum, denicotinized cigarettes, and nicotine-containing cigarettes utilizing a behavioral economic design in order to investigate the pharmacological and nonpharmacological aspects of cigarette smoking. Cigarette-deprived, dependent smokers worked for cigarette puffs and nicotine gum in daily operant sessions. In one phase, nicotine-containing cigarettes were available at increasing unit prices across sessions. Three phases replicated these sessions with nicotine gum, denicotinized cigarettes, or both, concurrently available at a constant unit price. As nicotine-containing cigarette unit price increased, consumption decreased. However, as nicotine-containing cigarette unit price increased, nicotine gum and denicotinized cigarette consumption increased. Consumption of nicotine gum, but not denicotinized cigarettes, diminished when all three reinforcers were concurrently available. Concurrently available denicotinized cigarettes, but not nicotine gum, caused a statistically significant reduction in nicotine-containing cigarette consumption. In another phase, denicotinized cigarettes were available at increasing unit prices across sessions while nicotine gum was concurrently available at a constant unit price. This phase demonstrated that nicotine content had no reliable effect on cigarette or nicotine gum consumption. These results suggest that denicotinized cigarettes are a more effective alternative reinforcer than nicotine gum, indicating that nonpharmacological stimuli of smoking merit attention in smoking cessation treatment. Furthermore, these findings indicate that alternative reinforcement would be most effective in smoking cessation treatment when combined with high prices for cigarettes.

Measures and models of nicotine dependence: positive reinforcement

This paper addresses the problem of assessing nicotine dependence. The main objective is to develop theory-led suggestions for measures that will be relevant in the early phases of tobacco use, as well as in established smokers. Theoretical models of addiction falling into the general class of 'positive reinforcement theories' were identified and reviewed. From this review a number of drug effects and patterns of behaviour were distilled and categorized as either vulnerability or dependence indicators. A comparison of those features with the International Classification of Diseases (ICD-10) and Diagnostic and Statistical Manual (DSM-IV) diagnostic systems shows that neither system includes detailed assessment of vulnerability indicators. It is argued that measurement of vulnerability indicators, in addition to dependence indicators, may add to the predictive validity of assessments carried out in early career tobacco users, especially where there is limited evidence of established dependence. In addition, it is suggested that examination of measures that differentiate a subgroup of early career smokers termed 'rapid accelerators' may prove profitable and enable identification of the key parameters of nicotine reinforcement.

Applying a behavioral economic framework to understanding adolescent smoking

Adolescents' choice to smoke may depend on substitute reinforcers for smoking, complementary activities to smoking, and individual differences in reinforcer value. The influence of these variables on smoking was determined among 983 adolescents. Substitutes were school involvement, academic performance, physical activity, and sports team participation: complements were peer smoking and substance use; delay discounting assessed individual differences in reinforcer value. Latent growth modeling indicated that substitute reinforcers reduced the odds of smoking progression almost two-fold, complementary reinforcers increased the odds by 1.14. and delay discounting indirectly influenced the odds of smoking progression through complementary reinforcers. Adolescents who smoke may have fewer reinforcers that protect against smoking and more reinforcers that promote smoking. Discounting of future rewards affects smoking through reinforcer type.

Neural and psychological mechanisms underlying appetitive learning: links to drug addiction

The complexity of drug addiction mirrors the complexity of the psychological processes that motivate animals to work for any reinforcer, be it a natural reward or a drug. Here, we review the role of the nucleus accumbens, together with its dopaminergic and cortical innervation, in responding to reinforcement. One important contribution made by the nucleus accumbens is to the process through which neutral stimuli, once paired with a reinforcer such as a drug, have the capacity to motivate behaviour. This process may be one of several contributing to addiction, and it may be amenable to pharmacological intervention.

Clinical Implications of Reinforcement as a Determinant of Substance Use Disorders

Extensive scientific evidence indicates that reinforcement plays an important role in the genesis, maintenance, and recovery from substance use disorders. In this chapter, we review recent clinical research from laboratory, clinic, and naturalistic settings examining the role of reinforcement in substance use disorders. Well-controlled human laboratory studies are reviewed characterizing orderly interactions between the reinforcing effects of drugs and environmental context that have important implications for understanding risk factors for substance use disorders and for the development of efficacious interventions. Recent treatment-outcome studies on voucher-based contingency management and community reinforcement therapy are reviewed demonstrating how reinforcement and related principles can be used to improve outcomes across a wide range of different substance use disorders and populations. Overall, the chapter characterizes a vigorous area of clinical research that has much to contribute to a scientific analysis of substance use disorders.

The behavioral economics of cigarette smoking: The concurrent presence of a substitute and an independent reinforcer

The present study examined the consumption of cigarettes and two alternative reinforcers in dependent smokers. Cigarette price (response requirement) increased across sessions while alternatives were available at a fixed price in four phases of availability: (1). cigarettes alone; (2). cigarettes and nicotine gum; (3). cigarettes and money; and (4). cigarettes, nicotine gum, and money. Cigarette consumption decreased with increasing price throughout. In the cigarette and nicotine gum phase, nicotine gum consumption increased with cigarette price, indicating nicotine gum to be a substitute for cigarettes. In the cigarette and money phase, money consumption increased slightly with cigarette price, indicating money to be an independent reinforcer for cigarettes. When all three reinforcers were present, money again served as an independent reinforcer. During this phase, nicotine gum consumption increased marginally, but the small magnitude of increase suggests that nicotine gum functioned as an independent reinforcer rather than a substitute. Cigarette consumption decreased modestly when nicotine gum was available, and to a larger extent when money or both alternatives were available. The results highlight the potential for an independent reinforcer such as money to be more effective at reducing drug use than a pharmacological substitute.

Effect of response-independent candy on responding maintained by candy using a novel model of commodity acquisition and consumption in nonhuman primates

Ingestive behavior consists of appetitive or foraging behavior, i.e., "acquisition," followed by consummatory behavior. Responding of six adult rhesus monkeys, living in three-chambered enclosures, was studied under an operant chain schedule that simulated commodity acquisition and commodity consumption. Responding during the initial acquisition component was reinforced by stimuli paired with that commodity, while responding during the following consumption component was reinforced with that commodity. Throughout the 10-h experimental day, monkeys experienced multiple candy (plain M & Ms) and fruit-drink (Kool-Aid) sessions in different end chambers. The effects of response-independent candy reinforcement, in the context of extinction, were examined when monkeys received a daily food ration of 8 or 20 chow. Response-independent candy increased responding during the acquisition components of candy sessions when monkeys received a daily food ration of 8 chow but not when the food ration was 20 chow. Furthermore, response-independent candy increased candy choice over fruit-drink during choice opportunities and increased the length of time spent in the candy chamber when the candy stimulus lights were illuminated under both food ration conditions, i.e., location preference. The present procedure, which combines operant and place preference measures of commodity acquisition, when used in combination with methods of studying reinstatement of responding, may prove useful in analyzing factors affecting relapse.

Relative reinforcing strength of three N-methyl-D-aspartate antagonists with different onsets of action

The potential contribution of onset and duration of pharmacological action to the reinforcing strength of three intravenously delivered N-methyl-D-aspartate antagonists was evaluated in this study. The onsets and durations of action of ketamine, phencyclidine, and dizocilpine were evaluated by observation and tabulation of their behavioral effects in rhesus monkeys after i.v. administration. The reinforcing effects of each drug were tested in a paradigm in which the fixed ratio requirements for i.v. drug injection were increased systematically. The peak observable effect of ketamine occurred immediately after its administration. There were some immediately observable effects of phencyclidine, although the peak effect of phencyclidine was delayed for 3 to 10 min. Dizocilpine had few immediate effects and a peak effect 32 min after administration. Ketamine had the shortest duration of action, followed by phencyclidine and dizocilpine. Analysis of demand curves and response output curves that were normalized to account for potency differences among the drugs revealed that ketamine and phencyclidine were equally effective as reinforcers, and they were both much stronger reinforcers than was dizocilpine. The data therefore suggest that a fast onset of action increases the reinforcing strength of drugs, although duration of action may play a role as well.

A behavioral economic analysis of polydrug abuse in alcoholics: asymmetrical substitution of alcohol and cocaine

Economic concepts can be used to assess how drug prices affect consumption patterns. Increases in price for a commodity typically result in reductions in consumption. Demand is considered elastic if decreases in consumption are proportionally greater than increases in price, and inelastic if they are proportionally smaller than rises in price. The price of one commodity can also affect consumption of others. Commodities can function as substitutes, complements or independents, and these concepts refer to increases, decreases, or no change in the consumption of one item as the price of another increases. This study evaluated the effects of drug prices on hypothetical drug-purchasing decisions in 53 alcohol abusers. Experiments 1, 2, and 3 examined how alcohol, cocaine, and Valium prices, respectively, influenced purchases of alcohol, cocaine, Valium, heroin, marijuana and nicotine. As price of alcohol rose in Experiment 1, alcohol purchases decreased and demand for alcohol was inelastic. Cocaine was a complement to alcohol, but other drugs purchases were independent of alcohol prices. In Experiment 2, demand for cocaine was elastic as its price increased. Alcohol was a substitute for cocaine, but other drug purchases did not change significantly. In Experiment 3, demand for Valium was elastic as its price rose, and all other drug purchases were independent of Valium prices. Hypothetical choices were reliable between and within subjects and associated with urinalysis results and lifetime histories of drug abuse. These results suggest that, among alcohol abusers, cocaine is a complement to alcohol, but alcohol is a substitute for cocaine.

Temporal discounting: basic research and the analysis of socially important behavior

Recent basic research on human temporal discounting is reviewed to illustrate procedures, summarize key findings, and draw parallels with both nonhuman animal research and conceptual writings on self-control. Lessons derived from this research are then applied to the challenge of analyzing socially important behaviors such as drug abuse, eating and exercise, and impulsiveness associated with attention deficit hyperactivity disorder. Attending to the broader temporal context in which behavior occurs may aid in the analysis of socially important behavior. Applying this perspective to the study of behavior in natural environments also highlights the importance of combining methodological flexibility with conceptual rigor to promote the extension of applied behavior analysis to a broader array of socially important behaviors.

Nicotine gum as a substitute for cigarettes: a behavioral economic analysis

The present experiment attempted to identify a substitute for cigarette smoking in a laboratory analog of the behavioral economics of drug dependence. The interaction between cigarette consumption and nicotine gum consumption was examined with eight human smokers by increasing the price of cigarettes (i.e. the number of responses required to obtain puffs) across sessions, while the price of concurrently available nicotine gum remained constant. In another phase, the price of nicotine gum was increased while the price of concurrently available cigarettes remained constant. To determine whether the presence of concurrently available nicotine gum influenced cigarette consumption, we also examined the effect of increasing the price of cigarettes on cigarette consumption without available nicotine gum. When cigarettes and nicotine gum were concurrently available, increases in the price of cigarettes increased consumption of nicotine gum. When the price of nicotine gum increased while the price of cigarettes remained constant, smokers nearly exclusively consumed cigarettes. The presence or absence of nicotine gum did not affect the relation between cigarette consumption and cigarette price. The results suggest that nicotine gum can maintain operant behavior of smokers in the laboratory and can function, in a behavioral economic sense, as a weak substitute for cigarette puffs. As a result, nicotine gum may be useful in human laboratory studies of the behavioral economics of reinforcer interactions and their role in drug dependence.

Similar consumption and responding across single and multiple sources of drug

Two experiments were conducted to assess whether total response output and total consumption would be similar when drugs are available from single and multiple sources of reinforcement, as predicted by behavioral economics. In Experiment 1, cigarette-deprived smokers were exposed to a concurrent-chains schedule in which equal fixed-ratio schedules served as the initial links, and different reinforcer magnitudes (i.e., number of cigarette puffs) were arranged across alternatives. After the session, obtained unit price was calculated and imposed in the next session when a different number of puffs was available according to a single fixed-ratio schedule. Thus, the unit price at which cigarette puffs could be earned was yoked within subjects across the single and concurrent-chains schedules. When plotted as a function of unit price, similar consumption and response rates were usually obtained across these schedules. Experiment 2 addressed a weakness of Experiment 1, namely, that responding was allocated exclusively to the larger reinforcer magnitude in concurrent-chains conditions, and therefore this schedule may have functioned as a single schedule. In Experiment 2, subjects were instructed to alternate responding between the two alternative schedules. Instructions produced approximately equal response allocation between the two alternatives. Again, similar consumption and response rates were observed across the single and instructed concurrent-chains schedules. These findings are discussed in the context of direct effects and behavioral economics perspectives of drug self-administration.

Effect of smoking abstinence on the subjective effects of caffeine

Abstinence from smoking increases blood levels of caffeine and may potentiate the ability of caffeine to increase anxiety, insomnia, etc., during smoking cessation. The present study tested this hypothesis using a wider range of abstinence levels (0, 36 and 84 h), caffeine doses (0, 200 and 400 mg) and subjective effects (31 measures) than prior studies. Fourteen participants were studied using a randomized, within-subjects, double-blind design. Participants were tested on 31 subjective variables, two performance and two physiological variables on five occasions over the 3 h following dosing. Although abstinence and caffeine produced their prototypic effects, only one of the 35 interactions tested was significant and the magnitude of this interaction was small. Although our statistical power was limited, we conclude abstinence from smoking does not change the subjective effects of caffeine in the first days of abstinence. These results and those of prior studies suggest smokers who are trying to stop smoking do not need to change their caffeine intake.

Food and cocaine self-administration by baboons: effects of alternatives

The effects of the availability of an alternative reinforcer on responding maintained by food pellets or drug solutions were examined in 8 adult male baboons (Papio hamadrayas anubis). During daily 23-hr experimental sessions, baboons had access to both food pellets and fluid under a two-choice procedure, in which the response requirement, under a fixed-ratio schedule, differed for the two commodities. There were no restrictions on access to water, which was continuously available from a spout at the rear of each cage. In Experiment 1, the fixed-ratio requirement, or cost, for fluid delivery remained constant while the fixed-ratio requirement for pellets was changed every 2 or 3 days when (a) no fluid, (b) a dilute dextrose vehicle, (c) 0.008 mg/kg per delivery cocaine, (d) 0.016 mg/kg per delivery cocaine, or (e) 0.032 mg/kg per delivery cocaine was available concurrently. In Experiment 1, progressively increasing the response requirement for pellets decreased pellet intake, but for 4 baboons pellet intake at maximum pellet cost was lower when cocaine, compared to the vehicle, was available. Increasing the response requirement for pellets had variable effects on vehicle intake. However, increasing the response requirement for pellets increased intake of at least one dose of cocaine to a greater extent than vehicle in all 8 baboons. Thus, cocaine could be considered a more effective economic substitute than vehicle for pellets. Experiment 2 systematically varied the order in which the response requirements for a pellet delivery were presented and added a control condition in which cocaine doses, yoked to the amount self-administered, were given three times during the session by the experimenter. Again, pellet intake at maximal pellet cost was lower when cocaine, compared to the vehicle, was available. In contrast, experimenter-given cocaine doses did not alter responding maintained by pellets. Thus, the effects of self-administered cocaine on responding maintained by food pellets differed from the effects of experimenter-given cocaine on responding maintained by food pellets.

Are we dependent upon coffee and caffeine? A review on human and animal data

Caffeine is the most widely used psychoactive substance and has been considered occasionally as a drug of abuse. The present paper reviews available data on caffeine dependence, tolerance, reinforcement and withdrawal. After sudden caffeine cessation, withdrawal symptoms develop in a small portion of the population but are moderate and transient. Tolerance to caffeine-induced stimulation of locomotor activity has been shown in animals. In humans, tolerance to some subjective effects of caffeine seems to occur, but most of the time complete tolerance to many effects of caffeine on the central nervous system does not occur. In animals, caffeine can act as a reinforcer, but only in a more limited range of conditions than with classical drugs of dependence. In humans, the reinforcing stimuli functions of caffeine are limited to low or rather moderate doses while high doses are usually avoided. The classical drugs of abuse lead to quite specific increases in cerebral functional activity and dopamine release in the shell of the nucleus accumbens, the key structure for reward, motivation and addiction. However, caffeine doses that reflect the daily human consumption, do not induce a release of dopamine in the shell of the nucleus accumbens but lead to a release of dopamine in the prefrontal cortex, which is consistent with caffeine reinforcing properties. Moreover, caffeine increases glucose utilization in the shell of the nucleus accumbens only at rather high doses that stimulate most brain structures, non-specifically, and likely reflect the side effects linked to high caffeine ingestion. That dose is also 5-10-fold higher than the one necessary to stimulate the caudate nucleus, which mediates motor activity and the structures regulating the sleep-wake cycle, the two functions the most sensitive to caffeine. In conclusion, it appears that although caffeine fulfils some of the criteria for drug dependence and shares with amphetamines and cocaine a certain specificity of action on the cerebral dopaminergic system, the methylxanthine does not act on the dopaminergic structures related to reward, motivation and addiction.

Food restriction and sex differences on concurrent, oral ethanol and water reinforcers in juvenile rhesus monkeys

The present study assessed the liability of ethanol to be established as an oral reinforcer in 24 juvenile rhesus monkeys. All of the monkeys had a prior oral self-administration history with concurrently available methadone and water. To determine if food restriction and sex differences would contribute to ethanol preference, the monkeys were divided into two groups of 12. Twelve monkeys received 30 biscuits of food each day while the other group received 15 biscuits; six monkeys were male and six were female in each food restriction group. Fluid deliveries (0.5 ml) were provided following contact responses on solenoid-operated drinking spouts. All monkeys were exposed to concurrent water on two spouts and, subsequently, ethanol was available on one spout with water in the alternate spout. Ethanol concentrations (0.25-16 g/l) were doubled weekly. Subsequently, some ethanol concentration exposures were repeated, as was the concurrent water condition. Ethanol (1-2 g/l) served to reinforce responding under most conditions except with the 30-biscuit females; where ethanol so functioned, water responding was reduced. At concentrations less than 1 g/l, ethanol and water were consumed in equal amounts. At 8-16 g/l, ethanol maintained less responding than water. Food restriction amplified ethanol preference in both males and females, although perhaps less in females. A complex set of relations exist among variables that control oral ethanol preference in rhesus monkeys.

Ethanol and food pellet self-administration by baboons

During daily 23-h sessions, baboons had concurrent access to food pellets and an oral ethanol/dextrose solution. The effect of increasing the fixed-ratio or "cost" for pellets on pellet and fluid intake was examined when baboons had access to 2%, 4%, or 8% (w/v) ethanol. Increasing the response requirement for a pellet decreased pellet intake. The rate of decrease in pellet intake with increasing pellet cost was unaffected by the availability of ethanol solutions, which were either self-administered or given in investigator-planned doses. Increasing the response cost for pellets significantly increased self-administration of 4% ethanol. The effect of increasing the cost for fluid on fluid and pellet intake was examined when baboons had access to vehicle, 4% or 8% (w/v) ethanol. Although the total daily number of fluid deliveries was significantly greater when 4% ethanol was available, compared to vehicle, increasing the cost for a fluid delivery to 32 responses and above decreased intake of all three fluids similarly. Increasing the cost of ethanol did not affect food intake.