Unit price as a useful metric in analyzing effects of reinforcer magnitude

Reinforcer efficacy of grain for horses

Positive reinforcement is becoming more common in horse training. Identifying effective reinforcers is critical for training success. The aim of this study was to determine relative reinforcer efficacy of different grains. Four horses learned to muzzle touch a target, after which they were tested using a progressive ratio schedule of reinforcement with different grains as the consequence. Break points were used to determine relative reinforcer efficacy of each grain and were also converted into unit price per kilocalorie to determine if caloric value impacted reinforcer efficacy. Condition 1 compared three textured grains that spanned industry-accepted standards of low to high nonstructural carbohydrate content. Condition 2 compared three pelleted grains that similarly differed in nonstructural carbohydrate content, comparable to Condition 1, but that had a different texture than those of Condition 1. Finally, Condition 3 directly compared one grain each from Conditions 1 and 2. Results showed overall little difference in reinforcer efficacy or unit price between grains but found that all grains tested functioned as reinforcers for the horses. This suggests that a range of commercially available grains can maintain behavior and therefore be used for training. We also identified possible extraexperimental factors that impact reinforcer efficacy.

Behavioral economic demand as a unifying language for addiction science: Promoting collaboration and integration of animal and human models

The intersection of pharmacological, psychological, and economic theory within behavioral economics has helped advance an understanding of substance use disorder. A notable contribution of this approach is the conceptualization of reinforcement from a behavioral economic demand perspective. Demand analyses provide a multidimensional view of reinforcement in which distinct behavioral mechanisms are measured that impact decision making and drug consumption. This review describes the state of research on behavioral economic demand as a common language for addiction science researchers across varied model systems and stages of a translational continuum. We first provide an overview of the theoretical concepts and procedures used to evaluate demand in animal and human models. The potential for demand to serve as a common language for diverse research groups in psychopharmacology and addiction science (e.g., those evaluating neurobehavioral outcomes, medications development, clinical practice) is then described. An overview is also provided of existing empirical studies that, while small in number, suggest good linguistic and conceptual overlap between animal and human demand models when studying biological, environmental, and pharmacological individual difference vulnerabilities underlying drug-taking behavior. Refinement of methodological procedures and incorporation of more nuanced environmental features should help improve correspondence between animal and human demand studies as well as clinical translation of such findings. Our hope is that this review and commentary ultimately serves as inspiration for new collaborative efforts involving behavioral economic demand between animal and human researchers who share a common goal of improving substance use treatment outcomes and broader psychological wellbeing. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The effect of economy type on heroin and saccharin essential value

According to behavioral economics, reinforcer value should be lower in an open economy than in a closed economy. An animal model was used to determine how economy type affected the value of heroin and saccharin. In a first phase, separate groups of rats worked for heroin or saccharin. The price of these reinforcers increased over sessions. For rats in the open heroin or open saccharin economies, the work period of each session was followed by a postwork period where a cheaper source of heroin or saccharin was available for three hours. For rats in the closed economies, the work period was their only opportunity to obtain the reinforcer. Rats in the open saccharin economy worked less hard to defend consumption of saccharin as price increased than rats in the closed saccharin economy. That is, opening the saccharin economy reduced its essential value. In contrast, economy type had no effect on heroin's essential value. In a second phase, rats were allowed to choose between heroin and saccharin. The majority of rats strongly preferred saccharin over heroin regardless of economy type. The finding that economy type changed the essential value of saccharin, but not heroin, adds to previous findings suggesting that the value of drug reinforcers is unaffected by future drug availability. The difference in effect of economy type on drug versus nondrug reinforcers could be relevant to addiction. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Examining effects of unit price on preference for reduced nicotine content cigarettes and smoking rate

Cigarette preference increases as a function of greater nicotine content, but manipulating cost can shift preference. The aims of the present study are to model whether (1) the behavioral-economic metric unit price (cost/reinforcer magnitude) accounts for preference shifts and (2) whether preference shifts toward reduced nicotine content are associated with smoking reductions. In a multisite study between 2015 and 2016, 169 daily smokers from vulnerable populations completed two concurrent-choice conditions examining preference for smoking normal (15.8 mg/g) and reduced (0.4 mg/g) nicotine content cigarettes. In Condition 1, both products were available at 10 responses/choice. In Condition 2, availability of the 0.4 mg/g dose remained at 10 responses/choice while the 15.8 mg/g dose was available on a progressive-ratio (PR) schedule wherein response cost increased following each choice. Unit prices were calculated by dividing dose by response requirement. Results were analyzed using ANOVA and binomial tests (p < .05). Participants preferred the 15.8 over 0.4 mg/g dose in Condition 1, but shifted preference to the 0.4 mg/g dose in Condition 2 (p < .001) immediately before the point in the PR progression where unit price for 15.8 dose exceeded unit price for the 0.4 dose (p < .001). This shift was associated with a reduction in smoking (p < .001). The unit price of nicotine appears to underpin cigarette product preference and may provide a metric for predicting preference and potentially impacting it through tobacco regulations. These results also demonstrate that reduced compared to normal nicotine content cigarettes sustain lower smoking rates discernible even under acute laboratory conditions and in vulnerable populations.

How suboptimal is suboptimal choice?

In a frequently used suboptimal-choice procedure pigeons choose between an alternative that delivers three food pellets with p = 1.0 and an alternative that delivers ten pellets with p = 0.2. Because pigeons reliably choose the probabilistic (suboptimal) alternative, the procedure has been proposed as a nonhuman analog of human gambling. The present experiments were conducted to evaluate two potential threats to the validity of this procedure. Experiments 1 and 2 evaluated if pigeons obtained food at a lower unit price (i.e., pecks per pellet) on the suboptimal alternative than on the optimal alternative. When pigeons worked under this suboptimal procedure they all preferred the suboptimal alternative despite some pigeons paying a higher price for food on that alternative. In Experiment 2, when the unit price ratio more closely approximated the inverse of the expected value ratio, pigeons continued to prefer the suboptimal alternative despite its economic suboptimality. Experiment 3 evaluated if, in accord with the string-theory of gambling, the valuation of the suboptimal alternative was increased when pigeons misattributed a subset of the suboptimal no-food trials to the optimal alternative. When trial sequences were arranged to minimize these possible attribution errors, pigeons still preferred the suboptimal alternative. These data remove two threats to the validity of the suboptimal choice procedure; threats that would have suggested that suboptimal choice reflects economic maximization.

Characterizing the relationship between increases in the cost of nicotine and decreases in nicotine content in adult male rats: implications for tobacco regulation

BACKGROUND

A large reduction in the nicotine content of cigarettes may benefit public health by reducing the rate and the prevalence of smoking. A behavioral economics framework suggests that a decrease in nicotine content may be considered an increase in the unit price of nicotine (unit price = reinforcer cost/reinforcer magnitude). Increasing the price of cigarettes (i.e., increasing reinforcer cost) would be considered an equivalent change in unit price to reducing nicotine content (i.e., reducing reinforcer magnitude).

OBJECTIVES

The goal of the present experiments was to characterize the relationship between increases in nicotine cost and decreases in nicotine dose.

MATERIALS AND METHODS

A rat self-administration model was used to assess this relationship across three experiments, with an emphasis on very low nicotine doses to model a potential nicotine reduction policy. Cost was manipulated via changes in the number of responses required to earn an infusion.

RESULTS

Results show that increases in the cost of nicotine and decreases in nicotine content were not equivalent manipulations. Nicotine consumption was more sensitive to nicotine dose than to nicotine cost. Nicotine consumption was also not equivalent across a variety of cost and dose combinations forming a single unit price.

CONCLUSIONS

Results of the present studies suggest that nicotine reduction is likely to have a large impact on nicotine exposure from cigarettes.

Novel Therapeutics for Addiction: Behavioral and Neuroeconomic Approaches

The maturing fields of behavioral- and neuro-economics provides conceptual understanding of the Competing Neurobehavioral Decision Systems theory (CNDS) and reinforcer pathology (i.e. high valuation of and excessive preference for drug reinforcers) allowing us to coherently categorize treatments into a theoretically comprehensive framework of addiction. In this chapter, we identify and clarify how existing and novel interventions can ameliorate reinforcer pathology in light of the CNDS and be leveraged to treat addiction.

Differences in temporal aspects of food acquisition between rats and two strains of mice in a closed operant economy

Rats and mice were studied for changes in meal-taking structure in a closed operant food economy, in which the consummatory or unit prices for food were increased. In experiment 1, as food price increased, male rats modestly decreased the number of meals per day and increased mean meal size. Female rats were similar to males but had smaller meal size and, at low costs, took more meals per day. In experiment 2, male and female B6 mice reduced food intake as price increased, accompanied by decreased meal number without change in meal size. They showed grazing-like behavior in the first part of the night. In contrast, we report in experiment 3, a large increase in intake and meal size during the final trimester of pregnancy. In experiment 4, we report that CD1 male mice subjected to a unit price series performed comparably to rats, and not like B6 mice. Other CD1 mice were tested using an interval schedule, and we found that mice were able to adapt eating patterns to greatly increased time demands without compromising total intake. Data are discussed in terms of the intercalation of food acquisition with global patterns of activity. Such interactions of organism and food environment are in particular need of mechanistic investigation.

Perceived intent motivates people to magnify observed harms

Existing moral psychology research commonly explains certain phenomena in terms of a motivation to blame. However, this motivation is not measured directly, but rather is inferred from other measures, such as participants' judgments of an agent's blameworthiness. The present paper introduces new methods for assessing this theoretically important motivation, using tools drawn from animal-model research. We test these methods in the context of recent "harm-magnification" research, which shows that people often overestimate the damage caused by intentional (versus unintentional) harms. A preliminary experiment exemplifies this work and also rules out an alternative explanation for earlier harm-magnification results. Exp. 1 asks whether intended harm motivates blame or merely demonstrates the actor's intrinsic blameworthiness. Consistent with a motivational interpretation, participants freely chose blaming, condemning, and punishing over other appealing tasks in an intentional-harm condition, compared with an unintentional-harm condition. Exp. 2 also measures motivation but with converging indicators of persistence (effort, rate, and duration) in blaming. In addition to their methodological contribution, these studies also illuminate people's motivational responses to intentional harms. Perceived intent emerges as catalyzing a motivated social cognitive process related to social prediction and control.

The behavioral economics of substance use disorders: reinforcement pathologies and their repair

The field of behavioral economics has made important inroads into the understanding of substance use disorders through the concept of reinforcer pathology. Reinforcer pathology refers to the joint effects of (a) the persistently high valuation of a reinforcer, broadly defined to include tangible commodities and experiences, and/or (b) the excessive preference for the immediate acquisition or consumption of a commodity despite long-term negative outcomes. From this perspective, reinforcer pathology results from the recursive interactions of endogenous person-level variables and exogenous environment-level factors. The current review describes the basic principles of behavioral economics that are central to reinforcer pathology, the processes that engender reinforcer pathology, and the approaches and procedures that can repair reinforcement pathologies. The overall goal of this review is to present a new understanding of substance use disorders as viewed by recent advances in behavioral economics.

Relationship between oral D-amphetamine self-administration and ratings of subjective effects: do subjective-effects ratings correspond with a progressive-ratio measure of drug-taking behavior?

The abuse potential of drugs has traditionally been determined in humans using subjective ratings of drug effects. However, drug self-administration procedures also provide valuable information about the reinforcing effects of drugs that may contribute to their potential for abuse. Although ratings of subjective effects and drug self-administration data are generally concordant, some divergent findings have been reported. Therefore, the aim of the present analysis was to directly investigate the relationship between the subjective-effects profile and self-administration of oral D-amphetamine in healthy volunteers with a history of stimulant use or abuse, using Pearson's correlational analyses. The results indicated that positive subjective and reinforcing effects significantly increased as a function of D-amphetamine dose. Further, significant, but modest, correlations were observed between ratings of six of 17 total items (Any Effect, High, Like Drug, Good Effects, Willing to Pay For, and Willing to Take Again) and D-amphetamine self-administration under a progressive-ratio schedule of reinforcement. The current findings suggest that, at least under the current set of conditions with oral D-amphetamine, subjective-effects measures and drug self-administration data likely provide different but complimentary information about abuse potential. The most informative findings will thus be obtained from studies that use ratings of subjective effects and drug self-administration methods.

Poor impulse control predicts inelastic demand for nicotine but not alcohol in rats

Tobacco and alcohol dependence are characterized by continued use despite deleterious health, social and occupational consequences, implying that addicted individuals pay a high price for their use. In behavioral economic terms, such persistent consumption despite increased costs can be conceptualized as inelastic demand. Recent animal studies demonstrated that high-impulsive individuals are more willing to work for nicotine or cocaine infusions than their low-impulsive counterparts, indicating that this trait might be causally related to inelastic drug demand. By employing progressive ratio schedules of reinforcement combined with a behavioral economics approach of analysis, we determined whether trait impulsivity is associated with an insensitivity of nicotine or alcohol consumption to price increments. Rats were trained on a delayed discounting task, measuring impulsive choice. Hereafter, high- and low-impulsive rats were selected and trained to nose poke for intravenous nicotine or oral alcohol. Upon stable self-administration on a continuous reinforcement schedule, the price (i.e. response requirement) was increased. Demand curves, depicting the relationship between price and consumption, were produced using Hursh's exponential demand equation. Similar to human observations, nicotine and alcohol consumption in rats fitted this equation, thereby demonstrating the validity of our model. Moreover, high-impulsive rats displayed inelastic nicotine demand, as their nicotine consumption was less sensitive to price increments as compared with that in low-impulsive rats. Impulsive choice was not related to differences in alcohol demand elasticity. Our model seems well suited for studying nicotine and alcohol demand in rats and, as such, might contribute to our understanding of tobacco and alcohol dependence.

Thought for food: imagined consumption reduces actual consumption

The consumption of a food typically leads to a decrease in its subsequent intake through habituation--a decrease in one's responsiveness to the food and motivation to obtain it. We demonstrated that habituation to a food item can occur even when its consumption is merely imagined. Five experiments showed that people who repeatedly imagined eating a food (such as cheese) many times subsequently consumed less of the imagined food than did people who repeatedly imagined eating that food fewer times, imagined eating a different food (such as candy), or did not imagine eating a food. They did so because they desired to eat it less, not because they considered it less palatable. These results suggest that mental representation alone can engender habituation to a stimulus.

Effects of 2-AG on the reinforcing properties of wheel activity in obese and lean Zucker rats

The endocannabinoid system plays a role in obesity, primarily by its role in food reward. Activity, also involved in obesity, seems to be at least partially controlled by the endocannabinoid system, but the relevant behavioral and neurochemical mechanisms have not been well established. This study represents an attempt to begin elucidating these mechanisms by examining the effects of an endogenous cannabinoid ligand, 2-arachidonoylglycerol (2-AG), on the reinforcing properties of exercise reinforcement in lean and obese Zucker rats. Ten obese and 10 lean Zucker rats pressed a locked door under a progressive ratio schedule of reinforcement that, when unlocked, provided access to a running wheel for 2-min periods. After baseline breakpoints were established, doses of 2-AG (0.3-3 mg/kg) were administered before experimental sessions. Obese rats exhibited lower breakpoints for wheel activity, lower response rates, and fewer revolutions compared with lean rats. 2-AG decreased breakpoints, response rates, and revolutions for obese rats, and revolutions only for lean rats. These data suggest that 2-AG may reduce the reinforcing properties of activity, and that obese Zuckers may show a greater sensitivity to 2-AG. The data also suggest that endocannabinoids may play a role in the reinforcing properties of exercise.

Economics, ecologics, and mechanics: The dynamics of responding under conditions of varying motivation

The mechanics of behavior developed by Killeen (1994) is extended to deal with deprivation and satiation and with recovery of arousal at the beginning of sessions. The extended theory is validated against satiation curves and within-session changes in response rates. Anomalies, such as (a) the positive correlation between magnitude of an incentive and response rates in some contexts and a negative correlation in other contexts and (b) the greater prominence of incentive effects when magnitude is varied within the session rather than between sessions, are explained in terms of the basic interplay of drive and incentive motivation. The models are applied to data from closed economies in which changes of satiation levels play a key role in determining the changes in behavior. Relaxation of various assumptions leads to closed-form models for response rates and demand functions in these contexts, ones that show reasonable accord with the data and reinforce arguments for unit price as a controlling variable. The central role of deprivation level in this treatment distinguishes it from economic models. It is argued that traditional experiments should be redesigned to reveal basic principles, that ecologic experiments should be redesigned to test the applicability of those principles in more natural contexts, and that behavioral economics should consist of the applications of these principles to economic contexts, not the adoption of economic models as alternatives to behavioral analysis.

Preference for reinforcers under varying schedule arrangements: A behavioral economic analysis

The field of behavioral economics combines concepts from economics and operant conditioning to examine the influence of schedules or price on preference for reinforcers. Three case studies are reported in which behavioral economic analyses were used to assess relative preference for reinforcers shown by people with intellectual disabilities when schedule requirements varied. The studies examined (a) preference for different reinforcers, (b) substitutability of reinforcers, and (c) changes in preference as a function of schedule requirements.

Behavioral economics and behavioral momentum

Some relations between elasticity of demand and the conditions of reinforcement are reanalyzed in terms of resistance to change, in ways suggested by the metaphor of behavioral momentum; some relations between resistance to change and the conditions of reinforcement are reanalyzed in terms of elasticity of demand, in ways suggested by behavioral economics. In addition, some data on labor supply in relation to variable-ratio schedules and alternative reinforcement are reanalyzed in terms of resistance to change and compared with steady-state resistance data for performance on multiple and concurrent interval schedules. The results of these studies can be summarized by two functions based on the behavioral momentum approach, relating relative behavioral mass to relative reinforcement per response or per unit time. The former is a relation between relative unit price and relative behavioral mass, suggesting the possibility of convergent measurement of a theoretical construct common to both approaches. However, the momentum and economic approaches differ fundamentally on whether it is preferable to construe discriminated operant behavior as selected and strengthened by its consequences or as part of a behavior-consequence bundle that maximizes utility.

Token reinforcement: a review and analysis

Token reinforcement procedures and concepts are reviewed and discussed in relation to general principles of behavior. The paper is divided into four main parts. Part I reviews and discusses previous research on token systems in relation to common behavioral functions--reinforcement, temporal organization, antecedent stimulus functions, and aversive control--emphasizing both the continuities with other contingencies and the distinctive features of token systems. Part II describes the role of token procedures in the symmetrical law of effect, the view that reinforcers (gains) and punishers (losses) can be measured in conceptually analogous terms. Part III considers the utility of token reinforcement procedures in cross-species analysis of behavior more generally, showing how token procedures can be used to bridge the methodological gulf separating research with humans from that with other animals. Part IV discusses the relevance of token systems to the field of behavioral economics. Token systems have the potential to significantly advance research and theory in behavioral economics, permitting both a more refined analysis of the costs and benefits underlying standard economic models, and a common currency more akin to human monetary systems. Some implications for applied research and for broader theoretical integration across disciplines will also be considered.

Behavioral economic analysis of opioid consumption in heroin-dependent individuals: effects of alternative reinforcer magnitude and post-session drug supply

This study investigated the extent to which hydromorphone (HYD) choice and behavioral economic demand were influenced by HYD unit price (UP), alternative money reinforcement magnitude and post-session HYD supply. Heroin-dependent research volunteers (n=13) stabilized on buprenorphine 8 mg/day first sampled two HYD doses (12 and 24 mg IM, labeled Drug A [session 1] and Drug B [session 2]). In each of the final six sessions, volunteers were given access to a 12-trial choice progressive ratio (PR) task and could earn a HYD unit dose (2 mg, fixed) or money ($2 or $4, varied across sessions), administered immediately after the work session. Before the PR task, volunteers were told which HYD supplemental dose (none, Drug A or B) would be available 3h after receiving the PR-contingent dose. PR-contingent HYD choice significantly decreased when $4 relative to $2 was concurrently available. Information about the post-session HYD supplement moderated this effect: when subjects were told a supplemental dose was available, HYD-seeking behavior decreased when the money alternative was smaller ($2), but this information did not further attenuate HYD choice, which was already low, when the money alternative was higher ($4). HYD demand elasticity was only increased by the $4 relative to $2 alternative without the HYD supplement. In summary, opioid-seeking behavior is influenced by the availability of concurrent non-drug and drug alternatives. These findings show that drug availability and non-drug alternatives interact to modulate drug-seeking behavior.

Effects of food deprivation on goal-directed behavior, spontaneous locomotion, and c-Fos immunoreactivity in the amygdala

Previous work in our laboratory has shown that food deprivation and food presentation produce different patterns of neuronal activity (as measured by c-Fos immunoreactivity) in the medial prefrontal cortex and nucleus accumbens of rats. Since the amygdala has been implicated in both motivational and reinforcement processes and has neuronal connections to both the prefrontal cortex and nucleus accumbens, it was of interest to assess amygdaloid c-Fos immunoreactivity during similar manipulations of food deprivation and presentation. In the current study, c-Fos counts in both basolateral and central amygdalar nuclei were observed to increase in rats 12- and 36-h food deprived (relative to 0-h controls)-an effect reversed by the presentation of either a small or large meal (2.5 or 20g of food). In another experiment, rats working on a progressive ratio schedule of reinforcement exhibited elevated break-points as a function of food deprivation, a result consistent with the view that the feeding manipulations increased the subjects' level of motivation. In contrast, food deprivation reduced the spontaneous locomotor activity of rats, presumably as a result of an inherent energy-conservation strategy when no food is readily available. These data suggest that the state of food deprivation is associated with: (a) enhanced behavioral output only when food is attainable (increased goal-directed behavior, but decreased spontaneous activity), and (b) increased synaptic engagement in neuronal circuits involved in affective valuation and related decision-making (increased c-Fos counts in the amygdala).

Cocaine self-administration on a hold-down schedule of reinforcement in rats

RATIONALE AND OBJECTIVE

Although many contingencies operating in the natural environment include continuous dimensions of responses and reinforcers, previous studies of drug self-administration have almost exclusively used discrete dimensions of responses (e.g., a lever press) and reinforcers (e.g., 1.0 mg/kg/injection cocaine). Therefore, the present study provides an initial examination under experimental conditions with both responses and reinforcers measured along continuous dimensions.

MATERIALS AND METHODS

Cocaine-maintained responding was studied in rats under a novel, hold-down schedule of reinforcement wherein the duration of the response was directly related to the magnitude of the reinforcer. These conditions were established by activating the syringe pump when the lever was pressed down and turning the pump off when the lever was released. The concentration of cocaine available in the syringe was varied across sessions.

RESULTS

Cocaine self-administration was readily maintained under these conditions and remained stable across sessions. Responding was concentration dependent, with the number of responses and total duration of the response inversely related to concentration, and overall session intake of cocaine was stable across concentrations. In general, the duration of the responses were less than 0.5 s and did not vary as a function of concentration.

CONCLUSIONS

Stability of responding under these schedule conditions was acquired quickly. This schedule of reinforcement may be useful for comparing across drug classes, can be extended for use with other types of responses and reinforcers, and may be more representative of the natural world where response-reinforcer contingencies are more likely to be experienced along continuous, rather than discrete, dimensions.

Temporal horizons of cigarette satiety: determining the window of time over which recent smoking influences motivation to smoke

One of the hallmarks of drug addiction is a limitation of the temporal horizon of events that affect the behavior of drug users. The purpose of this experiment was to examine the time period over which smoking was influenced by an earlier opportunity to smoke. Baseline sessions measured how much was smoked in a current opportunity when it was preceded by a 2-h wait time in which no smoking was allowed. After the baseline phase, we examined the effects of temporal distance when an earlier opportunity to smoke (upon completion of a fixed ratio 100) preceded current smoking (upon completion of a progressive ratio). Temporal distance between these two opportunities to smoke was varied from 0 to 120 min. We found that current smoking for the group was reduced from baseline levels when the temporal distance was 0 min. At temporal distances ranging from 30 to 90 min, the individual's smoking returned to levels that were similar to baseline. Breakpoints were also a function of earlier smoking, and latencies to first puff of the session followed a similar trend. These findings provide evidence of the limited temporal horizons related to smoking bouts of smokers and may provide a useful measure for metabolism differences across populations. In addition, we suggest that the quantitative description of satiety provided by our procedures may validate drug replacement therapies involved in cessation treatments.

Wheel running, voluntary ethanol consumption, and hedonic substitution

Few studies have examined the relationship between naturally rewarding behaviors and ethanol drinking behaviors in mice. Although natural and drug reinforcers activate similar brain circuitry, there is behavioral evidence suggesting food and drug rewards differ in perceived value. The primary goal of the present study was to investigate the relationships between naturally reinforcing stimuli and consumption of ethanol in ethanol preferring C57BL/6J mice. Mouse behaviors were observed after the following environmental manipulations: standard or enhanced environment, accessible or inaccessible wheel, and presence or absence of ethanol. Using a high-resolution volumetric drinking monitor and wheel running monitor, we evaluated whether alternating access to wheel running modified ethanol-related behaviors and whether alternating access to ethanol modified wheel running or subsequent ethanol-related behaviors. We found that ethanol consumption remains stable with alternating periods of wheel running. Wheel running increases in the absence of ethanol and decreases upon reintroduction of ethanol. Upon reintroduction of ethanol, an alcohol deprivation effect was seen. Collectively, the results support theories of hedonic substitution and suggest that female C57BL/6J mice express ethanol seeking and craving under these specific conditions.

Behavioral economic analysis of drug preference using multiple choice procedure data

The multiple choice procedure has been used to evaluate preference for psychoactive drugs, relative to money amounts (price), in human subjects. The present re-analysis shows that MCP data are compatible with behavioral economic analysis of drug choices. Demand curves were constructed from studies with intravenous fentanyl, intramuscular hydromorphone and oral methadone in opioid-dependent individuals; oral d-amphetamine, oral MDMA alone and during fluoxetine treatment, and smoked marijuana alone or following naltrexone pretreatment in recreational drug users. For each participant and dose, the MCP crossover point was converted into unit price (UP) by dividing the money value ($) by the drug dose (mg/70kg). At the crossover value, the dose ceases to function as a reinforcer, so "0" was entered for this and higher UPs to reflect lack of drug choice. At lower UPs, the dose functions as a reinforcer and "1" was entered to reflect drug choice. Data for UP vs. average percent choice were plotted in log-log space to generate demand functions. Rank of order of opioid inelasticity (slope of non-linear regression) was: fentanyl>hydromorphone (continuing heroin users)>methadone>hydromorphone (heroin abstainers). Rank order of psychostimulant inelasticity was d-amphetamine>MDMA>MDMA+fluoxetine. Smoked marijuana was more inelastic with high-dose naltrexone. These findings show this method translates individuals' drug preferences into estimates of population demand, which has the potential to yield insights into pharmacotherapy efficacy, abuse liability assessment, and individual differences in susceptibility to drug abuse.

Liquid sucrose bingeing in rats depends on the access schedule, concentration and delivery system

Previous studies have reported binge-type consumption of solid vegetable shortening in non-food deprived rats maintained on schedules of limited shortening access. The current study determined if limited access would promote binge-type consumption of sucrose solutions. Adult male rats (6 groups, n = 10 each) were provided with one of three different sucrose concentrations (3.2%, 10%, 32% w/v) for 2 h either everyday (Daily) or Monday, Wednesday, and Friday (Intermittent). A 'binge' during the 2-h access periods was operationally defined as Intermittent intakes significantly greater than Daily intakes. Sucrose initially was provided in a 100 ml glass tube equipped with a stainless-steel drinking spout. Under these conditions, there were no differences in sucrose intake between Daily and Intermittent groups at any of the concentrations. In contrast, when sucrose was provided in a modified 60 ml plastic syringe with the same drinking spout, intakes of the Intermittent groups consuming 3.2% and 10% sucrose were greater than those of the respective Daily groups, indicating that binge-type consumption of sucrose occurred. These results demonstrate that brief, intermittent access to low and moderate concentrations of sucrose can promote binge-type behavior, and the characteristics of the drinking apparatus can affect sucrose intake.

Behavioral economic analysis of opioid consumption in heroin-dependent individuals: effects of unit price and pre-session drug supply

Behavioral economic analysis has been used to investigate factors underlying drug consumption in laboratory animals and, increasingly, in human drug abusers. However, there are few studies in heroin abusers, especially those who are not in treatment; such studies may be valuable for understanding the mechanisms of persistent drug use. This study investigated effects of unit price (UP) and pre-session supply of hydromorphone (HYD) on choice and consumption of HYD. Heroin-dependent research volunteers (n=13) stabilized on buprenorphine 8 mg/day completed this eight-session inpatient study. In sessions 1-2, participants sampled two total HYD doses (12 and 24 mg IM) that could be earned in later sessions. In each of the final six sessions, volunteers were given access to a 12-trial choice progressive ratio schedule lasting 3h. On each trial, volunteers could earn a HYD unit dose (1 or 2 mg, for a maximum of 12 or 24 mg, respectively) or money (US dollars 2, for a maximum of US dollars 24). Fixed ratio requirements increased exponentially, generating 24 unit prices for behavioral economic analysis. Before some choice sessions, volunteers could choose (FR 1) to receive extra HYD (12 or 24 mg; at 0915), whereas on other days no supplement was available. HYD choice and peak responding (breakpoint, O(max)) measures increased with unit dose, decreased with pre-session supplements, and were greater among volunteers who used cocaine prior to the experiment. Taking pre-session supplements decreased P(max) and made group-percent HYD consumption more demand-elastic. Consumption was functionally equivalent at differing FR/unit dose combinations. Thus, opioid demand in heroin-dependent individuals not in treatment is a function of drug supply, unit price, and cocaine use.

Second-order schedules of token reinforcement with pigeons: implications for unit price

Four pigeons were exposed to second-order schedules of token reinforcement, with stimulus lights serving as token reinforcers. Tokens were earned according to a fixed-ratio (token-production) schedule, with the opportunity to exchange tokens for food (exchange period) occurring after a fixed number had been produced (exchange-production ratio). The token-production and exchange-production ratios were manipulated systematically across conditions. Response rates varied inversely with the token-production ratio at each exchange-production ratio. Response rates also varied inversely with the exchange-production ratio at each token-production ratio, particularly at the higher token-production ratios. At higher token-production and exchange-production ratios, response rates increased in token-production segments closer to exchange periods and food. Some conditions were conducted in a closed economy, in which the pigeons earned all their daily ration of food within the session. Relative to comparable open-economy conditions, response rates in the closed economy were less affected by changes in token-production ratio, resulting in higher levels of food intake and body weight. Some of the results are consistent with the economic concept of unit price, a cost-benefit ratio comprised of responses per unit of food delivery, but most are well accounted for by a consideration of the number of responses required to produce exchange periods, without regard to the amount of reinforcement available during those exchange periods.

Replacing relative reinforcing efficacy with behavioral economic demand curves

Relative reinforcing efficacy refers to the behavior-strengthening or maintaining property of a reinforcer when compared to that of another reinforcer. Traditional measures of relative reinforcing efficacy sometimes have led to discordant results across and within studies. By contrast, previous investigations have found traditional measures to be congruent with behavioral economic measures, which provide a framework for integrating the discordant results. This study tested whether the previously demonstrated congruence between traditional relative reinforcing efficacy measures and behavioral economic demand curve measures is sufficiently robust to persist when demand for one reinforcer is altered. Cigarette smokers pulled plungers for cigarettes or two magnitudes of money on progressive-ratio schedules that increased the response requirement across sessions. Demand for the two different reinforcers was assessed in single-schedule and concurrent-schedule sessions. Demand curve measures Pmax and Omax correlated significantly with traditional measures of breakpoint and peak response rate, respectively. Relative locations of demand curves for money and cigarettes under single schedules predicted preference in concurrent schedules in most cases. Although measures of relative reinforcing efficacy for money changed with money magnitude, the congruence between traditional and behavioral economic measures remained intact. This robust congruence supports the proposal that demand curves should replace measures of relative reinforcing efficacy. The demand curve analysis illustrates why concordance between traditional measures is expected under some experimental conditions but not others.

Morphine tolerance as a function of ratio schedule: response requirement or unit price?

Key pecking by 3 pigeons was maintained by a multiple fixed-ratio 10, fixed-ratio 30, fixed-ratio 90 schedule of food presentation. Components differed with respect to amount of reinforcement, such that the unit price was 10 responses per 1-s access to food. Acute administration of morphine, l-methadone, and cocaine dose-dependently decreased overall response rates in each of the components. When a rate decreasing dose of morphine was administered daily, tolerance, as measured by an increase in the dose that reduced response rates to 50% of control (i.e., the ED50 value), developed in each of the components; however, the degree of tolerance was smallest in the fixed-ratio 90 component (i.e., the ED50 value increased the least). When the l-methadone dose-effect curve was redetermined during the chronic morphine phase, the degree of cross-tolerance conferred to l-methadone was similar across components, suggesting that behavioral variables may not influence the degree of cross-tolerance between opioids. During the chronic phase, the cocaine dose-effect curve shifted to the right for 2 pigeons and to the left for 1 pigeon, which is consistent with predictions based on the lack of pharmacological similarity between morphine and cocaine. When the morphine, l-methadone, and cocaine dose-effect curves were redetermined after chronic morphine administration ended, the morphine and l-methadone ED50s replicated those obtained prior to chronic morphine administration. The morphine data suggest that the fixed-ratio value (i.e., the absolute output) determines the degree of tolerance and not the unit price.

Interactions among unit-price, fixed-ratio value, and dosing regimen in determining effects of repeated cocaine administration

Previous research has shown tolerance to cocaine that was dependent on fixed-ratio (FR) parameter size in the context of a multiple FR schedule of food reinforcement. Completion of the FR requirement in these studies resulted in the same magnitude of reinforcement, regardless of ratio size. The cost-to-benefits ratio (unit-price) was therefore not equated across the different FR components. The current study examined the effects of repeated administration of cocaine to pigeons when unit-price under FR schedules was either the same or different. Additionally, the role of a chronic variable-dosing versus chronic fixed-dosing procedure was examined when unit-price was equated across different ratio values. Pigeons were trained to key peck in daily sessions under a three-component multiple FR schedule of food presentation, according to which either 10, 30, or 100 pecks were required for each delivery of food. In Experiment 1, completion of the FR 10, FR 30, and FR 100 resulted in 1.5, 4.5, and 15.0 s access to food, respectively. That is, the response requirement was correlated with access to food time so that unit-price (pecks per second of access to food) was equated across components. After assessing acute effects of a range of doses of cocaine, drug administration occurred daily before each session, with the dose varying from day to day. Tolerance, the magnitude of which was unrelated to the peck requirement, developed under the repeated-dosing regimen. In order to assess whether having equal unit-price was responsible for producing similar levels of tolerance across components, daily drug administration continued in Experiment 2 using the variable-dose regimen, but the amount of food presented each time was fixed at 4.5 s access to food, yielding different unit-prices under the three pecking requirements. Subsequently, the conditions of Experiment 1 were reinstated, i.e., unit-price was equated. Making unit-price different or the same had little influence on effects of cocaine. In Experiment 3, a fixed dose of cocaine was administered before each session while programmed unit-price remained the same across components. Under these conditions, tolerance became peck-requirement related. Specifically, tolerance was most prevalent under the smaller requirements and less robust or absent when the largest requirement was in effect. Differences in unit-price, therefore, were not related to degree of tolerance, but work requirement was. Differences in effects of cocaine across responses requirements, however, were observed only when each session was preceded by the same dose, not when dose varied from session to session.

Unit price and choice in a token-reinforcement context

Pigeons were exposed to multiple and concurrent second-order schedules of token reinforcement, with stimulus lights serving as token reinforcers. Tokens were produced and exchanged for food according to various fixed-ratio schedules, yielding equal and unequal unit prices (responses per unit food delivery). On one schedule (termed the standard schedule), the unit price was held constant across conditions. On a second schedule (the alternative schedule), the unit price was either the same or different from the standard. Under conditions with unequal unit prices, near-exclusive preference for the lower unit price was obtained. Under conditions with equal unit prices, the direction and degree of preference depended on ratio size (number of responses per exchange period). When this ratio differed, strong preferences for the smaller ratio were observed. When this ratio was equal, preferences were nearer indifference. Response rates on the multiple schedule were generally consistent with the preference data in showing sensitivity to ratio size. Results are discussed in terms of a unit-price model that includes handling and reinforcer immediacy as additional costs. On the whole, results show that preferences were determined primarily by delay to the exchange period.

Behavioral economic analysis of water intake in a laboratory rhesus macaque

Behavioral economics is useful for understanding the influence of environmental manipulation on a variety of behaviors, including drug self-administration, food intake, and stock behavior. The present study employed behavioral economics to investigate the psychologically satisfying amount of water intake in a laboratory rhesus macaque. Our institutional guidelines set a minimum amount of daily water intake. However, no study to date has determined whether that minimum amount is psychologically sufficient. In the present experiment, a monkey lived in an individual cage in which the only water available was delivered by chain pulling. A fixed number of responses was required for water delivery. This fixed ratio (FR) of responses per water delivery was progressively increased from FR 2 to FR 10. The study findings showed that during the FR 2 condition, demand for water was saturated at 131.3 ml/kg body weight (BW) (ranging from 95.1 to 211.2). The monkey's daily intake of water decreased as FR size incrementally increased, approaching an asymptote under the FR 8 and FR 10 conditions. During the FR 8 and FR 10 conditions, responding ceased when this monkey earned 53.5 ml/kg-BW (ranging from 32.7 to 74.9) of water. Therefore, the amount of water obtained under these conditions might provide a psychologically satisfying amount. Although these values were obtained from the behavioral study of one monkey, they were almost equivalent to values in our institutional guidelines that were determined by veterinary observations. These findings imply that behavioral economics is useful for studying the welfare of laboratory animals.

Stimuli produced by observing responses make rats' ethanol self-administration more resistant to price increases

RATIONALE

Observing responses bring sensory receptors into contact with environmental stimuli. In the observing-response procedure, periods in which an operant response (e.g. pressing a lever) is reinforced by drug deliveries alternate with periods in which this response is never reinforced (i.e. extinction). These alternating periods of drug availability versus extinction are not signaled. Observing responses (i.e. presses on a second lever) produce brief stimuli signaling whether drug is available or not for responses on the first lever. Little is known about how parameters of the drug reinforcer affect drug-stimulus observing.

OBJECTIVES

The effects of changes in the unit price (responses/reinforcer magnitude) of self-administered ethanol on rats' observing were examined. Also, the effects of an observing-response-produced ethanol stimulus on ethanol consumption were examined by comparing consumption during signaled and unsignaled periods of ethanol availability.

METHODS

Rats self-administered oral ethanol in the observing-response procedure. The unit price of ethanol in the observing-response procedure was increased by increasing the response requirement for ethanol across conditions.

RESULTS

Observing and response rates on the ethanol lever increased and then decreased with increases in the unit price of ethanol. However, ethanol-lever responding and ethanol consumption during periods when ethanol was available were less sensitive to increases in price when the observing-response-produced ethanol stimulus was present.

CONCLUSIONS

Observing varies as an orderly function of unit price of a drug reinforcer, and drug stimuli produced by observing responses can make drug consumption less sensitive to increases in price. This procedure may provide an animal model of both attending to drug stimuli and the resultant effects of these stimuli on drug taking.

Effects of deprivation on hedonics and reinforcing value of food

Eating is influenced by both the hedonic preferences and reinforcing value of food. Incentive salience theory predicts these are separate influences. This study tested whether hedonics reliably change as a function of increasing the reinforcing value of food by deprivation in 17 non-obese, non-dietary restrained females. Baseline measures of hedonics for pleasant (chocolate milk), unpleasant (lemon juice) and neutral (water) tastes were determined under deprived conditions. Participants were then randomly assigned to fed or maintained in deprived conditions, and after food consumption, a second determination of hedonics was obtained, followed by assessing the reinforcing value of food. Hedonics was measured by subjective ratings and behavioral observations in a taste reactivity paradigm. Results showed food was more reinforcing for the deprived than the fed group, but no influences of group were observed for the subjective or objective hedonic measures. These results suggest that hedonics and the reinforcing value of food are separate processes in humans, and they may independently influence eating behavior.

Dynamics of extracellular dopamine in the acute and chronic actions of cocaine

Cocaine amplifies dopaminergic neurotransmission via blockade of presynaptic neuronal uptake. This action is believed to be a crucial component of cocaine's ability to exert its reinforcing effects. This review will provide a brief overview of extracellular dopamine dynamics associated with cocaine. The acute effects of cocaine reviewed include comparison of intravenous and intraperitoneal routes of administration to better understand how fast and slow routes (e.g., crack and intranasal) differ in their pharmacokinetics and neurochemical effects and how those differences relate to differences in abuse potential. Changes in the acute effects of cocaine within a session have been examined in neurochemical studies of acute tolerance to self-administered cocaine in rhesus monkeys, and the potential impact of that tolerance to patterns of use is discussed. Between-session sensitization of the dopaminergic response to cocaine is reviewed, and data indicating this also occurs in primates have been obtained in self-administering rhesus monkeys, demonstrating neurochemical sensitization in a primate species. The important question of whether cocaine-associated environmental cues elicit conditioned increases in dopamine release has also been examined in the rhesus monkey, with results indicating that, unlike rats, nonhuman primates do not show conditioned increases in dopamine release.

Sensitivity of nicotine-containing and de-nicotinized cigarette consumption to alternative non-drug reinforcement: a behavioral economic analysis

A previous report from our laboratory showed similar measures of reinforcing efficacy for nicotine-containing and de-nicotinized cigarettes when each cigarette type was presented alone. The present experiment further compared the reinforcing efficacy of nicotine-containing and de-nicotinized cigarettes by assessing the effects of alternative non-drug reinforcement on self-administration of both cigarette types. Eight human subjects responded on a progressive-ratio schedule in which the number of plunger pulls required for standardized cigarette puffs increased across sessions. Responding for the two types of cigarette was examined when each was available alone and when the concurrent opportunity to earn money was available. Consumption of nicotine-containing and de-nicotinized cigarettes was decreased by both increases in price and by the concurrent availability of money. The two cigarettes types did not differ in their sensitivity to price or alternative non-drug reinforcement. These results replicate our previous report of similar measures of reinforcing efficacy for the two cigarette types when each was presented alone, and extend our previous findings to a choice situation involving an alternative non-drug reinforcer. These data suggest the importance of further examination of non-pharmacological variables in the maintenance of drug taking and the sensitivity of drug taking to alternative non-drug sources of reinforcement. Factors potentially contributing to the maintenance of smoking the de-nicotinized cigarettes (i.e. conditioned reinforcement, primary reinforcement by respiratory stimulation, instructional control, demand characteristics) are also discussed.

Effort- and time-cost effects on demand curves for food by pigeons under short session closed economies

Demand curves for food were compared under the effort- and time-cost conditions using response-initiated fixed-ratio (FR) and fixed-interval (FI) schedules. For the effort-cost conditions, two pigeons were exposed to FR 3, 30, 90, and 150 for six sessions each. The time equivalent of each ratio was a FI schedule, each FI value equal to an average time from the first peck on the ratio to reinforcement (3-s access to mixed grain). The experiment was repeated in 1.5-, 3.0-, and 4.5-h closed economies in a different order for each pigeon. Food consumption as a function of time-based unit price (time equivalent per reinforcement duration) for each session length showed moderate convergence on a single demand function for the two cost conditions. When the demand function was separately fitted to each cost condition, however, the ranges of inelastic demand were generally larger in time-cost than effort-cost conditions. These curve-fitting analyses suggest that although time is a critical cost factor decreasing consumption at moderate prices, food intake under the effort-cost condition decreases more rapidly than under the time-cost condition as unit price increases. The analyses provide useful descriptions for the functional difference of costs.

Three predictions of the economic concept of unit price in a choice context

Economic theory makes three predictions about consumption and response output in a choice situation: (a) When plotted on logarithmic coordinates, total consumption (i.e., summed across concurrent sources of reinforcement) should be a positively decelerating function, and total response output should be a bitonic function of unit price increases; (b) total consumption and response output should be determined by the value of the unit price ratio, independent of its cost and benefit components; and (c) when a reinforcer is available at the same unit price across all sources of reinforcement, consumption should be equal between these sources. These predictions were assessed in human cigarette smokers who earned cigarette puffs in a two-choice situation at a range of unit prices. In some sessions, smokers chose between different amounts of puffs, both available at identical unit prices. Individual subjects' data supported the first two predictions but failed to support the third. Instead, at low unit prices, the relatively larger reinforcer (and larger response requirement) was preferred, whereas at high unit prices, the smaller reinforcer (and smaller response requirement) was preferred. An expansion of unit price is proposed in which handling costs and the discounted value of reinforcers available according to ratio schedules are incorporated.

Similar consumption and responding across single and multiple sources of drug

Two experiments were conducted to assess whether total response output and total consumption would be similar when drugs are available from single and multiple sources of reinforcement, as predicted by behavioral economics. In Experiment 1, cigarette-deprived smokers were exposed to a concurrent-chains schedule in which equal fixed-ratio schedules served as the initial links, and different reinforcer magnitudes (i.e., number of cigarette puffs) were arranged across alternatives. After the session, obtained unit price was calculated and imposed in the next session when a different number of puffs was available according to a single fixed-ratio schedule. Thus, the unit price at which cigarette puffs could be earned was yoked within subjects across the single and concurrent-chains schedules. When plotted as a function of unit price, similar consumption and response rates were usually obtained across these schedules. Experiment 2 addressed a weakness of Experiment 1, namely, that responding was allocated exclusively to the larger reinforcer magnitude in concurrent-chains conditions, and therefore this schedule may have functioned as a single schedule. In Experiment 2, subjects were instructed to alternate responding between the two alternative schedules. Instructions produced approximately equal response allocation between the two alternatives. Again, similar consumption and response rates were observed across the single and instructed concurrent-chains schedules. These findings are discussed in the context of direct effects and behavioral economics perspectives of drug self-administration.

Oral self-administration of sweetened nicotine solutions by rats

Oral self-administration of sweetened nicotine solutions in rats was studied in two ways. In the first experiment, one group had continuous access to a water bottle containing a sucrose solution and nicotine (10 micrograms/ml), while another group had access to an identical sucrose solution without nicotine. All rats had continuous access to water. While consumption of nicotine increased with increasing concentrations of sucrose, consumption of the sucrose+nicotine solution never exceeded the intake of sucrose alone. In subsequent experiments, the delivery of the solutions was made contingent upon an operant response. The sucrose+nicotine solution was found to maintain responding to higher response/reinforcer ratios than the sucrose only solution. These data demonstrate that rats will self-administer sweetened nicotine solutions and that sucrose+nicotine solutions are more reinforcing than sucrose solutions alone. Free access consumption is not a good predictor of the response maintaining properties of nicotine solutions.

The behavioral economics of concurrent drug reinforcers: a review and reanalysis of drug self-administration research

In economics, goods can function as substitutes, complements, or be independent of one another. These concepts refer to increases, decreases, or no change in the consumption of one item as the price of a second item increases. This review examined whether these economic terms can be used to describe relationships between concurrently available reinforcers in drug self-administration research. Sixteen drug self-administration studies that examined the effects of concurrent reinforcers were identified through a MEDLINE search. Across these studies, the following substances were employed: caffeinated coffee, cocaine, etonitazene, ethanol, heroin, food, methadone, morphine, nicotine cigarettes, pentobarbital, phencyclidine, sucrose and water. These studies were reanalyzed and the results were shown to be consistent with these economic notions. These analyses also showed that relationships among the concurrently available reinforcers were reliable within and across studies, that concurrently available reinforcers can affect each other asymmetrically, and that the relative price may determine the magnitude of effect for substitutes. These findings suggest that these economic concepts may be useful in characterizing the type and magnitude of interactions between concurrently available reinforcers and may suggest potential mechanisms that determine these relationships.

A behavioral economic analysis of concurrently available money and cigarettes

In economic terms, consumption of a reinforcer is determined by its price and the availability and price of other reinforcers. This study examined the effects of response-requirement (i.e., price) manipulations on the self-administration of two concurrently available reinforcers. Six cigarette smokers participated in 4-hr sessions in which money and puffs on a cigarette were concurrently available according to fixed-ratio schedules of reinforcement. Once stable responding was obtained with both reinforcers available at Fixed Ratio 100, the response requirement for one reinforcer was systematically varied (Fixed Ratio 1,000 and 2,500), while the other reinforcer remained scheduled at Fixed Ratio 100. Increasing the fixed-ratio size for a reinforcer decreased its consumption, with a greater decrease occurring for monetary reinforcement. This finding was quantified in economic terms as own-price elasticity, with elasticity coefficients greater for money than cigarettes. The effects of fixed-ratio size on response output also differed across the two reinforcers. Although greater responding occurred for money at Fixed Ratio 100, increases in fixed-ratio size (for money) decreased responding for money, whereas the same increase in fixed-ratio size (for puffs) increased responding for puffs. Finally, increasing the fixed-ratio size for one reinforcer had little effect on consumption of the other concurrently available reinforcer. This finding was quantified as cross-price elasticity, with elasticity coefficients near 0.0 for most subjects, indicating little or no reinforcer interaction. The results indicate that the reinforcing effects of cigarettes and money in the setting studied here differed, and that the effects produced by changing the price of one reinforcer did not interact with the consumption of the other concurrently available reinforcer.