Discounting: A practical guide to multilevel analysis of choice data

Discriminative-stimulus effects of cannabidiol oil in Sprague-Dawley rats

Cannabidiol (CBD) is one of the major centrally active phytocannabinoid components of cannabis, and has been approved by the FDA only for the treatment of seizures associated with three rare disorders. It has also been touted as a potential treatment for anxiety in place of more traditional treatments like benzodiazepines. Although there is some evidence of anxiolytic effects of CBD, its suitability as a substitute for benzodiazepines is unknown. This experiment was designed to assess the extent to which CBD shares interoceptive discriminative-stimulus properties with the anxiolytic drug chlordiazepoxide (CDP), a benzodiazepine. In the present experiment, a range of doses (0-1569 mg/kg) of over-the-counter CBD oil was administered (i.g.) in male Sprague-Dawley rats trained to discriminate 5.6 mg/kg CDP from saline. Due to the long time-course effects of CBD, generalization tests were conducted at 90 and 120 min post-CBD administration. The two highest doses of CBD tested (1064 and 1569 mg/kg) were found to partially substitute for 5.6 mg/kg CDP, with mean percent responding on the CDP-associated lever reaching above 20% at time 2 (120 min post-CBD administration), suggesting that high doses of the over-the-counter CBD oils used in this experiment share interoceptive discriminative-stimulus properties to some degree with CDP. These results are novel in comparison to existing research into stimulus effects of CBD, in which substitution for benzodiazepines has not previously been observed.

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

Statistical power and false positive rates for interdependent outcomes are strongly influenced by test type: Implications for behavioral neuroscience

Statistical errors in preclinical science are a barrier to reproducibility and translation. For instance, linear models (e.g., ANOVA, linear regression) may be misapplied to data that violate assumptions. In behavioral neuroscience and psychopharmacology, linear models are frequently applied to interdependent or compositional data, which includes behavioral assessments where animals concurrently choose between chambers, objects, outcomes, or types of behavior (e.g., forced swim, novel object, place/social preference). The current study simulated behavioral data for a task with four interdependent choices (i.e., increased choice of a given outcome decreases others) using Monte Carlo methods. 16,000 datasets were simulated (1000 each of 4 effect sizes by 4 sample sizes) and statistical approaches evaluated for accuracy. Linear regression and linear mixed effects regression (LMER) with a single random intercept resulted in high false positives (>60%). Elevated false positives were attenuated in an LMER with random effects for all choice-levels and a binomial logistic mixed effects regression. However, these models were underpowered to reliably detect effects at common preclinical sample sizes. A Bayesian method using prior knowledge for control subjects increased power by up to 30%. These results were confirmed in a second simulation (8000 datasets). These data suggest that statistical analyses may often be misapplied in preclinical paradigms, with common linear methods increasing false positives, but potential alternatives lacking power. Ultimately, using informed priors may balance statistical requirements with ethical imperatives to minimize the number of animals used. These findings highlight the importance of considering statistical assumptions and limitations when designing research studies.

Discounting of Hyper-Palatable Food and Money: Associations with Food Addiction Symptoms

INTRODUCTION

Delay discounting (DD), the tendency to prefer small, immediate rewards over larger, delayed rewards, is associated with health-risk behaviors. The study examined associations between DD for money and hyper-palatable foods (HPF) with food addiction (FA) symptoms among a general population sample.

METHODS

Participants (N = 296) completed an adjusting DD task that consisted of a single-commodity condition with HPF as the reward (HPF now vs. HPF later) and cross-commodity conditions comparing money and HPF (money now vs. HPF later; HPF now vs. money later). The Yale Food Addiction Scale 2.0 was used to assess FA symptoms. Zero-inflated negative binomial regression models tested whether discounting of HPF and money was associated with FA symptoms.

RESULTS

Findings indicated there were no significant associations between DD and FA symptoms in the single-commodity HPF condition (logit: OR = 1.02, p-value = 0.650; count: IRR = 1.04, p-value = 0.515). There were no significant associations among cross-commodity conditions comparing money now vs. HPF later (logit: OR = 0.96, p-value = 0.330; count: IRR = 1.02, p-value = 0.729) or conditions comparing HPF now vs. money later (logit: OR = 1.02, p-value = 0.682; count: IRR = 0.92, p-value = 0.128) and FA symptoms.

CONCLUSIONS

Discounting HPF may not be a key behavioral feature among individuals who endorse FA symptoms.

Longitudinal assessment of cognitive function in the APPswe/PS1dE9 mouse model of Alzheimer's-related beta-amyloidosis

Preclinical models of Alzheimer's disease (AD)-related cognitive decline can be useful for developing therapeutics. The current study longitudinally assessed short-term memory, using a delayed matching-to-position (DMTP) task, and attention, using a 3-choice serial reaction time (3CSRT) task, from approximately 18 weeks of age through death or 72 weeks of age in APPswe/PS1dE9 mice, a widely used mouse model of AD-related amyloidosis. Both transgenic (Tg) and non-Tg mice exhibited improvements in DMTP accuracy over time. Breaks in testing reduced DMTP accuracy but accuracy values quickly recovered in both Tg and non-Tg mice. Both Tg and non-Tg mice exhibited high accuracy in the 3CSRT task with breaks in testing briefly reducing accuracy values equivalently in the 2 genotypes. The current results raise the possibility that deficits in Tg APPswe/PS1dE9 mice involve impairments in learning rather than declines in established performances. A better understanding of the factors that determine whether deficits develop will be useful for designing evaluations of potential pharmacotherapeutics and may reveal interventions for clinical application.

Acute stressors do not impair short-term memory or attention in an aged mouse model of amyloidosis

Memory impairment in Alzheimer's disease patients is thought to be associated with the accumulation of amyloid-beta peptides and tau proteins. However, inconsistent reports of cognitive deficits in pre-clinical studies have raised questions about the link between amyloid-beta and cognitive decline. One possible explanation may be that studies reporting memory deficits often involve behavioral assessments that entail a high stress component. In contrast, in tasks without a high stress component transgenic mice do not consistently show declines in memory. The glucocorticoid cascade hypothesis of aging and the vicious cycle of stress framework suggest that stress exacerbates dementia progression by initiating a cycle of hypothalamic-pituitary-adrenal axis activation and subsequent brain deterioration. Using the APPswe/PS1dE9 mouse model of amyloidosis, we assessed whether stressor exposure prior to testing differentially impaired cognitive performance of aged male and female mice. As part of a larger study, mice performed a delayed match-to-position (DMTP) or a 3-choice serial-reaction time (3CSRT) task. Unexpectedly, these mice did not exhibit cognitive declines during aging. Therefore, at 73 and 74 weeks of age, we exposed mice to a predator odor or forced swim stressor prior to testing to determine if stress revealed cognitive deficits. We predicted stressor exposure would decrease performance accuracy more robustly in transgenic vs. non-transgenic mice. Acute stressor exposure increased accuracy in the DMTP task, but not in the 3CSRT task. Our data suggest that acute stressor exposure prior to testing does not impair cognitive performance in APPswe/PS1dE9 mice.

Temporal expectations in delay of gratification

We examined how temporal expectations influence preference reversals in a delay of gratification task for rats based on a hypothesis of Rachlin (2000), who suggested that preference for a larger-later reward may shift in favor of a smaller-immediate reward as a result of changes in when that larger reward is expected. To explore Rachlin's hypothesis, we preexposed two groups of rats to the delays associated with a larger-later reinforcer from a delay of gratification task. One group experienced the delays as a function of their choices in an intertemporal choice task and the other group experienced delays yoked from the first group (independent of their behavior) in an exposure training procedure. In addition, we included a third group of rats that were not exposed to delays during preexposure training as a comparison to the other two groups. Overall, the two groups of rats that experienced delays during preexposure training tended to make fewer defection responses than the comparison group during the delay of gratification task. Consistent with Rachlin's hypothesis, our results suggest that temporal learning may influence preference reversals in a delay of gratification task, providing a number of future directions for research in this area.

Dynamic effects of dietary protein restriction on body weights, food consumption, and protein preference in C57BL/6J and Fgf21-KO mice

Single-case experimental designs (SCEDs) are rarely used in behavioral neuroscience despite their potential benefits. The current study used a SCED to evaluate the effects of dietary protein restriction in C57BL/6J and Fgf21-knockout (KO) mice on body weight, food consumption, and protein preference and changes in those outcome measures were quantified using multilevel linear models. In C57BL/6J mice, rate of weight gain was lower and food consumption and protein preference higher during periods of low (4% kcal) protein diet feeding compared to periods of normal (18% kcal) protein diet feeding. In Fgf21-KO mice, who do not produce the liver-derived hormone FGF21, rate of weight gain and protein preference were not substantially affected by diet although food consumption was slightly higher during periods of low protein diet than periods of normal protein diet. These results demonstrate that protein restriction dynamically regulates physiological and behavioral responses at the individual mouse level and that FGF21 is necessary for those responses. Further, the current results demonstrate how a SCED can be used in behavioral neuroscience research, which entails both scientific and practical benefits.

Testing delay of gratification in rats using a within-session increasing-delay task

In delay discounting, preference reversals refer to shifts in preference from a larger-later reward to a smaller-sooner reward. Steep hyperbolic discounting predicts a preference reversal when a smaller-sooner and larger-later reward both become temporally proximal; prior research is consistent with this prediction. Hyperbolic discounting does not predict a preference reversal, however, after an individual chooses a larger-later reward over a smaller-immediate reward; prior research is inconsistent with this prediction. We sought to replicate and extend these findings using a delay of gratification task in rats. The task included a defection response which allowed rats to reverse their preference after choosing a larger-later sucrose reinforcer to instead obtain a smaller-immediate sucrose reinforcer. In Experiment 1, we found that rats would defect on their choice of the larger-later reinforcer, systematically replicating prior research. We also found that experience on the delay of gratification task led to decreases in defection responses. In Experiment 2, we found that prior experience on an intertemporal choice task, with no opportunity to defect, also led to few defection responses on the delay of gratification task. We discuss our findings in the context of whether inhibitory control or temporal learning could be involved in delay of gratification.

Beyond Systematic and Unsystematic Responding: Latent Class Mixture Models to Characterize Response Patterns in Discounting Research

Operant behavioral economic methods are increasingly used in basic research on the efficacy of reinforcers as well as in large-scale applied research (e.g., evaluation of empirical public policy). Various methods and strategies have been put forward to assist discounting researchers in conducting large-scale research and detecting irregular response patterns. Although rule-based approaches are based on well-established behavioral patterns, these methods for screening discounting data make assumptions about decision-making patterns that may not hold in all cases and across different types of choices. Without methods well-suited to the observed data, valid data could be omitted or invalid data could be included in study analyses, which subsequently affects study power, the precision of estimates, and the generality of effects. This review and demonstration explore existing approaches for characterizing discounting and presents a novel, data-driven approach based on Latent Class Analysis. This approach (Latent Class Mixed Modeling) characterizes longitudinal patterns of choice into classes, the goal of which is to classify groups of responders that differ characteristically from the overall sample of discounters. In the absence of responders whose behavior is characteristically distinct from the greater sample, modern approaches such as mixed-effects models are robust to less-systematic data series. This approach is discussed, demonstrated with a publicly available dataset, and reviewed as a potential supplement to existing methods for inspecting and screening discounting data.

Are You Sure: Preference and Ambivalence in Delay Discounting

Delay discounting (DD) research has become ubiquitous due to its robust associations with clinical outcomes. Typical DD tasks involve multiple trials in which participants indicate preference between smaller, sooner and larger, later rewards. Scoring of these binary choice tasks has not considered trial-level ambivalence as a possible decision-making construct. The present study explored the extent to which trial-level ambivalence varied within-individual using an established assessment of DD (the Monetary Choice Questionnaire). Results indicate that degree of ambivalence peaks around the trials associated with the DD rate. Moreover, ambivalence is associated with a diminished impact of reward delay differences on choice, where greater delay differences decrease the odds of choosing the larger, later rewards. Taken together, we believe ambivalence to be a relevant construct for research on intertemporal decision making, and it may be particularly useful in the study of manipulations on individual rates of DD.

Behavioral economic methods to inform infectious disease response: Prevention, testing, and vaccination in the COVID-19 pandemic

The role of human behavior to thwart transmission of infectious diseases like COVID-19 is evident. Psychological and behavioral science are key areas to understand decision-making processes underlying engagement in preventive health behaviors. Here we adapt well validated methods from behavioral economic discounting and demand frameworks to evaluate variables (e.g., delay, cost, probability) known to impact health behavior engagement. We examine the contribution of these mechanisms within a broader response class of behaviors reflecting adherence to public health recommendations made during the COVID-19 pandemic. Four crowdsourced samples (total N = 1,366) completed individual experiments probing a response class including social (physical) distancing, facemask wearing, COVID-19 testing, and COVID-19 vaccination. We also measure the extent to which choice architecture manipulations (e.g., framing, opt-in/opt-out) may promote (or discourage) behavior engagement. We find that people are more likely to socially distance when specified activities are framed as high risk, that facemask use during social interaction decreases systematically with greater social relationship, that describing delay until testing (rather than delay until results) increases testing likelihood, and that framing vaccine safety in a positive valence improves vaccine acceptance. These findings collectively emphasize the flexibility of methods from diverse areas of behavioral science for informing public health crisis management.

Hazard function effects on promoting self-control in variable interval time-based interventions in rats

The present experiments investigated properties of time-based interventions used to increase self-control. Rats received impulsive-choice assessments before and after interventions that consisted of different distributions of delays to reinforcement. In Experiment 1, rats received an intervention with an increasing hazard function where delays were more evenly distributed, a decreasing hazard function where delays were mostly short, or a constant hazard function where delays were exponentially distributed. Surprisingly, rats that received the decreasing hazard function made the most self-controlled choices. Response rates during intervention trials showed that rats anticipated reinforcement based on the shape of the distributions they received. In Experiment 2, rats received an intervention with a decreasing hazard function with a steep slope or a shallow slope. Both time-based interventions increased self-control and produced similar response-rate patterns, indicating that the slope of the decreasing hazard function may not play a strong role in intervention efficacy. While this research aligns with previous literature showing that time-based interventions improved self-control, exposure to short delays produced the biggest improvements. Ultimately, exposure to short delays may increase the subjective value of the larger-later choice while occasional long delays may promote the ability to wait, which may have important implications for translational applications.

The relationship between dietary fat intake, impulsive choice, and metabolic health

Unhealthful foods are convenient, ubiquitous, and inexpensive. Overconsumption of unhealthful foods can result in disease states such as obesity and Type 2 diabetes. In addition to the physiological consequences of unhealthful foods, research in rats has shown that diets high in processed fat and sugar induce impulsive choice behavior. Research in humans has demonstrated a link between metabolic health and impulsive choice, but most investigations have not included diet. We investigated how dietary fat intake interacts with body fat percentage, fasting glucose, insulin response, and systemic inflammation levels to predict impulsive choices in humans. Participants were split into either Control (<35% calories from fat) or High-Fat (≥40% calories from fat) groups based on self-reported dietary intake, completed an impulsive choice task, and underwent testing to determine their body fat, glucose, insulin response, and inflammation levels. High-fat diets were not predictive of impulsive choices, but added sugar was predictive. Body fat percentage was associated with impulsive choices only in the group who reported consuming high-fat diets. In addition, fasting glucose was associated with impulsive choices in the control group. Therefore, metabolic health and dietary fat intake interacted to predict impulsive choices. These findings indicate that knowledge of dietary patterns coupled with metabolic health markers may help us better understand impulsive choices, thereby improving our ability to target individuals who could benefit from interventions to reduce impulsive choice behavior, with the goal of promoting more self-controlled food choices.

Sexual Arousal Discounting: Devaluing Condom-Protected Sex as a Function of Reduced Arousal

Sexual discounting is a growing area of research aimed at identifying factors that reduce people's reported willingness to have safe sex. One commonly reported reason for condom non-use is that a condom reduces sexual arousal. However, researchers have yet to isolate the specific role of sexual arousal using a sexual discounting framework. We extended past research by measuring how sexual arousal reduced people's willingness to have condom-protected sex ("sexual arousal discounting": SAD). College students (n = 379; 67.5% females) selected partners they most wanted and least wanted to have sex with and were randomized to one of two groups. In one group, participants rated their willingness to have sex with a condom if their own arousal decreased (from 100 to 10%) from condom use. The other group completed the same task except their partner's arousal decreased from condom use instead of their own. We observed a three-way interaction between arousal levels, most versus least desirable partners, and self versus partner groups. Participants' willingness to have condom-protected sex systematically reduced as a function of sexual arousal. This was observed more with the most (vs. least) desirable partner and in the self-arousal (vs. partner-arousal) group but only when the partner was their least desirable. Men (vs. women) displayed more arousal discounting but only with the most desirable partner. Finally, higher arousal discounting was associated with lower safe-sex self-efficacy and higher reported frequency of unprotected sex in the past 3 months. This study demonstrates how reduced sexual arousal from condom use can be measured as a factor influencing sexual risk-taking.

Contemporary methods in delayed discounting: Applications for suicidology with simulation

OBJECTIVE

To present an approach for integrating recently developed methods in behavioral economics into suicidology research. At present, existing applications of delay discounting in suicidology have focused predominantly on hypothetical choices related to monetary value as a proxy to "risky" choices linked to unsafe or suicidal behavior. In this report, we outline a more targeted approach that directly indexes choices related to treatment in suicide prevention initiatives and incorporates the strengths afforded by multi-level modeling. This more targeted approach precludes the need for multi-step comparisons (improving power), avoids compressing choice variability across delays into individual values (improving precision), and better accommodates decision-making at the upper and lower extremes (improving reliability).

METHOD

We present this analytical approach within the context of a Hypothetical Firearm Decision-making Task with simulated participants. A simulated study is provided to illustrate how this approach can be used to evaluate how individuals make temporally delayed decisions related to treatment for suicidal behavior (i.e., temporarily limiting their access to firearms while undergoing treatment).

RESULTS AND CONCLUSIONS

The results of this simulated study are provided to illustrate how more advanced behavioral decision-making models can be used to supplement existing research methods in suicidology.

Effects of benztropine analogs on delay discounting in rats

RATIONALE

Methylphenidate and d-amphetamine, medications used for treatment of attention deficit hyperactivity disorder (ADHD), are used recreationally and self-administered by laboratory animals. Benztropine (BZT) analogs, like those medications, increase synaptic dopamine levels but are less effective in maintaining self-administration, suggesting clinical utility with less abuse liability.

OBJECTIVES

The current study was designed to evaluate potential therapeutic effects of BZT analogs related to ADHD.

METHODS

Rats responded under a delay-discounting procedure in which responses on one lever produced immediate delivery of a single food pellet and alternative responses produced four food pellets either immediately or with various temporal delays, with those delays arranged in ascending or random orders in different groups of rats. Selection of the smaller more immediate reinforcer has been suggested as an aspect of "impulsivity," a trait with suggested involvement in ADHD. Other rats were studied under fixed-interval (FI) 300-s schedules to assess drug effects on behavior under temporal control.

RESULTS

d-Amphetamine, methylphenidate, and the BZT analog AHN 1-055, but not AHN 2-005 or JHW 007, increased selection of the large, delayed reinforcer with either arrangement of delays. All drugs changed the temporal distribution of responses within the FI from one with responses concentrated at the end to a more uniform distribution. Changes in the temporal distribution of FI responding occurred with drugs that did not affect discounting suggesting that discounting does not arise directly from the same temporal control processes controlling FI responding.

CONCLUSIONS

AHN 1-055 may be of clinical utility in the treatment of ADHD.

Reinforcer pathology II: Reward magnitude, reward delay, and demand for alcohol collectively relate to college students' alcohol related problems

The reinforcer pathologies model of addiction posits that two characteristic patterns of operant behavior characterize addiction. Specifically, individuals suffering from addiction have elevated levels of behavioral economic demand for their substances of abuse and have an elevated tendency to devalue delayed rewards (reflected in high delay discounting rates). Prior research has demonstrated that these behavioral economic markers are significant predictors of many of college students' alcohol-related problems. Delay discounting, however, is a complex behavioral performance likely undergirded by multiple behavioral processes. Emerging analytical approaches have isolated the role of participants' sensitivity to changes in reinforcer magnitude and changes in reinforcer delay. The current study uses these analytic approaches to compare participants' discounting of money versus alcohol, and to build regression models that leverage these new insights to predict a wider range of college students' alcohol related problems. Using these techniques, we were able to 1) demonstrate that individuals differed in their sensitivity to magnitudes of alcohol versus money, but not sensitivity to delays to those commodities and 2) that we could use our behavioral economic measures to predict a range of students' alcohol related problems.

On the discounting of cannabis and money: Sensitivity to magnitude vs. delay

BACKGROUND

While using most drugs of abuse is associated with higher than control rates of delay discounting, cannabis use may be the exception. As such, between-commodity differences in delay discounting (i.e., money vs. cannabis) have not been thoroughly examined. We examined these between-commodity differences using modern analytic techniques to disentangle effects of subjects' sensitivity to magnitude and delay as potential drivers of any obtained delay discounting rate differences.

METHOD

; Fifty-eight college students (n = 33 cannabis users, n = 25 non-users) completed a monetary delay discounting task - with the cannabis users completing the cannabis problems questionnaire as well a delay discounting of cannabis task- in an on-campus laboratory.

RESULTS

Responding between groups differed on the cannabis problems questionnaire, but not on delay discounting of monetary outcomes. Cannabis users, however, discounted cannabis at higher rates than money. Multilevel logistic regression revealed that these between-commodity delay discounting differences were due to subjects' differential sensitivity to the magnitude of these two commodities, rather than sensitivity to delay to receiving these commodities.

CONCLUSIONS

Although differences in delay discounting rate were not obtained between students that did and did not use cannabis, cannabis users did discount cannabis at higher rates than they did money - suggesting considerable generality of the between commodity differences in delay discounting obtained elsewhere. The current between-commodity delay discounting differences appear to be driven by differential sensitivity to the reinforcer magnitudes presented in each task - a finding that awaits replication across other comparisons before statements about generality can be made.

Experience Matters: The Effects of Hypothetical versus Experiential Delays and Magnitudes on Impulsive Choice in Delay Discounting Tasks

Impulsive choice in humans is typically measured using hypothetical delays and rewards. In two experiments, we determined how experiencing the delay and/or the reward affected impulsive choice behavior. Participants chose between two amounts of real or hypothetical candy (M&Ms) after a real or hypothetical delay (5-30 s), where choosing the shorter delay was the impulsive choice. Experiment 1 compared choice behavior on a real-delay, real-reward (RD/RR) task where participants received M&Ms after experiencing the delays versus a real-delay, hypothetical-reward (RD/HR) task where participants accumulated hypothetical M&Ms after experiencing the delays. Experiment 2 compared the RD/HR task and a hypothetical-delay, hypothetical-reward (HD/HR) task where participants accumulated hypothetical M&Ms after hypothetical delays. The results indicated that choices did not differ between real and hypothetical M&Ms (Experiment 1), and participants were less sensitive to delay and more larger-later (LL)-preferring with hypothetical delays compared to real delays (Experiment 2). Experiencing delays to reward may be important for modeling real-world impulsive choices where delays are typically experienced. These novel experiential impulsive choice tasks may improve translational methods for comparison with animal models and may be improved procedures for predicting real-life choice behavior in humans.

Cognitive and behavioral training interventions to promote self-control

This review article discusses various cognitive and behavioral interventions that have been developed with the goal of promoting self-controlled responding. Self-control can exert a significant impact on human health and impulsive behaviors are associated with a wide range of diseases and disorders, leading to the suggestion that impulsivity is a trans-disease process. The self-control interventions include effort exposure, reward discrimination, reward bundling, interval schedules of reinforcement, impulse control training, and mindfulness training. Most of the interventions have been consistently shown to increase self-control, except for mindfulness training. Some of the successful interventions are long-lasting, whereas others may be transient. Most interventions are domain-specific, targeting specific cognitive and behavioral processes that relate to self-control rather than targeting overall self-control. For example, effort exposure appears to primarily increase effort tolerance, which in turn can improve self-control. Similarly, interval schedules primarily target interval timing, which promotes self-controlled responses. A diagram outlining a proposed set of intervention effects on self-control is introduced to motivate further research in this area. The diagram suggests that the individual target processes of the interventions may potentially summate to produce general self-control, or perhaps even produce synergistic effects. In addition, it is suggested that developing a self-control profile may be advantageous for aligning specific interventions to mitigate specific deficits. Overall, the results indicate that interventions are a promising avenue for promoting self-control and may help to contribute to changing health outcomes associated with a wide variety of diseases and disorders. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Resurgence of a target behavior suppressed by a combination of punishment and alternative reinforcement

Differential-reinforcement-based treatments involving extinction of target problem behavior and reinforcement of an alternative behavior are highly effective. However, extinction of problem behavior is sometimes difficult or contraindicated in clinical settings. In such cases, punishment instead of extinction may be used in combination with alternative reinforcement. Although it is well documented that omitting alternative reinforcement can produce recurrence (i.e., resurgence) of behavior previously suppressed by extinction plus alternative reinforcement, it remains unclear if resurgence similarly occurs for behavior previously suppressed by punishment plus alternative reinforcement. The present experiment examined this question with rats. In Phase 1, a target behavior (lever pressing) was reinforced with food pellets. In Phase 2, the target behavior continued to be reinforced, but it also produced mild foot shock and an alternative behavior (nose poking) also produced food. Finally, all consequences were removed and resurgence of target behavior occurred. Resurgence did not occur for another group that similarly received punishment of target behavior in Phase 2 but not alternative reinforcement. These results indicate that resurgence was a product of the history of exposure to and then removal of alternative reinforcement and that the removal of punishment alone did not produce resurgence of target behavior.

Examining the neurochemical underpinnings of animal models of risky choice: Methodological and analytic considerations

Because risky choice is associated with several psychiatric conditions, recent research has focused on examining the underlying neurochemical processes that control risk-based decision-making. Not surprisingly, several tasks have been developed to study the neural mechanisms involved in risky choice. The current review will briefly discuss the major tasks used to measure risky choice and will summarize the contribution of several major neurotransmitter systems to this behavior. To date, the most common measures of risky choice are the probability discounting task, the risky decision task, and the rat gambling task. Across these three tasks, the contribution of the dopaminergic system has been most studied, although the effects of serotonergic, adrenergic, cholinergic, and glutamatergic ligands will be discussed. Drug effects across these tasks have been inconsistent, which makes determining the precise role of neurotransmitter systems in risky choice somewhat difficult. Furthermore, procedural differences can modulate drug effects in these procedures, and the way data are analyzed can alter the interpretations one makes concerning pharmacological manipulations. By taking these methodological/analytic considerations into account, we may better elucidate the neurochemistry of risky decision-making. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Bayesian data analysis as a tool for behavior analysts

Bayesian approaches to data analysis are considered within the context of behavior analysis. The paper distinguishes between Bayesian inference, the use of Bayes Factors, and Bayesian data analysis using specialized tools. Given the importance of prior beliefs to these approaches, the review addresses those situations in which priors have a big effect on the outcome (Bayes Factors) versus a smaller effect (parameter estimation). Although there are many advantages to Bayesian data analysis from a philosophical perspective, in many cases a behavior analyst can be reasonably well-served by the adoption of traditional statistical tools as long as the focus is on parameter estimation and model comparison, not null hypothesis significance testing. A strong case for Bayesian analysis exists under specific conditions: When prior beliefs can help narrow parameter estimates (an especially important issue given the small sample sizes common in behavior analysis) and when an analysis cannot easily be conducted using traditional approaches (e.g., repeated measures censored regression).

A Monte Carlo method for comparing generalized estimating equations to conventional statistical techniques for discounting data

Discounting is the process by which outcomes lose value. Much of discounting research has focused on differences in the degree of discounting across various groups. This research has relied heavily on conventional null hypothesis significance tests that are familiar to psychologists, such as t-tests and ANOVAs. As discounting research questions have become more complex by simultaneously focusing on within-subject and between-group differences, conventional statistical testing is often not appropriate for the obtained data. Generalized estimating equations (GEE) are one type of mixed-effects model that are designed to handle autocorrelated data, such as within-subject repeated-measures data, and are therefore more appropriate for discounting data. To determine if GEE provides similar results as conventional statistical tests, we compared the techniques across 2,000 simulated data sets. The data sets were created using a Monte Carlo method based on an existing data set. Across the simulated data sets, the GEE and the conventional statistical tests generally provided similar patterns of results. As the GEE and more conventional statistical tests provide the same pattern of result, we suggest researchers use the GEE because it was designed to handle data that has the structure that is typical of discounting data.

Interventions aimed at changing impulsive choice in rats: Effects of immediate and relatively long delay to reward training

A relatively strong preference for smaller-sooner rewards (SSR) over larger-later rewards (LLR) is associated with a host of maladaptive behavioral patterns. As such, the clinical implications for increasing preference for LLR are profound. There is a growing body of literature that suggests extended exposure to delayed reward may increase preference for LLR in rats. However, questions remain about the underlying mechanism driving this effect and the extent to which extended exposure to immediate rewards may decrease LLR choice. In Experiment 1, we tested effects of a differential-reinforcement-of-low-rates schedule (DRL) to increase LLR choice using a pretest/posttest design with Wistar rats as subjects. We compared this group to a group of rats exposed to a differential-reinforcement-of-high-rates schedule (DRH). The DRH intervention has never been employed in this research context, but explicitly programs an immediate response-reinforcement requirement. In Experiment 2, we tested effects of an intervention with a delay longer than those used in the delay discounting pretest and posttest. No previous research has tested effects of an intervention delay this long, relative to the delay discounting task. We compared this group to a group exposed to a delay that was part of the delay discounting pretest and posttest and to a group exposed to a traditional no-delay, fixed-ratio (FR) 2 control intervention. In both experiments, we found that exposure to delayed rewards in the intervention phase significantly increased LLR choice relative to pretest performance. These findings replicate and extend a growing body of literature showing that delay exposure increases preference for LLR. We also found significant decreases in LLR choice from pretest to posttest in the DRH and no-delay intervention groups in Experiments 1 and 2, respectively. This is the first report of such an effect and has implications for understanding and interpreting effects of delay exposure training in past and future research. Our results also suggested no relationship between improved temporal tracking of reward and increases in LLR choice as a result of delay exposure training.

Comparison of three measurement models of discounting among individuals with methamphetamine use disorder

BACKGROUND AND OBJECTIVES

Delay discounting is associated with numerous clinically significant aspects of substance use disorders (SUDs). Recent studies have demonstrated that different models for assessing discounting may result in disparate conclusions. The current study compared two discounting tasks: money now versus money later (M-M) and methamphetamine now versus money later (MA-M) among non-treatment seeking individuals (N = 59) with methamphetamine use disorder (MAUD). Results from each task were assessed using three different models for assessing delay discounting.

METHODS

Discounting data were fit to three models of discounting, log k using Mazur's hyperbolic formula, area under the curve (AUC), and an alternative AUC model in which the delay values have been log transformed (AUClog).

RESULTS

For both discounting tasks, the distribution of model-related outcomes were normally distributed when using log k and AUClog, but skewed for AUC. Discounting in the MA-M task was significantly greater compared to the M-M task when using log k and AUClog but not AUC.

CONCLUSION

To our knowledge, the current study is the first to report significantly greater discounting in a MA-M relative to M-M discounting task among individuals with MAUD, an outcome consistent with other psychomotor stimulants and drugs of abuse.

SCIENTIFIC SIGNIFICANCE

The differential results observed across the three discounting models reaffirm potential issues with AUC noted in recent studies and highlight that researchers must be cautious when deciding on their final model of discounting. (Am J Addict 2018;XX:1-8).

Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay-exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay-exposure training shifting preference toward self-control or immediacy-exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay- and immediacy-exposure training to a no-training control group and evaluated within-subject changes in impulsive choice across 51 male Wistar rats. Delay-exposed rats made significantly fewer impulsive choices than immediacy-exposed and control rats. Between-group differences in impulsive choice were not observed in the latter two groups. While delay-exposed rats showed large, significant pre- to posttraining reductions in impulsive choice, immediacy-exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.